Dial2vec: Self-Guided Contrastive Learning of Unsupervised Dialogue Embeddings
Authors: Che Liu, Rui Wang, Junfeng Jiang, Yongbin Li, Fei Huang
AI-generated Key Points
⚠The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.
- Authors introduce the task of learning unsupervised dialogue embeddings
- Existing approaches often ignore conversational interactions, leading to poor performance
- Authors propose a self-guided contrastive learning approach called dial2vec
- Dial2vec captures conversational interaction patterns between interlocutors to guide embedding learning
- Dialogue embedding is obtained by aggregating embeddings from all interlocutors
- Comprehensive benchmark with six dialogue datasets and three evaluation tasks: domain categorization, semantic relatedness, and dialogue retrieval
- Dial2vec outperforms strongest baseline on all three tasks with average improvements in purity, Spearman's correlation, and mean average precision (MAP)
- Analysis shows informative and discriminative embeddings for both interlocutors by leveraging conversational interactions
- Best performance achieved through an interlocutor-level pooling strategy for aggregation of embeddings
- Codes and data available publicly at https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/dial2vec
- Overall, dial2vec is a novel approach for learning unsupervised dialogue embeddings that considers conversational interactions between interlocutors
Abstract: In this paper, we introduce the task of learning unsupervised dialogue embeddings. Trivial approaches such as combining pre-trained word or sentence embeddings and encoding through pre-trained language models (PLMs) have been shown to be feasible for this task. However, these approaches typically ignore the conversational interactions between interlocutors, resulting in poor performance. To address this issue, we proposed a self-guided contrastive learning approach named dial2vec. Dial2vec considers a dialogue as an information exchange process. It captures the conversational interaction patterns between interlocutors and leverages them to guide the learning of the embeddings corresponding to each interlocutor. The dialogue embedding is obtained by an aggregation of the embeddings from all interlocutors. To verify our approach, we establish a comprehensive benchmark consisting of six widely-used dialogue datasets. We consider three evaluation tasks: domain categorization, semantic relatedness, and dialogue retrieval. Dial2vec achieves on average 8.7, 9.0, and 13.8 points absolute improvements in terms of purity, Spearman's correlation, and mean average precision (MAP) over the strongest baseline on the three tasks respectively. Further analysis shows that dial2vec obtains informative and discriminative embeddings for both interlocutors under the guidance of the conversational interactions and achieves the best performance when aggregating them through the interlocutor-level pooling strategy. All codes and data are publicly available at https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/dial2vec.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
⚠The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
⚠The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm compares the title and abstract of this paper with all the papers of the same arXiv category that we have summarized, and finds the closest ones. You can rerun it from time to time: the results improve as our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.