Conditional Attention Networks for Distilling Knowledge Graphs in Recommendation

Authors: Ke Tu, Peng Cui, Daixin Wang, Zhiqiang Zhang, Jun Zhou, Yuan Qi, Wenwu Zhu

Accepted by CIKM21
License: CC0 1.0

Results of the summarizing process for the arXiv paper: 2111.02100v1

  • Comprehensive Summary
  • Key points
  • Layman's Summary
  • Blog article
In this paper, the authors propose a model called Knowledge-aware Conditional Attention Networks (KCAN) to incorporate knowledge graphs into recommender systems. They address the issue of generalization and scale in knowledge graphs, where most knowledge relationships are not helpful for target user-item predictions. To overcome this, they propose distilling the knowledge graph to reserve useful information and refine the knowledge to capture users' preferences. The KCAN model uses a knowledge-aware attention propagation method to obtain node representations that capture global semantic similarity on both the user-item network and the knowledge graph. Then, for a given target user-item pair, they automatically distill the knowledge graph into a target-specific subgraph based on knowledge-aware attention. By applying conditional attention aggregation on this subgraph, they refine the knowledge graph to obtain target-specific node representations. The authors highlight two key challenges: knowledge graph distillation and refinement. Knowledge graph distillation involves transforming the full massive knowledge graph into a small concentrated one that accurately captures users' preferences. On the other hand, knowledge graph refinement aims to give different weights to all knowledge relationships instead of just considering their neighbors when making recommendations. They argue that previous embedding-based models fail to solve these challenges effectively. Instead, they propose path-based methods that explore different paths in the knowledge graph to capture more specific and relevant information for recommendation tasks. The rest of the paper is structured as follows: Section 2 provides a brief review of related works focusing specifically on Knowledge Graph Embedding (KGE). Section 3 formally defines the solved problems and introduces details of their proposed KCAN model. In Section 4, experimental results using real-world datasets are reported demonstrating effectiveness of their framework compared with state-of-the art algorithms. Finally in Section 5 conclusions are drawn from findings presented in this paper.
AI-generated keywords: Knowledge Graph Recommender System KCAN Model Distillation Refinement

Abstract: Knowledge graph is generally incorporated into recommender systems to improve overall performance. Due to the generalization and scale of the knowledge graph, most knowledge relationships are not helpful for a target user-item prediction. To exploit the knowledge graph to capture target-specific knowledge relationships in recommender systems, we need to distill the knowledge graph to reserve the useful information and refine the knowledge to capture the users' preferences. To address the issues, we propose Knowledge-aware Conditional Attention Networks (KCAN), which is an end-to-end model to incorporate knowledge graph into a recommender system. Specifically, we use a knowledge-aware attention propagation manner to obtain the node representation first, which captures the global semantic similarity on the user-item network and the knowledge graph. Then given a target, i.e., a user-item pair, we automatically distill the knowledge graph into the target-specific subgraph based on the knowledge-aware attention. Afterward, by applying a conditional attention aggregation on the subgraph, we refine the knowledge graph to obtain target-specific node representations. Therefore, we can gain both representability and personalization to achieve overall performance. Experimental results on real-world datasets demonstrate the effectiveness of our framework over the state-of-the-art algorithms.

Submitted to arXiv on 03 Nov. 2021

Tools for this paper

Explain it differently 3 free rewrites left today
Export BibTeX · RIS (Zotero, Mendeley, EndNote) · Markdown (Notion, Obsidian) · Premium
Citation alerts Premium
Journal club Slides to present it Premium
For journalists Press kit and hype check Premium

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.