ChatGPT is not Enough: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling

AI-generated keywords: Knowledge Graph Pre-trained Language Model Large Language Model Factual Reasoning KGLLM

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • ChatGPT, a large language model (LLM), has gained attention for its emergent abilities
  • LLMs have the potential to replace structured knowledge bases like knowledge graphs (KGs)
  • Researchers propose enhancing LLMs with KGs to incorporate explicit factual knowledge
  • Existing studies on knowledge graph enhanced PLMs (KGPLMs) have shown effectiveness
  • Authors propose developing knowledge graph-enhanced large language models (KGLLMs)
  • KGLLMs aim to enhance factual reasoning ability and open up new research avenues
  • The paper reviews existing studies on enhancing PLMs with KGs and introduces KGPLM applications
  • The development of KGLLM is proposed as a solution to improve LLM's ability to recall facts and generate informed responses
  • This advancement holds promise for advancing research in large language models and their practical applications.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Linyao Yang, Hongyang Chen, Zhao Li, Xiao Ding, Xindong Wu

Abstract: Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention due to its powerful emergent abilities. Some researchers suggest that LLMs could potentially replace structured knowledge bases like knowledge graphs (KGs) and function as parameterized knowledge bases. However, while LLMs are proficient at learning probabilistic language patterns based on large corpus and engaging in conversations with humans, they, like previous smaller pre-trained language models (PLMs), still have difficulty in recalling facts while generating knowledge-grounded contents. To overcome these limitations, researchers have proposed enhancing data-driven PLMs with knowledge-based KGs to incorporate explicit factual knowledge into PLMs, thus improving their performance to generate texts requiring factual knowledge and providing more informed responses to user queries. This paper reviews the studies on enhancing PLMs with KGs, detailing existing knowledge graph enhanced pre-trained language models (KGPLMs) as well as their applications. Inspired by existing studies on KGPLM, this paper proposes to enhance LLMs with KGs by developing knowledge graph-enhanced large language models (KGLLMs). KGLLM provides a solution to enhance LLMs' factual reasoning ability, opening up new avenues for LLM research.

Submitted to arXiv on 20 Jun. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2306.11489v1

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

Recently, ChatGPT, a representative large language model (LLM), has gained considerable attention for its powerful emergent abilities. Some researchers believe that LLMs have the potential to replace structured knowledge bases like knowledge graphs (KGs) and function as parameterized knowledge bases. To address the limitation of LLMs in recalling facts while generating knowledge-grounded content, researchers have proposed enhancing data-driven pre-trained language models (PLMs) with KGs to incorporate explicit factual knowledge into PLMs. Existing studies on knowledge graph enhanced PLMs (KGPLMs) have explored this approach and demonstrated its effectiveness. Inspired by these studies, the authors of this paper propose enhancing LLMs with KGs by developing knowledge graph-enhanced large language models (KGLLMs). By incorporating KGs into LLMs, KGLLMs aim to enhance their factual reasoning ability and open up new avenues for research in this field. In summary, this paper reviews existing studies on enhancing PLMs with KGs and introduces existing KGPLM applications. It also proposes the development of KGLLM as a solution to improve LLM's ability to recall facts and generate more informed responses to user queries. This advancement holds promise for advancing research in large language models and their practical applications.
Created on 29 Jun. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

The license of this specific paper does not allow us to build upon its content and the summarizing tools will be run using the paper metadata rather than the full article. However, it still does a good job, and you can also try our tools on papers with more open licenses.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.