A Survey of Hallucination in Large Foundation Models

AI-generated keywords: Hallucination LFMs Mitigation Evaluation Multilingual

AI-generated Key Points

  • Hallucination in a Foundation Model (FM) refers to the generation of content that deviates from factual reality or includes fabricated information.
  • Large Foundation Models (LFMs) are smaller, open-source LLMs with fewer parameters that often experience significant hallucination issues compared to their larger counterparts.
  • The paper classifies various types of hallucination phenomena specific to LFMs and establishes evaluation criteria for assessing the extent of hallucination.
  • Existing strategies for mitigating hallucination in LFMs include using external knowledge through interactive question-knowledge alignment and dehallucinating LLMs using formal methods guided by iterative prompting.
  • Risks associated with LFMs can be mitigated by drawing parallels with web systems, such as incorporating elements like "citation" to improve content transparency and verifiability.
  • Challenges related to multilingual LFMs are highlighted, including the generation of hallucinated translations when deployed in large-scale multilingual machine translation systems.
  • The paper presents a comprehensive analysis conducted on both conventional neural machine translation models and ChatGPT, a versatile LLM that can be prompted for translation, covering various conditions including over 100 translation directions, resource levels, and languages beyond English-centric pairs.
  • Future directions for addressing the hallucination challenge in LFMs include automated evaluation methods and incorporating curated sources of knowledge.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Vipula Rawte, Amit Sheth, Amitava Das

License: CC BY 4.0

Abstract: Hallucination in a foundation model (FM) refers to the generation of content that strays from factual reality or includes fabricated information. This survey paper provides an extensive overview of recent efforts that aim to identify, elucidate, and tackle the problem of hallucination, with a particular focus on ``Large'' Foundation Models (LFMs). The paper classifies various types of hallucination phenomena that are specific to LFMs and establishes evaluation criteria for assessing the extent of hallucination. It also examines existing strategies for mitigating hallucination in LFMs and discusses potential directions for future research in this area. Essentially, the paper offers a comprehensive examination of the challenges and solutions related to hallucination in LFMs.

Submitted to arXiv on 12 Sep. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2309.05922v1

Hallucination in a Foundation Model (FM) refers to the generation of content that deviates from factual reality or includes fabricated information. This survey paper provides an extensive overview of recent efforts that aim to identify, elucidate, and tackle the problem of hallucination with a particular focus on "Large" Foundation Models (LFMs). LFMs are smaller, open-source LLMs with fewer parameters that often experience significant hallucination issues compared to their larger counterparts. The paper classifies various types of hallucination phenomena that are specific to LFMs and establishes evaluation criteria for assessing the extent of hallucination. It also examines existing strategies for mitigating hallucination in LFMs and discusses potential directions for future research in this area. The risks associated with LFMs can be mitigated by drawing parallels with web systems such as incorporating elements like "citation" to improve content transparency and verifiability. The paper explores different approaches for mitigating hallucination in LFMs. One approach is using external knowledge through interactive question-knowledge alignment which helps assess the extent of hallucinations in LLMs. Another approach involves dehallucinating LLMs using formal methods guided by iterative prompting aiming to reduce the generation of inaccurate or hallucinated information. Additionally, the paper highlights the challenges related to multilingual LLMs. Large-scale multilingual machine translation systems have shown impressive capabilities but can generate hallucinated translations when deployed. Existing research on hallucinations has mainly focused on small bilingual models for high-resource languages leaving a gap in understanding hallucinations in massively multilingual models across diverse translation scenarios. To address this gap, the paper presents a comprehensive analysis conducted on both conventional neural machine translation models and ChatGPT, a versatile LLM that can be prompted for translation. The investigation covers various conditions including over 100 translation directions resource levels and languages beyond English-centric pairs. In conclusion, this survey paper offers a comprehensive examination of the challenges and solutions related to hallucination in LFMs. It provides insights into the classification detection mitigation strategies tasks datasets and evaluation metrics associated with hallucination in LFMs. The paper also suggests future directions for addressing the hallucination challenge in LFMs including automated evaluation methods and incorporating curated sources of knowledge.
Created on 24 Sep. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.