Active Retrieval Augmented Generation

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

1. Very close Cites this paper Not relevant

   Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy

   Zhihong Shao, Yeyun Gong, Yelong Shen et al. · 2023 · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · cited 287 times · Not summarized yet

   Abstract

   Retrieval-augmented generation has raise extensive attention as it is promising to address the limitations of large language models including outdated knowledge and hallucinations.However, retrievers struggle to capture relevance, especially for queries with complex information needs.Recent work has proposed to improve relevance modeling by having large language models actively involved in retrieval, i.e., to guide retrieval with generation.In this paper, we show that strong performance can be achieved by a method we call ITER-RETGEN, which synergizes retrieval and generation in an iterative manner: a model's response to a task input shows what might be needed to finish the task, and thus ca…

2. Very close Not relevant

   Corrective Retrieval Augmented Generation

   Shi-Qi Yan, Jia-Chen Gu, Yun Zhu et al. · 2024 · Computation and Language · preprint, not peer reviewed · cited 353 times · AI summary available

   Abstract

   Large language models (LLMs) inevitably exhibit hallucinations since the accuracy of generated texts cannot be secured solely by the parametric knowledge they encapsulate. Although retrieval-augmented generation (RAG) is a practicable complement to LLMs, it relies heavily on the relevance of retrieved documents, raising concerns about how the model behaves if retrieval goes wrong. To this end, we propose the Corrective Retrieval Augmented Generation (CRAG) to improve the robustness of generation. Specifically, a lightweight retrieval evaluator is designed to assess the overall quality of retrieved documents for a query, returning a confidence degree based on which different knowledge retriev…

3. Very close Not relevant

   Parametric Retrieval Augmented Generation

   Wei-Hang Su, Yi-Chen Tang, Qing-Yao Ai et al. · 2025 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · cited 70 times · Not summarized yet

   Abstract

   Retrieval-augmented generation (RAG) has emerged as a promising solution to enhance the reliability of large language models (LLMs) with external knowledge. Existing RAG methods share a common strategy for knowledge injection: they place the retrieved documents into the input context of the LLM, which we refer to as the in-context knowledge injection method. While this approach is simple and often effective, it has inherent limitations. Firstly, increasing the context length and number of relevant documents can lead to higher computational overhead and degraded performance, especially in complex reasoning tasks. More importantly, in-context knowledge injection operates primarily at the input…

4. Very close Not relevant

   Dynamic and Parametric Retrieval Augmented Generation

   Wei-Hang Su, Qian Dong, Qing-Yao Ai et al. · 2025 · SIGIR-AP · cited 1 time · Not summarized yet

   Abstract

   Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information retrieval and knowledge-intensive applications. However, conventional RAG systems typically adopt a static retrieve-then-generate pipeline and rely on in-context knowledge injection, which can be suboptimal for complex tasks that require multihop reasoning, adaptive information access, and deeper integration of external knowledge. Motivated by these limitations, the research community has moved beyond static retrieval and in-context knowledge injection. Among the emerging directions, this tutorial delves into two ra…

5. Very close Cites this paper Not relevant

   Latent Retrieval Augmented Generation

   Shuran Zhou, Junan Chen, Rui Ling et al. · 2026 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · Not summarized yet

   Abstract

   Retrieval-augmented generation (RAG) has emerged as a promising solution to enhance the reliability of large language models (LLMs) with external knowledge. Existing RAG methods operate in explicit representation spaces: in-context methods inject knowledge through text tokens in the input, while parametric methods like Parametric RAG encode documents into model parameters. Although effective, these approaches face inherent limitations. In-context injection suffers from quadratic computational complexity with context length and degraded performance in complex reasoning tasks. Parametric injection, while reducing inference costs, requires substantial storage overhead and computationally expens…

6. Very close Not relevant

   Dynamic and Parametric Retrieval-Augmented Generation

   Wei-Hang Su, Qing-Yao Ai, Jingtao Zhan et al. · 2025 · Annual International ACM SIGIR Conference on Research and Development in Information Retrieval · cited 17 times · Not summarized yet

   Abstract

   Retrieval-Augmented Generation (RAG) has become a foundational paradigm for enhancing large language models (LLMs) with external knowledge, playing an important role in modern information retrieval and knowledge-intensive NLP applications. Standard RAG systems typically adopt a static retrieve-then-generate pipeline and rely on in-context knowledge injection, which can be suboptimal for complex tasks that require multihop reasoning, adaptive information access, and deeper integration of external knowledge. Motivated by these limitations, the research community has moved beyond static retrieval and in-context knowledge injection. Among the emerging directions, this tutorial delves into two ra…

7. Very close Not relevant

   Retrieval-Augmented Generation for Large Language Models: A Survey

   Yunfan Gao, Yun Xiong, Xinyu Gao et al. · 2023 · Computation and Language · preprint, not peer reviewed · cited 4,455 times · AI summary available

   Abstract

   Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes. Retrieval-Augmented Generation (RAG) has emerged as a promising solution by incorporating knowledge from external databases. This enhances the accuracy and credibility of the generation, particularly for knowledge-intensive tasks, and allows for continuous knowledge updates and integration of domain-specific information. RAG synergistically merges LLMs' intrinsic knowledge with the vast, dynamic repositories of external databases. This comprehensive review paper offers a detailed examination of the progression of …

8. Very close Cites this paper Not relevant

   Towards Adaptive and Retriever-friendly Retrieval-augmented Generation via Reinforcement Learning

   Yubo Fang, Hai-Tao Yu, Hideo Joho et al. · 2026 · International Conference on the Theory of Information Retrieval · Not summarized yet

   Abstract

   Retrieval-augmented Generation (RAG) has emerged as an effective paradigm for enhancing large language models (LLMs) with external knowledge, delivering substantial performance gains without costly parameter updates, particularly in low-resource settings. However, existing RAG systems still face several open challenges. Many approaches rely on static or heuristic retrieval strategies, limiting their ability to adapt retrieval strategies to different tasks with different reasoning requirements. Some methods build RAG systems based on independently optimized components, making joint optimization across all components infeasible. Moreover, empirical evidence shows that stronger retrievers do no…

Prior work it builds on

1. Close Used in depth by this paper A method it uses Not relevant

   In-Context Retrieval-Augmented Language Models

   Ori Ram, Yoav Levine, Itay Dalmedigos et al. · 2023 · Computation and Language · cited 1,193 times · AI summary available

   Abstract

   Retrieval-Augmented Language Modeling (RALM) methods, that condition a language model (LM) on relevant documents from a grounding corpus during generation, have been shown to significantly improve language modeling while also providing a natural source attribution mechanism. Existing RALM approaches focus on modifying the LM architecture in order to facilitate the incorporation of external information, significantly complicating deployment. This paper proposes an under-explored alternative, which we dub In-Context RALM: leaving the LM architecture unchanged and prepending grounding documents to the input. We show that in-context RALM which uses off-the-shelf general purpose retrievers provid…

2. Close A method it uses Not relevant

   Generate rather than Retrieve: Large Language Models are Strong Context Generators

   Wenhao Yu, Dan Iter, Shuohang Wang et al. · 2022 · Computation and Language · cited 461 times · AI summary available

   Abstract

   Knowledge-intensive tasks, such as open-domain question answering (QA), require access to a large amount of world or domain knowledge. A common approach for knowledge-intensive tasks is to employ a retrieve-then-read pipeline that first retrieves a handful of relevant contextual documents from an external corpus such as Wikipedia and then predicts an answer conditioned on the retrieved documents. In this paper, we present a novel perspective for solving knowledge-intensive tasks by replacing document retrievers with large language model generators. We call our method generate-then-read (GenRead), which first prompts a large language model to generate contextutal documents based on a given qu…

3. Close A method it uses Not relevant

   Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

   Patrick Lewis, Ethan Perez, Aleksandra Piktus et al. · 2020 · Computation and Language · cited 20,707 times · AI summary available

   Abstract

   Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate knowledge is still limited, and hence on knowledge-intensive tasks, their performance lags behind task-specific architectures. Additionally, providing provenance for their decisions and updating their world knowledge remain open research problems. Pre-trained models with a differentiable access mechanism to explicit non-parametric memory can overcome this issue, but have so far been only investigated for extractive downstream tasks. We explore a general-purpose …

4. Close A method it uses Not relevant

   Recitation-Augmented Language Models

   Zhiqing Sun, Xue-Zhi Wang, Yi Tay et al. · 2022 · International Conference on Learning Representations · cited 92 times · Not summarized yet

   Abstract

   We propose a new paradigm to help Large Language Models (LLMs) generate more accurate factual knowledge without retrieving from an external corpus, called RECITation-augmented gEneration (RECITE). Different from retrieval-augmented language models that retrieve relevant documents before generating the outputs, given an input, RECITE first recites one or several relevant passages from LLMs' own memory via sampling, and then produces the final answers. We show that RECITE is a powerful paradigm for knowledge-intensive NLP tasks. Specifically, we show that by utilizing recitation as the intermediate step, a recite-and-answer scheme can achieve new state-of-the-art performance in various closed-…

5. Close A method it uses Not relevant

   Generation-Augmented Retrieval for Open-Domain Question Answering

   Yuning Mao, Peng-Cheng He, Xiao-Dong Liu et al. · 2020 · Annual Meeting of the Association for Computational Linguistics · cited 335 times · Not summarized yet

   Abstract

   We propose Generation-Augmented Retrieval (GAR) for answering open-domain questions, which augments a query through text generation of heuristically discovered relevant contexts without external resources as supervision. We demonstrate that the generated contexts substantially enrich the semantics of the queries and GAR with sparse representations (BM25) achieves comparable or better performance than state-of-the-art dense retrieval methods such as DPR. We show that generating diverse contexts for a query is beneficial as fusing their results consistently yields better retrieval accuracy. Moreover, as sparse and dense representations are often complementary, GAR can be easily combined with D…

Papers that cite it

1. Very close Uses this paper in depth Not relevant

   Predictive Prefetching for Retrieval-Augmented Generation

   Wuyang Zhang, Shi-Chao Pei · 2026 · arXiv.org · preprint, not peer reviewed · Not summarized yet

   Abstract

   Retrieval-Augmented Generation (RAG) improves factual grounding in large language models but suffers from substantial latency due to synchronous retrieval. While recent work explores asynchronous retrieval, existing approaches rely on heuristic coordination between retrieval and generation and assume stable information demands during decoding that often break in complex, multi-domain settings. In this paper, we propose an advanced asynchronous retrieval framework that enables predictive prefetching aligned with evolving information needs. The framework explicitly predicts when retrieval should be triggered and what information should be retrieved using three components, a retrieval predictor…

2. Close Not relevant

   A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models

   Wen-Qi Fan, Yujuan Ding, Liang-Bo Ning et al. · 2024 · Knowledge Discovery and Data Mining · cited 1,254 times · Not summarized yet

   Abstract

   As one of the most advanced techniques in AI, Retrieval-Augmented Generation (RAG) can offer reliable and up-to-date external knowledge, providing huge convenience for numerous tasks. Particularly in the era of AI-Generated Content (AIGC), the powerful capacity of retrieval in providing additional knowledge enables RAG to assist existing generative AI in producing high-quality outputs. Recently, Large Language Models (LLMs) have demonstrated revolutionary abilities in language understanding and generation, while still facing inherent limitations such as hallucinations and out-of-date internal knowledge. Given the powerful abilities of RAG in providing the latest and helpful auxiliary informa…

3. Very close Not relevant

   Retrieval-Augmented Generation for AI-Generated Content: A Survey

   Penghao Zhao, Hailin Zhang, Qinhan Yu et al. · 2024 · Computer Vision and Pattern Recognition · cited 549 times · AI summary available

   Abstract

   Advancements in model algorithms, the growth of foundational models, and access to high-quality datasets have propelled the evolution of Artificial Intelligence Generated Content (AIGC). Despite its notable successes, AIGC still faces hurdles such as updating knowledge, handling long-tail data, mitigating data leakage, and managing high training and inference costs. Retrieval-Augmented Generation (RAG) has recently emerged as a paradigm to address such challenges. In particular, RAG introduces the information retrieval process, which enhances the generation process by retrieving relevant objects from available data stores, leading to higher accuracy and better robustness. In this paper, we c…

4. Very close Not relevant

   Retrieval‐Augmented Generation for Large Language Models: Evolution, Architectures, Applications, and Challenges (2020–2025)

   Arman Rasool Faridi, Faraz Masood, Keshvi et al. · 2026 · WIREs Data Mining and Knowledge Discovery · cited 1 time · Not summarized yet

   Abstract

   Large language models (LLMs) generate fluent text but remain vulnerable to hallucinations, outdated knowledge, weak provenance, and costly model updates in knowledge‐intensive settings. Retrieval‐augmented generation (RAG) addresses these limitations by grounding generation in external evidence retrieved at inference time. This Advanced Review presents a PRISMA‐guided synthesis of 91 studies published between January 2020 and December 2025. It traces the evolution of RAG from early retrieve‐then‐generate pipelines to a broader design space that includes sparse, dense, and hybrid retrieval; multi‐stage reranking; evidence fusion; retrieval‐aware pre‐training; non‐parametric memory; iterative …

5. Close Not relevant

   Benchmarking Retrieval-Augmented Generation for Medicine

   Guangzhi Xiong, Qiao Jin, Zhiyong Lu et al. · 2024 · Computation and Language · cited 373 times · AI summary available

   Abstract

   While large language models (LLMs) have achieved state-of-the-art performance on a wide range of medical question answering (QA) tasks, they still face challenges with hallucinations and outdated knowledge. Retrieval-augmented generation (RAG) is a promising solution and has been widely adopted. However, a RAG system can involve multiple flexible components, and there is a lack of best practices regarding the optimal RAG setting for various medical purposes. To systematically evaluate such systems, we propose the Medical Information Retrieval-Augmented Generation Evaluation (MIRAGE), a first-of-its-kind benchmark including 7,663 questions from five medical QA datasets. Using MIRAGE, we condu…