A Survey on Large Language Model based Autonomous Agents

AI-generated keywords: Autonomous Agents Large Language Models Memory Systems Human Alignment Reasoning Abilities

AI-generated Key Points

  • Autonomous agents incorporating large language models (LLMs) have transformed the field with human-level intelligence.
  • LLM-based agents show potential in social science, natural science, and engineering applications.
  • Diverse agent architectures are developed for different tasks, focusing on utilizing LLM capabilities.
  • Memory systems of LLM-based agents feature hybrid structures with short-term and long-term functions for flexible planning.
  • Memory formats in these agents use natural languages for reasoning and programming, enhancing storage and access efficiency.
  • Surveys provide insights into LLM development and applications in downstream tasks; human alignment research addresses biases.
  • Reasoning abilities are crucial for intelligence, influencing decision-making and problem-solving capabilities.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, Wayne Xin Zhao, Zhewei Wei, Ji-Rong Wen

32 pages, 3 figures
License: CC BY 4.0

Abstract: Autonomous agents have long been a prominent research topic in the academic community. Previous research in this field often focuses on training agents with limited knowledge within isolated environments, which diverges significantly from the human learning processes, and thus makes the agents hard to achieve human-like decisions. Recently, through the acquisition of vast amounts of web knowledge, large language models (LLMs) have demonstrated remarkable potential in achieving human-level intelligence. This has sparked an upsurge in studies investigating autonomous agents based on LLMs. To harness the full potential of LLMs, researchers have devised diverse agent architectures tailored to different applications. In this paper, we present a comprehensive survey of these studies, delivering a systematic review of the field of autonomous agents from a holistic perspective. More specifically, our focus lies in the construction of LLM-based agents, for which we propose a unified framework that encompasses a majority of the previous work. Additionally, we provide a summary of the various applications of LLM-based AI agents in the domains of social science, natural science, and engineering. Lastly, we discuss the commonly employed evaluation strategies for LLM-based AI agents. Based on the previous studies, we also present several challenges and future directions in this field. To keep track of this field and continuously update our survey, we maintain a repository for the related references at https://github.com/Paitesanshi/LLM-Agent-Survey.

Submitted to arXiv on 22 Aug. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2308.11432v1

The field of autonomous agents has undergone a significant transformation in recent years with the incorporation of large language models (LLMs) to achieve human-level intelligence. These LLM-based agents have shown immense potential in various applications across social science, natural science, and engineering domains. Researchers have developed diverse agent architectures tailored to different tasks and environments, with a focus on harnessing the full capabilities of LLMs. One key aspect that sets these LLM-based agents apart is their memory systems. Hybrid memory structures are commonly employed, distinguishing between short-term and long-term functions. The short-term component buffers recent perceptions while long-term memory consolidates important information over time. This dual-layered approach allows for flexible planning based on stable knowledge and insights. Memory formats also play a crucial role in how information is stored and accessed within these agents. Natural languages are often used for task reasoning and programming, enabling semantic-rich storage and access. Embeddings enhance memory reading efficiency, providing a comprehensive understanding of stored information. Additionally, related surveys have emerged to provide detailed insights into the development of LLMs and their applications in various downstream tasks. Human alignment with LLMs is an active area of research to address biases and ensure ethical deployment. Reasoning abilities are also highlighted as crucial for intelligence, influencing decision-making processes and problem-solving capabilities. Overall, the field of autonomous agents based on LLMs is rapidly evolving with ongoing challenges and future directions being explored by researchers. The integration of advanced memory systems and diverse memory formats showcases the potential for these agents to achieve human-like decision-making processes across a wide range of applications.
Created on 04 Mar. 2024

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.