A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applications
AI-generated Key Points
- Graphs are essential for representing complex relationships in society and nature, including social networks, transportation systems, financial structures, and biomedical networks.
- Large language models (LLMs) have transformed natural language processing (NLP) and multi-modal tasks with their exceptional generalization capabilities, particularly in addressing challenges related to graph tasks.
- The survey focuses on LLM applications in graph data analysis, highlighting the effectiveness of LLM models in various graph analytics tasks such as generative graph analytics (LLM-GGA), graph query processing (LLM-GQP), graph inference and learning (LLM-GIL), and graph-LLM-based applications.
- LLM-GQP integrates graph analytics techniques with LLM prompts to enhance functionalities like graph understanding and knowledge graph-based augmented retrieval.
- LLM-GIL leverages LLM capabilities for learning and reasoning over graphs through mechanisms such as graph learning, reasoning formation based on graphs, and enhancing overall graph representation.
- The survey explores how integrating different prompts into LLM models can effectively address various downstream tasks related to graphs.
- It provides insights into evaluating LLM models, benchmark datasets/tasks used for assessment purposes, along with a detailed analysis of pros and cons associated with employing these models.
- This interdisciplinary research area at the intersection of LLMs and graph analytics presents numerous open problems and future directions for exploration.
Authors: Wenbo Shang, Xin Huang
Abstract: A graph is a fundamental data model to represent various entities and their complex relationships in society and nature, such as social networks, transportation networks, financial networks, and biomedical systems. Recently, large language models (LLMs) have showcased a strong generalization ability to handle various NLP and multi-mode tasks to answer users' arbitrary questions and specific-domain content generation. Compared with graph learning models, LLMs enjoy superior advantages in addressing the challenges of generalizing graph tasks by eliminating the need for training graph learning models and reducing the cost of manual annotation. In this survey, we conduct a comprehensive investigation of existing LLM studies on graph data, which summarizes the relevant graph analytics tasks solved by advanced LLM models and points out the existing remaining challenges and future directions. Specifically, we study the key problems of LLM-based generative graph analytics (LLM-GGA) with three categories: LLM-based graph query processing (LLM-GQP), LLM-based graph inference and learning (LLM-GIL), and graph-LLM-based applications. LLM-GQP focuses on an integration of graph analytics techniques and LLM prompts, including graph understanding and knowledge graph (KG) based augmented retrieval, while LLM-GIL focuses on learning and reasoning over graphs, including graph learning, graph-formed reasoning and graph representation. We summarize the useful prompts incorporated into LLM to handle different graph downstream tasks. Moreover, we give a summary of LLM model evaluation, benchmark datasets/tasks, and a deep pro and cons analysis of LLM models. We also explore open problems and future directions in this exciting interdisciplinary research area of LLMs and graph analytics.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.