AI summary · arXiv: 2403.01744v1 · cs.IR
NoteLLM: A Retrievable Large Language Model for Note Recommendation
The essentials
- Authors emphasize the importance of recommending notes aligned with user interests in online communities
- Limitations of existing methods that rely solely on BERT-based models for note embeddings
- Introduction of a novel unified framework called NoteLLM for item-to-item (I2I) note recommendation
- Utilization of Note Compression Prompt to condense notes into a single special token and contrastive learning approach for related note embeddings
- Automatic generation of hashtags/categories through instruction tuning
- Validation demonstrating the effectiveness of the proposed method compared to online baselines, with significant improvements in Xiaohongshu's recommendation system
- Enhancement of note embeddings by incorporating important cues and leveraging LLMs' superior performance in understanding natural languages
Key points written by AI: they may contain errors, check them against the paper.
Ask questions about this paper to our AI assistant
How to chat with this paper? Illustrated guide
You can also chat with multiple papers at once here.
Keep this conversation — a free account saves your questions and answers, your collections of papers and your alerts.
Create a free accountTools for this paper
Advanced tools Premium
For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium
Papers around this one
See them on a mapRanked by how close their title and abstract are to this paper’s. Select some to read them together.
Closest papers
-
TagLLM: A Fine-Grained Tag Generation Approach for Note RecommendationZhijia Chen, Li-Kai Wang, Lei Chen et al. · 2026 · arXiv.org · preprint, not peer reviewed · Not summarized yet
Abstract
Large Language Models (LLMs) have shown promising potential in E-commerce community recommendation. While LLMs and Multimodal LLMs (MLLMs) are widely used to encode notes into implicit embeddings, leveraging their generative capabilities to represent notes with interpretable tags remains unexplored. In the field of tag generation, traditional close-ended methods heavily rely on the design of tag pools, while existing open-ended methods applied directly to note recommendations face two limitations: (1) MLLMs lack guidance during generation, resulting in redundant tags that fail to capture user interests; (2) The generated tags are often coarse and lack fine-grained representation of notes, in…
-
NoteLLM-2: Multimodal Large Representation Models for RecommendationChao Zhang, Haoxin Zhang, Shiwei Wu et al. · 2024 · Knowledge Discovery and Data Mining · cited 91 times · Not summarized yet
Abstract
Large Language Models (LLMs) have demonstrated exceptional proficiency in text understanding and embedding tasks. However, their potential in multimodal representation, particularly for item-to-item (I2I) recommendations, remains underexplored. While leveraging existing Multimodal Large Language Models (MLLMs) for such tasks is promising, challenges arise due to their delayed release compared to corresponding LLMs and the inefficiency in representation tasks. To address these issues, we propose an end-to-end fine-tuning method that customizes the integration of any existing LLMs and vision encoders for efficient multimodal representation. Preliminary experiments revealed that fine-tuned LLMs…
-
Adapting Large Language Models by Integrating Collaborative Semantics for RecommendationBo-Wen Zheng, Yupeng Hou, Hong-Yu Lu et al. · 2023 · IEEE International Conference on Data Engineering · cited 495 times · Not summarized yet
Abstract
Recently, large language models (LLMs) have shown great potential in recommender systems, either improving existing recommendation models or serving as the backbone. However, there exists a large semantic gap between LLMs and recommender systems, since items to be recommended are often indexed by discrete identifiers (item ID) out of the LLM's vocabulary. In essence, LLMs capture language semantics while recommender systems imply collaborative semantics, making it difficult to sufficiently leverage the model capacity of LLMs for recommendation. To address this challenge, in this paper, we propose a new LLM-based recommendation model called LC-Rec, which can better integrate language and coll…
-
Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive AggregationSichun Luo, Yuxuan Yao, Bowei He et al. · 2024 · Information Retrieval · cited 63 times · AI summary available
Integrating LLMs with conventional recommendation methods through mutual augmentation and adaptive aggregation addresses recommendation, while NoteLLM compresses notes and learns item-to-item similarities.
Abstract
Conventional recommendation methods have achieved notable advancements by harnessing collaborative or sequential information from user behavior. Recently, large language models (LLMs) have gained prominence for their capabilities in understanding and reasoning over textual semantics, and have found utility in various domains, including recommendation. Conventional recommendation methods and LLMs each have their strengths and weaknesses. While conventional methods excel at mining collaborative information and modeling sequential behavior, they struggle with data sparsity and the long-tail problem. LLMs, on the other hand, are proficient at utilizing rich textual contexts but face challenges i…
-
LLM-Rec: Personalized Recommendation via Prompting Large Language ModelsHanjia Lyu, Song Jiang, Hanqing Zeng et al. · 2023 · Computation and Language · cited 206 times · AI summary available
Abstract
We investigate various prompting strategies for enhancing personalized content recommendation performance with large language models (LLMs) through input augmentation. Our proposed approach, termed LLM-Rec, encompasses four distinct prompting strategies: (1) basic prompting, (2) recommendation-driven prompting, (3) engagement-guided prompting, and (4) recommendation-driven + engagement-guided prompting. Our empirical experiments show that combining the original content description with the augmented input text generated by LLM using these prompting strategies leads to improved recommendation performance. This finding highlights the importance of incorporating diverse prompts and input augmen…
-
Recommender Systems in the Era of Large Language Models (LLMs)Wenqi Fan, Zihuai Zhao, Jiatong Li et al. · 2023 · Information Retrieval · cited 612 times · AI summary available
Recommender Systems in the Era of Large Language Models surveys how LLMs relate to recommender systems, a broader area that includes NoteLLM.
Abstract
With the prosperity of e-commerce and web applications, Recommender Systems (RecSys) have become an important component of our daily life, providing personalized suggestions that cater to user preferences. While Deep Neural Networks (DNNs) have made significant advancements in enhancing recommender systems by modeling user-item interactions and incorporating textual side information, DNN-based methods still face limitations, such as difficulties in understanding users' interests and capturing textual side information, inabilities in generalizing to various recommendation scenarios and reasoning on their predictions, etc. Meanwhile, the emergence of Large Language Models (LLMs), such as ChatG…
-
A Survey on Large Language Models for RecommendationLikang Wu, Zhi Zheng, Zhaopeng Qiu et al. · 2023 · Information Retrieval · cited 1,068 times · AI summary available
A Survey on Large Language Models for Recommendation reviews LLM techniques for recommendation, the broader field in which NoteLLM proposes a note-specific method.
Abstract
Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, trained on massive amounts of data using self-supervised learning, have demonstrated remarkable success in learning universal representations and have the potential to enhance various aspects of recommendation systems by some effective transfer techniques such as fine-tuning and prompt tuning, and so on. The crucial aspect of harnessing the power of language models in enhancing recommendation quality is the utilization of their high-quality representations of textual features an…
-
concept2code: Sequential Recommendation with Large Language ModelsOmprakash Sonie · 2025 · ACM Conference on Recommender Systems · Not summarized yet
Abstract
Large Language Models (LLMs) have demonstrated remarkable abilities in understanding and generating language, inspiring their adoption in various domains beyond NLP. In this tutorial, we explore how LLMs can be leveraged to enhance sequential recommendation systems. We begin by introducing key LLM concepts relevant to this domain, followed by a structured presentation of increasingly advanced approaches, including semantic embeddings, text-rich modeling, latent relations, long-textual behavior modeling, hierarchical item-user architectures, model distillation, cross-domain generalization, and user-centric personalization. We also include live code walkthroughs that illustrate core ideas and …
Prior work it builds on
-
A Bi-Step Grounding Paradigm for Large Language Models in Recommendation SystemsKeqin Bao, Jizhi Zhang, Wen-Jie Wang et al. · 2023 · Trans. Recomm. Syst. · cited 224 times · Not summarized yet
Abstract
As the focus on Large Language Models (LLMs) in the field of recommendation intensifies, the optimization of LLMs for recommendation purposes (referred to as LLM4Rec) assumes a crucial role in enhancing their recommendation performance. However, existing approaches for LLM4Rec often assess performance using restricted sets of candidates, which may not accurately reflect the models’ overall ranking capabilities. In this article, our objective is to pursue LLM4Rec models with comprehensive ranking capacity and propose a two-step grounding framework known as BIGRec (Bi-step Grounding Paradigm for Recommendation). BIGRecm initially grounds LLMs to the recommendation space by fine-tuning them to …
-
Recommender AI Agent: Integrating Large Language Models for Interactive RecommendationsXu Huang, Jian-Xun Lian, Yuxuan Lei et al. · 2023 · ACM Trans. Inf. Syst. · cited 298 times · Not summarized yet
Abstract
Recommender models capture ever-changing user preferences by training with in-domain user behavior data. These models are typically lightweight, facilitating real-time and large-scale online services. However, these models often falter when tasked with providing more sophisticated functionalities, such as offering explanations or engaging in conversations. Recently, large language models (LLMs) have emerged as a significant advancement towards artificial general intelligence, demonstrating impressive capabilities in instruction comprehension, reasoning, and human interaction. Unfortunately, LLMs lack the understanding of domain-specific item catalogs and behavioral patterns, especially in ar…
-
How Can Recommender Systems Benefit from Large Language Models: A SurveyJianghao Lin, Xin-Yi Dai, Yun-Jia Xi et al. · 2023 · ACM Trans. Inf. Syst. · cited 460 times · Not summarized yet
Abstract
With the rapid development of online services and web applications, recommender systems (RS) have become increasingly indispensable for mitigating information overload and matching users’ information needs by providing personalized suggestions over items. Although the RS research community has made remarkable progress over the past decades, conventional recommendation models (CRM) still have some limitations, e.g., lacking open-domain world knowledge, and difficulties in comprehending users’ underlying preferences and motivations. Meanwhile, large language models (LLM) have shown impressive general intelligence and human-like capabilities for various natural language processing (NLP) tasks, …
-
Large Language Models are Zero-Shot Rankers for Recommender SystemsYupeng Hou, Jun-Jie Zhang, Zihan Lin et al. · 2023 · European Conference on Information Retrieval · cited 688 times · Not summarized yet
Abstract
Recently, large language models (LLMs) (e.g., GPT-4) have demonstrated impressive general-purpose task-solving abilities, including the potential to approach recommendation tasks. Along this line of research, this work aims to investigate the capacity of LLMs that act as the ranking model for recommender systems. We first formalize the recommendation problem as a conditional ranking task, considering sequential interaction histories as conditions and the items retrieved by other candidate generation models as candidates. To solve the ranking task by LLMs, we carefully design the prompting template and conduct extensive experiments on two widely-used datasets. We show that LLMs have promising…
-
TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with RecommendationKeqin Bao, Jizhi Zhang, Yang Zhang et al. · 2023 · Information Retrieval · cited 941 times · AI summary available
Abstract
Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains, thereby prompting researchers to explore their potential for use in recommendation systems. Initial attempts have leveraged the exceptional capabilities of LLMs, such as rich knowledge and strong generalization through In-context Learning, which involves phrasing the recommendation task as prompts. Nevertheless, the performance of LLMs in recommendation tasks remains suboptimal due to a substantial disparity between the training tasks for LLMs and recommendation tasks, as well as inadequate recommendation data during pre-training. To bridge the gap, we consider building a Large Recommendation Langua…
Papers that cite it
-
Large Language Model Enhanced Recommender Systems: A SurveyQi-Dong Liu, Xiang-Yu Zhao, Yu-Hao Wang et al. · 2024 · cited 18 times · Not summarized yet
Abstract
Large Language Model (LLM) has transformative potential in various domains, including recommender systems (RS). There have been a handful of research that focuses on empowering the RS by LLM. However, previous efforts mainly focus on LLM as RS, which may face the challenge of intolerant inference costs by LLM. Recently, the integration of LLM into RS, known as LLM-Enhanced Recommender Systems (LLMERS), has garnered significant interest due to its potential to address latency and memory constraints in real-world applications. This paper presents a comprehensive survey of the latest research efforts aimed at leveraging LLM to enhance RS capabilities. We identify a critical shift in the field w…
-
Large Language Model Enhanced Recommender Systems: Methods, Applications and TrendsQi-Dong Liu, Xiang-Yu Zhao, Yu-Hao Wang et al. · 2025 · Knowledge Discovery and Data Mining · cited 23 times · Not summarized yet
Abstract
Due to exceptional reasoning and understanding abilities, the Large Language Model (LLM) has revolutionized the pattern of many fields, including recommender systems (RS). There has been a handful of research that focuses on empowering the RS by LLM. Recently, considering the latency and memory costs in real-world applications, LLM-Enhanced RS (LLMERS) is highlighted. This direction pushes the LLM into the online system with a large step by eliminating the utilization of LLM during inference. As a cutting-edge field, there is a clear need for a comprehensive survey to summarize this direction. In this survey, we systematically investigate the most up-to-date works of LLM-enhanced RS to boost…
-
LLM2Rec: Large Language Models Are Powerful Embedding Models for Sequential RecommendationYing-Zhi He, Xiao-Hao Liu, An Zhang et al. · 2025 · Knowledge Discovery and Data Mining · cited 46 times · Not summarized yet
Abstract
Sequential recommendation aims to predict users' future interactions by modeling collaborative filtering (CF) signals from historical behaviors of similar users or items. Traditional sequential recommenders predominantly rely on ID-based embeddings, which capture CF signals through high-order co-occurrence patterns. However, these embeddings depend solely on past interactions, lacking transferable knowledge to generalize to unseen domains. Recent advances in large language models (LLMs) have motivated text-based recommendation approaches that derive item representations from textual descriptions. While these methods enhance generalization, they fail to encode CF signals-i.e., latent item cor…
-
RecLM: Recommendation Instruction TuningYangqin Jiang, Yuhao Yang, Lianghao Xia et al. · 2024 · Information Retrieval · cited 6 times · AI summary available
Abstract
Modern recommender systems aim to deeply understand users' complex preferences through their past interactions. While deep collaborative filtering approaches using Graph Neural Networks (GNNs) excel at capturing user-item relationships, their effectiveness is limited when handling sparse data or zero-shot scenarios, primarily due to constraints in ID-based embedding functions. To address these challenges, we propose a model-agnostic recommendation instruction-tuning paradigm that seamlessly integrates large language models with collaborative filtering. Our proposed Recommendation Language Model (RecLM) enhances the capture of user preference diversity through a carefully designed reinforceme…
-
Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential RecommendationYucong Luo, Qitao Qin, Hao Zhang et al. · 2024 · arXiv.org · preprint, not peer reviewed · cited 14 times · Not summarized yet
Abstract
Sequential recommendation (SR) systems have evolved significantly over the past decade, transitioning from traditional collaborative filtering to deep learning approaches and, more recently, to large language models (LLMs). While the adoption of LLMs has driven substantial advancements, these models inherently lack collaborative filtering information, relying primarily on textual content data neglecting other modalities and thus failing to achieve optimal recommendation performance. To address this limitation, we propose Molar, a Multimodal large language sequential recommendation framework that integrates multiple content modalities with ID information to capture collaborative signals effec…
Go further
How are these papers found?
We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.
Updated on 2 November 2026.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.