AI summary · arXiv: 2403.01744v1 · cs.IR

NoteLLM: A Retrievable Large Language Model for Note Recommendation

Chao Zhang, Shiwei Wu, Haoxin Zhang, Tong Xu, Yan Gao, Yao Hu, Enhong Chen
Original paper Submitted to arXiv on 04 Mar. 2024 Published as a WWW'24 full paper License: NONEXCLUSIVE-DISTRIB 1.0

How to read this summary? Illustrated guide

The essentials

  • Authors emphasize the importance of recommending notes aligned with user interests in online communities
  • Limitations of existing methods that rely solely on BERT-based models for note embeddings
  • Introduction of a novel unified framework called NoteLLM for item-to-item (I2I) note recommendation
  • Utilization of Note Compression Prompt to condense notes into a single special token and contrastive learning approach for related note embeddings
  • Automatic generation of hashtags/categories through instruction tuning
  • Validation demonstrating the effectiveness of the proposed method compared to online baselines, with significant improvements in Xiaohongshu's recommendation system
  • Enhancement of note embeddings by incorporating important cues and leveraging LLMs' superior performance in understanding natural languages

Key points written by AI: they may contain errors, check them against the paper.

AI-generated keywords: NoteLLM Large Language Models Note Recommendation Item-to-Item Personalized

Read further

  • Comprehensive Summary
  • Layman's Summary
  • Blog article
  • Original abstract
In their paper titled "NoteLLM: A Retrievable Large Language Model for Note Recommendation," authors Chao Zhang, Shiwei Wu, Haoxin Zhang, Tong Xu, Yan Gao, Yao Hu, and Enhong Chen address the importance of recommending notes aligned with user interests within online communities. They highlight the limitations of existing methods that solely rely on BERT-based models to generate note embeddings for assessing similarity. These methods may overlook crucial cues such as hashtags or categories, which encapsulate the key concepts of notes. By learning to generate hashtags/categories and leveraging Large Language Models (LLMs) over BERT, the authors introduce a novel unified framework called NoteLLM for item-to-item (I2I) note recommendation. The framework utilizes a Note Compression Prompt to condense a note into a single special token and employs a contrastive learning approach to learn embeddings of potentially related notes. Additionally, is used to summarize notes and automatically generate hashtags/categories through instruction tuning. Extensive validations conducted on real scenarios demonstrate the effectiveness of the proposed method compared to online baselines, showcasing significant improvements in Xiaohongshu's recommendation system. This innovative approach not only enhances note embeddings by incorporating important cues but also leverages LLMs' superior performance in understanding natural languages. The authors' research sheds light on the potential of utilizing advanced language models for personalized note recommendations tailored to individual user preferences within online communities.

Was this synthesis useful?

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Tools for this paper

Explain it differently 3 free rewrites left today
Save to a collection Group papers in collections to compare them, chat with them and export them. Create a free account Log in

Advanced tools Premium

For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium

Zotero
Citation alerts Citation alerts guide

Papers around this one

See them on a map

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

  1. Very close Cites this paper
    TagLLM: A Fine-Grained Tag Generation Approach for Note Recommendation
    Zhijia Chen, Li-Kai Wang, Lei Chen et al. · 2026 · arXiv.org · preprint, not peer reviewed · Not summarized yet
    Abstract

    Large Language Models (LLMs) have shown promising potential in E-commerce community recommendation. While LLMs and Multimodal LLMs (MLLMs) are widely used to encode notes into implicit embeddings, leveraging their generative capabilities to represent notes with interpretable tags remains unexplored. In the field of tag generation, traditional close-ended methods heavily rely on the design of tag pools, while existing open-ended methods applied directly to note recommendations face two limitations: (1) MLLMs lack guidance during generation, resulting in redundant tags that fail to capture user interests; (2) The generated tags are often coarse and lack fine-grained representation of notes, in…

  2. Very close Cites this paper Uses this paper in depth
    NoteLLM-2: Multimodal Large Representation Models for Recommendation
    Chao Zhang, Haoxin Zhang, Shiwei Wu et al. · 2024 · Knowledge Discovery and Data Mining · cited 91 times · Not summarized yet
    Abstract

    Large Language Models (LLMs) have demonstrated exceptional proficiency in text understanding and embedding tasks. However, their potential in multimodal representation, particularly for item-to-item (I2I) recommendations, remains underexplored. While leveraging existing Multimodal Large Language Models (MLLMs) for such tasks is promising, challenges arise due to their delayed release compared to corresponding LLMs and the inefficiency in representation tasks. To address these issues, we propose an end-to-end fine-tuning method that customizes the integration of any existing LLMs and vision encoders for efficient multimodal representation. Preliminary experiments revealed that fine-tuned LLMs…

  3. Close
    Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation
    Bo-Wen Zheng, Yupeng Hou, Hong-Yu Lu et al. · 2023 · IEEE International Conference on Data Engineering · cited 495 times · Not summarized yet
    Abstract

    Recently, large language models (LLMs) have shown great potential in recommender systems, either improving existing recommendation models or serving as the backbone. However, there exists a large semantic gap between LLMs and recommender systems, since items to be recommended are often indexed by discrete identifiers (item ID) out of the LLM's vocabulary. In essence, LLMs capture language semantics while recommender systems imply collaborative semantics, making it difficult to sufficiently leverage the model capacity of LLMs for recommendation. To address this challenge, in this paper, we propose a new LLM-based recommendation model called LC-Rec, which can better integrate language and coll…

  4. Close Another approach to the problem
    Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive Aggregation
    Sichun Luo, Yuxuan Yao, Bowei He et al. · 2024 · Information Retrieval · cited 63 times · AI summary available

    Integrating LLMs with conventional recommendation methods through mutual augmentation and adaptive aggregation addresses recommendation, while NoteLLM compresses notes and learns item-to-item similarities.

    Abstract

    Conventional recommendation methods have achieved notable advancements by harnessing collaborative or sequential information from user behavior. Recently, large language models (LLMs) have gained prominence for their capabilities in understanding and reasoning over textual semantics, and have found utility in various domains, including recommendation. Conventional recommendation methods and LLMs each have their strengths and weaknesses. While conventional methods excel at mining collaborative information and modeling sequential behavior, they struggle with data sparsity and the long-tail problem. LLMs, on the other hand, are proficient at utilizing rich textual contexts but face challenges i…

  5. Close
    LLM-Rec: Personalized Recommendation via Prompting Large Language Models
    Hanjia Lyu, Song Jiang, Hanqing Zeng et al. · 2023 · Computation and Language · cited 206 times · AI summary available
    Abstract

    We investigate various prompting strategies for enhancing personalized content recommendation performance with large language models (LLMs) through input augmentation. Our proposed approach, termed LLM-Rec, encompasses four distinct prompting strategies: (1) basic prompting, (2) recommendation-driven prompting, (3) engagement-guided prompting, and (4) recommendation-driven + engagement-guided prompting. Our empirical experiments show that combining the original content description with the augmented input text generated by LLM using these prompting strategies leads to improved recommendation performance. This finding highlights the importance of incorporating diverse prompts and input augmen…

  6. Close Review Cited by this paper
    Recommender Systems in the Era of Large Language Models (LLMs)
    Wenqi Fan, Zihuai Zhao, Jiatong Li et al. · 2023 · Information Retrieval · cited 612 times · AI summary available

    Recommender Systems in the Era of Large Language Models surveys how LLMs relate to recommender systems, a broader area that includes NoteLLM.

    Abstract

    With the prosperity of e-commerce and web applications, Recommender Systems (RecSys) have become an important component of our daily life, providing personalized suggestions that cater to user preferences. While Deep Neural Networks (DNNs) have made significant advancements in enhancing recommender systems by modeling user-item interactions and incorporating textual side information, DNN-based methods still face limitations, such as difficulties in understanding users' interests and capturing textual side information, inabilities in generalizing to various recommendation scenarios and reasoning on their predictions, etc. Meanwhile, the emergence of Large Language Models (LLMs), such as ChatG…

  7. Close Review Cited by this paper Cites this paper A method it uses
    A Survey on Large Language Models for Recommendation
    Likang Wu, Zhi Zheng, Zhaopeng Qiu et al. · 2023 · Information Retrieval · cited 1,068 times · AI summary available

    A Survey on Large Language Models for Recommendation reviews LLM techniques for recommendation, the broader field in which NoteLLM proposes a note-specific method.

    Abstract

    Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS). These models, trained on massive amounts of data using self-supervised learning, have demonstrated remarkable success in learning universal representations and have the potential to enhance various aspects of recommendation systems by some effective transfer techniques such as fine-tuning and prompt tuning, and so on. The crucial aspect of harnessing the power of language models in enhancing recommendation quality is the utilization of their high-quality representations of textual features an…

  8. Close
    concept2code: Sequential Recommendation with Large Language Models
    Omprakash Sonie · 2025 · ACM Conference on Recommender Systems · Not summarized yet
    Abstract

    Large Language Models (LLMs) have demonstrated remarkable abilities in understanding and generating language, inspiring their adoption in various domains beyond NLP. In this tutorial, we explore how LLMs can be leveraged to enhance sequential recommendation systems. We begin by introducing key LLM concepts relevant to this domain, followed by a structured presentation of increasingly advanced approaches, including semantic embeddings, text-rich modeling, latent relations, long-textual behavior modeling, hierarchical item-user architectures, model distillation, cross-domain generalization, and user-centric personalization. We also include live code walkthroughs that illustrate core ideas and …

Prior work it builds on

  1. Close A method it uses
    A Bi-Step Grounding Paradigm for Large Language Models in Recommendation Systems
    Keqin Bao, Jizhi Zhang, Wen-Jie Wang et al. · 2023 · Trans. Recomm. Syst. · cited 224 times · Not summarized yet
    Abstract

    As the focus on Large Language Models (LLMs) in the field of recommendation intensifies, the optimization of LLMs for recommendation purposes (referred to as LLM4Rec) assumes a crucial role in enhancing their recommendation performance. However, existing approaches for LLM4Rec often assess performance using restricted sets of candidates, which may not accurately reflect the models’ overall ranking capabilities. In this article, our objective is to pursue LLM4Rec models with comprehensive ranking capacity and propose a two-step grounding framework known as BIGRec (Bi-step Grounding Paradigm for Recommendation). BIGRecm initially grounds LLMs to the recommendation space by fine-tuning them to …

  2. Close A method it uses
    Recommender AI Agent: Integrating Large Language Models for Interactive Recommendations
    Xu Huang, Jian-Xun Lian, Yuxuan Lei et al. · 2023 · ACM Trans. Inf. Syst. · cited 298 times · Not summarized yet
    Abstract

    Recommender models capture ever-changing user preferences by training with in-domain user behavior data. These models are typically lightweight, facilitating real-time and large-scale online services. However, these models often falter when tasked with providing more sophisticated functionalities, such as offering explanations or engaging in conversations. Recently, large language models (LLMs) have emerged as a significant advancement towards artificial general intelligence, demonstrating impressive capabilities in instruction comprehension, reasoning, and human interaction. Unfortunately, LLMs lack the understanding of domain-specific item catalogs and behavioral patterns, especially in ar…

  3. Close A method it uses
    How Can Recommender Systems Benefit from Large Language Models: A Survey
    Jianghao Lin, Xin-Yi Dai, Yun-Jia Xi et al. · 2023 · ACM Trans. Inf. Syst. · cited 460 times · Not summarized yet
    Abstract

    With the rapid development of online services and web applications, recommender systems (RS) have become increasingly indispensable for mitigating information overload and matching users’ information needs by providing personalized suggestions over items. Although the RS research community has made remarkable progress over the past decades, conventional recommendation models (CRM) still have some limitations, e.g., lacking open-domain world knowledge, and difficulties in comprehending users’ underlying preferences and motivations. Meanwhile, large language models (LLM) have shown impressive general intelligence and human-like capabilities for various natural language processing (NLP) tasks, …

  4. Close
    Large Language Models are Zero-Shot Rankers for Recommender Systems
    Yupeng Hou, Jun-Jie Zhang, Zihan Lin et al. · 2023 · European Conference on Information Retrieval · cited 688 times · Not summarized yet
    Abstract

    Recently, large language models (LLMs) (e.g., GPT-4) have demonstrated impressive general-purpose task-solving abilities, including the potential to approach recommendation tasks. Along this line of research, this work aims to investigate the capacity of LLMs that act as the ranking model for recommender systems. We first formalize the recommendation problem as a conditional ranking task, considering sequential interaction histories as conditions and the items retrieved by other candidate generation models as candidates. To solve the ranking task by LLMs, we carefully design the prompting template and conduct extensive experiments on two widely-used datasets. We show that LLMs have promising…

  5. Close
    TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation
    Keqin Bao, Jizhi Zhang, Yang Zhang et al. · 2023 · Information Retrieval · cited 941 times · AI summary available
    Abstract

    Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains, thereby prompting researchers to explore their potential for use in recommendation systems. Initial attempts have leveraged the exceptional capabilities of LLMs, such as rich knowledge and strong generalization through In-context Learning, which involves phrasing the recommendation task as prompts. Nevertheless, the performance of LLMs in recommendation tasks remains suboptimal due to a substantial disparity between the training tasks for LLMs and recommendation tasks, as well as inadequate recommendation data during pre-training. To bridge the gap, we consider building a Large Recommendation Langua…

Papers that cite it

  1. Close Uses this paper in depth
    Large Language Model Enhanced Recommender Systems: A Survey
    Qi-Dong Liu, Xiang-Yu Zhao, Yu-Hao Wang et al. · 2024 · cited 18 times · Not summarized yet
    Abstract

    Large Language Model (LLM) has transformative potential in various domains, including recommender systems (RS). There have been a handful of research that focuses on empowering the RS by LLM. However, previous efforts mainly focus on LLM as RS, which may face the challenge of intolerant inference costs by LLM. Recently, the integration of LLM into RS, known as LLM-Enhanced Recommender Systems (LLMERS), has garnered significant interest due to its potential to address latency and memory constraints in real-world applications. This paper presents a comprehensive survey of the latest research efforts aimed at leveraging LLM to enhance RS capabilities. We identify a critical shift in the field w…

  2. Close Uses this paper in depth
    Large Language Model Enhanced Recommender Systems: Methods, Applications and Trends
    Qi-Dong Liu, Xiang-Yu Zhao, Yu-Hao Wang et al. · 2025 · Knowledge Discovery and Data Mining · cited 23 times · Not summarized yet
    Abstract

    Due to exceptional reasoning and understanding abilities, the Large Language Model (LLM) has revolutionized the pattern of many fields, including recommender systems (RS). There has been a handful of research that focuses on empowering the RS by LLM. Recently, considering the latency and memory costs in real-world applications, LLM-Enhanced RS (LLMERS) is highlighted. This direction pushes the LLM into the online system with a large step by eliminating the utilization of LLM during inference. As a cutting-edge field, there is a clear need for a comprehensive survey to summarize this direction. In this survey, we systematically investigate the most up-to-date works of LLM-enhanced RS to boost…

  3. Close
    LLM2Rec: Large Language Models Are Powerful Embedding Models for Sequential Recommendation
    Ying-Zhi He, Xiao-Hao Liu, An Zhang et al. · 2025 · Knowledge Discovery and Data Mining · cited 46 times · Not summarized yet
    Abstract

    Sequential recommendation aims to predict users' future interactions by modeling collaborative filtering (CF) signals from historical behaviors of similar users or items. Traditional sequential recommenders predominantly rely on ID-based embeddings, which capture CF signals through high-order co-occurrence patterns. However, these embeddings depend solely on past interactions, lacking transferable knowledge to generalize to unseen domains. Recent advances in large language models (LLMs) have motivated text-based recommendation approaches that derive item representations from textual descriptions. While these methods enhance generalization, they fail to encode CF signals-i.e., latent item cor…

  4. Close Uses this paper in depth
    RecLM: Recommendation Instruction Tuning
    Yangqin Jiang, Yuhao Yang, Lianghao Xia et al. · 2024 · Information Retrieval · cited 6 times · AI summary available
    Abstract

    Modern recommender systems aim to deeply understand users' complex preferences through their past interactions. While deep collaborative filtering approaches using Graph Neural Networks (GNNs) excel at capturing user-item relationships, their effectiveness is limited when handling sparse data or zero-shot scenarios, primarily due to constraints in ID-based embedding functions. To address these challenges, we propose a model-agnostic recommendation instruction-tuning paradigm that seamlessly integrates large language models with collaborative filtering. Our proposed Recommendation Language Model (RecLM) enhances the capture of user preference diversity through a carefully designed reinforceme…

  5. Close
    Molar: Multimodal LLMs with Collaborative Filtering Alignment for Enhanced Sequential Recommendation
    Yucong Luo, Qitao Qin, Hao Zhang et al. · 2024 · arXiv.org · preprint, not peer reviewed · cited 14 times · Not summarized yet
    Abstract

    Sequential recommendation (SR) systems have evolved significantly over the past decade, transitioning from traditional collaborative filtering to deep learning approaches and, more recently, to large language models (LLMs). While the adoption of LLMs has driven substantial advancements, these models inherently lack collaborative filtering information, relying primarily on textual content data neglecting other modalities and thus failing to achieve optimal recommendation performance. To address this limitation, we propose Molar, a Multimodal large language sequential recommendation framework that integrates multiple content modalities with ID information to capture collaborative signals effec…

How are these papers found?

We compare the title and abstract of this paper with those of every paper summarized on this site, and with the papers Semantic Scholar recommends, those it cites and those citing it (for a much-cited paper, its most recent citations and, from OpenAlex, the most cited ones). Among the prior work and the follow-ups, the papers that use each other in depth, a method it uses and the much-cited follow-ups come a little higher. The levels (very close, close, related) come from the similarity of the texts, not from a judgment of quality; * marks a paper without an abstract, compared by its title. The sentence under a paper is written by an AI from the two abstracts: check it in the papers. A paper marked not relevant by three readers leaves the list.

Updated on 2 November 2026.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.