Results of the summarizing process for the arXiv paper: 2502.18965v1

, , , , This paper introduces OneRec, a unified end-to-end generative framework for single-stage recommendation, designed to address the challenges faced by traditional recommendation systems. Inspired by the scaling laws observed in training large language models, OneRec incorporates an encoder-decoder architecture and scales up its model parameters based on a sparse Mixture-of-Experts (MoE) structure. This allows OneRec to effectively capture user interests. Unlike conventional point-by-point prediction methods, OneRec adopts a session-wise list generation approach that considers both the relative content and order of items within each session. This eliminates the need for hand-crafted strategies and allows the model to autonomously learn optimal session structures from input data. To further improve the quality of generated recommendations, OneRec explores preference learning through direct preference optimization (DPO). To construct preference pairs, self-hard rejected samples are created from beam search results instead of random sampling. An Iterative Preference Alignment (IPA) strategy ranks sampled responses based on scores provided by a pre-trained reward model (RM), identifying the best-chosen and worst-rejected samples. Extensive experiments conducted on large-scale industry datasets demonstrate the superiority of OneRec in generating high-quality recommendations. The framework was successfully deployed in Kuaishou, a popular short video recommendation platform with millions of daily active users, resulting in a significant 1.6% increase in watch-time. Overall, OneRec represents a novel approach to recommendation systems that combines advanced generative modeling techniques with innovative preference alignment strategies to deliver superior performance in real-world scenarios.

• OneRec is a unified end-to-end generative framework for single-stage recommendation
• Incorporates encoder-decoder architecture and scales up model parameters based on sparse Mixture-of-Experts (MoE) structure
• Adopts session-wise list generation approach considering content and order of items within each session
• Explores preference learning through direct preference optimization (DPO) using self-hard rejected samples from beam search results
• Implements Iterative Preference Alignment (IPA) strategy to rank sampled responses based on pre-trained reward model scores
• Extensive experiments demonstrate superiority in generating high-quality recommendations
• Successfully deployed in Kuaishou, resulting in a significant 1.6% increase in watch-time

SummaryOneRec is a special tool that helps suggest things for you to watch or use. It uses a special way of organizing information and making decisions based on different experts. It looks at what you like and how things are arranged before suggesting something to you. It tries hard to understand your preferences and improve its suggestions over time. Many tests show that it is very good at giving recommendations, and it has been used successfully in a popular app, helping people watch more videos. Definitions- Unified: Bringing together different parts into one system. - Generative: Creating or producing something new. - Framework: A structure or set of rules for doing something. - Recommendation: Suggesting something that might be useful or interesting. - Encoder-decoder architecture: A method of converting information from one form to another. - Sparse Mixture-of-Experts (MoE) structure: Using a combination of specialized individuals to make decisions. - Session-wise list generation approach: Creating a list based on how items are grouped together in sessions. - Preference learning: Understanding what someone likes or prefers. - Direct preference optimization (DPO): Improving suggestions by focusing on individual choices. - Self-hard rejected samples: Items that were not chosen during the decision-making process. - Beam search results: A method used in finding solutions by exploring different paths simultaneously. - Iterative Preference Alignment (IPA) strategy: Adjusting suggestions based on feedback received over time. - Pre-trained reward model scores: Ratings given to suggestions based on

Introduction

Recommendation systems have become an integral part of our daily lives, helping us discover new products, services, and content that align with our interests. However, traditional recommendation systems face several challenges such as scalability, personalization, and diversity. To address these issues, a team of researchers from Kuaishou Technology has developed OneRec - a unified end-to-end generative framework for single-stage recommendation. In this blog article, we will dive into the details of the research paper "OneRec: Unified End-to-End Generative Framework for Single-Stage Recommendation" and explore how this innovative approach to recommendation systems can revolutionize the way we receive recommendations.

The Challenges Faced by Traditional Recommendation Systems

Traditional recommendation systems rely on collaborative filtering techniques or matrix factorization methods to generate recommendations. These approaches suffer from scalability issues as they struggle to handle large datasets with millions of users and items. Moreover, they often fail to capture user preferences accurately due to their reliance on past interactions rather than considering current interests. Another challenge faced by traditional recommendation systems is their lack of diversity in recommendations. They tend to recommend similar items repeatedly based on past behavior patterns instead of exploring new options that may align with a user's evolving interests.

The Solution: OneRec Framework

To overcome these challenges, the researchers at Kuaishou Technology developed OneRec - a unified end-to-end generative framework for single-stage recommendation. This framework incorporates an encoder-decoder architecture inspired by scaling laws observed in training large language models like GPT-3. OneRec also adopts a sparse Mixture-of-Experts (MoE) structure that allows it to scale up its model parameters effectively while capturing user interests accurately. This enables OneRec to generate high-quality recommendations even on large-scale industry datasets with millions of users and items.

Session-Wise List Generation Approach

One of the key features of OneRec is its session-wise list generation approach. Unlike traditional point-by-point prediction methods, OneRec considers both the relative content and order of items within each session to generate recommendations. This eliminates the need for hand-crafted strategies and allows the model to autonomously learn optimal session structures from input data.

Preference Learning through Direct Preference Optimization (DPO)

To further improve the quality of generated recommendations, OneRec explores preference learning through direct preference optimization (DPO). This approach involves creating self-hard rejected samples from beam search results instead of random sampling. These samples are then ranked using an Iterative Preference Alignment (IPA) strategy based on scores provided by a pre-trained reward model (RM). The IPA strategy identifies the best-chosen and worst-rejected samples, which are then used to construct preference pairs. By optimizing these preferences directly, OneRec can generate highly personalized and diverse recommendations that align with a user's interests.

Experimental Results

Extensive experiments were conducted on large-scale industry datasets to evaluate the performance of OneRec against other state-of-the-art recommendation systems. The results showed that OneRec outperformed existing methods in terms of accuracy, diversity, and scalability. Moreover, OneRec was successfully deployed in Kuaishou - a popular short video recommendation platform with millions of daily active users. The framework resulted in a significant 1.6% increase in watch-time compared to previous recommendation systems used by Kuaishou.

Conclusion

In conclusion, "OneRec: Unified End-to-End Generative Framework for Single-Stage Recommendation" presents an innovative approach to recommendation systems that combines advanced generative modeling techniques with innovative preference alignment strategies. This framework has shown superior performance in real-world scenarios and has been successfully deployed by Kuaishou Technology. With its ability to handle large-scale datasets, capture user interests accurately, and generate diverse recommendations, OneRec has the potential to revolutionize the way we receive recommendations in various industries. We look forward to seeing how this framework evolves and impacts the field of recommendation systems in the future.