Generative recommendation has emerged as a promising paradigm in information retrieval, with generative ranking systems being particularly understudied in large-scale industrial settings. This paper delves into the topic at the ranking stage of Xiaohongshu's Explore Feed, a recommender system serving millions of users. The study reveals that generative ranking outperforms current industrial recommenders primarily due to its architecture rather than the training paradigm. To address inefficiencies in current generative architectures, the authors propose RankGPT, a novel architecture tailored for large-scale training and inference. The main contributions of this paper include identifying the sources of effectiveness in generative recommendation, proposing an efficient generative architecture for industrial scenarios, and conducting large-scale online A/B testing to demonstrate the feasibility of generative ranking in recommender systems. The study utilizes hundreds of billions of item exposure logs from Xiaohongshu's Explore Feed to construct datasets for offline experiments, incorporating categorical features, numerical features discretized into categorical ones, and frozen embeddings from pre-trained models. The effectiveness of generative ranking is explored through experiments focusing on distinct underlying mechanisms that differentiate it from conventional approaches. The study also discusses scaling laws in recommendation systems, drawing parallels with established principles in natural language processing and computer vision. Overall, the findings highlight the potential of generative ranking methods in enhancing user satisfaction and performance metrics in industrial recommender systems.
- Generative recommendation is a promising paradigm in information retrieval
- Generative ranking systems are particularly understudied in large-scale industrial settings
- Generative ranking outperforms current industrial recommenders primarily due to its architecture
- RankGPT is proposed as a novel architecture tailored for large-scale training and inference
- Main contributions of the paper include identifying sources of effectiveness in generative recommendation, proposing an efficient generative architecture for industrial scenarios, and conducting large-scale online A/B testing
- The study utilizes hundreds of billions of item exposure logs from Xiaohongshu's Explore Feed to construct datasets for offline experiments
- Generative ranking effectiveness is explored through experiments focusing on distinct underlying mechanisms that differentiate it from conventional approaches
- Scaling laws in recommendation systems are discussed, drawing parallels with principles in natural language processing and computer vision
- Generative ranking methods have the potential to enhance user satisfaction and performance metrics in industrial recommender systems
SummaryGenerative recommendation is a new way to help find things online. It works better than other methods used by big companies. A special system called RankGPT was created to make it work even better. The study looked at lots of data to see how well this new method works. By using generative ranking, we can make online recommendations more helpful and satisfying for users.
Definitions- Generative recommendation: A method that helps suggest things to people based on their preferences.
- Ranking systems: Systems that determine the order or importance of items or information.
- Architecture: The design or structure of a system or process.
- Industrial settings: Places where large-scale operations or businesses are carried out.
- A/B testing: Comparing two versions (A and B) to see which one performs better.
- Item exposure logs: Records of how often different items are shown to users.
- Scaling laws: Patterns or rules that describe how systems change as they grow.
Generative recommendation has emerged as a promising paradigm in information retrieval, offering a new approach to personalized recommendations. While generative ranking systems have been extensively studied in academic settings, their potential in large-scale industrial scenarios remains largely understudied. In this research paper, titled "RankGPT: Generative Ranking for Industrial Recommender Systems," the authors delve into the topic of generative ranking at the Explore Feed stage of Xiaohongshu, a popular Chinese social e-commerce platform serving millions of users.
The study begins by highlighting the limitations of traditional collaborative filtering methods used in recommender systems and introducing generative recommendation as an alternative approach. The authors then focus on the ranking stage of Xiaohongshu's Explore Feed and compare it with conventional approaches used in industrial recommenders. Through extensive experiments using hundreds of billions of item exposure logs from Xiaohongshu's Explore Feed, they demonstrate that generative ranking outperforms current industrial recommenders primarily due to its architecture rather than the training paradigm.
One of the main contributions of this paper is identifying the sources of effectiveness in generative recommendation. The authors conduct experiments focusing on distinct underlying mechanisms that differentiate it from conventional approaches such as collaborative filtering and content-based methods. They also incorporate categorical features, numerical features discretized into categorical ones, and frozen embeddings from pre-trained models to construct datasets for offline experiments.
To address inefficiencies in current generative architectures when applied to large-scale industrial scenarios, the authors propose RankGPT - a novel architecture tailored specifically for efficient training and inference. This architecture combines ideas from both natural language processing (NLP) and computer vision (CV) domains to create a robust framework for generating recommendations.
In addition to proposing RankGPT, this paper also conducts large-scale online A/B testing to demonstrate the feasibility and effectiveness of generative ranking in recommender systems. The results show significant improvements in user satisfaction metrics such as click-through rate (CTR) and conversion rate (CVR) when compared to traditional approaches.
The study also discusses scaling laws in recommendation systems, drawing parallels with established principles in NLP and CV. This provides valuable insights into the potential of generative ranking methods for enhancing user satisfaction and performance metrics in industrial recommender systems.
In conclusion, this research paper highlights the potential of generative ranking methods in improving personalized recommendations in large-scale industrial settings. The authors' contributions include identifying the sources of effectiveness in generative recommendation, proposing an efficient architecture tailored for industrial scenarios, and conducting extensive experiments to demonstrate its feasibility. With the growing demand for personalized recommendations, this study opens up new avenues for further research and development in the field of generative recommendation.