Towards Large-scale Generative Ranking

AI-generated keywords: Generative recommendation Information retrieval Industrial settings Ranking systems Xiaohongshu's Explore Feed

AI-generated Key Points

  • Generative recommendation is a promising paradigm in information retrieval
  • Generative ranking systems are particularly understudied in large-scale industrial settings
  • Generative ranking outperforms current industrial recommenders primarily due to its architecture
  • RankGPT is proposed as a novel architecture tailored for large-scale training and inference
  • Main contributions of the paper include identifying sources of effectiveness in generative recommendation, proposing an efficient generative architecture for industrial scenarios, and conducting large-scale online A/B testing
  • The study utilizes hundreds of billions of item exposure logs from Xiaohongshu's Explore Feed to construct datasets for offline experiments
  • Generative ranking effectiveness is explored through experiments focusing on distinct underlying mechanisms that differentiate it from conventional approaches
  • Scaling laws in recommendation systems are discussed, drawing parallels with principles in natural language processing and computer vision
  • Generative ranking methods have the potential to enhance user satisfaction and performance metrics in industrial recommender systems
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Yanhua Huang, Yuqi Chen, Xiong Cao, Rui Yang, Mingliang Qi, Yinghao Zhu, Qingchang Han, Yaowei Liu, Zhaoyu Liu, Xuefeng Yao, Yuting Jia, Leilei Ma, Yinqi Zhang, Taoyu Zhu, Liujie Zhang, Lei Chen, Weihang Chen, Min Zhu, Ruiwen Xu, Lei Zhang

License: CC BY-NC-SA 4.0

Abstract: Generative recommendation has recently emerged as a promising paradigm in information retrieval. However, generative ranking systems are still understudied, particularly with respect to their effectiveness and feasibility in large-scale industrial settings. This paper investigates this topic at the ranking stage of Xiaohongshu's Explore Feed, a recommender system that serves hundreds of millions of users. Specifically, we first examine how generative ranking outperforms current industrial recommenders. Through theoretical and empirical analyses, we find that the primary improvement in effectiveness stems from the generative architecture, rather than the training paradigm. To facilitate efficient deployment of generative ranking, we introduce RankGPT, a novel generative architecture for ranking. We validate the effectiveness and efficiency of our solution through online A/B experiments. The results show that RankGPT achieves significant improvements in user satisfaction with nearly equivalent computational resources compared to the existing production system.

Submitted to arXiv on 07 May. 2025

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2505.04180v1

Generative recommendation has emerged as a promising paradigm in information retrieval, with generative ranking systems being particularly understudied in large-scale industrial settings. This paper delves into the topic at the ranking stage of Xiaohongshu's Explore Feed, a recommender system serving millions of users. The study reveals that generative ranking outperforms current industrial recommenders primarily due to its architecture rather than the training paradigm. To address inefficiencies in current generative architectures, the authors propose RankGPT, a novel architecture tailored for large-scale training and inference. The main contributions of this paper include identifying the sources of effectiveness in generative recommendation, proposing an efficient generative architecture for industrial scenarios, and conducting large-scale online A/B testing to demonstrate the feasibility of generative ranking in recommender systems. The study utilizes hundreds of billions of item exposure logs from Xiaohongshu's Explore Feed to construct datasets for offline experiments, incorporating categorical features, numerical features discretized into categorical ones, and frozen embeddings from pre-trained models. The effectiveness of generative ranking is explored through experiments focusing on distinct underlying mechanisms that differentiate it from conventional approaches. The study also discusses scaling laws in recommendation systems, drawing parallels with established principles in natural language processing and computer vision. Overall, the findings highlight the potential of generative ranking methods in enhancing user satisfaction and performance metrics in industrial recommender systems.
Created on 08 May. 2025

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.