End-to-end Autonomous Driving: Challenges and Frontiers
AI-generated Key Points
- Significant growth in the use of end-to-end algorithm frameworks in autonomous driving
- End-to-end systems offer joint feature optimization for perception and planning
- Factors contributing to this growth include large-scale datasets, closed-loop evaluation, and the need for effective performance in challenging scenarios
- A survey covering more than 250 papers provides a comprehensive analysis of this trend
- Critical challenges discussed include multi-modality, interpretability, causal confusion, robustness, and world models
- Causal confusion in imitation learning remains an open problem despite efforts to study it
- Dataset imbalance within long-tailed distributions is a severe issue in end-to-end autonomous driving
- Methods proposed to tackle dataset imbalance include over sampling, under sampling, data augmentation, and weighting based approaches
- Advancements in foundation models and visual pre-training techniques are discussed for incorporation into the end-to-end driving framework
- Modeling and utilizing uncertainty is emphasized for autonomous driving
- An active repository with links to relevant literature and open source projects is maintained for further research.
Authors: Li Chen, Penghao Wu, Kashyap Chitta, Bernhard Jaeger, Andreas Geiger, Hongyang Li
Abstract: The autonomous driving community has witnessed a rapid growth in approaches that embrace an end-to-end algorithm framework, utilizing raw sensor input to generate vehicle motion plans, instead of concentrating on individual tasks such as detection and motion prediction. End-to-end systems, in comparison to modular pipelines, benefit from joint feature optimization for perception and planning. This field has flourished due to the availability of large-scale datasets, closed-loop evaluation, and the increasing need for autonomous driving algorithms to perform effectively in challenging scenarios. In this survey, we provide a comprehensive analysis of more than 250 papers, covering the motivation, roadmap, methodology, challenges, and future trends in end-to-end autonomous driving. We delve into several critical challenges, including multi-modality, interpretability, causal confusion, robustness, and world models, amongst others. Additionally, we discuss current advancements in foundation models and visual pre-training, as well as how to incorporate these techniques within the end-to-end driving framework. To facilitate future research, we maintain an active repository that contains up-to-date links to relevant literature and open-source projects at https://github.com/OpenDriveLab/End-to-end-Autonomous-Driving.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.