nuScenes: A multimodal dataset for autonomous driving

AI-generated keywords: Autonomous Vehicle Technology Object Detection Range Sensors nuTonomy Scenes Dataset Computer Vision Research

AI-generated Key Points

The license of the paper does not allow us to build upon its content and the key points are generated using the paper metadata rather than the full article.

  • Robust detection and tracking of objects are essential for safe and efficient operation of autonomous vehicles
  • Autonomous vehicles are equipped with a combination of cameras, lidar, and radar sensors
  • The authors present the nuScenes dataset, which includes 6 cameras, 5 radars, and 1 lidar providing a complete 360-degree field of view
  • The dataset comprises 1000 scenes with detailed annotations for 23 different classes of objects along with 8 attributes
  • nuScenes dataset offers seven times more annotations and a hundred times more images compared to the KITTI dataset
  • Introduces novel metrics for evaluating 3D object detection and tracking performance
  • Provides baseline results for both lidar-based and image-based detection and tracking methods
  • Researchers can access the data online to facilitate advancements in autonomous driving technology
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Holger Caesar, Varun Bankiti, Alex H. Lang, Sourabh Vora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Giancarlo Baldan, Oscar Beijbom

CVPR 2020 camera ready incl. supplementary material

Abstract: Robust detection and tracking of objects is crucial for the deployment of autonomous vehicle technology. Image based benchmark datasets have driven development in computer vision tasks such as object detection, tracking and segmentation of agents in the environment. Most autonomous vehicles, however, carry a combination of cameras and range sensors such as lidar and radar. As machine learning based methods for detection and tracking become more prevalent, there is a need to train and evaluate such methods on datasets containing range sensor data along with images. In this work we present nuTonomy scenes (nuScenes), the first dataset to carry the full autonomous vehicle sensor suite: 6 cameras, 5 radars and 1 lidar, all with full 360 degree field of view. nuScenes comprises 1000 scenes, each 20s long and fully annotated with 3D bounding boxes for 23 classes and 8 attributes. It has 7x as many annotations and 100x as many images as the pioneering KITTI dataset. We define novel 3D detection and tracking metrics. We also provide careful dataset analysis as well as baselines for lidar and image based detection and tracking. Data, development kit and more information are available online.

Submitted to arXiv on 26 Mar. 2019

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

The license of the paper does not allow us to build upon its content and the AI assistant only knows about the paper metadata rather than the full article.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 1903.11027v5

This paper's license doesn't allow us to build upon its content and the summarizing process is here made with the paper's metadata rather than the article.

In the rapidly evolving field of autonomous vehicle technology, robust detection and tracking of objects are essential for safe and efficient operation. While image-based benchmark datasets have been instrumental in advancing computer vision tasks such as object detection, tracking, and segmentation, most autonomous vehicles are equipped with a combination of cameras and range sensors like lidar and radar. As machine learning methods for detection and tracking continue to gain traction, there is a growing need to train and evaluate these algorithms on datasets that incorporate both image data and range sensor information. Addressing this need, the authors present , a groundbreaking dataset that encompasses the full suite of sensors typically found on autonomous vehicles: 6 cameras, 5 radars, and 1 lidar, all offering a complete 360-degree field of view. Comprising 1000 scenes, each lasting 20 seconds, is meticulously annotated with detailed 3D bounding boxes for 23 different classes of objects along with 8 attributes. Notably, this dataset boasts seven times more annotations and a hundred times more images compared to the pioneering KITTI dataset. In addition to providing an extensive dataset for training and evaluation purposes, introduces novel metrics for evaluating 3D object detection and tracking performance. The authors also offer comprehensive dataset analysis along with baseline results for both lidar-based and image-based detection and tracking methods. Researchers and developers can access the data,,and further information online to facilitate advancements in autonomous driving technology. The paper "nuScenes: A multimodal dataset for autonomous driving" authored by Holger Caesar et al., presents a significant contribution to the field of computer vision research by introducing a comprehensive dataset that reflects real-world conditions faced by autonomous vehicles. This resource has the potential to drive innovation in object detection and tracking algorithms tailored specifically for autonomous driving applications.
Created on 23 Jan. 2025

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.