CVCP-Fusion: On Implicit Depth Estimation for 3D Bounding Box Prediction

Ranked by how close their title and abstract are to this paper’s. Select some to read them together.

Closest papers

1. Close Not relevant

   Multi-Camera Calibration Free BEV Representation for 3D Object Detection

   Hongxiang Jiang, Wenming Meng, Hongmei Zhu et al. · 2022 · Computer Vision and Pattern Recognition · AI summary available

   Abstract

   In advanced paradigms of autonomous driving, learning Bird's Eye View (BEV) representation from surrounding views is crucial for multi-task framework. However, existing methods based on depth estimation or camera-driven attention are not stable to obtain transformation under noisy camera parameters, mainly with two challenges, accurate depth prediction and calibration. In this work, we present a completely Multi-Camera Calibration Free Transformer (CFT) for robust BEV representation, which focuses on exploring implicit mapping, not relied on camera intrinsics and extrinsics. To guide better feature learning from image views to BEV, CFT mines potential 3D information in BEV via our designed p…

2. Close Not relevant

   Boosting Monocular 3D Object Detection with Object-Centric Auxiliary Depth Supervision

   Youngseok Kim, Sanmin Kim, Sangmin Sim et al. · 2022 · Computer Vision and Pattern Recognition · AI summary available

   Abstract

   Recent advances in monocular 3D detection leverage a depth estimation network explicitly as an intermediate stage of the 3D detection network. Depth map approaches yield more accurate depth to objects than other methods thanks to the depth estimation network trained on a large-scale dataset. However, depth map approaches can be limited by the accuracy of the depth map, and sequentially using two separated networks for depth estimation and 3D detection significantly increases computation cost and inference time. In this work, we propose a method to boost the RGB image-based 3D detector by jointly training the detection network with a depth prediction loss analogous to the depth estimation tas…

3. Close Not relevant

   Video Depth Estimation by Fusing Flow-to-Depth Proposals

   Jiaxin Xie, Chenyang Lei, Zhuwen Li et al. · 2019 · Computer Vision and Pattern Recognition · Not summarized yet

   Abstract

   Depth from a monocular video can enable billions of devices and robots with a single camera to see the world in 3D. In this paper, we present an approach with a differentiable flow-to-depth layer for video depth estimation. The model consists of a flow-to-depth layer, a camera pose refinement module, and a depth fusion network. Given optical flow and camera pose, our flow-to-depth layer generates depth proposals and the corresponding confidence maps by explicitly solving an epipolar geometry optimization problem. Our flow-to-depth layer is differentiable, and thus we can refine camera poses by maximizing the aggregated confidence in the camera pose refinement module. Our depth fusion network…

4. Close Not relevant

   BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers

   Zhiqi Li, Wenhai Wang, Hongyang Li et al. · 2022 · Computer Vision and Pattern Recognition · AI summary available

   Abstract

   3D visual perception tasks, including 3D detection and map segmentation based on multi-camera images, are essential for autonomous driving systems. In this work, we present a new framework termed BEVFormer, which learns unified BEV representations with spatiotemporal transformers to support multiple autonomous driving perception tasks. In a nutshell, BEVFormer exploits both spatial and temporal information by interacting with spatial and temporal space through predefined grid-shaped BEV queries. To aggregate spatial information, we design spatial cross-attention that each BEV query extracts the spatial features from the regions of interest across camera views. For temporal information, we pr…

5. Close Not relevant

   3D Bounding Box Estimation Using Deep Learning and Geometry

   Arsalan Mousavian, Dragomir Anguelov, John Flynn et al. · 2016 · Computer Vision and Pattern Recognition · AI summary available

   Abstract

   We present a method for 3D object detection and pose estimation from a single image. In contrast to current techniques that only regress the 3D orientation of an object, our method first regresses relatively stable 3D object properties using a deep convolutional neural network and then combines these estimates with geometric constraints provided by a 2D object bounding box to produce a complete 3D bounding box. The first network output estimates the 3D object orientation using a novel hybrid discrete-continuous loss, which significantly outperforms the L2 loss. The second output regresses the 3D object dimensions, which have relatively little variance compared to alternatives and can often b…

6. Close Not relevant

   DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queries

   Yue Wang, Vitor Guizilini, Tianyuan Zhang et al. · 2021 · Computer Vision and Pattern Recognition · AI summary available

   Abstract

   We introduce a framework for multi-camera 3D object detection. In contrast to existing works, which estimate 3D bounding boxes directly from monocular images or use depth prediction networks to generate input for 3D object detection from 2D information, our method manipulates predictions directly in 3D space. Our architecture extracts 2D features from multiple camera images and then uses a sparse set of 3D object queries to index into these 2D features, linking 3D positions to multi-view images using camera transformation matrices. Finally, our model makes a bounding box prediction per object query, using a set-to-set loss to measure the discrepancy between the ground-truth and the predictio…

7. Close Not relevant

   BEV-SAN: Accurate BEV 3D Object Detection via Slice Attention Networks

   Xiaowei Chi, Jiaming Liu, Ming Lu et al. · 2022 · Computer Vision and Pattern Recognition · AI summary available

   Abstract

   Bird's-Eye-View (BEV) 3D Object Detection is a crucial multi-view technique for autonomous driving systems. Recently, plenty of works are proposed, following a similar paradigm consisting of three essential components, i.e., camera feature extraction, BEV feature construction, and task heads. Among the three components, BEV feature construction is BEV-specific compared with 2D tasks. Existing methods aggregate the multi-view camera features to the flattened grid in order to construct the BEV feature. However, flattening the BEV space along the height dimension fails to emphasize the informative features of different heights. For example, the barrier is located at a low height while the truck…

8. Close Not relevant

   OriCon3D: Effective 3D Object Detection using Orientation and Confidence

   Dhyey Manish Rajani, Surya Pratap Singh, Rahul Kashyap Swayampakula · 2023 · Computer Vision and Pattern Recognition · AI summary available

   Abstract

   In this paper, we propose an advanced methodology for the detection of 3D objects and precise estimation of their spatial positions from a single image. Unlike conventional frameworks that rely solely on center-point and dimension predictions, our research leverages a deep convolutional neural network-based 3D object weighted orientation regression paradigm. These estimates are then seamlessly integrated with geometric constraints obtained from a 2D bounding box, resulting in derivation of a comprehensive 3D bounding box. Our novel network design encompasses two key outputs. The first output involves the estimation of 3D object orientation through the utilization of a discrete-continuous los…