Towards Open World Object Detection

Authors: K J Joseph, Salman Khan, Fahad Shahbaz Khan, Vineeth N Balasubramanian

To appear in CVPR 2021 as an ORAL paper. Code is available in https://github.com/JosephKJ/OWOD
License: CC BY 4.0

Results of the summarizing process for the arXiv paper: 2103.02603v2

  • Comprehensive Summary
  • Key points
  • Layman's Summary
  • Blog article
Humans have a natural instinct to identify unknown object instances in their environments. This curiosity about unknown instances helps us learn about them when we eventually have the corresponding knowledge. In this problem, a model is tasked with identifying objects that it has not been introduced to as "unknown," without explicit supervision to do so. Additionally, the model should be able to incrementally learn these identified unknown categories without forgetting previously learned classes when it receives the corresponding labels progressively. To address this problem, we introduce a novel solution called ORE: Open World Object Detector. ORE is based on contrastive clustering and energy-based unknown identification. We also formulate a strong evaluation protocol to assess the efficacy of ORE in achieving open-world objectives. In our experimental evaluation and ablation studies, we analyze the performance of ORE and its ability to achieve open-world objectives. Interestingly, we find that identifying and characterizing unknown instances also helps reduce confusion in an incremental object detection setting. As a result, we achieve state-of-the-art performance without any additional methodological effort. We hope that our work will attract further research into this newly identified but crucial research direction of open-world object detection.
AI-generated keywords: Humans natural instinct curiosity unknown instances open-world object detection

AI-generated Key Points

  • Humans have a natural instinct to identify unknown object instances in their environments
  • Curiosity about unknown instances helps us learn about them when we eventually have the corresponding knowledge
  • A model is tasked with identifying unknown objects without explicit supervision
  • The model should be able to incrementally learn these identified unknown categories without forgetting previously learned classes
  • ORE (Open World Object Detector) is a novel solution based on contrastive clustering and energy-based unknown identification
  • ORE introduces a strong evaluation protocol to assess its efficacy in achieving open-world objectives
  • Experimental evaluation and ablation studies analyze the performance of ORE and its ability to achieve open-world objectives
  • Identifying and characterizing unknown instances helps reduce confusion in incremental object detection setting
  • State-of-the-art performance is achieved without additional methodological effort
  • The work aims to attract further research into the direction of open-world object detection.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Abstract: Humans have a natural instinct to identify unknown object instances in their environments. The intrinsic curiosity about these unknown instances aids in learning about them, when the corresponding knowledge is eventually available. This motivates us to propose a novel computer vision problem called: `Open World Object Detection', where a model is tasked to: 1) identify objects that have not been introduced to it as `unknown', without explicit supervision to do so, and 2) incrementally learn these identified unknown categories without forgetting previously learned classes, when the corresponding labels are progressively received. We formulate the problem, introduce a strong evaluation protocol and provide a novel solution, which we call ORE: Open World Object Detector, based on contrastive clustering and energy based unknown identification. Our experimental evaluation and ablation studies analyze the efficacy of ORE in achieving Open World objectives. As an interesting by-product, we find that identifying and characterizing unknown instances helps to reduce confusion in an incremental object detection setting, where we achieve state-of-the-art performance, with no extra methodological effort. We hope that our work will attract further research into this newly identified, yet crucial research direction.

Submitted to arXiv on 03 Mar. 2021

Tools for this paper

Explain it differently 3 free rewrites left today
Export BibTeX · RIS (Zotero, Mendeley, EndNote) · Markdown (Notion, Obsidian) · Premium
Citation alerts Premium
Journal club Slides to present it Premium
For journalists Press kit and hype check Premium

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

Figures and plots

Ask about a figure by number or use its question button to request visual analysis. Up to two figures and four image panels per question. Values read from plots are approximate; check the original data.

AI assistant instructions?

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.