ReContrast: Domain-Specific Anomaly Detection via Contrastive Reconstruction
AI-generated Key Points
- Most advanced methods in unsupervised anomaly detection rely on pre-trained encoder networks trained on large-scale datasets like ImageNet.
- Pre-trained encoders often extract features that are not well-suited for the target UAD domain, such as industrial inspection and medical imaging.
- The authors propose a novel UAD method called ReContrast to address this issue.
- ReContrast optimizes the entire network to reduce biases towards the pre-trained image domain and aligns it with the target domain.
- ReContrast starts with a feature reconstruction approach that detects anomalies based on errors.
- It incorporates elements of contrastive learning into feature reconstruction to prevent training instability, pattern collapse, and identical shortcut problems.
- This approach simultaneously optimizes both the encoder and decoder on the target domain.
- Extensive experiments were conducted on two popular industrial defect detection benchmarks and three medical image UAD tasks to demonstrate the transferability of ReContrast across different image domains.
- ReContrast outperforms current state-of-the-art methods in terms of accuracy and performance.
- An ablation study was conducted to verify the effectiveness of different elements proposed in ReContrast.
- The method was also evaluated on open-sourced datasets specific to each domain (MVTec AD for industrial defect detection, APTOS for medical imaging).
- The results further validate the superiority of ReContrast in adapting to various medical image modalities.
- Overall, this paper presents a promising approach for domain-specific anomaly detection by reducing biases towards pre-trained encoders and optimizing networks for target domains.
Authors: Jia Guo, Shuai Lu, Lize Jia, Weihang Zhang, Huiqi Li
Abstract: Most advanced unsupervised anomaly detection (UAD) methods rely on modeling feature representations of frozen encoder networks pre-trained on large-scale datasets, e.g. ImageNet. However, the features extracted from the encoders that are borrowed from natural image domains coincide little with the features required in the target UAD domain, such as industrial inspection and medical imaging. In this paper, we propose a novel epistemic UAD method, namely ReContrast, which optimizes the entire network to reduce biases towards the pre-trained image domain and orients the network in the target domain. We start with a feature reconstruction approach that detects anomalies from errors. Essentially, the elements of contrastive learning are elegantly embedded in feature reconstruction to prevent the network from training instability, pattern collapse, and identical shortcut, while simultaneously optimizing both the encoder and decoder on the target domain. To demonstrate our transfer ability on various image domains, we conduct extensive experiments across two popular industrial defect detection benchmarks and three medical image UAD tasks, which shows our superiority over current state-of-the-art methods.
Ask questions about this paper to our AI assistant
You can also chat with multiple papers at once here.
Assess the quality of the AI-generated content by voting
Score: 0
Why do we need votes?
Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.
The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.
Similar papers summarized with our AI tools
Navigate through even more similar papers through a
tree representationLook for similar papers (in beta version)
By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.
Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.