Deep Learning based Micro-expression Recognition: A Survey

AI-generated keywords: Deep Learning Micro-expression Recognition Deep MER Traditional Methods DL-based MER

AI-generated Key Points

  • Micro-expressions (MEs) are involuntary facial movements that reveal hidden emotions in high-stake situations
  • Deep learning (DL) techniques have been applied to micro-expression recognition (MER)
  • Early methods for MER relied on traditional appearance and geometry features
  • DL approaches have been proposed to improve MER performance and overcome limitations of small-scale datasets
  • The paper provides a comprehensive review of deep MER, including datasets, pipeline, benchmarking methods, and a new taxonomy based on DL
  • Remaining challenges in deep MER are highlighted and potential directions for designing robust systems are proposed
  • The paper aims to bridge the gap between traditional methods and DL-based approaches in MER research
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Yante Li, Jinsheng Wei, Seyednavid Mohammadifoumani, Yang Liu, Guoying Zhao

23 pages, 12 figures
License: CC BY-NC-SA 4.0

Abstract: Micro-expressions (MEs) are involuntary facial movements revealing people's hidden feelings in high-stake situations and have practical importance in medical treatment, national security, interrogations and many human-computer interaction systems. Early methods for MER mainly based on traditional appearance and geometry features. Recently, with the success of deep learning (DL) in various fields, neural networks have received increasing interests in MER. Different from macro-expressions, MEs are spontaneous, subtle, and rapid facial movements, leading to difficult data collection, thus have small-scale datasets. DL based MER becomes challenging due to above ME characters. To data, various DL approaches have been proposed to solve the ME issues and improve MER performance. In this survey, we provide a comprehensive review of deep micro-expression recognition (MER), including datasets, deep MER pipeline, and the bench-marking of most influential methods. This survey defines a new taxonomy for the field, encompassing all aspects of MER based on DL. For each aspect, the basic approaches and advanced developments are summarized and discussed. In addition, we conclude the remaining challenges and and potential directions for the design of robust deep MER systems. To the best of our knowledge, this is the first survey of deep MER methods, and this survey can serve as a reference point for future MER research.

Submitted to arXiv on 06 Jul. 2021

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2107.02823v1

This paper presents a comprehensive survey on deep micro-expression recognition (MER), focusing on the application of deep learning (DL) techniques. Micro-expressions (MEs) are involuntary facial movements that reveal hidden emotions in high-stake situations, making them important in various fields such as medical treatment, national security, interrogations, and human-computer interaction systems. Early methods for MER primarily relied on traditional appearance and geometry features. However, with the success of DL in various domains, there has been increasing interest in using neural networks for MER. Unlike macro-expressions, MEs are spontaneous, subtle, and rapid facial movements which pose challenges for data collection due to their difficult-to-capture nature. To address these challenges, various DL approaches have been proposed to improve MER performance and overcome the limitations of small-scale datasets. In this survey, the authors provide a comprehensive review of deep MER by discussing datasets used in research, the deep MER pipeline and benchmarking influential methods. They introduce a new taxonomy for the field that encompasses all aspects of MER based on DL. For each aspect they summarize and discuss both basic approaches and advanced developments. Additionally they highlight remaining challenges in deep MER and propose potential directions for designing robust systems. This survey serves as a reference point for future research in deep MER and aims to bridge the gap between traditional methods and DL-based approaches. Overall this paper is the first systematic and detailed survey specifically focusing on DL-based MER. It evaluates dynamic network inputs blocks structures losses and special tasks in detail while identifying further study directions with the goal of providing researchers with a comprehensive understanding of current advancements in DL-based MER techniques and inspiring future innovations in this field.
Created on 20 Dec. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.