Voting-based Multimodal Automatic Deception Detection

AI-generated keywords: Automatic Deception Detection Multimodal Features Machine Learning Deep Learning Word2Vec

AI-generated Key Points

  • Researchers use machine learning and deep learning techniques for Automatic Deception Detection
  • The paper proposes a method for detecting deception from videos using audio, visual, and lexical features
  • The proposed solution consists of three models: CNN for image detection, SVM on Mel spectrograms for audio detection, and Word2Vec on SVM for text detection
  • Experiments were conducted on two datasets: Real-life trial dataset by Michigan University and Miami University deception detection dataset
  • Results show that the proposed solution outperforms state-of-the-art methods:
  • 97% accuracy for image detection
  • 96% accuracy for audio detection
  • 92% accuracy for text detection
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Lana Touma, Mohammad Al Horani, Manar Tailouni, Anas Dahabiah, Khloud Al Jallad

License: CC BY 4.0

Abstract: Automatic Deception Detection has been a hot research topic for a long time, using machine learning and deep learning to automatically detect deception, brings new light to this old field. In this paper, we proposed a voting-based method for automatic deception detection from videos using audio, visual and lexical features. Experiments were done on two datasets, the Real-life trial dataset by Michigan University and the Miami University deception detection dataset. Video samples were split into frames of images, audio, and manuscripts. Our Voting-based Multimodal proposed solution consists of three models. The first model is CNN for detecting deception from images, the second model is Support Vector Machine (SVM) on Mel spectrograms for detecting deception from audio and the third model is Word2Vec on Support Vector Machine (SVM) for detecting deception from manuscripts. Our proposed solution outperforms state of the art. Best results achieved on images, audio and text were 97%, 96%, 92% respectively on Real-Life Trial Dataset, and 97%, 82%, 73% on video, audio and text respectively on Miami University Deception Detection.

Submitted to arXiv on 30 Jun. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2307.07516v1

In the field of Automatic Deception Detection, researchers have been using machine learning and deep learning techniques to detect deception. In this paper titled "Voting-based Multimodal Automatic Deception Detection," the authors propose a method for automatically detecting deception from videos using audio, visual, and lexical features. The proposed solution consists of three models: a Convolutional Neural Network (CNN) for detecting deception from images, a Support Vector Machine (SVM) on Mel spectrograms for detecting deception from audio, and Word2Vec on SVM for detecting deception from manuscripts. The video samples are split into frames of images, audio, and transcripts. To evaluate the performance of their proposed solution, experiments were conducted on two datasets: the Real-life trial dataset by Michigan University and the Miami University deception detection dataset. The results show that their solution outperforms state-of-the-art methods. On the Real-Life Trial Dataset, the best results achieved were 97% accuracy for image detection, 96% accuracy for audio detection, and 92% accuracy for text detection.
Created on 24 Nov. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.