Classifying Autism from Crowdsourced Semi-Structured Speech Recordings: A Machine Learning Approach

Nathan A. Chi; Peter Washington; Aaron Kline; Arman Husic; Cathy Hou; Chloe He; Kaitlyn Dunlap; Dennis Wall

AI summary · arXiv: 2201.00927v1 · cs.SD

Classifying Autism from Crowdsourced Semi-Structured Speech Recordings: A Machine Learning Approach

Nathan A. Chi, Peter Washington, Aaron Kline, Arman Husic, Cathy Hou, Chloe He, Kaitlyn Dunlap, Dennis Wall

Original paper Submitted to arXiv on 04 Jan. 2022 17 pages, 4 figures, submitted to JMIR Pediatrics and Parenting License: CC BY 4.0

How to read this summary? Illustrated guide

The essentials

Autism spectrum disorder (ASD) affects behavior, social development, and communication patterns.
Prevalence of autism has tripled in recent years with 1 in 54 children now affected.
Traditional diagnosis is lengthy and labor-intensive, leading to the development of systems that can automatically screen for autism.
Prosody abnormalities are clear signs of autism, including echolalia, monotonous intonation, atypical pitch, and irregular linguistic stress patterns.
Researchers present a suite of machine learning approaches to detect autism in self-recorded speech audio captured from autistic and neurotypical children in home environments.
Three methods were considered: Random Forests trained on extracted audio features, convolutional neural networks (CNNs) trained on spectrograms, and fine-tuned wav2vec 2.0 - a state-of-the-art Transformer-based ASR model.
The classifiers were trained on a novel dataset of cellphone-recorded child speech audio curated from Stanford's Guess What? mobile game.
The Random Forest classifier achieved 70% accuracy, the fine-tuned wav2vec 2.0 model achieved 77% accuracy, and the CNN achieved 79% accuracy when classifying children's audio as either ASD or NT.
Models were able to predict autism status when training on a varied selection of home audio clips with inconsistent recording quality which may be more generalizable to real-world conditions.
Future work could involve expanding the dataset used for training the classifiers or exploring other machine learning techniques to improve accuracy.

Key points written by AI: they may contain errors, check them against the paper.

AI-generated keywords: Autism Machine Learning Speech Audio Diagnosis Home Environment

Read further

Comprehensive Summary
Layman's Summary
Blog article
Original abstract

Autism spectrum disorder (ASD) is a neurodevelopmental disorder that affects behavior, social development, and communication patterns. The prevalence of autism has tripled in recent years, with 1 in 54 children now affected. Traditional diagnosis is a lengthy and labor-intensive process, which has led to significant attention being given to developing systems that can automatically screen for autism. Prosody abnormalities are among the clearest signs of autism, with affected children displaying speech idiosyncrasies such as echolalia, monotonous intonation, atypical pitch, and irregular linguistic stress patterns. In this study, researchers present a suite of machine learning approaches to detect autism in self-recorded speech audio captured from autistic and neurotypical (NT) children in home environments. They consider three methods: Random Forests trained on extracted audio features (including Mel-frequency cepstral coefficients), convolutional neural networks (CNNs) trained on spectrograms, and fine-tuned wav2vec 2.0—a state-of-the-art Transformer-based ASR model. The classifiers were trained on a novel dataset of cellphone-recorded child speech audio curated from Stanford's Guess What? mobile game—an app designed to crowdsource videos of autistic and neurotypical children in a natural home environment. The Random Forest classifier achieved 70% accuracy, the fine-tuned wav2vec 2.0 model achieved 77% accuracy, and the CNN achieved 79% accuracy when classifying children's audio as either ASD or NT. One strength of this study is that the models were able to predict autism status when training on a varied selection of home audio clips with inconsistent recording quality which may be more generalizable to real world conditions. Additionally, the researchers noted that they were able to conduct their experiment in an unobtrusive way without specialized equipment. Future work could involve expanding the dataset used for training the classifiers or exploring other machine learning techniques to improve accuracy. Overall these results demonstrate that machine learning methods offer promise in detecting autism automatically from speech without specialized equipment which could potentially lead to earlier and more accurate diagnoses for autism spectrum disorder.

Using Machine Learning to Automatically Detect Autism from Speech

In this article we will discuss a research paper that explores the use of machine learning approaches to detect autism from self-recorded speech audio captured from autistic and neurotypical (NT) children in home environments. We will discuss the methods used by the researchers as well as their results and implications for future work.

Background

Prosody abnormalities are among the clearest signs of autism, with affected children displaying speech idiosyncrasies such as echolalia, monotonous intonation, atypical pitch, and irregular linguistic stress patterns. To address this issue, researchers have developed various machine learning techniques for detecting these prosodic features automatically from speech recordings.

The study discussed here focuses on three different methods: Random Forests trained on extracted audio features (including Mel-frequency cepstral coefficients), convolutional neural networks (CNNs) trained on spectrograms, and fine-tuned wav2vec 2.0—a state-of-the-art Transformer-based ASR model.

Methods

The classifiers were trained on a novel dataset of cellphone-recorded child speech audio curated from Stanford's Guess What? mobile game—an app designed to crowdsource videos of autistic and neurotypical children in a natural home environment. This dataset was used to train the models so they could accurately classify between ASD or NT based solely on audio recordings without any other information about the speaker or context provided by parents or clinicians.

Results

The Random Forest classifier achieved 70% accuracy when classifying children's audio as either ASD or NT while the fine tuned wav2vec 2.0 model achieved 77% accuracy and CNN achieved 79% accuracy respectively when tested against this same dataset . One strength of this study is that it shows promise even when training on varied selection of home audio clips with inconsistent recording quality which may be more generalizable to real world conditions than traditional lab settings where recordings are taken under controlled conditions with high quality equipment . Additionally , since no specialized equipment was required , it allowed them to conduct their experiment in an unobtrusive way without disrupting participants' daily lives .

Implications & Future Work

Overall these results demonstrate that machine learning methods offer promise in detecting autism automatically from speech without specialized equipment which could potentially lead to earlier and more accurate diagnoses for autism spectrum disorder . However , further work needs to be done before these techniques can be implemented into clinical practice including expanding the dataset used for training the classifiers as well as exploring other machine learning techniques such as transfer learning or deep reinforcement learning algorithms which may improve accuracy even further .

Created on 20 May. 2023

Was this synthesis useful?

Score: 1

Ask questions about this paper to our AI assistant

How to chat with this paper? Illustrated guide

Compare with the PDF

You can also chat with multiple papers at once here.

AI assistant instructions?

Tools for this paper

Explain it differently 1 free rewrite left today

Save to a collection Group papers in collections to compare them, chat with them and export them. Continue with Google Create a free account Log in

Export BibTeX · RIS (Zotero, Mendeley, EndNote) · Obsidian (Markdown) · Notion (Markdown) · Guides: Obsidian, Notion

Advanced tools Premium

For researchers who follow a field closely: citation alerts, journal-club slides, version comparison and Zotero export. Discover Premium

Zotero Zotero guide

Citation alerts Citation alerts guide

Who works on it? The people and institutions who publish on its topic

Journal club Premium+ Slides to present it Propose for the journal club Journal club guide

Versions What changed between versions Versions guide

Talk about it in public Premium+ Press kit: release, questions, hype check Press kit guide

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.

Classifying Autism from Crowdsourced Semi-Structured Speech Recordings: A Machine Learning Approach

The essentials

Read further

Definitions

Using Machine Learning to Automatically Detect Autism from Speech

Background

Methods

Results

Implications & Future Work

Ask questions about this paper to our AI assistant

Tools for this paper

Advanced tools Premium

Papers around this one

Closest papers

Prior work it builds on

Papers that cite it

Go further

Cite this paper (BibTeX)