Decentralizing Feature Extraction with Quantum Convolutional Neural Network for Automatic Speech Recognition

AI-generated keywords: Decentralized Feature Extraction Quantum Convolutional Neural Network (QCNN) Privacy Preservation Speech Recognition

AI-generated Key Points

  • Decentralized approach for feature extraction in federated learning to address privacy-preservation concerns in speech recognition
  • Utilizes a quantum convolutional neural network (QCNN) with a quantum circuit encoder and recurrent neural network (RNN) based end-to-end acoustic model (AM)
  • Input speech is sent to a quantum computing server for Mel-spectrogram extraction
  • Convolutional features are encoded using a quantum circuit algorithm with random parameters
  • Encoded features are sent back to the local RNN model for final recognition
  • Leverages advancements in quantum learning for secure models and prevention of privacy leakage attacks
  • QCNN encoder achieves an accuracy of 95.12% in the decentralized model on the Google Speech Commands Dataset, outperforming previous architectures
  • Analysis of different quantum circuit encoder architectures provides insights into designing QCNN-based feature extractors
  • Correlation between proposed QCNN features, class activation maps, and input spectrograms revealed through neural saliency analyses
  • Research contributes to addressing privacy concerns in speech recognition by combining quantum computing techniques with deep learning models
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Chao-Han Huck Yang, Jun Qi, Samuel Yen-Chi Chen, Pin-Yu Chen, Sabato Marco Siniscalchi, Xiaoli Ma, Chin-Hui Lee

2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Accepted to IEEE ICASSP 2021. Code is available: https://github.com/huckiyang/QuantumSpeech-QCNN
License: CC BY-NC-SA 4.0

Abstract: We propose a novel decentralized feature extraction approach in federated learning to address privacy-preservation issues for speech recognition. It is built upon a quantum convolutional neural network (QCNN) composed of a quantum circuit encoder for feature extraction, and a recurrent neural network (RNN) based end-to-end acoustic model (AM). To enhance model parameter protection in a decentralized architecture, an input speech is first up-streamed to a quantum computing server to extract Mel-spectrogram, and the corresponding convolutional features are encoded using a quantum circuit algorithm with random parameters. The encoded features are then down-streamed to the local RNN model for the final recognition. The proposed decentralized framework takes advantage of the quantum learning progress to secure models and to avoid privacy leakage attacks. Testing on the Google Speech Commands Dataset, the proposed QCNN encoder attains a competitive accuracy of 95.12% in a decentralized model, which is better than the previous architectures using centralized RNN models with convolutional features. We also conduct an in-depth study of different quantum circuit encoder architectures to provide insights into designing QCNN-based feature extractors. Neural saliency analyses demonstrate a correlation between the proposed QCNN features, class activation maps, and input spectrograms. We provide an implementation for future studies.

Submitted to arXiv on 26 Oct. 2020

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2010.13309v2

This paper presents a novel decentralized approach for feature extraction in federated learning to address privacy-preservation concerns in speech recognition. The proposed approach utilizes a quantum convolutional neural network (QCNN) consisting of a quantum circuit encoder for feature extraction and a recurrent neural network (RNN) based end-to-end acoustic model (AM). To enhance model parameter protection in a decentralized architecture, the input speech is first sent to a quantum computing server where the Mel-spectrogram is extracted. The corresponding convolutional features are then encoded using a quantum circuit algorithm with random parameters. These encoded features are subsequently sent back to the local RNN model for final recognition. The decentralized framework proposed in this study leverages the advancements in quantum learning to ensure secure models and prevent privacy leakage attacks. Experimental results on the Google Speech Commands Dataset demonstrate that the QCNN encoder achieves an impressive accuracy of 95.12% in the decentralized model, outperforming previous architectures that employ centralized RNN models with convolutional features. Additionally, this paper conducts an extensive analysis of different quantum circuit encoder architectures to provide insights into designing QCNN-based feature extractors. Neural saliency analyses reveal a correlation between the proposed QCNN features, class activation maps, and input spectrograms. Overall, this research contributes to addressing privacy concerns in speech recognition by introducing a decentralized feature extraction approach that combines quantum computing techniques with deep learning models. The provided implementation serves as a valuable resource for future studies in this domain.
Created on 05 Sep. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.