# The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches

**Authors:** Md Zahangir Alom, Tarek M. Taha, Christopher Yakopcic, Stefan Westberg, Mahmudul Hasan, Brian C Van Esesn, Abdul A S. Awwal, Vijayan K. Asari  
**arXiv:** [1803.01164](https://arxiv.org/abs/1803.01164)  
**Date:** 2018-03-03  
**Summary page:** https://www.summarizepaper.com/en/paper/1803.01164v1/

## Key points

- Deep learning is a highly successful field in machine learning with applications in various domains.
- The survey explores the development and advancements of deep learning approaches, including DNN, CNN, RNN (LSTM and GRU), AE, DBN, GAN, and DRL.
- Deep learning techniques consistently outperform traditional machine learning methods in areas such as Image Processing, Computer Vision, Speech Recognition, Machine Translation, Art, Medical Imaging and Information Processing, Robotics and Control, Bioinformatics, NLP, and Cybersecurity.
- The survey covers recent developments in advanced variant deep learning techniques based on the aforementioned approaches.
- It evaluates the performance of deep learning approaches across different domains.
- The report includes information on frameworks, SDKs, and benchmark datasets used for implementing and evaluating deep learning models.
- The survey distinguishes itself by discussing individual advanced techniques for training large-scale deep learning models and generative models.
- It provides additional context by referencing related papers on arXiv that overlap with their work.
- The survey is authored by experts in the field of deep learning.

## Summary

Deep learning has emerged as a highly successful field in machine learning, with applications spanning various domains. This comprehensive survey explores the development and advancements of deep learning approaches, including Deep Neural Networks (DNN), Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN) such as Long Short Term Memory (LSTM) and Gated Recurrent Units (GRU), Auto-Encoders (AE), Deep Belief Networks (DBN), Generative Adversarial Networks (GAN), and Deep Reinforcement Learning (DRL). The experimental results demonstrate that deep learning techniques consistently outperform traditional machine learning methods in areas such as Image Processing, Computer Vision, Speech Recognition, Machine Translation, Art, Medical Imaging and Information Processing, Robotics and Control, Bioinformatics, Natural Language Processing (NLP), Cybersecurity, among others. This survey also covers recent developments in advanced variant deep learning techniques based on the aforementioned approaches. Additionally, it explores the application of deep learning approaches across different domains and includes an evaluation of their performance. The report further encompasses recently developed frameworks, Software Development Kits (SDKs), and benchmark datasets used for implementing and evaluating deep learning models. While previous surveys have focused on Deep Learning in Neural Networks [1, 38] and Reinforcement Learning [234], this survey distinguishes itself by discussing individual advanced techniques for training large-scale deep learning models and the recently developed method of generative models [1]. Furthermore, the authors provide additional context by referencing a related paper on arXiv that overlaps with their work [1408.3264]. The survey is authored by Md Zahangir Alom et al., who are experts in the field of deep learning. Overall, this comprehensive survey provides valuable insights into the history and advancements of deep learning approaches across various application domains. It serves as a valuable resource for researchers seeking to gain an understanding of the latest developments in this rapidly growing field.