The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches

AI-generated keywords: Deep Learning Neural Networks Reinforcement Learning Generative Models Machine Learning

AI-generated Key Points

  • Deep learning is a highly successful field in machine learning with applications in various domains.
  • The survey explores the development and advancements of deep learning approaches, including DNN, CNN, RNN (LSTM and GRU), AE, DBN, GAN, and DRL.
  • Deep learning techniques consistently outperform traditional machine learning methods in areas such as Image Processing, Computer Vision, Speech Recognition, Machine Translation, Art, Medical Imaging and Information Processing, Robotics and Control, Bioinformatics, NLP, and Cybersecurity.
  • The survey covers recent developments in advanced variant deep learning techniques based on the aforementioned approaches.
  • It evaluates the performance of deep learning approaches across different domains.
  • The report includes information on frameworks, SDKs, and benchmark datasets used for implementing and evaluating deep learning models.
  • The survey distinguishes itself by discussing individual advanced techniques for training large-scale deep learning models and generative models.
  • It provides additional context by referencing related papers on arXiv that overlap with their work.
  • The survey is authored by experts in the field of deep learning.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Md Zahangir Alom, Tarek M. Taha, Christopher Yakopcic, Stefan Westberg, Mahmudul Hasan, Brian C Van Esesn, Abdul A S. Awwal, Vijayan K. Asari

39 pages, 46 figures, 3 tables. arXiv admin note: text overlap with arXiv:1408.3264, arXiv:1411.4046
License: CC BY 4.0

Abstract: Deep learning has demonstrated tremendous success in variety of application domains in the past few years. This new field of machine learning has been growing rapidly and applied in most of the application domains with some new modalities of applications, which helps to open new opportunity. There are different methods have been proposed on different category of learning approaches, which includes supervised, semi-supervised and un-supervised learning. The experimental results show state-of-the-art performance of deep learning over traditional machine learning approaches in the field of Image Processing, Computer Vision, Speech Recognition, Machine Translation, Art, Medical imaging, Medical information processing, Robotics and control, Bio-informatics, Natural Language Processing (NLP), Cyber security, and many more. This report presents a brief survey on development of DL approaches, including Deep Neural Network (DNN), Convolutional Neural Network (CNN), Recurrent Neural Network (RNN) including Long Short Term Memory (LSTM) and Gated Recurrent Units (GRU), Auto-Encoder (AE), Deep Belief Network (DBN), Generative Adversarial Network (GAN), and Deep Reinforcement Learning (DRL). In addition, we have included recent development of proposed advanced variant DL techniques based on the mentioned DL approaches. Furthermore, DL approaches have explored and evaluated in different application domains are also included in this survey. We have also comprised recently developed frameworks, SDKs, and benchmark datasets that are used for implementing and evaluating deep learning approaches. There are some surveys have published on Deep Learning in Neural Networks [1, 38] and a survey on RL [234]. However, those papers have not discussed the individual advanced techniques for training large scale deep learning models and the recently developed method of generative models [1].

Submitted to arXiv on 03 Mar. 2018

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 1803.01164v1

Deep learning has emerged as a highly successful field in machine learning, with applications spanning various domains. This comprehensive survey explores the development and advancements of deep learning approaches, including Deep Neural Networks (DNN), Convolutional Neural Networks (CNN), Recurrent Neural Networks (RNN) such as Long Short Term Memory (LSTM) and Gated Recurrent Units (GRU), Auto-Encoders (AE), Deep Belief Networks (DBN), Generative Adversarial Networks (GAN), and Deep Reinforcement Learning (DRL). The experimental results demonstrate that deep learning techniques consistently outperform traditional machine learning methods in areas such as Image Processing, Computer Vision, Speech Recognition, Machine Translation, Art, Medical Imaging and Information Processing, Robotics and Control, Bioinformatics, Natural Language Processing (NLP), Cybersecurity, among others. This survey also covers recent developments in advanced variant deep learning techniques based on the aforementioned approaches. Additionally, it explores the application of deep learning approaches across different domains and includes an evaluation of their performance. The report further encompasses recently developed frameworks, Software Development Kits (SDKs), and benchmark datasets used for implementing and evaluating deep learning models. While previous surveys have focused on Deep Learning in Neural Networks [1, 38] and Reinforcement Learning [234], this survey distinguishes itself by discussing individual advanced techniques for training large-scale deep learning models and the recently developed method of generative models [1]. Furthermore, the authors provide additional context by referencing a related paper on arXiv that overlaps with their work [1408.3264]. The survey is authored by Md Zahangir Alom et al., who are experts in the field of deep learning. Overall, this comprehensive survey provides valuable insights into the history and advancements of deep learning approaches across various application domains. It serves as a valuable resource for researchers seeking to gain an understanding of the latest developments in this rapidly growing field.
Created on 10 Jul. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.