Deep Reinforcement Learning in Quantitative Algorithmic Trading: A Review

AI-generated keywords: Deep Reinforcement Learning Automated Trading Quantitative Stock Trading Algorithmic Trading Super-human Agent

AI-generated Key Points

  • Deep reinforcement learning (DRL) has been explored for automated low-frequency quantitative stock trading
  • Prototype systems developed using DRL have shown success in specific markets
  • Existing studies highlight limitations and challenges faced by DRL agents, including lack of profitability and real-time testing on online trading platforms
  • DRL has potential in algorithmic trading, particularly in minute to daily timeframes
  • The question of whether DRL can outperform professional human traders is explored, with some studies suggesting it can compete in terms of risk-adjusted return rates
  • Further research is needed to fully understand the extent of DRL's power in this environment
  • The paper provides an overview of reinforcement learning (RL) concepts and discusses a specific experiment involving market data and a supervised learning system called RCNN for sentiment analysis
  • Multiple approaches proposed in the literature for creating successful trading agents using RL and deep neural networks are presented
  • Further research is necessary to fully exploit the potential of DRL in algorithmic trading.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Tidor-Vlad Pricope

License: CC BY 4.0

Abstract: Algorithmic stock trading has become a staple in today's financial market, the majority of trades being now fully automated. Deep Reinforcement Learning (DRL) agents proved to be to a force to be reckon with in many complex games like Chess and Go. We can look at the stock market historical price series and movements as a complex imperfect information environment in which we try to maximize return - profit and minimize risk. This paper reviews the progress made so far with deep reinforcement learning in the subdomain of AI in finance, more precisely, automated low-frequency quantitative stock trading. Many of the reviewed studies had only proof-of-concept ideals with experiments conducted in unrealistic settings and no real-time trading applications. For the majority of the works, despite all showing statistically significant improvements in performance compared to established baseline strategies, no decent profitability level was obtained. Furthermore, there is a lack of experimental testing in real-time, online trading platforms and a lack of meaningful comparisons between agents built on different types of DRL or human traders. We conclude that DRL in stock trading has showed huge applicability potential rivalling professional traders under strong assumptions, but the research is still in the very early stages of development.

Submitted to arXiv on 31 May. 2021

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2106.00123v1

This paper explores the applicability of deep reinforcement learning (DRL) in automated low-frequency quantitative stock trading. Prototype systems developed using DRL have demonstrated great success in specific markets. The authors review the progress made so far in this subdomain of AI in finance and discuss the limitations and challenges faced by existing studies. They highlight that while DRL agents have shown significant improvements in performance compared to established baseline strategies, they have not achieved a decent level of profitability. The lack of real-time testing on online trading platforms and meaningful comparisons between different types of DRL or human traders is also noted. The paper emphasizes that DRL has enormous potential in algorithmic trading, particularly in minute to daily timeframes. The question of whether DRL can lead to a super-human agent capable of outperforming professional human traders is also explored. While some studies suggest that DRL systems can compete with professional traders in terms of risk-adjusted return rates, further research is needed to fully understand the extent of DRL's power in this environment. In the background section, the paper provides an overview of reinforcement learning (RL) concepts for readers unfamiliar with the topic. It discusses a specific experiment involving market data on a daily timeframe for one stock and a supervised learning system for sentiment analysis called RCNN. The RCNN model was trained using news headlines from various companies and achieved satisfactory accuracy on testing. Overall, this paper aims to present multiple approaches proposed in the literature for creating successful trading agents using RL and deep neural networks. It concludes that while DRL shows promise, further research is necessary to fully exploit its potential in algorithmic trading.
Created on 29 Sep. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.