Generative AI for End-to-End Limit Order Book Modelling: A Token-Level Autoregressive Generative Model of Message Flow Using a Deep State Space Network

AI-generated keywords: Autoregressive Financial Generative Model Tokenizer Jax-LOB

AI-generated Key Points

  • Authors propose an end-to-end autoregressive generative model for tokenized limit order book (LOB) messages in financial markets
  • Jax-LOB simulator used to interpret and update LOB state
  • Model employs simplified structured state-space layers to handle long sequences efficiently
  • Custom tokenizer developed for message data using LOBSTER data of NASDAQ equity LOBs
  • Out-of-sample results show promising performance in approximating data distribution and generating mid-price returns with significant correlation
  • Generated data offers new application areas beyond forecasting, such as acting as a world model in high-frequency financial reinforcement learning applications
  • Future research directions include increasing model and dataset size, training on longer sequences, and exploring alternative architectural choices
  • Code will be open-sourced to facilitate further research in autoregressive large financial models for high-frequency financial data generation.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Peer Nagy, Sascha Frey, Silvia Sapora, Kang Li, Anisoara Calinescu, Stefan Zohren, Jakob Foerster

arXiv: 2309.00638v1 - DOI (q-fin.TR)
License: CC BY 4.0

Abstract: Developing a generative model of realistic order flow in financial markets is a challenging open problem, with numerous applications for market participants. Addressing this, we propose the first end-to-end autoregressive generative model that generates tokenized limit order book (LOB) messages. These messages are interpreted by a Jax-LOB simulator, which updates the LOB state. To handle long sequences efficiently, the model employs simplified structured state-space layers to process sequences of order book states and tokenized messages. Using LOBSTER data of NASDAQ equity LOBs, we develop a custom tokenizer for message data, converting groups of successive digits to tokens, similar to tokenization in large language models. Out-of-sample results show promising performance in approximating the data distribution, as evidenced by low model perplexity. Furthermore, the mid-price returns calculated from the generated order flow exhibit a significant correlation with the data, indicating impressive conditional forecast performance. Due to the granularity of generated data, and the accuracy of the model, it offers new application areas for future work beyond forecasting, e.g. acting as a world model in high-frequency financial reinforcement learning applications. Overall, our results invite the use and extension of the model in the direction of autoregressive large financial models for the generation of high-frequency financial data and we commit to open-sourcing our code to facilitate future research.

Submitted to arXiv on 23 Aug. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2309.00638v1

The authors propose an end-to-end autoregressive generative model for tokenized limit order book (LOB) messages in financial markets. They use a Jax-LOB simulator to interpret these messages and update the LOB state. To handle long sequences efficiently, the model employs simplified structured state-space layers. The authors develop a custom tokenizer for message data using LOBSTER data of NASDAQ equity LOBs, converting groups of successive digits to tokens. Out-of-sample results show promising performance in approximating the data distribution and generating mid-price returns that exhibit a significant correlation with the data. The accuracy and granularity of the generated data offer new application areas beyond forecasting, such as acting as a world model in high-frequency financial reinforcement learning applications. The authors suggest future research directions including increasing model and dataset size, training on longer sequences, and exploring alternative architectural choices. They commit to open-sourcing their code to facilitate further research in autoregressive large financial models for high-frequency financial data generation.
Created on 09 Nov. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.