OpenHLS: High-Level Synthesis for Low-Latency Deep Neural Networks for Experimental Science

AI-generated keywords: OpenHLS

AI-generated Key Points

  • Large datasets are common in scientific domains such as high-energy physics, materials science, and cosmology.
  • Collected data must be compressed or filtered to reduce storage costs and meet latency requirements.
  • Filtering mechanisms involve machine learning models or physics-based approaches that require efficient use of hardware platforms like FPGAs or ASICs.
  • Deep neural networks have proven effective in filtering tasks but are not widely employed in data acquisition systems due to design and deployment complexities.
  • OpenHLS is an open-source compiler framework that can translate high-level representations of deep neural networks into low-level representations suitable for deployment on near-sensor devices like FPGAs.
  • OpenHLS has been evaluated on different workloads and implemented in a case study involving Bragg peak detection within the context of high-energy diffraction microscopy.
  • Results show that OpenHLS can produce an implementation of the network with a throughput of 4.8 $\mu$s/sample - approximately four times faster than existing implementations.
  • OpenHLS does not rely on any proprietary dependencies and is lightweight enough to facilitate easy deployment across various hardware platforms.
  • OpenHLS provides a viable solution for translating deep neural networks into low-level representations suitable for real-time filtering applications in scientific domains with high data rates such as high-energy physics, materials science, and cosmology.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Maksim Levental, Arham Khan, Ryan Chard, Kazutomo Yoshii, Kyle Chard, Ian Foster

License: CC BY 4.0

Abstract: In many experiment-driven scientific domains, such as high-energy physics, material science, and cosmology, high data rate experiments impose hard constraints on data acquisition systems: collected data must either be indiscriminately stored for post-processing and analysis, thereby necessitating large storage capacity, or accurately filtered in real-time, thereby necessitating low-latency processing. Deep neural networks, effective in other filtering tasks, have not been widely employed in such data acquisition systems, due to design and deployment difficulties. We present an open source, lightweight, compiler framework, without any proprietary dependencies, OpenHLS, based on high-level synthesis techniques, for translating high-level representations of deep neural networks to low-level representations, suitable for deployment to near-sensor devices such as field-programmable gate arrays. We evaluate OpenHLS on various workloads and present a case-study implementation of a deep neural network for Bragg peak detection in the context of high-energy diffraction microscopy. We show OpenHLS is able to produce an implementation of the network with a throughput 4.8 $\mu$s/sample, which is approximately a 4$\times$ improvement over the existing implementation

Submitted to arXiv on 13 Feb. 2023

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2302.06751v4

The generation of large datasets is a common occurrence in many scientific domains, including high-energy physics, materials science, and cosmology. For instance, the LHCb detector at the Large Hadron Collider (LHC) generates approximately 2 TB/s of data while processing proton-proton collisions at 40 MHz. The Square Kilometer Array, a radio telescope that will be operational by 2027, is projected to sustain data rates exceeding 10 TB/s. To reduce storage costs and meet stringent latency requirements for filtering mechanisms, collected data must either be compressed or filtered to retain only the most relevant information during acquisition. Filtering mechanisms typically involve machine learning models or physics-based approaches that require efficient use of hardware platforms such as field-programmable gate arrays (FPGAs) or application-specific integrated circuits (ASICs). Deep neural networks have proven effective in various filtering tasks but are not widely employed in data acquisition systems due to design and deployment complexities. To address this challenge, researchers have developed OpenHLS - an open-source compiler framework based on high-level synthesis techniques that can translate high-level representations of deep neural networks into low-level representations suitable for deployment on near-sensor devices like FPGAs. The OpenHLS framework has been evaluated on different workloads and implemented in a case study involving Bragg peak detection within the context of high-energy diffraction microscopy. Results show that OpenHLS can produce an implementation of the network with a throughput of 4.8 $\mu$s/sample - approximately four times faster than existing implementations. Additionally, OpenHLS does not rely on any proprietary dependencies and is lightweight enough to facilitate easy deployment across various hardware platforms. In summary, OpenHLS provides a viable solution for translating deep neural networks into low-level representations suitable for real-time filtering applications in scientific domains with high data rates such as high-energy physics, materials science, and cosmology. Its ability to improve processing speed while maintaining accuracy makes it a valuable tool for researchers and scientists working in these fields.
Created on 12 Jun. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.