Results of the summarizing process for the arXiv paper: 2303.17218v1

The use of 3D Convolutional Neural Networks (CNNs) has become increasingly popular for Human Action Recognition (HAR) tasks, as they have proven to be highly effective in achieving state-of-the-art results. However, the computational and memory requirements of 3D CNNs are often larger than those of 2D CNNs due to the additional temporal dimension. To address this issue, a novel toolflow called HARFLOW3D has been introduced in this study. The toolflow is based on a streaming architecture that maps 3D CNN models onto Field Programmable Gate Array (FPGA) devices while considering the model's inherent characteristics and the features of the targeted FPGA device. The HARFLOW3D toolflow takes as input a 3D CNN in ONNX format and a description of the FPGA characteristics, generating a design that minimizes the latency of computation. It comprises several parts, including a 3D CNN parser, performance and resource model, scheduling algorithm for executing 3D models on generated hardware, resource-aware optimization engine tailored for 3D models, and automated mapping to synthesizable code for FPGAs. Experiments were conducted on various pairs of 3D CNN models and FPGA systems to demonstrate the ability of HARFLOW3D to support a broad range of models and devices. The toolflow produced high-performing results for some previously unmapped 3D CNN models to FPGAs, demonstrating the potential of FPGA-based systems in this space. In particular, HARFLOW3D was able to achieve up to five times better performance compared to some existing hand-tuned approaches. The growing focus on video-related applications such as video surveillance, autonomous driving and patient monitoring has necessitated algorithms that integrate and take into account the temporal domain. As such there is an increasing need for efficient tools like HARFLOW3D that can accelerate computations involving volumetric data using FPGAs. Overall HARFLOW3Ds has demonstrated its ability to deliver competitive latency and resource utilization compared to a range of state-of-the-art hand tuned approaches.

• - 3D Convolutional Neural Networks (CNNs) are effective for Human Action Recognition (HAR) tasks
• - However, they require more computational and memory resources than 2D CNNs due to the additional temporal dimension
• - HARFLOW3D is a novel toolflow that maps 3D CNN models onto Field Programmable Gate Array (FPGA) devices while considering the model's inherent characteristics and the features of the targeted FPGA device
• - The toolflow takes as input a 3D CNN in ONNX format and a description of the FPGA characteristics, generating a design that minimizes computation latency
• - It comprises several parts, including a 3D CNN parser, performance and resource model, scheduling algorithm for executing 3D models on generated hardware, resource-aware optimization engine tailored for 3D models, and automated mapping to synthesizable code for FPGAs
• - Experiments showed that HARFLOW3D can support a broad range of models and devices with high-performing results compared to existing hand-tuned approaches
• - HARFLOW3D was able to achieve up to five times better performance compared to some existing hand-tuned approaches
• - There is an increasing need for efficient tools like HARFLOW3D that can accelerate computations involving volumetric data using FPGAs in video-related applications such as video surveillance, autonomous driving and patient monitoring.

1. There is a way to teach computers to recognize human actions using something called 3D Convolutional Neural Networks (CNNs). 2. These 3D CNNs are really good at recognizing actions, but they need more computer power and memory than other types of CNNs. 3. HARFLOW3D is a new tool that helps make it easier for computers to use 3D CNNs by mapping them onto special computer chips called Field Programmable Gate Array (FPGA) devices. 4. This tool takes the 3D CNN and information about the FPGA device, and makes a design that does the job quickly. 5. HARFLOW3D is important because it can help make things like video surveillance, autonomous driving, and patient monitoring work better. Definitions- 3D Convolutional Neural Networks (CNNs): A type of computer program that can learn how to recognize patterns in videos or images by looking at lots of examples. - Computational resources: The amount of computer power needed to do a task. - Memory resources: The amount of space needed to store information on a computer. - Field Programmable Gate Array (FPGA): A special kind of computer chip that can be programmed to do specific tasks very quickly. - Latency: The time it takes for a computer program to respond after getting an input. - Optimization engine: A part of the toolflow that helps make sure everything runs as efficiently as possible. - Synthesizable code: Code that can

HARFLOW3D: A Toolflow for Accelerating 3D Convolutional Neural Networks on FPGAs

The use of 3D Convolutional Neural Networks (CNNs) has become increasingly popular for Human Action Recognition (HAR) tasks, as they have proven to be highly effective in achieving state-of-the-art results. However, the computational and memory requirements of 3D CNNs are often larger than those of 2D CNNs due to the additional temporal dimension. To address this issue, a novel toolflow called HARFLOW3D has been introduced in this study. The toolflow is based on a streaming architecture that maps 3D CNN models onto Field Programmable Gate Array (FPGA) devices while considering the model's inherent characteristics and the features of the targeted FPGA device.

What is HARFLOW3D?

HARFLOW3D is a toolflow designed to accelerate computations involving volumetric data using FPGAs. It takes as input a 3D CNN in ONNX format and a description of the FPGA characteristics, generating a design that minimizes latency and resource utilization compared to existing hand-tuned approaches. The toolflow comprises several parts including:

• A 3D CNN parser
• Performance and resource model
• Scheduling algorithm for executing 3D models on generated hardware
• Resource-aware optimization engine tailored for 3D models

. In addition, it also includes an automated mapping to synthesizable code for FPGAs which allows it to achieve up to five times better performance compared to some existing hand-tuned approaches. This makes it an ideal solution for video related applications such as video surveillance, autonomous driving and patient monitoring where algorithms need to integrate temporal information into their calculations.

Experimental Results

Experiments were conducted on various pairs of 3