Auto-DOK: Compiler-Assisted Automatic Detection of Offload Kernels for FPGA-HBM Architectures
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
The bandwidth improvement provided by high-bandwidth memory (HBM), and the capability of FPGAs to customize the processing and memory hierarchy, results in a considerable performance increase for memory-intensive work-loads such as graph processing, sorting, machine learning, and database analytics. Modern systems integrating 3D-stacked DRAM memory can be leveraged to realize the Near-Memory Computing (NMC) paradigm by offloading some computations to accelerators placed near the HBM. Although numerous studies have investigated efficient accelerators for FPGA-HBM platforms, researchers have not proposed a systematic way for identifying which application kernels are suitable for execution near the HBM. In this article, we propose compiler support for recognizing offloading candidates without any burden on programmers. Auto-DOK analyzes an application code based on criteria derived from the hardware design goals of FPGA-HBM platforms, and automatically identifies kernels suitable for offloading. We evaluate Auto-DOK on benchmarks ranging from microbenchmarks to real-world kernels. Our results show that Auto-DOK can correctly identify kernels and input sizes suitable for execution near the HBM, and prevents slowdown caused by incorrect offloading decisions for other workloads. Moreover, Auto-DOK operates at compile time with negligible overhead and without the need for expensive profiling.
Details
Original language | English |
---|---|
Title of host publication | Proceedings - 2023 26th Euromicro Conference on Digital System Design, DSD 2023 |
Editors | Smail Niar, Hamza Ouarnoughi, Amund Skavhaug |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 577-584 |
Number of pages | 8 |
ISBN (electronic) | 9798350344196 |
Publication status | Published - 2023 |
Peer-reviewed | Yes |
Conference
Title | 26th Euromicro Conference on Digital System Design |
---|---|
Abbreviated title | DSD 2023 |
Conference number | 26 |
Duration | 6 - 8 September 2023 |
Website | |
Location | Grand Blue Fafa Resort |
City | Durres |
Country | Albania |
External IDs
ORCID | /0000-0003-2571-8441/work/159607522 |
---|
Keywords
ASJC Scopus subject areas
Keywords
- Code Characterization, High-bandwidth Memory (HBM), Parallel Architectures