Auto-DOK: Compiler-Assisted Automatic Detection of Offload Kernels for FPGA-HBM Architectures

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Abstract

The bandwidth improvement provided by high-bandwidth memory (HBM), and the capability of FPGAs to customize the processing and memory hierarchy, results in a considerable performance increase for memory-intensive work-loads such as graph processing, sorting, machine learning, and database analytics. Modern systems integrating 3D-stacked DRAM memory can be leveraged to realize the Near-Memory Computing (NMC) paradigm by offloading some computations to accelerators placed near the HBM. Although numerous studies have investigated efficient accelerators for FPGA-HBM platforms, researchers have not proposed a systematic way for identifying which application kernels are suitable for execution near the HBM. In this article, we propose compiler support for recognizing offloading candidates without any burden on programmers. Auto-DOK analyzes an application code based on criteria derived from the hardware design goals of FPGA-HBM platforms, and automatically identifies kernels suitable for offloading. We evaluate Auto-DOK on benchmarks ranging from microbenchmarks to real-world kernels. Our results show that Auto-DOK can correctly identify kernels and input sizes suitable for execution near the HBM, and prevents slowdown caused by incorrect offloading decisions for other workloads. Moreover, Auto-DOK operates at compile time with negligible overhead and without the need for expensive profiling.

Details

Original languageEnglish
Title of host publicationProceedings - 2023 26th Euromicro Conference on Digital System Design, DSD 2023
EditorsSmail Niar, Hamza Ouarnoughi, Amund Skavhaug
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages577-584
Number of pages8
ISBN (electronic)9798350344196
Publication statusPublished - 2023
Peer-reviewedYes

Conference

Title26th Euromicro Conference on Digital System Design
Abbreviated titleDSD 2023
Conference number26
Duration6 - 8 September 2023
Website
LocationGrand Blue Fafa Resort
CityDurres
CountryAlbania

External IDs

ORCID /0000-0003-2571-8441/work/159607522

Keywords

Keywords

  • Code Characterization, High-bandwidth Memory (HBM), Parallel Architectures