Exploring RISC-V Instruction-Level Optimization Through Macro-Operation Fusion for TensorFlow-based Models
Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review
Contributors
Abstract
Macro-operation fusion represents an advanced approach to optimizing instruction streams with the goal of enhancing processor efficiency, offering potential benefits for compute-intensive domains including deep learning and large language models. This work presents a software-based framework designed to systematically explore instruction fusion strategies targeting the RISC-V ISA for TensorFlow-based models. The framework combines model transformation, dynamic instruction trace analysis, and fusion simulation to identify and evaluate both established and novel fusion idioms targeting integer and floating-point operations. Evaluation across a diverse set of benchmarks, spanning classical computational tasks and modern deep learning workloads, demonstrates that the proposed fusion techniques effectively fuse, on average, 30% of dynamic instructions in deep learning models, and over 60% fusion in large language models such as GPT-2. These results provide valuable insights into the trade-offs between software-driven optimization and necessary hardware extensions, informing future RISC-V microarchitecture and compiler design aimed at maximizing instruction-level parallelism.
Details
| Original language | English |
|---|---|
| Title of host publication | 2025 IEEE 38th International System-on-Chip Conference (SOCC) |
| Editors | Danella Zhao, Klaus Hofmann |
| Pages | 1-6 |
| Number of pages | 6 |
| ISBN (electronic) | 979-8-3315-9478-7 |
| Publication status | Published - 2025 |
| Peer-reviewed | Yes |
Publication series
| Series | IEEE International SOC Conference |
|---|---|
| ISSN | 2164-1676 |
External IDs
| ORCID | /0000-0003-2571-8441/work/203808963 |
|---|---|
| Mendeley | 0e728ee8-f939-373a-9d3d-a279fc20d065 |
| unpaywall | 10.1109/socc66126.2025.11235386 |
| Scopus | 105029599518 |
Keywords
ASJC Scopus subject areas
Keywords
- Instruction Fusion, Instruction-Level Parallelism, Macro-operation Fusion, RISC-V