Enlarging the Time Budget for Neural Network Based Predictors for Access Interval Prediction

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Abstract

Embedded systems implemented on a single chip commonly contain several Processing Elements (PEs). To optimize both area and energy efficiency, these individual PEs are often linked to the same Tightly Coupled Memory (TCM). Nonetheless, the advantage of memory sharing is offset by potential conflicts. Recently introduced systems with offline conflict detection and memory arbitration avoid the performance degradation of online arbiters. Access Interval Prediction (AIP) is exploited to detect the conflicts offline by forecasting the time interval between two memory accesses. In this context, neural network models for time-series prediction are the State-of-the-Art AIP units. However, the influence of the latency of these neural network predictors on the accuracy of the AIP system has not been considered yet. Our analysis shows a significant degradation of the system accuracy by the predictor latency. To enlarge the time budget for calculation, we introduce a novel neural network AIP predictor that predicts the next-but-one memory access. Further, we present an advanced system model that integrates two independent next-but-one predictors. By combining multiple predictors, we can maintain the high accuracy of the AIP system even for implementations that exhibit high latency. For example, our system model demonstrates a 2.59 times higher accuracy compared to the State-of-the-Art AIP with neural networks when executing the models with a latency of 5 cycles.

Details

OriginalspracheEnglisch
Titel2024 International Conference on Artificial Intelligence, Computer, Data Sciences and Applications (ACDSA)
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers (IEEE)
Seitenumfang7
ISBN (elektronisch)979-8-3503-9452-8
ISBN (Print)979-8-3503-9453-5
PublikationsstatusVeröffentlicht - 2 Feb. 2024
Peer-Review-StatusJa

Konferenz

Titel2024 International Conference on Artificial Intelligence, Computer, Data Sciences, and Applications
KurztitelACDSA 2024
Dauer1 - 2 Februar 2024
Webseite
OrtUniversity of Seychelles & Online
StadtVictoria
LandSeychellen

Externe IDs

Scopus 85189941534

Schlagworte

Ziele für nachhaltige Entwicklung

Schlagwörter

  • access interval, latency, memory prediction, neural network, shared memory