Access Interval Prediction with Neural Networks for Tightly Coupled Memory Systems

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

Abstract

Embedded systems usually integrate multiple Pro-cessing Elements (PEs) on a single chip. Various PEs are con-nected to the same Tightly Coupled Memory (TCM) to increase the area and energy efficiency. However, memory sharing comes at the cost of conflicts resulting in performance degradation. To counteract this issue, Access Interval Prediction (AIP) has been introduced in the literature to predict the interval between two memory accesses. State-of-the-art AIP units are based on predictors proposed for branch prediction, such as TAgged GEometric (TAGE). This work shows for the first time that several types of neural networks are suitable for AIP as well. By treating AIP as a classification problem, we can continue to decrease the error rate compared to the TAGE predictor. For example, Vision Transformer (ViT) networks reduce the average error rate by over one-third to 2.1 percent. Through our investigation, we demonstrate that offline training alone is sufficient since the memory access traces contain the same repetitive patterns independent from the input parameters of the program run.

Details

Original languageEnglish
Title of host publication2023 26th Euromicro Conference on Digital System Design (DSD)
EditorsSmail Niar, Hamza Ouarnoughi, Amund Skavhaug
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages391-398
Number of pages8
ISBN (electronic)979-8-3503-4419-6
ISBN (print)979-8-3503-4420-2
Publication statusPublished - 8 Sept 2023
Peer-reviewedYes

Publication series

SeriesEuromicro Symposium on Digital System Design (DSD)
ISSN2639-3859

Conference

Title26th Euromicro Conference on Digital System Design
Abbreviated titleDSD 2023
Conference number26
Duration6 - 8 September 2023
Website
LocationGrand Blue Fafa Resort
CityDurres
CountryAlbania

External IDs

Scopus 85189178651

Keywords

Sustainable Development Goals

Keywords

  • Benchmark testing, Embedded systems, Error analysis, Memory management, Neural networks, Predictive models, Training, access interval, memory prediction, neural network, shared memory