MONO: Enhancing Bit-Flip Resilience with Bit Homogeneity for Neural Networks
Publikation: Beitrag in Fachzeitschrift › Forschungsartikel › Beigetragen › Begutachtung
Beitragende
Abstract
Deep neural networks (DNNs) have been applied across diverse domains, including safety-critical applications. Past studies indicate that DNNs are very sensitive to changes in weights and activations due to uneven bit-weight distribution in standard number formats like fixed points, which can cause significant output accuracy fluctuations. To address this issue, we introduce a new data type called MONO to enhance bit-flip resilience using uniformity at the bit level by employing symmetric weights for all bit positions. On average, MONO has improved error resilience more effectively than the fixed-point data type, even when utilizing triple modular redundancy (TMR) and most significant bit (MSB) protection, while maintaining low overhead.
Details
| Originalsprache | Englisch |
|---|---|
| Seiten (von - bis) | 333-336 |
| Seitenumfang | 4 |
| Fachzeitschrift | IEEE Embedded Systems Letters |
| Jahrgang | 16 |
| Ausgabenummer | 4 |
| Publikationsstatus | Veröffentlicht - Dez. 2024 |
| Peer-Review-Status | Ja |
Schlagworte
ASJC Scopus Sachgebiete
- Steuerungs- und Systemtechnik - Deep neural network (DNN), error resilience, fault Injection, hardware fault, homogeneity
- Allgemeine Computerwissenschaft - Deep neural network (DNN), error resilience, fault Injection, hardware fault, homogeneity
Schlagwörter
- Deep neural network (DNN), error resilience, fault Injection, hardware fault, homogeneity