Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

Rishav Mukherji; Mark Schöne; Khaleelulla Khan Nazeer; Christian Mayr; David Kappel; Anand Subramoney

doi:10.48550/arXiv.2405.00433

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

Research output: Preprint/Documentation/Report › Preprint

Contributors

Rishav Mukherji - (Author)
Mark Schöne - , Chair of Highly-Parallel VLSI Systems and Neuro-Microelectronics (Author)
Khaleelulla Khan Nazeer - , Chair of Highly-Parallel VLSI Systems and Neuro-Microelectronics (Author)
Christian Mayr - , Chair of Highly-Parallel VLSI Systems and Neuro-Microelectronics, Clusters of Excellence CeTI: Centre for Tactile Internet, Center for Scalable Data Analytics and Artificial Intelligence (ScaDS.AI Dresden) (Author)
David Kappel - (Author)
Anand Subramoney - (Author)

Details

Original language	English
Publication status	Published - 2024

No renderer: customAssociatesEventsRenderPortal,dk.atira.pure.api.shared.model.researchoutput.WorkingPaper

External IDs

ORCID	/0000-0001-8525-8702/work/168206516

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

Mukherji, R., Schone, M., Nazeer, K. K., Mayr, C., Kappel, D. & Subramoney, A., 2 Dec 2024, (E-pub ahead of print) Proceedings - 2024 International Conference on Neuromorphic Systems, ICONS 2024. Institute of Electrical and Electronics Engineers (IEEE), p. 132-139 8 p.

Research output: Contribution to book/Conference proceedings/Anthology/Report › Conference contribution › Contributed › peer-review

View all research output (1)

Research Portal of the TU Dresden

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

Contributors

Details

External IDs

Related content

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models