BiKA: Binarized KAN-inspired Neural Network for Efficient Hardware Accelerator Designs

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

Abstract

The continuously growing size of Neural Network (NN) models makes the design of lightweight neural network accelerators for edge devices an emerging subject in recent research. Previous works explored different lightweight technologies or even emerging neural network structures, such as quantization, approximate computing, neuromorphic computing, etc., to reduce hardware resource consumption in accelerator designs. This inspired our interest in exploring the potential of other emerging network structures in hardware accelerator designs. Kolmogorov-Arnold Network (KAN) [1] is a recently proposed novel neural network structure by replacing the multiplication and activation function in Artificial Neural Networks (ANN) with learnable nonlinear functions, which has the potential to transform the paradigm of neural network design. However, considering the complexity of the nonlinear function on hardware, the design of the lightweight hardware accelerator of KAN lacks thoroughly related research.

Details

Original languageEnglish
Title of host publicationProceedings - 2025 IEEE 33rd Annual International Symposium on Field-Programmable Custom Computing Machines, FCCM 2025
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages276
Number of pages1
ISBN (electronic)979-8-3315-0281-2
Publication statusPublished - 2025
Peer-reviewedYes

Publication series

SeriesAnnual IEEE Symposium on Field-Programmable Custom Computing Machines (FCCM)
ISSN2576-2613

Conference

Title33rd IEEE Annual International Symposium on Field-Programmable Custom Computing Machines
Abbreviated titleFCCM 2025
Conference number33
Duration4 - 7 May 2025
Website
LocationGraduate Hotel
CityFayetteville
CountryUnited States of America

Keywords

Keywords

  • approximate computing, fpga, hardware accelerator, kolmogorov-arnold network