Matrix-Vectorized Canonical Signed Digit Quantized Neural Networks for Efficient Forward Pass Simulation
Khan, Maria; Nurmi, Jari (2025)
Khan, Maria
Nurmi, Jari
2025
This publication is copyrighted. You may download, display and print it for Your own personal use. Commercial use is prohibited.
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi:tuni-202601191573
https://urn.fi/URN:NBN:fi:tuni-202601191573
Kuvaus
Peer reviewed
Tiivistelmä
Quantized neural networks (QNNs) reduce computational cost but typically rely on multiplications, which limits their efficiency. Canonical Signed Digit (CSD) representation eliminates the need for multipliers through signed shifts. We present a matrix-vectorized Python framework for efficient batch forward-pass evaluation of CSD-QNNs, achieving near-lossless accuracy (absolute errors 10-5, MSE 10-10) and robustness across 8 - 16 bit quantization, while highlighting hardware potential for shift-and-add implementations in FPGA/ASIC deployments.
Kokoelmat
- TUNICRIS-julkaisut [24189]
