Silicon-based analog neural networks physically embody the ideal neural network model in an approximate way. We show that by retraining the neural network using a physics-informed hardware-aware model one can fully recover the inference accuracy of the ideal network model even in the presence of significant non-idealities. This is way more promising for scalability and integration density than the default option of improving the fidelity of the analog neural network at the cost of significant energy, area, and design overhead, through extensive calibration and conservative analog design. We first present a physics‑informed hardware-aware model for a time-domain vector–matrix multiplier implemented with single‑transistor floating‑gate memory cells that explicitly accounts for two dominant non-idealities of the physical implementation—capacitive crosstalk and bit‑line voltage drop—and integrates seamlessly with modern deep‑learning workflows. The model discretizes each operation into adaptive time slots, processes activation patterns in parallel, and accumulates their contributions to predict effective multiplier outputs. Using measurements from a 16×16 silicon array demonstrator, we show that crosstalk is layout‑dependent and often dominant and we introduce an improved weight‑extraction procedure that doubles signal‑to‑error ratio versus an ideal vector-matrix multiplier model. Finally, we show that by training silicon-based analog neural networks using a hardware-aware model in the forward pass we can recover the accuracy of the ideal software networks across six architectures on datasets of increasing complexity, establishing a complete design‑to‑deployment workflow for time-domain analog neuromorphic chips.

Hardware-Aware Model Design and Training of Silicon-based Analog Neural Networks

Lanuzza M.;
In corso di stampa

Abstract

Silicon-based analog neural networks physically embody the ideal neural network model in an approximate way. We show that by retraining the neural network using a physics-informed hardware-aware model one can fully recover the inference accuracy of the ideal network model even in the presence of significant non-idealities. This is way more promising for scalability and integration density than the default option of improving the fidelity of the analog neural network at the cost of significant energy, area, and design overhead, through extensive calibration and conservative analog design. We first present a physics‑informed hardware-aware model for a time-domain vector–matrix multiplier implemented with single‑transistor floating‑gate memory cells that explicitly accounts for two dominant non-idealities of the physical implementation—capacitive crosstalk and bit‑line voltage drop—and integrates seamlessly with modern deep‑learning workflows. The model discretizes each operation into adaptive time slots, processes activation patterns in parallel, and accumulates their contributions to predict effective multiplier outputs. Using measurements from a 16×16 silicon array demonstrator, we show that crosstalk is layout‑dependent and often dominant and we introduce an improved weight‑extraction procedure that doubles signal‑to‑error ratio versus an ideal vector-matrix multiplier model. Finally, we show that by training silicon-based analog neural networks using a hardware-aware model in the forward pass we can recover the accuracy of the ideal software networks across six architectures on datasets of increasing complexity, establishing a complete design‑to‑deployment workflow for time-domain analog neuromorphic chips.
In corso di stampa
analog neural networks
floating-gate memories
hardware-aware training
in-memory computing
time-domain analogue computing
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11770/413157
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact