Tim Stevens

Tim Stevens

Auto-generated profile, based on publicly available information

Tim Stevens

Department of Mechanical Engineering and Institute for Complex Molecular Systems, Eindhoven University of Technology, Eindhoven 5612AP, Netherlands

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 July 2024 in Science Advances
Verified
Journal Article
Open access
EDEveline R. W. van Doremaele
Eveline R. W. van Doremaele
TSTim Stevens
Tim Stevens
SRStijn Ringeling
Stijn Ringeling
SSSimone Spolaor
Simone Spolaor
MFMarco Fattori
Marco Fattori
YBYoeri van de Burgt
Yoeri van de Burgt
Neural network training can be slow and energy-expensive due to the frequent transfer of weight data between digital memory and processing units. Neuromorphic systems can accelerate neural networks by performing multiply-accumulate operations in parallel using nonvolatile analog memory. However, executing the widely used backpropagation training algorithm in multilayer neural networks requires information—and therefore storage—of the partial derivatives of the weight values preventing suitable and scalable implementation in hardware. Here, we propose a hardware implementation of the backpropagation algorithm that progressively updates each layer using in situ stochastic gradient descent, avoiding this storage requirement. We experimentally demonstrate the in situ error calculation and the proposed progressive backpropagation method in a multilayer hardware-implemented neural network. We confirm identical learning characteristics and classification performance compared to conventional backpropagation in software. We show that our approach can be scaled to large and deep neural networks, enabling highly efficient training of advanced artificial intelligence computing systems.

1 January 2019
Verified
Book Chapter
Closed access
ANAjit S. Narang
Ajit S. Narang
TSTim Stevens
Tim Stevens
SPSrinivasa Paruchuri
Srinivasa Paruchuri
KMKevin Macias
Kevin Macias
ZGZhihui Gao
Zhihui Gao
MHMario Hubert
Mario Hubert