1 December 2017 in Neuron
10 August 2023 in Nature Electronics
30 August 2023 in Nature Communications
Analog in-memory computing—a promising approach for energy-efficient acceleration of deep learning workloads—computes matrix-vector multiplications but only approximately, due to nonidealities that often are non-deterministic or nonlinear. This can adversely impact the achievable inference accuracy. Here, we develop an hardware-aware retraining approach to systematically examine the accuracy of analog in-memory computing across multiple network topologies, and investigate sensitivity and robustness to a broad set of nonidealities. By introducing a realistic crossbar model, we improve significantly on earlier retraining approaches. We show that many larger-scale deep neural networks—including convnets, recurrent networks, and transformers—can in fact be successfully retrained to show iso-accuracy with the floating point implementation. Our results further suggest that nonidealities that add noise to the inputs or outputs, not the weights, have the largest impact on accuracy, and that recurrent networks are particularly robust to all nonidealities.
6 March 2017 in Nature Neuroscience
18 August 2016 in BMC Neuroscience
A1 Functional advantages of cell-type heterogeneity in neural circuits
20 November 2018 in Nature Communications
Autapses are synaptic contacts of a neuron’s axon onto its own dendrite and soma. In the neocortex, self-inhibiting autapses in GABAergic interneurons are abundant in number and play critical roles in regulating spike precision and network activity. Here we examine whether the principal glutamatergic pyramidal cells (PCs) also form functional autapses. In patch-clamp recording from both rodent and human PCs, we isolated autaptic responses and found that these occur predominantly in layer-5 PCs projecting to subcortical regions, with very few in those projecting to contralateral prefrontal cortex and layer 2/3 PCs. Moreover, PC autapses persist during development into adulthood. Surprisingly, they produce giant postsynaptic responses (∼5 fold greater than recurrent PC-PC synapses) that are exclusively mediated by AMPA receptors. Upon activation, autapses enhance burst firing, neuronal responsiveness and coincidence detection of synaptic inputs. These findings indicate that PC autapses are functional and represent an important circuit element in the neocortex.