Neuromorphic computing offers transformative potential for AI in resource-constrained environments by mimicking biological neural efficiency. This perspective article analyzes recent advances and future directions, advocating a system design approach that integrates specialized sensing (e.g., event-based cameras), brain-inspired algorithms (SNNs and SNN-ANN hybrids), and dedicated neuromorphic hardware. Using vision-based drone navigation (VDN) as an exemplar-drawing parallels with biological systems like Drosophila-we demonstrate how these components enable event-driven processing and overcome von Neumann architecture limitations through near-/in-memory computing. Key challenges include large-scale integration, benchmarking standardization, and algorithm-hardware co-design for emerging applications, which we discuss alongside current and future research directions.
17 November 2023 in IEEE Transactions on Cognitive and Developmental Systems
Spiking neural networks (SNNs) are a promising avenue for machine learning with superior energy efficiency compared to traditional artificial neural networks (ANNs). Recent advances in training and input encoding have put SNNs on par with state-of-the-art ANNs in image classification. However, such tasks do not utilize the internal dynamics of SNNs fully. Notably, a spiking neuron’s membrane potential acts as an internal memory, merging incoming inputs sequentially. This recurrent dynamic enables the networks to learn temporal correlations, making SNNs suitable for sequential learning. Such problems can also be tackled using ANNs. However, to capture the temporal dependencies, either the inputs have to be lumped over time (e.g. Transformers); or explicit recurrence needs to be introduced (e.g. recurrent neural networks (RNNs), long-short-term memory (LSTM) networks), which incurs considerable complexity. To that end, we explore the capabilities of SNNs in providing lightweight solutions to four sequential tasks involving text, speech and vision. Our results demonstrate that SNNs, by leveraging their intrinsic memory, can be an efficient alternative to RNNs and LSTMs for sequence processing, especially for certain edge applications. Furthermore, SNNs can be combined with ANNs (hybrid networks) synergistically to obtain the best of both worlds in terms of accuracy and efficiency.
Heart rate (HR) is one of the key indicators of the physiological condition of a person and Photoplethysmography (PPG) is a non-invasive and low-cost method for its estimation. However, the PPG signal is severely corrupted in the presence of motion artifacts which makes HR estimation difficult. A real-time technique for estimating HR is presented here using a cascaded architecture of adaptive filter and recurrent neural networks (RNN) with HR estimation tracking. The NLMS based adaptive filter reduces the motion artifact from PPG signal, then HR is estimated from the cleaned PPG signal using RNN. Finally, the HR tracking approach provides the eventual estimates and prevents the sudden falls in tracking due to estimation errors. The dataset of 2015 SP Cup organized by IEEE, is used for validation of our proposed approach and mean absolute error of 0.98 beats per minute (BPM) is achieved which is lower compared to other cutting edge techniques. From analysis of experimental results, the robustness and suitability for real-time applications are also validated.