17 August 2022 in IEEE Journal of Solid-State Circuits
This article presents the first keyword spotting (KWS) IC that uses a ring-oscillator-based time-domain processing technique for its analog feature extractor (FEx). Its extensive usage of time-encoding schemes allows the analog audio signal to be processed in a fully time-domain manner except for the voltage-to-time conversion stage of the analog front end. Benefiting from fundamental building blocks based on digital logic gates, it offers better technology scalability compared to conventional voltage-domain designs. Fabricated in a 65-nm CMOS process, the prototyped KWS IC occupies 2.03 mm2 and dissipates 23- $\mu$ W power consumption, including analog FEx and digital neural network classifier. The 16-channel time-domain FEx achieves a 54.89-dB dynamic range for 16-ms frame shift size while consuming 9.3 $\mu$ W. The measurement result verifies that the proposed IC performs a 12-class KWS task on the Google Speech Command dataset (GSCD) with $>$ 86% accuracy and 12.4-ms latency.
1 February 2025 in Journal of Neural Engineering
JMJonatan Märcher-Rørsted
+6
Enhancing speech perception in everyday noisy acoustic environments remains an outstanding challenge for hearing aids. Speech separation technology is improving rapidly, but hearing devices cannot fully exploit this advance without knowing which sound sources the user wants to hear. Even with high-quality source separation, the hearing aid must know which speech streams to enhance and which to suppress. Advances in EEG-based decoding of auditory attention raise the potential of neurosteering, in which a hearing instrument selectively enhances the sound sources that a hearing-impaired listener is focusing their attention on. Here, we present and discuss a real-time brain–computer interface system that combines a stimulus–response model based on canonical correlation analysis for real-time EEG attention decoding, coupled with a multi-microphone hardware platform enabling low-latency real-time speech separation through spatial beamforming. We provide an overview of the system and its various components, discuss prospects and limitations of the technology, and illustrate its application with case studies of listeners steering acoustic feedback of competing speech streams via real-time attention decoding. A software implementation code of the system is publicly available for further research and explorations.
15 June 2023 in IEEE Transactions on Biomedical Circuits and Systems
Sweat secreted by the human eccrine sweat glands can provide valuable biomarker information during exercise. Real-time non-invasive biomarker recordings are therefore useful for evaluating the physiological conditions of an athlete such as their hydration status during endurance exercise. This work describes a wearable sweat biomonitoring patch incorporat- ing printed electrochemical sensors into a plastic microfluidic sweat collector and data analysis that shows the real-time recorded sweat biomarkers can be used to predict a physiological biomarker. The system was placed on subjects carrying out an hour-long exercise session and results were compared to a wearable system using potentiometric robust silicon-based sensors and to commercially available HORIBA-LAQUAtwin devices. Both prototypes were applied to the real-time monitoring of sweat during cycling sessions and showed stable readings for around an hour. Analysis of the sweat biomarkers collected from the printed patch prototype shows that their real-time measurements correlate well (correlation coefficient 0.65) with other physiological biomarkers such as heart rate and regional sweat rate collected in the same session. We show for the first time, that the real-time sweat sodium and potassium concentration biomarker measurements from the printed sensors can be used to predict the core body temperature with root mean square error (RMSE) of 0.02 °C which is 71% lower compared to the use of only the physiological biomarkers. These results show that these wearable patch technologies are promising for real- time portable sweat monitoring analytical platforms, especially for athletes performing endurance exercise.
22 April 2020 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Evaluation methods for multi-channel speech separation algorithms in the real world are becoming increasingly important as the number of applications involving audio assistants and hearing aid devices continues to grow. To make such evaluations easier, this paper presents a multi-microphone hardware platform, WHISPER, built specifically for this purpose and its subsequent use for evaluating speech processing algorithms. The platform can also be constructed as an ad-hoc wireless acoustic sensor network (WASN) with high synchronization precision. Using WHISPER, we describe real-world experiments where an example speech separation algorithm is applied to mixtures of varying number of talkers and signal-to-noise ratios. The results when compared with those from a simulated environment, show the usefulness of WASNs and that simulations tend to underestimate the difficulty of speech separation in real-world scenarios. This work represents an important step towards developing a hardware-software framework for evaluating speech processing algorithms in the wild.
17 February 2022 in IEEE Transactions on Circuits and Systems I: Regular Papers
Including local automatic gain control (AGC) circuitry into a silicon cochlea design has been challenging because of transistor mismatch and model complexity. To address this, we present an alternative system-level algorithm that implements channel-specific AGC in a silicon spiking cochlea by measuring the output spike activity of individual channels. The bandpass filter gain of a channel is adapted dynamically to the input amplitude so that the average output spike rate stays within a defined range. Because this AGC mechanism only needs counting and adding operations, it can be implemented at low hardware cost in a future design. We evaluate the impact of the local AGC algorithm on a classification task where the input signal varies over 32dB input range. Two classifier types receiving cochlea spike features were tested on a speech versus noise classification task. The logistic regression classifier achieves an average of 6% improvement and 40.8% relative improvement in accuracy when the AGC is enabled. The deep neural network classifier shows a similar improvement for the AGC case and achieves a higher mean accuracy of 96% compared to the best accuracy of 91% from the logistic regression classifier.