The combination of delayed sound from a digital hearing aid with direct sound through an open or vented fitting can potentially degrade the sound quality due to audible changes in timbre and/or perception of echo. The present study was designed to test a number of delay and high-pass combinations under worst-case (i.e. most sensitive) conditions. Eighteen normal-hearing and 18 mildly hearing-impaired subjects performed the test in a paired comparison (A/B) task. The subjects were asked to select a preferred setting with respect to sound quality. The test was set in an anechoic chamber using recorded speech, environmental sounds, and own voice. Experimental hearing aids were fitted binaurally with open domes thus providing maximum ventilation. The preference data were processed using a statistical choice model that derives a ratio-scale. The analysis indicated that in these test conditions there was no change in sound quality when varying the delay in the range 5–10 ms and that there was a preference for 2000 Hz high-pass filtering in most conditions, regardless of the hearing losses tested. Sumario La combinación de sonido retrasado de un auxiliar auditivo con un sonido directo a través de una adaptación ventilada potencialmente puede degradar la calidad del sonido debido a cambios auditivos en timbre y/o la percepción de eco. El presente estudio fue designado para probar un número de retrasos y combinaciones pasa alto bajo las peores condiciones (i.e. las más sensibles). Dieciocho sujetos normales y 18 con hipoacusia superficial hicieron la prueba con comparación pareada (A/B). Se les pidió a los sujetos que escogieran su condición preferida con respecto a la calidad del sonido. La prueba se llevó a cabo en una cámara anecoica utilizando lenguaje grabado, sonidos ambientales y la propia voz. Se adaptaron auxiliares auditivos experimentales en forma binaural con cúpulas abiertas para máxima ventilación. Los datos preferidos fueron procesados utilizando un modelo de selección estadístico que deriva en una escala por ratios. El análisis indicó que en estas condiciones de prueba no hubo cambios en la calidad de sonido cuando se varió el retraso en el rango de 5–10 ms y que había una preferencia por la filtración pasa-alto de 2000Hz en la mayoría de condiciones , sin importar la hipoacusia en cuestión.
1 July 2018 in The Journal of the Acoustical Society of America
Hearing aid users are challenged in listening situations with noise and especially speech-on-speech situations with two or more competing voices. Specifically, the task of attending to and segregating two competing voices is particularly hard, unlike for normal-hearing listeners, as shown in a small sub-experiment. In the main experiment, the competing voices benefit of a deep neural network (DNN) based stream segregation enhancement algorithm was tested on hearing-impaired listeners. A mixture of two voices was separated using a DNN and presented to the two ears as individual streams and tested for word score. Compared to the unseparated mixture, there was a 13%-point benefit from the separation, while attending to both voices. If only one output was selected as in a traditional target-masker scenario, a larger benefit of 37%-points was found. The results agreed well with objective metrics and show that for hearing-impaired listeners, DNNs have a large potential for improving stream segregation and speech intelligibility in difficult scenarios with two equally important targets without any prior selection of a primary target stream. An even higher benefit can be obtained if the user can select the preferred target via remote control.
1 April 2017 in The Journal of the Acoustical Society of America
Old, hearing-impaired listeners generally benefit little from lateral separation of multiple talkers when listening to one of them. This study aimed to determine how spatial release from masking (SRM) in such listeners is affected when the interaural time differences (ITDs) in the temporal fine structure (TFS) are manipulated by tone-vocoding (TVC) at the ears by a master hearing aid system. Word recall was compared, with and without TVC, when target and masker sentences from a closed set were played simultaneously from the front loudspeaker (co-located) and when the maskers were played 45° to the left and right of the listener (separated). For 20 hearing-impaired listeners aged 64 to 86, SRM was 3.7 dB smaller with TVC than without TVC. This difference in SRM correlated with mean audiometric thresholds below 1.5 kHz, even when monaural TFS sensitivity (discrimination of frequency-shifts in identically filtered complexes) was partialed out, suggesting that low-frequency audiometric thresholds may be a good indicator of candidacy for hearing aids that preserve ITDs. The TVC difference in SRM was not correlated with age, pure-tone ITD thresholds, nor fundamental frequency difference limens, and only with monaural TFS sensitivity before control for low-frequency audiometric thresholds.
30 October 2023 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
This paper proposes neural networks for compensating sensorineural hearing loss. The aim of the hearing loss compensation task is to transform a speech signal to increase speech intelligibility after further processing by a person with a hearing impairment, which is modeled by a hearing loss model. We propose an interpretable model called dynamic processing network, which has a structure similar to band-wise dynamic compressor. The network is differentiable, and therefore allows to learn its parameters to maximize speech intelligibility. More generic models based on convolutional layers were tested as well. The performance of the tested architectures was assessed using spectro-temporal objective index (STOI) with hearing-threshold noise and hearing aid speech intelligibility (HASPI) metrics. The dynamic processing network gave a significant improvement of STOI and HASPI in comparison to popular compressive gain prescription rule Camfit. A large enough convolutional network could outperform the interpretable model with the cost of larger computational load. Finally, a combination of the dynamic processing network with convolutional neural network gave the best results in terms of STOI and HASPI.
30 January 2025 in IEEE Transactions on Audio, Speech and Language Processing
This article investigates the use of deep neural networks (DNNs) for hearing-loss compensation. Hearing loss is a prevalent issue affecting millions of people worldwide, and conventional hearing aids have limitations in providing satisfactory compensation. DNNs have shown remarkable performance in various auditory tasks, including speech recognition, speaker identification, and music classification. In this study, we propose a DNN-based approach for hearing-loss compensation, which is trained on the outputs of hearing-impaired and normal-hearing DNN-based auditory models in response to speech signals. First, we introduce a framework for emulating auditory models using DNNs, focusing on an auditory-nerve model in the auditory pathway. We propose a linearization of the DNN-based approach, which we use to analyze the DNN-based hearing-loss compensation. Additionally we develop a simple approach to choose the acoustic center frequencies of the auditory model used for the compensation strategy. Finally, we evaluate, to our knowledge for the first time, the DNN-based hearing-loss compensation strategies using listening tests with hearing impaired listeners. The results demonstrate that the proposed approach results in feasible hearing-loss compensation strategies. Our proposed approach was shown to provide an increase in speech intelligibility versus an unprocessed baseline and was found to outperform a conventional approach in terms of both intelligibility and preference.
18 March 2024 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Advanced auditory models are useful in designing signal-processing algorithms for hearing-loss compensation or speech enhancement. Such auditory models provide rich and detailed descriptions of the auditory pathway, and might allow for individualization of signal-processing strategies, based on physiological measurements. However, these auditory models are often computationally demanding, requiring significant time to compute. To address this issue, previous studies have explored the use of deep neural networks to emulate auditory models and reduce inference time. While these deep neural networks offer impressive efficiency gains in terms of computational time, they may suffer from uneven emulation performance as a function of auditory-model frequency-channels and input sound pressure level, making them unsuitable for many tasks. In this study, we demonstrate that the conventional machine-learning optimization objective used in existing state-of-the-art methods is the primary source of this limitation. Specifically, the optimization objective fails to account for the frequency- and level-dependencies of the auditory model, caused by a large input dynamic range and different types of hearing losses emulated by the auditory model. To overcome this limitation, we propose a new optimization objective that explicitly embeds the frequency- and level-dependencies of the auditory model. Our results show that this new optimization objective significantly improves the emulation performance of deep neural networks across relevant input sound levels and auditory-model frequency channels, without increasing the computational load during inference. Addressing these limitations is essential for advancing the application of auditory models in signal-processing tasks, ensuring their efficacy in diverse scenarios.