Acoustic wildlife monitoring systems are important tools for capturing information about animal habitation in ecosystems. Previous work has demonstrated the effectiveness of audio-based bird localization techniques. However, few studies have investigated the performance and robustness of distributed systems in large forests. Here, the performance of distributed microphone arrays for localizing birds is examined by simulating forest scenes with added reverberation, ambient noise, and measurement errors. The simulation revealed the importance of the signal-to-noise ratio and the spectral weighting in the localization algorithm. These results may guide the design of large-scale wildlife monitoring systems and suggest promising directions for further improvements.
Real-time auralization is essential in virtual reality (VR), gaming, and architecture to enable an immersive audio-visual experience. The audio rendering must be congruent with visual feedback and respond with minimal delay to interactive events and user motion. The wave nature of sound poses critical challenges for plausible and immersive rendering and leads to enormous computational costs. These costs have only increased as virtual scenes have progressed away from enclosures toward complex, city-scale scenes that mix indoor and outdoor areas. However, hard real-time constraints must be obeyed while supporting numerous dynamic sound sources, frequently within a tightly limited computational budget. In this chapter, we provide a general overview of VR auralization systems and approaches that allow them to meet such stringent requirements. We focus on the mathematical foundation, perceptual considerations, and application-specific design requirements of practical systems today, and the future challenges that remain.
10 October 2023 in Journal of the Audio Engineering Society
Parametric spatial audio rendering aims to provide perceptually convincing audio cues that are agnostic to the playback system to enable the acoustic design of games and virtual reality. The authors propose an algorithm for detecting perceptually important reflections from spatial room impulse responses. First, a parametric representation of the sound field is derived based on perceptually motivated spatio-temporal windowing, followed by a second step that estimates the perceptual salience of...
1 September 2018 in The Journal of the Acoustical Society of America
Room acoustic parameters, including the reverberation time (T60) and the direct-to-reverberant ratio (DRR), quantitatively describe the behaviour of an acoustic environment. These parameters are typically derived from an acoustic impulse response (AIR) obtained using an omnidirectional sound source and an omnidirectional receiver. However, the acoustic interaction between a source with a complex radiation pattern, for example, a human talker, and a receiver with a complex directivity pattern, for example, a human listener, cannot be accurately described by an omnidirectional AIR or the acoustic parameters derived from it. Here, we propose characterizing acoustic environments while taking the source and receiver directionality into account. A spherical loudspeaker array allows modelling a source with an arbitrary radiation pattern. Analogously, a spherical microphone can be used to describe a receiver with an arbitrary directivity pattern. By combining spherical loudspeaker and microphone arrays, a multiple-input multiple-output (MIMO) AIR of an acoustic environment can be measured to simulate sources and receivers with arbitrary directivities and estimate acoustic parameters accordingly.
1 May 2017 in The Journal of the Acoustical Society of America
Modern audio signal processing and speech enhancement relies more and more on machine learning approaches, which require vast amount of data for training. One of the ways to create a dataset for training is by convolving measured impulse response between the sound source and the device with clean speech and adding noise. This approach is limited to the pair of used sound source and microphone, as it incorporates not only the reverberation of the room, but also the radiation pattern of the sound source (typically mouth simulator or head and torso simulator) and the directivity patterns of the microphones in the device under test. In this paper we propose using a spherical loudspeaker array as a transmitter and a spherical microphone array as a receiver to create a sound source and receiver independent impulse response. During the dataset synthesis this spatial impulse response is modified to model the impulse response between transmitter and receiver with given directivity patterns.