Tuomas Virtanen

Tuomas Virtanen

Auto-generated profile, based on publicly available information

Tuomas Virtanen

Faculty of Information Technology and Communication Sciences, Tampere University, Tampere, Finland

Research Focus & Metrics

Academic Career Length

37Years (1990-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 April 2019 in IEEE Journal of Selected Topics in Signal Processing
Verified
Journal Article
Closed access
HPHendrik Purwins
Hendrik Purwins
BLBo Li
Bo Li
TVTuomas Virtanen
Tuomas Virtanen
JSJan Schluter
Jan Schluter
SCShuo-Yiin Chang
Shuo-Yiin Chang
TSTara N Sainath
Tara N Sainath
Given the recent surge in developments of deep learning, this article provides a review on the state-of-the-art deep learning techniques for audio signal processing. Speech, music, and environmental sound processing are considered side- by-side, in order to point out similarities and differences between the domains, highlighting general methods, problems, key refer- ences, and potential for cross-fertilization between areas. The dominant feature representations (in particular, log-mel spectra and raw waveform) and deep learning models are reviewed, including convolutional neural networks, variants of the long short-term memory architecture, as well as more audio-specific neural network models. Subsequently prominent deep learning application areas are covered, i.e. audio recognition (automatic speech recognition, music information retrieval, environmental sound detection, localization and tracking) and synthesis and transformation (source separation, audio enhancement, genera- tive models for speech, sound, and music synthesis). Finally, key issues and future questions regarding deep learning applied to audio signal processing are identified.

25 May 2016 in Applied Sciences
Verified
Journal Article
Open access
PDF file
AMAnnamaria Mesaros
Annamaria Mesaros
THToni Heittola
Toni Heittola
TVTuomas Virtanen
Tuomas Virtanen
This paper presents and discusses various metrics proposed for evaluation of polyphonic sound event detection systems used in realistic situations where there are typically multiple sound sources active simultaneously. The system output in this case contains overlapping events, marked as multiple sounds detected as being active at the same time. The polyphonic system output requires a suitable procedure for evaluation against a reference. Metrics from neighboring fields such as speech recognition and speaker diarization can be used, but they need to be partially redefined to deal with the overlapping events. We present a review of the most common metrics in the field and the way they are adapted and interpreted in the polyphonic case. We discuss segment-based and event-based definitions of each metric and explain the consequences of instance-based and class-based averaging using a case study. In parallel, we provide a toolbox containing implementations of presented metrics.

7 December 2018 in IEEE Journal of Selected Topics in Signal Processing
Verified
Journal Article
Closed access
SASharath Adavanne
Sharath Adavanne
APArchontis Politis
Archontis Politis
JNJoonas Nikunen
Joonas Nikunen
TVTuomas Virtanen
Tuomas Virtanen
In this paper, we propose a convolutional recurrent neural network for joint sound event localization and detection (SELD) of multiple overlapping sound events in three-dimensional (3D) space. The proposed network takes a sequence of consecutive spectrogram time-frames as input and maps it to two outputs in parallel. As the first output, the sound event detection (SED) is performed as a multi-label classification task on each time-frame producing temporal activity for all the sound event classes. As the second output, localization is performed by estimating the 3D Cartesian coordinates of the direction-of-arrival (DOA) for each sound event class using multi-output regression. The proposed method is able to associate multiple DOAs with respective sound event labels and further track this association with respect to time. The proposed method uses separately the phase and magnitude component of the spectrogram calculated on each audio channel as the feature, thereby avoiding any method- and array-specific feature extraction. The method is evaluated on five Ambisonic and two circular array format datasets with different overlapping sound events in anechoic, reverberant and real-life scenarios. The proposed method is compared with two SED, three DOA estimation, and one SELD baselines. The results show that the proposed method is generic and applicable to any array structures, robust to unseen DOA values, reverberation, and low SNR scenarios. The proposed method achieved a consistently higher recall of the estimated number of DOAs across datasets in comparison to the best baseline. Additionally, this recall was observed to be significantly better than the best baseline method for a higher number of overlapping sound events.

14 January 2002 in The FASEB Journal
Verified
Journal Article
Open access
PDF file
RHReinhard Hiller
Reinhard Hiller
SLSylvia Laffer
Sylvia Laffer
CHChristian Harwanegg
Christian Harwanegg
MHMartin Huber
Martin Huber
WSWolfgang M. Schmidt
Wolfgang M. Schmidt
RVRudolf Valenta
Rudolf Valenta
Type I allergy is an immunoglobulin E (IgE)‐mediated hypersensitivity disease affecting more than 25% of the population. Currently, diagnosis of allergy is performed by provocation testing and IgE serology using allergen extracts. This process defines allergen‐containing sources but cannot identify the disease‐eliciting allergenic molecules. We have applied microarray technology to develop a miniaturized allergy test containing 94 purified allergen molecules that represent the most common allergen sources. The allergen microarray allows the determination and monitoring of allergic patients’ IgE reactivity profiles to large numbers of disease‐causing allergens by using single measurements and minute amounts of serum. This method may change established practice in allergy diagnosis, prevention, and therapy. In addition, microarrayed antigens may be applied to the diagnosis of autoimmune and infectious diseases.

27 August 2021 in IEEE Signal Processing Magazine
Verified
Journal Article
Closed access
AMAnnamaria Mesaros
Annamaria Mesaros
THToni Heittola
Toni Heittola
TVTuomas Virtanen
Tuomas Virtanen
MPMark D. Plumbley
Mark D. Plumbley
Imagine standing on a street corner in the city. With your eyes closed you can hear and recognize a succession of sounds: cars passing by, people speaking, their footsteps when they walk by, and the continuous falling of rain. The recognition of all these sounds and interpretation of the perceived scene as a city street soundscape comes naturally to humans. It is, however, the result of years of "training": encountering and learning associations among the vast varieties of sounds in everyday life, the sources producing these sounds, and the names given to them.

24 December 2020 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Open access
APArchontis Politis
Archontis Politis
AMAnnamaria Mesaros
Annamaria Mesaros
SASharath Adavanne
Sharath Adavanne
THToni Heittola
Toni Heittola
TVTuomas Virtanen
Tuomas Virtanen
Sound event localization and detection is a novel area of research that emerged from the combined interest of analyzing the acoustic scene in terms of the spatial and temporal activity of sounds of interest. This paper presents an overview of the first international evaluation on sound event localization and detection, organized as a task of the DCASE 2019 Challenge. A large-scale realistic dataset of spatialized sound events was generated for the challenge, to be used for training of learning-based approaches, and for evaluation of the submissions in an unlabeled subset. The overview presents in detail how the systems were evaluated and ranked and the characteristics of the best-performing systems. Common strategies in terms of input features, model architectures, training approaches, exploitation of prior knowledge, and data augmentation are discussed. Since ranking in the challenge was based on individually evaluating localization and event classification performance, part of the overview focuses on presenting metrics for the joint measurement of the two, together with a reevaluation of submissions using these new metrics. The new analysis reveals submissions that performed better on the joint task of detecting the correct type of event close to its original location than some of the submissions that were ranked higher in the challenge. Consequently, ranking of submissions which performed strongly when evaluated separately on detection or localization, but not jointly on both, was affected negatively.