Katerina Zmolikova

Katerina Zmolikova

Auto-generated profile, based on publicly available information

Katerina Zmolikova

Demant A/S, Smorum, Denmark

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 June 2019 in IEEE Journal of Selected Topics in Signal Processing
Verified
Journal Article
Closed access
KZKaterina Zmolikova
Katerina Zmolikova
MDMarc Delcroix
Marc Delcroix
KKKeisuke Kinoshita
Keisuke Kinoshita
TOTsubasa Ochiai
Tsubasa Ochiai
TNTomohiro Nakatani
Tomohiro Nakatani
HCHonza Cernocky
Honza Cernocky
The processing of speech corrupted by interfering overlapping speakers is one of the challenging problems as regards today's automatic speech recognition systems. Recently, approaches based on deep learning have made great progress towards solving this problem. Most of these approaches tackle the problem as speech separation, i.e. they blindly recover all the speakers from the mixture. In some scenarios, such as smart personal devices, we may however be interested in recovering one target speaker from a mixture. In this paper, we introduce SpeakerBeam, a method for extracting a target speaker from the mixture based on an adaptation utterance spoken by the target speaker. Formulating the problem as speaker extraction avoids certain issues such as label permutation and the need to determine the number of speakers in the mixture. With SpeakerBeam, we jointly learn to extract a representation from the adaptation utterance characterizing the target speaker and to use this representation to extract the speaker. We explore several ways to do this, mostly inspired by speaker adaptation in acoustic models for automatic speech recognition. We evaluate the performance on the widely used WSJ0-2mix and WSJ0-3mix datasets, and these datasets modified with more noise or more realistic overlapping patterns. We further analyze the learned behavior by exploring the speaker representations and assessing the effect of the length of the adaptation data. The results show the benefit of including speaker information in the processing and the effectiveness of the proposed method.

1 May 2023 in IEEE Signal Processing Magazine
Verified
Journal Article
Closed access
KZKaterina Zmolikova
Katerina Zmolikova
MDMarc Delcroix
Marc Delcroix
TOTsubasa Ochiai
Tsubasa Ochiai
KKKeisuke Kinoshita
Keisuke Kinoshita
HCHonza Cernocky
Honza Cernocky
DYDong Yu
Dong Yu
Humans can listen to a target speaker even in challenging acoustic conditions that have noise, reverberation, and interfering speakers. This phenomenon is known as the cocktail party effect . For decades, researchers have focused on approaching the listening ability of humans. One critical issue is handling interfering speakers because the target and nontarget speech signals share similar characteristics, complicating their discrimination. Target speech/speaker extraction (TSE) isolates the speech signal of a target speaker from a mixture of several speakers, with or without noises and reverberations, using clues that identify the speaker in the mixture. Such clues might be a spatial clue indicating the direction of the target speaker, a video of the speaker’s lips, and a prerecorded enrollment utterance from which the speaker’s voice characteristics can be derived. TSE is an emerging field of research that has received increased attention in recent years because it offers a practical approach to the cocktail party problem and involves such aspects of signal processing as audio, visual, and array processing as well as deep learning. This article focuses on recent neural-based approaches and presents an in-depth overview of TSE. We guide readers through the different major approaches, emphasizing the similarities among frameworks and discussing potential future directions.

14 December 2023 in IEEE Open Journal of Signal Processing
Verified
Journal Article
Open access
KZKaterina Zmolikova
Katerina Zmolikova
MPMichael Syskind Pedersen
Michael Syskind Pedersen
JJJesper Jensen
Jesper Jensen
Supervised learning-based speech enhancement methods often work remarkably well in acoustic situations represented in the training corpus but generalize poorly to out-of-domain situations, i.e. situations not seen during training. This stands in the way of further improvement of these methods in realistic scenarios, as collecting paired noisy-clean recordings in the target application domain is typically not feasible. Recording noisy-only in-domain data is, though, much more practical. In this paper, we tackle the problem of unsupervised domain adaptation in speech enhancement. Specifically, we propose a way to use in-domain noisy-only data in the training of a neural network to improve upon a model trained solely on out-of-domain paired data. For this, we make use of masked spectrogram prediction, a technique from self-supervised learning that aims to interpolate masked regions of a spectrogram. We hypothesize that masked spectrogram prediction encourages learning of features that represent well both speech and noise components of the noisy signals. These features can then be used to train a more robust speech enhancement system. We evaluate the proposed method on the VoiceBank-DEMAND and LibriFSD50k databases, with WSJ0-CHiME3 serving as the out-of-domain database. We show that the proposed method outperforms both the out-of-domain system and the baseline approaches, i.e. RemixIT and noisy-target training, and also combines well with the previously proposed RemixIT method.

18 September 2022
Verified
Conference Paper
Open access
MKMartin Kocour
Martin Kocour
KZKaterina Zmolikova
Katerina Zmolikova
Lucas OndelLucas Ondel
Lucas Ondel
JSJan Svec
Jan Svec
MDMarc Delcroix
Marc Delcroix
HCHonza Cernocky
Honza Cernocky