Daniel Stoller

Daniel Stoller

Auto-generated profile, based on publicly available information

Daniel Stoller

Queen Mary University of London

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 September 2019
Verified
Conference Paper
Closed access
BCBhusan Chettri
Bhusan Chettri
DSDaniel Stoller
Daniel Stoller
VMVeronica Morfi
Veronica Morfi
MRMarco A Martínez Ramírez
Marco A Martínez Ramírez
Emmanouil BenetosEmmanouil Benetos
Emmanouil Benetos
BSBob L. Sturm
Bob L. Sturm

1 April 2018
Verified
Conference Paper
Closed access
DSDaniel Stoller
Daniel Stoller
SESebastian Ewert
Sebastian Ewert
SDSimon Dixon
Simon Dixon
The state of the art in music source separation employs neural networks trained in a supervised fashion on multi-track databases to estimate the sources from a given mixture. With only few datasets available, often extensive data augmentation is used to combat overfitting. Mixing random tracks, however, can even reduce separation performance as instruments in real music are strongly correlated. The key concept in our approach is that source estimates of an optimal separator should be indistinguishable from real source signals. Based on this idea, we drive the separator towards outputs deemed as realistic by discriminator networks that are trained to tell apart real from separator samples. This way, we can also use unpaired source and mixture recordings without the drawbacks of creating unrealistic music mixtures. Our framework is widely applicable as it does not assume a specific network architecture or number of sources. To our knowledge, this is the first adoption of adversarial training for music source separation. In a prototype experiment for singing voice separation, separation performance increases with our approach compared to purely supervised training.

1 May 2019
Verified
Conference Paper
Closed access
DSDaniel Stoller
Daniel Stoller
SDSimon Durand
Simon Durand
SESebastian Ewert
Sebastian Ewert
Time-aligned lyrics can enrich the music listening experience by enabling karaoke, text-based song retrieval and intra-song navigation, and other applications. Compared to text-to-speech alignment, lyrics alignment remains highly challenging, despite many attempts to combine numerous sub-modules including vocal separation and detection in an effort to break down the problem. Furthermore, training required fine-grained annotations to be available in some form. Here, we present a novel system based on a modified Wave-U-Net architecture, which predicts character probabilities directly from raw audio using learnt multi-scale representations of the various signal components. There are no sub-modules whose interdependencies need to be optimized. Our training procedure is designed to work with weak, line-level annotations available in the real world. With a mean alignment error of 0.35s on a standard dataset our system outperforms the state-of-the-art by an order of magnitude.


8 June 2018 in arXiv
Verified
Preprint
Open access
PDF file
DSDaniel Stoller
Daniel Stoller
SESebastian Ewert
Sebastian Ewert
SDSimon Dixon
Simon Dixon
Models for audio source separation usually operate on the magnitude spectrum, which ignores phase information and makes separation performance dependant on hyper-parameters for the spectral front-end. Therefore, we investigate end-to-end source separation in the time-domain, which allows modelling phase information and avoids fixed spectral transformations. Due to high sampling rates for audio, employing a long temporal input context on the sample level is difficult, but required for high quality separation results because of long-range temporal correlations. In this context, we propose the Wave-U-Net, an adaptation of the U-Net to the one-dimensional time domain, which repeatedly resamples feature maps to compute and combine features at different time scales. We introduce further architectural improvements, including an output layer that enforces source additivity, an upsampling technique and a context-aware prediction framework to reduce output artifacts. Experiments for singing voice separation indicate that our architecture yields a performance comparable to a state-of-the-art spectrogram-based U-Net architecture, given the same data. Finally, we reveal a problem with outliers in the currently used SDR evaluation metrics and suggest reporting rank-based statistics to alleviate this problem.

6 June 2018 in Journal of New Music Research
Verified
Journal Article
Closed access
DSDaniel Stoller
Daniel Stoller
IVIgor Vatolkin
Igor Vatolkin
HMHeinrich Müller
Heinrich Müller
A promising approach to create new versions of existing music pieces automatically is to cut out and rearrange sections so that transitions are minimally perceptible and constraints regarding duration or structure are fulfilled. We evaluate previous work and improve on its limitations, particularly the disregard for loudness changes at cuts and the unintuitive control over the musical structure of the output. Our software provides a user-friendly interface, which we make more responsive by greatly accelerating the search for an optimal output track using the A* algorithm. Listening experiments demonstrate an improvement in perceived audio quality.