Yossi Adi

Yossi Adi

Auto-generated profile, based on publicly available information

Yossi Adi

Facebook AI Research

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 August 2022 in IEEE Journal of Selected Topics in Signal Processing
Verified
Journal Article
Open access
ETEfthymios Tzinis
Efthymios Tzinis
YAYossi Adi
Yossi Adi
VIVamsi K. Ithapu
Vamsi K. Ithapu
BXBuye Xu
Buye Xu
PSParis Smaragdis
Paris Smaragdis
AKAnurag Kumar
Anurag Kumar
We present RemixIT, a simple yet effective self-supervised method for training speech enhancement without the need of a single isolated in-domain speech nor a noise waveform. Our approach overcomes limitations of previous methods which make them dependent on clean in-domain target signals and thus, sensitive to any domain mismatch between train and test samples. RemixIT is based on a continuous self-training scheme in which a pre-trained teacher model on out-of-domain data infers estimated pseudo-target signals for in-domain mixtures. Then, by permuting the estimated clean and noise signals and remixing them together, we generate a new set of bootstrapped mixtures and corresponding pseudo-targets which are used to train the student network. Vice-versa, the teacher periodically refines its estimates using the updated parameters of the latest student models. Experimental results on multiple speech enhancement datasets and tasks not only show the superiority of our method over prior approaches but also showcase that RemixIT can be combined with any separation model as well as be applied towards any semi-supervised and unsupervised domain adaptation task. Our analysis, paired with empirical evidence, sheds light on the inside functioning of our self-training scheme wherein the student model keeps obtaining better performance while observing severely degraded pseudo-targets.

20 August 2023
Verified
Conference Paper
Open access
TNTu Anh Nguyen
Tu Anh Nguyen
WHWei-Ning Hsu
Wei-Ning Hsu
ADAntony D'AVirro
Antony D'AVirro
BSBowen Shi
Bowen Shi
IGItai Gat
Itai Gat
EDEmmanuel Dupoux
Emmanuel Dupoux

20 August 2023
Verified
Conference Paper
Closed access
GYGuy Yariv
Guy Yariv
IGItai Gat
Itai Gat
LWLior Wolf
Lior Wolf
YAYossi Adi
Yossi Adi
ISIdan Schwartz
Idan Schwartz

11 December 2020 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
KTKe Tan
Ke Tan
BXBuye Xu
Buye Xu
AKAnurag Kumar
Anurag Kumar
ENEliya Nachmani
Eliya Nachmani
YAYossi Adi
Yossi Adi
Most existing deep learning based binaural speaker separation systems focus on producing a monaural estimate for each of the target speakers, and thus do not preserve the interaural cues, which are crucial for human listeners to perform sound localization and lateralization. In this study, we address talker-independent binaural speaker separation with interaural cues preserved in the estimated binaural signals. Specifically, we extend a newly-developed gated recurrent neural network for monaural separation by additionally incorporating self-attention mechanisms and dense connectivity. We develop an end-to-end multiple-input multiple-output system, which directly maps from the binaural waveform of the mixture to those of the speech signals. The experimental results show that our proposed approach achieves significantly better separation performance than a recent binaural separation approach. In addition, our approach effectively preserves the interaural cues, which improves the accuracy of sound localization.

6 June 2021
Verified
Conference Paper
Open access
SCShlomo E. Chazan
Shlomo E. Chazan
LWLior Wolf
Lior Wolf
ENEliya Nachmani
Eliya Nachmani
YAYossi Adi
Yossi Adi
We present a unified network for voice separation of an unknown number of speakers. The proposed approach is composed of several separation heads optimized together with a speaker classification branch. The separation is carried out in the time domain, together with parameter sharing between all separation heads. The classification branch estimates the number of speakers while each head is specialized in separating a different number of speakers. We evaluate the proposed model under both clean and noisy reverberant settings. Results suggest that the proposed approach is superior to the baseline model by a significant margin. Additionally, we present a new noisy and reverberant dataset of up to five different speakers speaking simultaneously.

1 September 2015
Verified
Conference Paper
Open access
YAYossi Adi
Yossi Adi
JKJoseph Keshet
Joseph Keshet
MGMatthew Goldrick
Matthew Goldrick
Vowel durations are most often utilized in studies addressing specific issues in phonetics. Thus far this has been hampered by a reliance on subjective, labor-intensive manual annotation. Our goal is to build an algorithm for automatic accurate measurement of vowel duration, where the input to the algorithm is a speech segment contains one vowel preceded and followed by consonants (CVC). Our algorithm is based on a deep neural network trained at the frame level on manually annotated data from a phonetic study. Specifically, we try two deep-network architectures: convolutional neural network (CNN), and deep belief network (DBN), and compare their accuracy to an HMM-based forced aligner. Results suggest that CNN is better than DBN, and both CNN and HMM-based forced aligner are comparable in their results, but neither of them yielded the same predictions as models fit to manually annotated data.