Fahim Dalvi

Fahim Dalvi

Auto-generated profile, based on publicly available information

Fahim Dalvi

Qatar Computing Research Institute HBKU Qatar

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 July 2022 in Computer Speech & Language
Verified
Journal Article
Closed access
HSHassan Sajjad
Hassan Sajjad
FDFahim Dalvi
Fahim Dalvi
NDNadir Durrani
Nadir Durrani
PNPreslav Nakov
Preslav Nakov

22 November 2022 in Transactions of the Association for Computational Linguistics
Verified
Journal Article
Open access
PDF file
HSHassan Sajjad
Hassan Sajjad
NDNadir Durrani
Nadir Durrani
FDFahim Dalvi
Fahim Dalvi
The proliferation of Deep Neural Networks in various domains has seen an increased need for interpretability of these models. Preliminary work done along this line, and papers that surveyed such, are focused on high-level representation analysis. However, a recent branch of work has concentrated on interpretability at a more granular level of analyzing neurons within these models. In this paper, we survey the work done on neuron analysis including: i) methods to discover and understand neurons in a network; ii) evaluation methods; iii) major findings including cross architectural comparisons that neuron analysis has unraveled; iv) applications of neuron probing such as: controlling the model, domain adaptation, and so forth; and v) a discussion on open issues and future research directions.

1 January 2024
Verified
Conference Paper
Open access
PDF file
XYXuemin Yu
Xuemin Yu
FDFahim Dalvi
Fahim Dalvi
NDNadir Durrani
Nadir Durrani
MNMarzia Nouri
Marzia Nouri
HSHassan Sajjad
Hassan Sajjad
Xuemin Yu, Fahim Dalvi, Nadir Durrani, Marzia Nouri, Hassan Sajjad. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.

1 January 2021
Verified
Conference Paper
Open access
PDF file
HSHassan Sajjad
Hassan Sajjad
NKNarine Kokhlikyan
Narine Kokhlikyan
FDFahim Dalvi
Fahim Dalvi
NDNadir Durrani
Nadir Durrani
Hassan Sajjad, Narine Kokhlikyan, Fahim Dalvi, Nadir Durrani. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Tutorials. 2021.

14 January 2024 in arXiv
Verified
Preprint
Open access
PDF file
NDNadir Durrani
Nadir Durrani
FDFahim Dalvi
Fahim Dalvi
HSHassan Sajjad
Hassan Sajjad
While a lot of work has been done in understanding representations learned within deep NLP models and what knowledge they capture, little attention has been paid towards individual neurons. We present a technique called as Linguistic Correlation Analysis to extract salient neurons in the model, with respect to any extrinsic property - with the goal of understanding how such a knowledge is preserved within neurons. We carry out a fine-grained analysis to answer the following questions: (i) can we identify subsets of neurons in the network that capture specific linguistic properties? (ii) how localized or distributed neurons are across the network? iii) how redundantly is the information preserved? iv) how fine-tuning pre-trained models towards downstream NLP tasks, impacts the learned linguistic knowledge? iv) how do architectures vary in learning different linguistic properties? Our data-driven, quantitative analysis illuminates interesting findings: (i) we found small subsets of neurons that can predict different linguistic tasks, ii) with neurons capturing basic lexical information (such as suffixation) localized in lower most layers, iii) while those learning complex concepts (such as syntactic role) predominantly in middle and higher layers, iii) that salient linguistic neurons are relocated from higher to lower layers during transfer learning, as the network preserve the higher layers for task specific information, iv) we found interesting differences across pre-trained models, with respect to how linguistic information is preserved within, and v) we found that concept exhibit similar neuron distribution across different languages in the multilingual transformer models. Our code is publicly available as part of the NeuroX toolkit.

16 November 2022 in arXiv
Verified
Preprint
Open access
PDF file
AAAhmed Abdelali
Ahmed Abdelali
NDNadir Durrani
Nadir Durrani
CDCenk Demiroglu
Cenk Demiroglu
FDFahim Dalvi
Fahim Dalvi
HMHamdy Mubarak
Hamdy Mubarak
KDKareem Darwish
Kareem Darwish
NatiQ is end-to-end text-to-speech system for Arabic. Our speech synthesizer uses an encoder-decoder architecture with attention. We used both tacotron-based models (tacotron-1 and tacotron-2) and the faster transformer model for generating mel-spectrograms from characters. We concatenated Tacotron1 with the WaveRNN vocoder, Tacotron2 with the WaveGlow vocoder and ESPnet transformer with the parallel wavegan vocoder to synthesize waveforms from the spectrograms. We used in-house speech data for two voices: 1) neutral male "Hamza"- narrating general content and news, and 2) expressive female "Amina"- narrating children story books to train our models. Our best systems achieve an average Mean Opinion Score (MOS) of 4.21 and 4.40 for Amina and Hamza respectively. The objective evaluation of the systems using word and character error rate (WER and CER) as well as the response time measured by real-time factor favored the end-to-end architecture ESPnet. NatiQ demo is available on-line at https://tts.qcri.org