Nadir Durrani

Dr. Nadir Durrani


Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 November 2022 in Transactions of the Association for Computational Linguistics
Verified
Journal Article
Open access
PDF file
HSHassan Sajjad
Hassan Sajjad
NDNadir Durrani
Nadir Durrani
FDFahim Dalvi
Fahim Dalvi
The proliferation of Deep Neural Networks in various domains has seen an increased need for interpretability of these models. Preliminary work done along this line, and papers that surveyed such, are focused on high-level representation analysis. However, a recent branch of work has concentrated on interpretability at a more granular level of analyzing neurons within these models. In this paper, we survey the work done on neuron analysis including: i) methods to discover and understand neurons in a network; ii) evaluation methods; iii) major findings including cross architectural comparisons that neuron analysis has unraveled; iv) applications of neuron probing such as: controlling the model, domain adaptation, and so forth; and v) a discussion on open issues and future research directions.

1 January 2024
Verified
Conference Paper
Open access
PDF file
BMBasel Mousi
Basel Mousi
NDNadir Durrani
Nadir Durrani
FDFahim Dalvi
Fahim Dalvi
MHMajd Hawasly
Majd Hawasly
AAAhmed Abdelali
Ahmed Abdelali
Basel Mousi, Nadir Durrani, Fahim Dalvi, Majd Hawasly, Ahmed Abdelali. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

1 January 2023
Verified
Conference Paper
Open access
PDF file
BMBasel Mousi
Basel Mousi
NDNadir Durrani
Nadir Durrani
FDFahim Dalvi
Fahim Dalvi
Basel Mousi, Nadir Durrani, Fahim Dalvi. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.

1 January 2024
Verified
Conference Paper
Open access
PDF file
XYXuemin Yu
Xuemin Yu
FDFahim Dalvi
Fahim Dalvi
NDNadir Durrani
Nadir Durrani
MNMarzia Nouri
Marzia Nouri
HSHassan Sajjad
Hassan Sajjad
Xuemin Yu, Fahim Dalvi, Nadir Durrani, Marzia Nouri, Hassan Sajjad. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.

26 June 2023 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
FAFiroj Alam
Firoj Alam
FDFahim Dalvi
Fahim Dalvi
NDNadir Durrani
Nadir Durrani
HSHassan Sajjad
Hassan Sajjad
AKAbdul Rafae Khan
Abdul Rafae Khan
JXJia Xu
Jia Xu
The opacity of deep neural networks remains a challenge in deploying solutions where explanation is as important as precision. We present ConceptX, a human-in-the-loop framework for interpreting and annotating latent representational space in pre-trained Language Models (pLMs). We use an unsupervised method to discover concepts learned in these models and enable a graphical interface for humans to generate explanations for the concepts. To facilitate the process, we provide auto-annotations of the concepts (based on traditional linguistic ontologies). Such annotations enable development of a linguistic resource that directly represents latent concepts learned within deep NLP models. These include not just traditional linguistic concepts, but also task-specific or sensitive concepts (words grouped based on gender or religious connotation) that helps the annotators to mark bias in the model. The framework consists of two parts (i) concept discovery and (ii) annotation platform.

1 January 2025
Verified
Conference Paper
Open access
PDF file
NDNadir Durrani
Nadir Durrani
BMBasel Mousi
Basel Mousi
FDFahim Dalvi
Fahim Dalvi
Nadir Durrani, Basel Mousi, Fahim Dalvi. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing. 2025.