Mitesh M. Khapra

Mitesh M. Khapra

Auto-generated profile, based on publicly available information

Mitesh M. Khapra

Indian Institute of Technology Madras India

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 February 2022 in Transactions of the Association for Computational Linguistics
Verified
Journal Article
Open access
PDF file
GRGowtham Ramesh
Gowtham Ramesh
SDSumanth Doddapaneni
Sumanth Doddapaneni
ABAravinth Bheemaraj
Aravinth Bheemaraj
MJMayank Jobanputra
Mayank Jobanputra
RARaghavan Ak
Raghavan Ak
MKMitesh Shantadevi Khapra
Mitesh Shantadevi Khapra
We present Samanantar, the largest publicly available parallel corpora collection for Indic languages. The collection contains a total of 49.7 million sentence pairs between English and 11 Indic languages (from two language families). Specifically, we compile 12.4 million sentence pairs from existing, publicly available parallel corpora, and additionally mine 37.4 million sentence pairs from the Web, resulting in a 4× increase. We mine the parallel sentences from the Web by combining many corpora, tools, and methods: (a) Web-crawled monolingual corpora, (b) document OCR for extracting sentences from scanned documents, (c) multilingual representation models for aligning sentences, and (d) approximate nearest neighbor search for searching in a large collection of sentences. Human evaluation of samples from the newly mined corpora validate the high quality of the parallel sentences across 11 languages. Further, we extract 83.4 million sentence pairs between all 55 Indic language pairs from the English-centric parallel corpus using English as the pivot language. We trained multilingual NMT models spanning all these languages on Samanantar which outperform existing models and baselines on publicly available benchmarks, such as FLORES, establishing the utility of Samanantar. Our data and models are available publicly at Samanantar and we hope they will help advance research in NMT and multilingual NLP for Indic languages.

17 July 2023 in ACM Computing Surveys
Verified
Journal Article
Open access
SGShreya Goyal
Shreya Goyal
SDSumanth Doddapaneni
Sumanth Doddapaneni
MKMitesh M. Khapra
Mitesh M. Khapra
BRBalaraman Ravindran
Balaraman Ravindran
In the past few years, it has become increasingly evident that deep neural networks are not resilient enough to withstand adversarial perturbations in input data, leaving them vulnerable to attack. Various authors have proposed strong adversarial attacks for computer vision and Natural Language Processing (NLP) tasks. As a response, many defense mechanisms have also been proposed to prevent these networks from failing. The significance of defending neural networks against adversarial attacks lies in ensuring that the model’s predictions remain unchanged even if the input data is perturbed. Several methods for adversarial defense in NLP have been proposed, catering to different NLP tasks such as text classification, named entity recognition, and natural language inference. Some of these methods not only defend neural networks against adversarial attacks but also act as a regularization mechanism during training, saving the model from overfitting. This survey aims to review the various methods proposed for adversarial defenses in NLP over the past few years by introducing a novel taxonomy. The survey also highlights the fragility of advanced deep neural networks in NLP and the challenges involved in defending them.

1 January 2024
Verified
Conference Paper
Open access
PDF file
MKMohammed Khan
Mohammed Khan
PMPriyam Mehta
Priyam Mehta
ASAnanth Sankar
Ananth Sankar
UKUmashankar Kumaravelan
Umashankar Kumaravelan
SDSumanth Doddapaneni
Sumanth Doddapaneni
MKMitesh M. Khapra
Mitesh M. Khapra
Mohammed Khan, Priyam Mehta, Ananth Sankar, Umashankar Kumaravelan, Sumanth Doddapaneni, Suriyaprasaad B, Varun G, Sparsh Jain, Anoop Kunchukuttan, Pratyush Kumar, Raj Dabre, Mitesh Khapra. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

6 May 2025 in ACM Computing Surveys
Verified
Journal Article
Open access
SDSumanth Doddapaneni
Sumanth Doddapaneni
GRGowtham Ramesh
Gowtham Ramesh
MKMitesh Khapra
Mitesh Khapra
AKAnoop Kunchukuttan
Anoop Kunchukuttan
PKPratyush Kumar
Pratyush Kumar
Multilingual Language Models (MLLMs) such as mBERT, XLM, XLM-R, and the like, have emerged as a viable option for bringing the power of pretraining to a large number of languages. Given their success in zero-shot transfer learning, there has emerged a large body of work in (i) building bigger MLLMs covering a large number of languages, (ii) creating exhaustive benchmarks covering a wider variety of tasks and languages for evaluating MLLMs, (iii) analysing the performance of MLLMs on monolingual, zero-shot cross-lingual and bilingual tasks, (iv) understanding the universal language patterns (if any) learnt by MLLMs, and (v) augmenting the (often) limited capacity of MLLMs to improve their performance on seen or even unseen languages. In this survey, we review the existing literature covering the above broad areas of research pertaining to MLLMs. Based on our survey, we recommend some promising directions of future research.

26 June 2023 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
TJTahir Javed
Tahir Javed
KBKaushal Bhogale
Kaushal Bhogale
ARAbhigyan Raman
Abhigyan Raman
PKPratyush Kumar
Pratyush Kumar
AKAnoop Kunchukuttan
Anoop Kunchukuttan
MKMitesh M. Khapra
Mitesh M. Khapra
A cornerstone in AI research has been the creation and adoption of standardized training and test datasets to earmark the progress of state-of-the-art models. A particularly successful example is the GLUE dataset for training and evaluating Natural Language Understanding (NLU) models for English. The large body of research around self-supervised BERT-based language models revolved around performance improvements on NLU tasks in GLUE. To evaluate language models in other languages, several language-specific GLUE datasets were created. The area of speech language understanding (SLU) has followed a similar trajectory. The success of large self-supervised models such as wav2vec2 enable creation of speech models with relatively easy to access unlabelled data. These models can then be evaluated on SLU tasks, such as the SUPERB benchmark. In this work, we extend this to Indic languages by releasing the IndicSUPERB benchmark. Specifically, we make the following three contributions. (i) We collect Kathbath containing 1,684 hours of labelled speech data across 12 Indian languages from 1,218 contributors located in 203 districts in India. (ii) Using Kathbath, we create benchmarks across 6 speech tasks: Automatic Speech Recognition, Speaker Verification, Speaker Identification (mono/multi), Language Identification, Query By Example, and Keyword Spotting for 12 languages. (iii) On the released benchmarks, we train and evaluate different self-supervised models alongside the a commonly used baseline FBANK. We show that language-specific fine-tuned models are more accurate than baseline on most of the tasks, including a large gap of 76% for Language Identification task. However, for speaker identification, self-supervised models trained on large datasets demonstrate an advantage. We hope IndicSUPERB contributes to the progress of developing speech language understanding models for Indian languages.

1 January 2023
Verified
Conference Paper
Open access
PDF file
YMYash Madhani
Yash Madhani
SPSushane Parthan
Sushane Parthan
PBPriyanka Bedekar
Priyanka Bedekar
GNGokul Nc
Gokul Nc
RKRuchi Khapra
Ruchi Khapra
MKMitesh M. Khapra
Mitesh M. Khapra
Yash Madhani, Sushane Parthan, Priyanka Bedekar, Gokul Nc, Ruchi Khapra, Anoop Kunchukuttan, Pratyush Kumar, Mitesh Khapra. Findings of the Association for Computational Linguistics: EMNLP 2023. 2023.