Diwakar Mahajan

Diwakar Mahajan

Auto-generated profile, based on publicly available information

Diwakar Mahajan

IBM TJ Watson Research Center 1101 Kitchawan Rd. Yorktown Heights NY USA

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 November 2020 in JMIR Medical Informatics
Verified
Journal Article
Open access
DMDiwakar Mahajan
Diwakar Mahajan
APAnanya Poddar
Ananya Poddar
JLJennifer J Liang
Jennifer J Liang
YLYen-Ting Lin
Yen-Ting Lin
JPJohn M Prager
John M Prager
CTChing-Huei Tsou
Ching-Huei Tsou
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Although electronic health records (EHR) have been widely adopted in healthcare, effective use of EHR data is often limited due to redundant information in clinical notes introduced by use of templates and copy-paste during note generation. Thus, it is imperative to develop solutions that can condense information while retaining its value. A step in this direction is measuring the semantic similarity between clinical text snippets. To address this problem, we participated in the 2019 National NLP Clinical Challenges (n2c2) / Open Health Natural Language Processing Consortium (OHNLP) Clinical Semantic Textual Similarity (ClinicalSTS) shared task. Objective: This study aims to improve the performance and robustness of semantic textual similarity in the clinical domain by leveraging manually labeled data from related tasks and contextualized embeddings from pretrained transformer-based language models. Methods: The ClinicalSTS dataset consists of 1,642 pairs of de-identified clinical text snippets annotated in a continuous scale of 0-5 indicating degrees of semantic similarity. We developed Iterative Intermediate Training approach using Multi-Task Learning (IIT-MTL), a multi-task training approach that employs iterative dataset selection. We applied this process on ClinicalBERT, a pretrained domain-specific transformer-based language model, and fine-tuned the resulting model on the target ClinicalSTS task. We incrementally ensembled the output from applying IIT-MTL on ClinicalBERT with (1) output of other language models (BioBERT, MT-DNN, RoBERTa) and (2) hand-crafted features using regression-based learning algorithms. Based on these experiments, we adopted the top performing configurations as our official submissions. Results: Our system placed first out of 87 submitted systems in the 2019 n2c2/OHNLP ClinicalSTS challenge, achieving state-of-the-art results with a Pearson correlation coefficient of 0.9010. This winning system was an ensembled model leveraging the output of IIT-MTL on ClinicalBERT with BioBERT, MT-DNN and hand-crafted medication features. Conclusions: This study demonstrates that IIT-MTL is an effective way to leverage annotated data from related tasks to improve performance on a target task with a limited dataset. This contribution opens to the community new avenues of exploration for optimized dataset selection in order to generate more robust and universal contextual representations of text in clinical domain.

25 March 2021 in Scientific Data
Verified
Journal Article
Open access
PDF file
PSParthasarathy Suryanarayanan
Parthasarathy Suryanarayanan
CTChing-Huei Tsou
Ching-Huei Tsou
APAnanya Poddar
Ananya Poddar
DMDiwakar Mahajan
Diwakar Mahajan
BDBharath Dandala
Bharath Dandala
MRMichal Rosen-Zvi
Michal Rosen-Zvi
The Coronavirus disease 2019 (COVID-19) global pandemic has transformed almost every facet of human society throughout the world. Against an emerging, highly transmissible disease, governments worldwide have implemented non-pharmaceutical interventions (NPIs) to slow the spread of the virus. Examples of such interventions include community actions, such as school closures or restrictions on mass gatherings, individual actions including mask wearing and self-quarantine, and environmental actions such as cleaning public facilities. We present the Worldwide Non-pharmaceutical Interventions Tracker for COVID-19 (WNTRAC), a comprehensive dataset consisting of over 6,000 NPIs implemented worldwide since the start of the pandemic. WNTRAC covers NPIs implemented across 261 countries and territories, and classifies NPIs into a taxonomy of 16 NPI types. NPIs are automatically extracted daily from Wikipedia articles using natural language processing techniques and then manually validated to ensure accuracy and veracity. We hope that the dataset will prove valuable for policymakers, public health leaders, and researchers in modeling and analysis efforts to control the spread of COVID-19.

28 January 2026 in Advanced Science
Verified
Journal Article
Open access
PSParthasarathy Suryanarayanan
Parthasarathy Suryanarayanan
YQYunguang Qiu
Yunguang Qiu
SSShreyans Sethi
Shreyans Sethi
DMDiwakar Mahajan
Diwakar Mahajan
HLHongyang Li
Hongyang Li
JMJoseph A. Morrone
Joseph A. Morrone
Molecular foundation models hold promise to provide accurate predictions for a large and diverse set of downstream tasks in bio‐medical research. Quality molecular representations are key and foundation model development has typically focused on a single representation or molecular view, which may have strengths or weaknesses on a given task. We develop Multi‐view Molecular Embedding with Late Fusion (MMELON), an approach that integrates pre‐trained graph, image and text foundation models and may be readily extended to additional views and models. The multi‐view model performs robustly and is validated on over 120 tasks, including molecular solubility, ADME properties, and activity against G Protein‐Coupled receptors (GPCRs). The GPCR model array is leveraged to perform a virtual screen in search of ligands binding to Alzheimer's disease related GPCRs. We identify a number of such targets and employ the multi‐view model to select strong binders from a compound screen. Predictions are validated through structure‐based modeling and identification of key binding motifs.

1 August 2024
Verified
Conference Paper
Open access
PDF file
BKBum Chul Kwon
Bum Chul Kwon
SRSimona Rabinovici-Cohen
Simona Rabinovici-Cohen
BMBeldine Moturi
Beldine Moturi
RMRuth Mwaura
Ruth Mwaura
KWKezia Wahome
Kezia Wahome
WCWendy Cornell
Wendy Cornell
Biomedical foundation models, trained on diverse sources of small molecule data, hold great potential for accelerating drug discovery. However, their complex nature often presents a barrier for researchers seeking scientific insights and drug candidate generation. SPARK addresses this challenge by providing a user-friendly, web-based interface that empowers researchers to leverage these powerful models in their scientific workflows. Through SPARK, users can specify target proteins and desired molecule properties, adjust pre-trained models for tailored inferences, generate lists of potential drug candidates, analyze and compare molecules through interactive visualizations, and filter candidates based on key metrics (e.g., toxicity). By seamlessly integrating human knowledge and biomedical AI models' capabilities through an interactive web-based system, SPARK can improve the efficiency of collaboration between human experts and AI, thereby accelerating drug candidate discovery and ultimately leading to breakthroughs in finding cures for various diseases.

1 October 2025 in arXiv
Verified
Preprint
Open access
PDF file
CTChing-Huei Tsou
Ching-Huei Tsou
MOMichal Ozery-Flato
Michal Ozery-Flato
EBElla Barkan
Ella Barkan
DMDiwakar Mahajan
Diwakar Mahajan
BSBen Shapira
Ben Shapira
Recent advances in large language models (LLMs) and biomedical foundation models (BioFMs) have achieved strong results in biological text reasoning, molecular modeling, and single-cell analysis, yet they remain siloed in disjoint embedding spaces, limiting cross-modal reasoning. We present BIOVERSE (Biomedical Vector Embedding Realignment for Semantic Engagement), a two-stage approach that adapts pretrained BioFMs as modality encoders and aligns them with LLMs through lightweight, modality-specific projection layers. The approach first aligns each modality to a shared LLM space through independently trained projections, allowing them to interoperate naturally, and then applies standard instruction tuning with multi-modal data to bring them together for downstream reasoning. By unifying raw biomedical data with knowledge embedded in LLMs, the approach enables zero-shot annotation, cross-modal question answering, and interactive, explainable dialogue. Across tasks spanning cell-type annotation, molecular description, and protein function reasoning, compact BIOVERSE configurations surpass larger LLM baselines while enabling richer, generative outputs than existing BioFMs, establishing a foundation for principled multi-modal biomedical reasoning.

19 May 2021 in arXiv
Verified
Preprint
Open access
PDF file
DMDiwakar Mahajan
Diwakar Mahajan
JLJennifer J Liang
Jennifer J Liang
CTChing-Huei Tsou
Ching-Huei Tsou
Understanding medication events in clinical narratives is essential to achieving a complete picture of a patient's medication history. While prior research has explored classification of medication changes from clinical notes, studies to date have not considered the necessary clinical context needed for their use in real-world applications, such as medication timeline generation and medication reconciliation. In this paper, we present the Contextualized Medication Event Dataset (CMED), a dataset for capturing relevant context of medication changes documented in clinical notes, which was developed using a novel conceptual framework that organizes context for clinical events into various orthogonal dimensions. In this process, we define specific contextual aspects pertinent to medication change events, characterize the dataset, and report the results of preliminary experiments. CMED consists of 9,013 medication mentions annotated over 500 clinical notes, and will be released to the community as a shared task in 2021.