Maneesh Bilalpur

Maneesh Bilalpur

Auto-generated profile, based on publicly available information

Maneesh Bilalpur

University of Pittsburgh, Pittsburgh, Pennsylvania, USA

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 October 2023
Verified
Conference Paper
Open access
MBManeesh Bilalpur
Maneesh Bilalpur
SHSaurabh Hinduja
Saurabh Hinduja
LCLaura Cariola
Laura Cariola
LSLisa B. Sheeber
Lisa B. Sheeber
NANicholas Allen
Nicholas Allen
JCJeffrey Cohn
Jeffrey Cohn
Depression strongly impacts parents’ behavior. Does parents’ depression strongly affect the behavior of their children as well? To investigate this question, we compared dyadic interactions between 73 depressed and 75 non-depressed mothers and their adolescent child. Families were of low income and 84% were white. Child behavior was measured from audio-video recordings using manual annotation of verbal and nonverbal behavior by expert coders and by multimodal computational measures of facial expression, face and head dynamics, prosody, speech behavior, and linguistics. For both sets of measures, we used Support Vector Machines. For computational measures, we investigated the relative contribution of single versus multiple modalities using a novel approach to SHapley Additive exPlanations (SHAP). Computational measures outperformed manual ratings by human experts. Among individual computational measures, prosody was the most informative. SHAP reduction resulted in a four-fold decrease in the number of features and highest performance (77% accuracy; positive and negative agreements at 75% and 76%, respectively). These findings suggest that maternal depression strongly impacts the behavior of adolescent children; differences are most revealed in prosody; multimodal features together with SHAP reduction are most powerful.

3 January 2025 in IEEE Transactions on Cognitive and Developmental Systems
Verified
Journal Article
Closed access
GSGulshan Sharma
Gulshan Sharma
SMSurbhi Madan
Surbhi Madan
MBManeesh Bilalpur
Maneesh Bilalpur
ADAbhinav Dhall
Abhinav Dhall
RSRamanathan Subramanian
Ramanathan Subramanian
Sonification is a data visualization technique which expresses data attributes via psychoacoustic parameters , which are non-speech audio signals used to convey information. This paper investigates the binary estimation of cognitive load induced by psychoacoustic parameters conveying the focus level of an astronomical image via Electroencephalogram (EEG) embeddings. Employing machine learning and deep learning methodologies, we demonstrate that EEG signals are reliable for (a) binary estimation of cognitive load, (b) isolating easy vs difficult visual-to- auditory perceptual mappings, and (c) capturing perceptual similarities among psychoacoustic parameters. Our key findings reveal that (1) EEG embeddings can reliably measure cognitive load, achieving a peak F1-score of 0.98; (2) Extreme focus levels are easier to detect via auditory mappings than intermediate ones, and (3) psychoacoustic parameters inducing comparable cognitive load levels tend to generate similar EEG encodings.

18 October 2022
Verified
Conference Paper
Closed access
MBManeesh Bilalpur
Maneesh Bilalpur
SHSaurabh Hinduja
Saurabh Hinduja
KGKenneth Goodrich
Kenneth Goodrich
JCJeffrey Cohn
Jeffrey Cohn
Smiles are highly variable. In some, contraction of the orbicularis oculi raises the cheeks and amplifies their intensity. In others, smile controls counteract the oblique pull of the zygomatic major, alter their shape, and decrease their intensity. Despite this variability, some features appear to be stereotypic. These features include a high correlation between the amplitude and velocity of smile onsets and same for smile offsets. The larger a smile's amplitude, the greater its velocity. This dependence is referred to as ballistic timing. In two relatively large publicly available databases (EB+ and Belfast), we tested the hypothesis of ballistic timing of smile onsets and offsets. We found high and consistent non-linear correlations between amplitude and velocity of both onsets and offsets that were robust to individual differences in persons (gender and ethnicity), context, presence or absence of the Duchenne marker, and country of residence (United States, Ireland, Peru). All $R_{2}$ exceeded 0.85. The findings were highly consistent with ballistic timing. They have implications for detecting smiles that may be posed (which have been found to violate ballistic timing) and for realistic synthesis of smiles in social robots and virtual humans. Smiles that depart from ballistic timing are likely to be perceived as false or uncanny.

11 June 2026 in JMIR Medical Informatics
Verified
Journal Article
Open access
MBManeesh Bilalpur
Maneesh Bilalpur
MHMegan E Hamm
Megan E Hamm
YLYoung Ji Lee
Young Ji Lee
NNNatasha G Norman
Natasha G Norman
KMKathleen M Mctigue
Kathleen M Mctigue
YWYanshan Wang
Yanshan Wang
Background: Existing work to understand adults’ health care experiences has focused on the analysis of patient feedback provided as written responses to after-visit surveys or social media discourse. Often, such written feedback has been studied using natural language processing techniques, such as topic detection and sentiment analysis, to provide coarse-grained insights. Storytelling is a powerful form of communication and may provide insights into factors contributing to gaps in health care outcomes and avenues for improvement. In addition, studying health care experiences using natural language processing techniques has been limited to patients. The experiences of stakeholders, such as caregivers and health care providers, remain underexplored. Objective: We extract fine-grained insights from health care experiences through narratives collected from patients, caregivers, and health care providers using large language models (LLMs). Topic detection, together with hierarchical summarization of long-form stories from individuals, offers fine-grained insights. Furthermore, the study demonstrates that generated summaries can be evaluated using the LLM-as-a-judge framework and validates the outcomes through comparisons with 2 domain experts. Methods: Fifty automatically transcribed stories of African American experiences were used to identify topics in their experiences using the latent Dirichlet allocation (LDA) technique. Stories about a given topic were summarized using an open-source LLM-based hierarchical summarization approach. Topic summaries were generated by summarizing across story summaries for each story that addressed a given topic. The generated topic summaries were rated for fabrication, accuracy, comprehensiveness, and usefulness by the GPT-4 model; its reliability was validated against the original story summaries by 2 domain experts. Results: Whisper-based automatic transcription of audio narrations achieved a Levenshtein score of 6%. Twenty-six topics were identified using LDA and labeled using the LLM in the 50 African American stories. The GPT-4 ratings suggest that topic summaries were free from fabrication, highly accurate, comprehensive, and useful. The reliability of GPT ratings compared to expert assessments showed moderate-to-high agreement (Bennett S -score of 0.65 or higher). Our approach identified African American experience-relevant topics, such as health behaviors, interactions with medical team members, caregiving, and symptom management, among others. Such insights could help researchers learn from unstructured datasets in an efficient manner—leveraging the communicative power of storytelling. Conclusions: The use of LDA and LLMs to identify and summarize the experiences of African American individuals suggests a variety of possible avenues for health research and possible clinical improvements to support patients and caregivers, thereby improving health outcomes.

5 October 2026
Verified
Conference Paper
Open access
MBManeesh Bilalpur
Maneesh Bilalpur
SHSaurabh Hinduja
Saurabh Hinduja
SSSonish Sivarajkumar
Sonish Sivarajkumar
YWYanshan Wang
Yanshan Wang
NANicholas Allen
Nicholas Allen
JCJeff Cohn
Jeff Cohn

14 July 2026 in JMIR Preprints
Verified
Preprint
Open access
HWHongjian Wang
Hongjian Wang
KMKatie Leigh Mullen
Katie Leigh Mullen
MSMinmei Shih
Minmei Shih
MBManeesh Bilalpur
Maneesh Bilalpur
JZJay Zeng
Jay Zeng
YWYanshan Wang
Yanshan Wang
BACKGROUND Strategy training is an evidence-based rehabilitation approach in which therapists guide stroke survivors to apply cognitive and metacognitive strategies to functional tasks with the goal of optimizing independence and recovery outcomes. Central to this intervention are therapist verbal cues, which are structured spoken prompts that support learning and strategy use. The type, frequency, and quality of these cues reflect how faithfully the intervention is being delivered. Systematic assessment of verbal cues is important for quality monitoring and therapist training; however, current assessment methods rely entirely on manual coding by trained human raters, making large-scale or real-time fidelity assessment impractical. OBJECTIVE This study evaluates large language models (LLMs) for automated analysis of therapist verbal cues in rehabilitation sessions and compares prompt-based and supervised fine-tuned LLM approaches against conventional natural language processing (NLP) approaches, such as Bidirectional Encoder Representations from Transformers (BERT), using both quantitative classification metrics and session-level qualitative assessment. METHODS Rehabilitation therapy session recordings from occupational therapy (OT), physical therapy (PT), and speech-language pathology (SLP) were transcribed and manually annotated to create a gold standard dataset of 3,833 therapist utterances labeled as directed, guided, or none. The dataset was split using a discipline-stratified design with a balanced training set and a naturally imbalanced test set. Models included a Bidirectional Encoder Representations from Transformers (BERT) baseline and LLM (GPT-5 mini, Qwen-2.5-7B, and Llama-3-8B. LLMs) evaluated using zero-shot, few-shot, and Low-Rank Adaptation (LoRA) fine-tuning. Performance was assessed using accuracy, precision, recall, and F1 score, with additional class-level evaluation and session-level fidelity assessment. RESULTS Fine-tuned LLMs achieved the highest performance, with Qwen-2.5-7B LoRA reaching 85.4% accuracy and a macro F1 score of 0.8638, outperforming BERT (77.1% accuracy; macro F1 0.7161) and prompt-based approaches. Class-level analysis showed that directed cues were most consistently identified, while guided cues and none categories were more challenging. Session-level quality assessment demonstrated that guided cue counts exceeded directed cue counts in all selected strategy training sessions, whereas pre-training sessions before therapist training showed higher or comparable directed cue counts. CONCLUSIONS Fine-tuned LLMs provide an effective approach for automated therapist cue classification and fidelity monitoring in rehabilitation, supporting future clinical implementation and evaluation across diverse settings.