25 April 2025 in ACM Transactions on Computing for Healthcare
The segmentation of glioma is crucial for early diagnosis, according to a World Health Organization (WHO) 2021 report. For glioma diagnosis, 3D multi-modal brain MRI/CT imaging has become an essential tool, offering detailed information. Nowadays, deep learning frameworks have been applied to various medical imaging problems, including brain glioma segmentation. Recently, foundation models like Segment Anything Model (SAM) have emerged as pivotal tools in computer vision tasks. These models are trained using large (real-world) datasets, offering a generalized understanding of visual data and semantic key features. Therefore, the effective utilization of foundation models in medical imaging is a significant area of current research. However, the differences in data distribution between multi-modal medical images and real-world images present challenges in directly applying foundation models to medical imaging. Additionally, utilizing multi-modal images to extract crucial information and its fusion poses further challenges. To address these issues, we propose a framework using foundation model and novel strategies for multi-modal fusion. Our fusion adapters effectively integrate the information from different modalities to enhance glioma segmentation in multi-modal MRI scans. Our method outperforms current state-of-the-art methods for accurate segmentation of the glioma using private and publicly available brain MRI datasets, proving the effectiveness of our approach across different datasets and imaging modalities.
13 December 2025 in Biomedical Signal Processing and Control
22 June 2026 in ACM Transactions on Computing for Healthcare
Depression, a pervasive mental health condition, affects millions globally, challenging early and accurate diagnosis due to its subtle and varied manifestations. Recognizing the critical link between emotional dysregulation and depressive symptoms, our research introduces a pioneering training paradigm that integrates sentiment analysis with depression detection. This approach is motivated by the potential of sentiment data to enrich models with a deeper understanding of emotional states, crucial for identifying depressive patterns. To leverage the nuanced sentiment information without compromising the pretrained model’s integrity, we employ deep prefix tuning. This novel technique allows for targeted model refinement, ensuring that the valuable pretrained structures are not overshadowed by the sparse and specific nature of depression-related data. The empirical results demonstrate superior performance across standard benchmarks, setting a new precedent for multimodal depression detection.
12 June 2026 in IEEE Journal of Biomedical and Health Informatics
Explainable artificial intelligence (XAI) is increasingly important for computational pathology, where reliable and interpretable predictions are required for clinical use. Pre-trained Vision-Language Models (VLMs) offer a natural pathway to connect visual evidence with textual concepts, but adapting them to the domain of cancer pathology remains challenging due to fine-grained and heterogeneous morphological patterns. Visual prompt learning enables efficient task adaptation with minimal fine-tuning; however, existing prompting techniques face critical limitations: soft prompts often lack clinical specificity, while manually designed hard prompts reduce adaptability. To address these issues, we propose RAPT, a retrieval-augmented and text-guided visual prompting framework for explainable pathology classification. Given an input image, RAPT retrieves semantically related exemplars and leverages class-specific textual descriptions to construct disease-aware prompt tokens, injecting diagnostic cues without manual annotation. An adaptive weighting mechanism attenuates unreliable retrieval evidence, and bridge prompt tokens facilitate the integration of retrieved cues with image representations. Extensive experiments on three public cancer pathology datasets (PatchGastric, BACH, and LC25000) demonstrate that RAPT consistently outperforms prompting baselines across diverse backbone settings. Additional analyses and qualitative case studies demonstrate clinically actionable cues, robustness to imperfect retrieval, and clear failure-mode boundaries for trustworthy pathology decision support, highlighting the potential of robust and explainable prompting for computational pathology.
30 September 2025 in Displays