27 October 2025 in IEEE Transactions on Neural Networks and Learning Systems
In the rapidly evolving field of AI research, foundational models like BERT and GPT have significantly advanced language and vision tasks. The advent of pretrain-prompting models, such as ChatGPT and segment anything model (SAM), has further revolutionized image segmentation. However, their applications in specialized areas, particularly in nuclei segmentation within medical imaging, reveal a key challenge: the generation of high-quality, informative prompts is as crucial as applying state-of-the-art (SOTA) fine-tuning techniques on foundation models. To address this, we introduce segment any cell (SAC), an innovative framework that enhances SAM specifically for nuclei segmentation. SAC integrates a low-rank adaptation (LoRA) within the attention layer of the Transformer to improve the fine-tuning process, outperforming existing SOTA methods. It also introduces an innovative auto-prompt generator that produces effective prompts to guide segmentation, a critical factor in handling the complexities of nuclei segmentation in biomedical imaging. Our extensive experiments demonstrate the superiority of SAC in nuclei segmentation tasks, proving its effectiveness as a tool for pathologists and researchers. Our contributions include a novel prompt generation strategy, automated adaptability for diverse segmentation tasks, the innovative application of low-rank attention adaptation in SAM, and a versatile framework for semantic and instance segmentation challenges.
19 January 2021 in Journal of Geovisualization and Spatial Analysis
Thousands of results of scientific publications on the topic of COVID-19 have emerged within a short time, raising significant challenges for scholars to organize the research, or even synthesize the knowledge in a timely or comprehensive manner. To facilitate this, we have developed a geospatial and semantic mapping platform to search and organize these large and unmapped digital collections. The semantic map visualizes research topics based on customized natural language processing algorithms, which helps users to identify their content of specific interest beyond keyword searches in web search engines. The resultant geospatial map extracts all the location names mentioned in the publications, illustrating where COVID-19 studies have been conducted and where neglected study areas might exist. The system has been deployed as a web service for public access.
27 June 2025 in Nature Cancer