Beijing National Research Center for Information Science and Technology, Department of Electronic Engineering, Tsinghua University 30 Shuangqing Road, Haidian, Beijing 100084, P. R. China
Auto-generated profile, based on publicly available information
Liujie Gu
Beijing National Research Center for Information Science and Technology, Department of Electronic Engineering, Tsinghua University 30 Shuangqing Road, Haidian, Beijing 100084, P. R. China
Assessing the metastatic status of axillary lymph nodes is a common clinical practice in the staging of early breast cancers. Yet sentinel lymph nodes (SLNs) are the regional lymph nodes believed to be the first stop along the lymphatic drainage path of the metastasizing cancer cells. Compared to axillary lymph node dissection, sentinel lymph node biopsy (SLNB) helps reduce morbidity and side effects. Current SLNB methods, however, still have suboptimum properties, such as restrictions due to nuclide accessibility and a relatively low therapeutic efficacy when only a single contrast agent is used. To overcome these limitations, researchers have been motivated to develop a non-radioactive SLN mapping method to replace or supplement radionuclide mapping. We proposed and demonstrated a clinical procedure using a dual-modality photoacoustic (PA)/ultrasound (US) imaging system to locate the SLNs to offer surgical guidance. In our work, the high contrast of PA imaging and its specificity to SLNs were based on the accumulation of carbon nanoparticles (CNPs) in the SLNs. A machine-learning model was also trained and validated to distinguish stained SLNs based on single-wavelength PA images. In the pilot study, we imaged 11 patients in vivo, and the specimens from 13 patients were studied ex vivo. PA/US imaging identified stained SLNs in vivo without a single false positive (23 SLNs), yielding 100% specificity and 52.6% sensitivity based on the current PA imaging system. Our machine-learning model can automatically detect SLNs in real time. In the new procedure, single-wavelength PA/US imaging uses CNPs as the contrast agent. The new system can, with that contrast agent, noninvasively image SLNs with high specificity in real time based on the unique features of the SLNs in the PA images. Ultimately, we aim to use our systems and approach to substitute or supplement nuclide tracers for a non-radioactive, less invasive SLN mapping method in SLNB for the axillary staging of breast cancer.
27 August 2024 in Journal of Innovative Optical Health Sciences
Foundation models (FMs) have rapidly evolved and have achieved significant accomplishments in computer vision tasks. Specifically, the prompt mechanism conveniently allows users to integrate image prior information into the model, making it possible to apply models without any training. Therefore, we proposed a workflow based on foundation models and zero training to solve the tasks of photoacoustic (PA) image processing. We employed the Segment Anything Model (SAM) by setting simple prompts and integrating the model’s outputs with prior knowledge of the imaged objects to accomplish various tasks, including: (1) removing the skin signal in three-dimensional PA image rendering; (2) dual speed-of-sound reconstruction, and (3) segmentation of finger blood vessels. Through these demonstrations, we have concluded that FMs can be directly applied in PA imaging without the requirement for network design and training. This potentially allows for a hands-on, convenient approach to achieving efficient and accurate segmentation of PA images. This paper serves as a comprehensive tutorial, facilitating the mastery of the technique through the provision of code and sample datasets.