1 June 2018 in Medical & Biological Engineering & Computing
27 November 2024 in IEEE Journal of Biomedical and Health Informatics
Breast cancer is a pervasive global health concern among women. Leveraging multimodal data from enterprise patient databases-including Picture Archiving and Communication Systems (PACS) and Electronic Health Records (EHRs)-holds promise for improving prediction. This study introduces a multimodal deep-learning model leveraging mammogram datasets to evaluate breast cancer prediction. Our approach integrates frozen large-scale pretrained vision-language models, showcasing superior performance and stability compared to traditional image-tabular models across two public breast cancer datasets. The model consistently outperforms conventional full fine-tuning methods by using frozen pretrained vision-language models alongside a lightweight trainable classifier. The observed improvements are significant. In the CBIS-DDSM dataset, the Area Under the Curve (AUC) increases from 0.867 to 0.902 during validation and from 0.803 to 0.830 for the official test set. Within the EMBED dataset, AUC improves from 0.780 to 0.805 during validation. In scenarios with limited data, using Breast Imaging-Reporting and Data System category three (BI-RADS 3) cases, AUC improves from 0.91 to 0.96 on the official CBIS-DDSM test set and from 0.79 to 0.83 on a challenging validation set. This study underscores the benefits of vision-language models in jointly training diverse image-clinical datasets from multiple healthcare institutions, effectively addressing challenges related to non-aligned tabular features. Combining training data enhances breast cancer prediction on the EMBED dataset, outperforming all other experiments. In summary, our research emphasizes the efficacy of frozen large-scale pretrained vision-language models in multimodal breast cancer prediction, offering superior performance and stability over conventional methods, reinforcing their potential for breast cancer prediction.
21 January 2018 in Computational and Mathematical Methods in Medicine
High angular resolution diffusion imaging (HARDI) has opened up new perspectives for the delineation of crossing and branching fiber pathways by orientation distribution function (ODF). The fiber orientations contained in an imaging voxel are the key factor in tractography. To extract real fiber orientations from ODF, a hybrid method is proposed for computing the principal directions of ODF by combining the variation of Particle Swarm Optimization (PSO) algorithm with the modified Powell algorithm. This method is comprised of the global searching ability of PSO and the powerful local optimizing of Powell search. This combination can guarantee finding all the diffusion directions without applying sliding windows and improve the accuracy and efficiency. The proposed approach was evaluated on simulated crossing-fiber datasets, Tractometer, and in vivo datasets. The results show that this method could correctly identify fiber directions under a range of noise levels. This method was compared with the state-of-the-art methods, such as modified Powell, ball-stick model, and diffusion decomposition, showing that it outperformed them. As to the multimodal voxels where different fiber populations exist, the proposed approach allows us to improve the estimation accuracy of fiber orientations from ODF. It can play a significant role in the nerve fiber tracking.