Junjie Shi

Junjie Shi

Auto-generated profile, based on publicly available information

Junjie Shi

Huazhong University of Science and Technology

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 October 2023 in IEEE Journal of Biomedical and Health Informatics
Verified
Journal Article
Closed access
JSJunjie Shi
Junjie Shi
LYLi Yu
Li Yu
QCQimin Cheng
Qimin Cheng
XYXin Yang
Xin Yang
KCKwang-Ting Cheng
Kwang-Ting Cheng
ZYZengqiang Yan
Zengqiang Yan
Brain tumor segmentation is a fundamental task and existing approaches usually rely on multi-modality magnetic resonance imaging (MRI) images for accurate segmentation. However, the common problem of missing/incomplete modalities in clinical practice would severely degrade their segmentation performance, and existing fusion strategies for incomplete multi-modality brain tumor segmentation are far from ideal. In this work, we propose a novel framework named M $^{2}$ FTrans to explore and fuse cross-modality features through modality-masked fusion transformers under various incomplete multi-modality settings. Considering vanilla self-attention is sensitive to missing tokens/inputs, both learnable fusion tokens and masked self-attention are introduced to stably build long-range dependency across modalities while being more flexible to learn from incomplete modalities. In addition, to avoid being biased toward certain dominant modalities, modality-specific features are further re-weighted through spatial weight attention and channel- wise fusion transformers for feature redundancy reduction and modality re-balancing. In this way, the fusion strategy in M $^{2}$ FTrans is more robust to missing modalities. Experimental results on the widely-used BraTS2018, BraTS2020, and BraTS2021 datasets demonstrate the effectiveness of M $^{2}$ FTrans, outperforming the state-of-the-art approaches with large margins under various incomplete modalities for brain tumor segmentation. Code is available at https://github.com/Jun-Jie-Shi/M2FTrans .

28 October 2024
Verified
Conference Paper
Open access
JSJunjie Shi
Junjie Shi
CSCaozhi Shang
Caozhi Shang
ZSZhaobin Sun
Zhaobin Sun
LYLi Yu
Li Yu
XYXin Yang
Xin Yang
ZYZengqiang Yan
Zengqiang Yan
Incomplete multi-modal image segmentation is a fundamental task in medical imaging to refine deployment efficiency when only partial modalities are available. However, the common practice that complete-modality data is visible during model training is far from realistic, as modalities can have imbalanced missing rates in clinical scenarios. In this paper, we, for the first time, formulate such a challenging setting and propose Preference-Aware Self-diStillatION (PASSION) for incomplete multi-modal medical image segmentation under imbalanced missing rates. Specifically, we first construct pixel-wise and semantic-wise self-distillation to balance the optimization objective of each modality. Then, we define relative preference to evaluate the dominance of each modality during training, based on which to design task-wise and gradient-wise regularization to balance the convergence rates of different modalities. Experimental results on two publicly available multi-modal datasets demonstrate the superiority of PASSION against existing approaches for modality balancing. More importantly, PASSION is validated to work as a plug-and-play module for consistent performance improvement across different backbones. Code is available.

3 October 2024
Verified
Book Chapter
Closed access
PDF file
ZSZhaobin Sun
Zhaobin Sun
NWNannan Wu
Nannan Wu
JSJunjie Shi
Junjie Shi
LYLi Yu
Li Yu
KCKwang-Ting Cheng
Kwang-Ting Cheng
ZYZengqiang Yan
Zengqiang Yan

20 July 2024 in arXiv
Verified
Preprint
Open access
PDF file
JSJunjie Shi
Junjie Shi
CSCaozhi Shang
Caozhi Shang
ZSZhaobin Sun
Zhaobin Sun
LYLi Yu
Li Yu
XYXin Yang
Xin Yang
ZYZengqiang Yan
Zengqiang Yan
Incomplete multi-modal image segmentation is a fundamental task in medical imaging to refine deployment efficiency when only partial modalities are available. However, the common practice that complete-modality data is visible during model training is far from realistic, as modalities can have imbalanced missing rates in clinical scenarios. In this paper, we, for the first time, formulate such a challenging setting and propose Preference-Aware Self-diStillatION (PASSION) for incomplete multi-modal medical image segmentation under imbalanced missing rates. Specifically, we first construct pixel-wise and semantic-wise self-distillation to balance the optimization objective of each modality. Then, we define relative preference to evaluate the dominance of each modality during training, based on which to design task-wise and gradient-wise regularization to balance the convergence rates of different modalities. Experimental results on two publicly available multi-modal datasets demonstrate the superiority of PASSION against existing approaches for modality balancing. More importantly, PASSION is validated to work as a plug-and-play module for consistent performance improvement across different backbones. Code is available at https://github.com/Jun-Jie-Shi/PASSION.

9 July 2025
Verified
Book Chapter
Closed access
PDF file
ZWZhehao Wang
Zhehao Wang
XLXian Lin
Xian Lin
JSJunjie Shi
Junjie Shi
CSCaozhi Shang
Caozhi Shang
LYLi Yu
Li Yu
ZYZengqiang Yan
Zengqiang Yan