Sheng Wang

Sheng Wang

Auto-generated profile, based on publicly available information

Sheng Wang

School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 January 2022 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Closed access
SWSheng Wang
Sheng Wang
XOXi Ouyang
Xi Ouyang
Tianming LiuTianming Liu
Tianming Liu
QWQian Wang
Qian Wang
DSDinggang Shen
Dinggang Shen
When deep neural network (DNN) was first introduced to the medical image analysis community, researchers were impressed by its performance. However, it is evident now that a large number of manually labeled data is often a must to train a properly functioning DNN. This demand for supervision data and labels is a major bottleneck in current medical image analysis, since collecting a large number of annotations from experienced experts can be time-consuming and expensive. In this paper, we demonstrate that the eye movement of radiologists reading medical images can be a new form of supervision to train the DNN-based computer-aided diagnosis (CAD) system. Particularly, we record the tracks of the radiologists’ gaze when they are reading images. The gaze information is processed and then used to supervise the DNN’s attention via an Attention Consistency module. To the best of our knowledge, the above pipeline is among the earliest efforts to leverage expert eye movement for deep-learning-based CAD. We have conducted extensive experiments on knee X-ray images for osteoarthritis assessment. The results show that our method can achieve considerable improvement in diagnosis performance, with the help of gaze supervision.

6 October 2023 in IEEE Journal of Biomedical and Health Informatics
Verified
Journal Article
Closed access
XZXiangyu Zhao
Xiangyu Zhao
ZQZengxin Qi
Zengxin Qi
SWSheng Wang
Sheng Wang
QWQian Wang
Qian Wang
XWXuehai Wu
Xuehai Wu
LZLichi Zhang
Lichi Zhang
Medical image segmentation methods are generally designed as fully-supervised to guarantee model performance, which requires a significant amount of expert annotated samples that are high-cost and laborious. Semi-supervised image segmentation can alleviate the problem by utilizing a large number of unlabeled images along with limited labeled images. However, learning a robust representation from numerous unlabeled images remains challenging due to potential noise in pseudo labels and insufficient class separability in feature space, which undermines the performance of current semi-supervised segmentation approaches. To address the issues above, we propose a novel semi-supervised segmentation method named as Rectified Contrastive Pseudo Supervision (RCPS), which combines a rectified pseudo supervision and voxel-level contrastive learning to improve the effectiveness of semi-supervised segmentation. Particularly, we design a novel rectification strategy for the pseudo supervision method based on uncertainty estimation and consistency regularization to reduce the noise influence in pseudo labels. Furthermore, we introduce a bidirectional voxel contrastive loss in the network to ensure intra-class consistency and inter-class contrast in feature space, which increases class separability in the segmentation. The proposed RCPS segmentation method has been validated on two public datasets and an in-house clinical dataset. Experimental results reveal that the proposed method yields better segmentation performance compared with the state-of-the-art methods in semi-supervised medical image segmentation. The source code is available at https://github.com/hsiangyuzhao/RCPS .

22 March 2025 in Medical Image Analysis
Verified
Journal Article
Closed access
ZZZihao Zhao
Zihao Zhao
YLYuxiao Liu
Yuxiao Liu
HWHan Wu
Han Wu
MWMei Wang
Mei Wang
YLYonghao Li
Yonghao Li
DSDinggang Shen
Dinggang Shen

8 May 2024 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Closed access
ZZZihao Zhao
Zihao Zhao
SWSheng Wang
Sheng Wang
JGJinchen Gu
Jinchen Gu
YZYitao Zhu
Yitao Zhu
LMLanzhuju Mei
Lanzhuju Mei
DSDinggang Shen
Dinggang Shen
The integration of Computer-Aided Diagnosis (CAD) with Large Language Models (LLMs) presents a promising frontier in clinical applications, notably in automating diagnostic processes akin to those performed by radiologists and providing consultations similar to a virtual family doctor. Despite the promising potential of this integration, current works face at least two limitations: (1) From the perspective of a radiologist, existing studies typically have a restricted scope of applicable imaging domains, failing to meet the diagnostic needs of different patients. Also, the insufficient diagnostic capability of LLMs further undermine the quality and reliability of the generated medical reports. (2) Current LLMs lack the requisite depth in medical expertise, rendering them less effective as virtual family doctors due to the potential unreliability of the advice provided during patient consultations. To address these limitations, we introduce ChatCAD+, to be universal and reliable. Specifically, it is featured by two main modules: (1) Reliable Report Generation and (2) Reliable Interaction. The Reliable Report Generation module is capable of interpreting medical images from diverse domains and generate high-quality medical reports via our proposed hierarchical in-context learning. Concurrently, the interaction module leverages up-to-date information from reputable medical websites to provide reliable medical advice. Together, these designed modules synergize to closely align with the expertise of human medical professionals, offering enhanced consistency and reliability for interpretation and advice. The source code is available at GitHub.

19 June 2023 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Closed access
CMChong Ma
Chong Ma
LZLin Zhao
Lin Zhao
YCYuzhong Chen
Yuzhong Chen
SWSheng Wang
Sheng Wang
LGLei Guo
Lei Guo
Tianming LiuTianming Liu
Tianming Liu
Learning harmful shortcuts such as spurious correlations and biases prevents deep neural networks from learning meaningful and useful representations, thus jeopardizing the generalizability and interpretability of the learned representation. The situation becomes even more serious in medical image analysis, where the clinical data are limited and scarce while the reliability, generalizability and transparency of the learned model are highly required. To rectify the harmful shortcuts in medical imaging applications, in this paper, we propose a novel eye-gaze-guided vision transformer (EG-ViT) model which infuses the visual attention from radiologists to proactively guide the vision transformer (ViT) model to focus on regions with potential pathology rather than spurious correlations. To do so, the EG-ViT model takes the masked image patches that are within the radiologists’ interest as input while has an additional residual connection to the last encoder layer to maintain the interactions of all patches. The experiments on two medical imaging datasets demonstrate that the proposed EG-ViT model can effectively rectify the harmful shortcut learning and improve the interpretability of the model. Meanwhile, infusing the experts’ domain knowledge can also improve the large-scale ViT model’s performance over all compared baseline methods with limited samples available. In general, EG-ViT takes the advantages of powerful deep neural networks while rectifies the harmful shortcut learning with human expert’s prior knowledge. This work also opens new avenues for advancing current artificial intelligence paradigms by infusing human intelligence.

30 January 2023 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Closed access
LYLinlin Yao
Linlin Yao
FSFeng Shi
Feng Shi
SWSheng Wang
Sheng Wang
XZXiao Zhang
Xiao Zhang
ZXZhong Xue
Zhong Xue
DSDinggang Shen
Dinggang Shen
Anatomical labeling of head and neck vessels is a vital step for cerebrovascular disease diagnosis. However, it remains challenging to automatically and accurately label vessels in computed tomography angiography (CTA) since head and neck vessels are tortuous, branched, and often spatially close to nearby vasculature. To address these challenges, we propose a novel topology-aware graph network (TaG-Net) for vessel labeling. It combines the advantages of volumetric image segmentation in the voxel space and centerline labeling in the line space, wherein the voxel space provides detailed local appearance information, and line space offers high-level anatomical and topological information of vessels through the vascular graph constructed from centerlines. First, we extract centerlines from the initial vessel segmentation and construct a vascular graph from them. Then, we conduct vascular graph labeling using TaG-Net, in which techniques of topology-preserving sampling, topology-aware feature grouping, and multi-scale vascular graph are designed. After that, the labeled vascular graph is utilized to improve volumetric segmentation via vessel completion. Finally, the head and neck vessels of 18 segments are labeled by assigning centerline labels to the refined segmentation. We have conducted experiments on CTA images of 401 subjects, and experimental results show superior vessel segmentation and labeling of our method compared to other state-of-the-art methods.