Renjie Pan

Renjie Pan

Auto-generated profile, based on publicly available information

Renjie Pan

College of Computer and Information Science, Chongqing Normal University, Chongqing, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 December 2023 in IEEE Journal of Biomedical and Health Informatics
Verified
Journal Article
Closed access
RPRenjie Pan
Renjie Pan
RRruisheng Ran
ruisheng Ran
WHWei Hu
Wei Hu
WZwenfeng zhang
wenfeng zhang
QQQibing Qin
Qibing Qin
SCshaoguo cui
shaoguo cui
Intelligent medicine is eager to automatically generate radiology reports to ease the tedious work of radiologists. Previous researches mainly focused on the text generation with encoder-decoder structure, while CNN networks for visual features ignored the long-range dependencies correlated with textual information. Besides, few studies exploit cross-modal mappings to promote radiology report generation. To alleviate the above problems, we propose a novel end-to-end radiology report generation model dubbed Self-Supervised dual-Stream Network (S3-Net). Specifically, a Dual-Stream Visual Feature Extractor (DSVFE) composed of ResNet and SwinTransformer is proposed to capture more abundant and effective visual features, where the former focuses on local response and the latter explores long-range dependencies. Then, we introduced the Fusion Alignment Module (FAM) to fuse the dual-stream visual features and facilitate alignment between visual features and text features. Furthermore, the Self-Supervised Learning with Mask(SSLM) is introduced to further enhance the visual feature representation ability. Experimental results on two mainstream radiology reporting datasets (IU X-ray and MIMIC-CXR) show that our proposed approach outperforms previous models in terms of language generation metrics.

24 August 2024 in Applied Intelligence
Verified
Journal Article
Closed access
PDF file
RRruisheng Ran
ruisheng Ran
RPRenjie Pan
Renjie Pan
WYWen Yang
Wen Yang
YDYan Deng
Yan Deng
WZwenfeng zhang
wenfeng zhang
QQQibing Qin
Qibing Qin