Yuanhe Tian

Yuanhe Tian

Auto-generated profile, based on publicly available information

Yuanhe Tian

University of Science and Technology of China ♥ University of Washington

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
CLChang Liu
Chang Liu
YTYuanhe Tian
Yuanhe Tian
WCWeidong Chen
Weidong Chen
YSYan Song
Yan Song
YZYongdong Zhang
Yongdong Zhang
Radiology report generation (RRG) aims to automatically generate a free-text description from a specific clinical radiograph, e.g., chest X-Ray images. Existing approaches tend to perform RRG with specific models trained on the public yet limited data from scratch, where they often lead to inferior performance owing to the problem of inefficient capabilities in both aligning visual and textual features and generating informative reports accordingly. Currently, large language models (LLMs) offered a promising solution to text generation with their power in learning from big data, especially for cross-modal scenarios such as RRG. However, most existing LLMs are pre-trained on general data, and suffer from the same problem of conventional approaches caused by knowledge gap between general and medical domain if they are applied to RRG. Therefore in this paper, we propose an approach to bootstrapping LLMs for RRG with a in-domain instance induction and a coarse-to-fine decoding process. Specifically, the in-domain instance induction process learns to align the LLM to radiology reports from general texts through contrastive learning. The coarse-to-fine decoding performs a text elevating process for those reports from the ranker, further enhanced with visual features and refinement prompts. Experimental results on two prevailing RRG datasets, namely, IU X-Ray and MIMIC-CXR, demonstrate the superiority of our approach to previous state-of-the-art solutions. Further analyses illustrate that, for the LLM, the induction process enables it to better align with the medical domain and the coarse-to-fine generation allows it to conduct more precise text generation.

1 January 2024
Verified
Conference Paper
Open access
PDF file
YTYuanhe Tian
Yuanhe Tian
RGRuyi Gan
Ruyi Gan
YSYan Song
Yan Song
JZJiaxing Zhang
Jiaxing Zhang
YZYongdong Zhang
Yongdong Zhang
Yuanhe Tian, Ruyi Gan, Yan Song, Jiaxing Zhang, Yongdong Zhang. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

1 January 2023
Verified
Conference Paper
Open access
PDF file
TWTing Wang
Ting Wang
WCWeidong Chen
Weidong Chen
YTYuanhe Tian
Yuanhe Tian
YSYan Song
Yan Song
ZMZhendong Mao
Zhendong Mao
Ting Wang, Weidong Chen, Yuanhe Tian, Yan Song, Zhendong Mao. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.

1 January 2024
Verified
Conference Paper
Open access
PDF file
BHBo Hu
Bo Hu
MZMeng Zhang
Meng Zhang
CXChenfei Xie
Chenfei Xie
YTYuanhe Tian
Yuanhe Tian
YSYan Song
Yan Song
ZMZhendong Mao
Zhendong Mao
Bo Hu, Meng Zhang, Chenfei Xie, Yuanhe Tian, Yan Song, Zhendong Mao. Findings of the Association for Computational Linguistics ACL 2024. 2024.

1 January 2024
Verified
Conference Paper
Open access
PDF file
CLChenxi Li
Chenxi Li
YTYuanhe Tian
Yuanhe Tian
ZZZhaxi Zerong
Zhaxi Zerong
YSYan Song
Yan Song
FXFei Xia
Fei Xia
Chenxi Li, Yuanhe Tian, Zhaxi Zerong, Yan Song, Fei Xia. Findings of the Association for Computational Linguistics ACL 2024. 2024.

25 April 2024 in arXiv
Verified
Preprint
Open access
PDF file
CLChang Liu
Chang Liu
YTYuanhe Tian
Yuanhe Tian
YSYan Song
Yan Song
Radiology report generation (RRG) aims to automatically generate free-text descriptions from clinical radiographs, e.g., chest X-Ray images. RRG plays an essential role in promoting clinical automation and presents significant help to provide practical assistance for inexperienced doctors and alleviate radiologists' workloads. Therefore, consider these meaningful potentials, research on RRG is experiencing explosive growth in the past half-decade, especially with the rapid development of deep learning approaches. Existing studies perform RRG from the perspective of enhancing different modalities, provide insights on optimizing the report generation process with elaborated features from both visual and textual information, and further facilitate RRG with the cross-modal interactions among them. In this paper, we present a comprehensive review of deep learning-based RRG from various perspectives. Specifically, we firstly cover pivotal RRG approaches based on the task-specific features of radiographs, reports, and the cross-modal relations between them, and then illustrate the benchmark datasets conventionally used for this task with evaluation metrics, subsequently analyze the performance of different approaches and finally offer our summary on the challenges and the trends in future directions. Overall, the goal of this paper is to serve as a tool for understanding existing literature and inspiring potential valuable research in the field of RRG.