Sendong Zhao

Dr. Sendong Zhao


Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
14 February 2025 in ACM Transactions on Knowledge Discovery From Data
Verified
Journal Article
Open access
HWHaochun Wang
Haochun Wang
Sendong ZhaoSendong Zhao
Sendong Zhao
ZQZewen Qiang
Zewen Qiang
ZLZijian Li
Zijian Li
CLChi Liu
Chi Liu
TLTing Liu
Ting Liu
Large Language Models (LLMs) have demonstrated remarkable success in diverse natural language processing (NLP) tasks in general domains. However, LLMs sometimes generate responses with the hallucination about medical facts due to limited domain knowledge. Such shortcomings pose potential risks in the utilization of LLMs within medical contexts. To address this challenge, we propose knowledge-tuning, which leverages structured medical knowledge bases for the LLMs to grasp domain knowledge efficiently and facilitate trustworthy response generation. We also release cMedKnowQA, a Chinese medical knowledge question-answering dataset constructed from medical knowledge bases to assess the medical knowledge proficiency of LLMs. Experimental results show that the LLMs which are knowledge-tuned with cMedKnowQA can exhibit higher levels of accuracy in response generation compared with vanilla instruction-tuning and offer a new trustworthy way for the domain adaptation of LLMs. We release our code and data at https://github.com/SCIR-HI/Huatuo-Llama-Med-Chinese .

14 April 2023 in arXiv
Verified
Preprint
Open access
PDF file
HWHaochun Wang
Haochun Wang
CLChi Liu
Chi Liu
NXNuwa Xi
Nuwa Xi
ZQZewen Qiang
Zewen Qiang
Sendong ZhaoSendong Zhao
Sendong Zhao
TLTing Liu
Ting Liu
Large Language Models (LLMs), such as the LLaMA model, have demonstrated their effectiveness in various general-domain natural language processing (NLP) tasks. Nevertheless, LLMs have not yet performed optimally in biomedical domain tasks due to the need for medical expertise in the responses. In response to this challenge, we propose HuaTuo, a LLaMA-based model that has been supervised-fine-tuned with generated QA (Question-Answer) instances. The experimental results demonstrate that HuaTuo generates responses that possess more reliable medical knowledge. Our proposed HuaTuo model is accessible at https://github.com/SCIR-HI/Huatuo-Llama-Med-Chinese.

24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
HGHaoqiang Guo
Haoqiang Guo
Sendong ZhaoSendong Zhao
Sendong Zhao
HWHaochun Wang
Haochun Wang
YDYanrui Du
Yanrui Du
BQBing Qin
Bing Qin
Deep learning is now widely used in drug discovery, providing significant acceleration and cost reduction. As the most fundamental building block, molecular representation is essential for predicting molecular properties to enable various downstream applications. Most existing methods attempt to incorporate more information to learn better representations. However, not all features are equally important for a specific task. Ignoring this would potentially compromise the training efficiency and predictive accuracy. To address this issue, we propose a novel approach, which treats language models as an agent and molecular pretraining models as a knowledge base. The agent accentuates task-relevant features in the molecular representation by understanding the natural language description of the task, just as a tailor customizes clothes for clients. Thus, we call this approach MolTailor. Evaluations demonstrate MolTailor's superior performance over baselines, validating the efficacy of enhancing relevance for molecular representation learning. This illustrates the potential of language model guided optimization to better exploit and unleash the capabilities of existing powerful molecular representation methods. Our code and appendix are available at https://github.com/SCIR-HI/MolTailor.

9 December 2021 in IEEE Journal of Biomedical and Health Informatics
Verified
Journal Article
Closed access
XSXiaoming Shi
Xiaoming Shi
Sendong ZhaoSendong Zhao
Sendong Zhao
YWYuxuan Wang
Yuxuan Wang
XCXi Chen
Xi Chen
ZZZiheng Zhang
Ziheng Zhang
WCWanxiang Che
Wanxiang Che
Currently, the need for high-quality dialogue systems that assist users to conduct self-diagnosis is rapidly increasing. Slot filling for automatic diagnosis, which converts medical queries into structured represen- tations, plays an important role in diagnostic dialogue systems. However, the lack of high-quality datasets limits the performance of slot filling. While medical communities like AskAPatient usually have multiple rounds of diagnos- tic dialogue containing colloquial input and professional responses from doctors. Therefore, the data of diagnostic dialogue in medical communities can be utilized to solve the main challenges in slot filling. This paper proposes a two-step training framework to make full use of these unlabeled dialogue data in medical communities. To promote further researches, we provide a Chinese dataset with 2,652 annotated samples and a large amount of unlabeled samples. Experimental results on the dataset demonstrate the effectiveness of the proposed method with an increase of 6.32% in Micro F1 and 8.20% in Macro F1 on average over strong baselines.

24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
YCYuhan Chen
Yuhan Chen
NXNuwa Xi
Nuwa Xi
YDYanrui Du
Yanrui Du
HWHaochun Wang
Haochun Wang
JCJianyu Chen
Jianyu Chen
BQBing Qin
Bing Qin
Molecule discovery serves as a cornerstone in numerous scientific domains, fueling the development of new materials and innovative drug designs. Recent developments of in-silico molecule discovery have highlighted the promising results of cross-modal techniques, which bridge molecular structures with their descriptive annotations. However, these cross-modal methods frequently encounter the issue of data scarcity, hampering their performance and application. In this paper, we address the low-resource challenge by utilizing artificially-real data generated by Large Language Models (LLMs). We first introduce a retrieval-based prompting strategy to construct high-quality pseudo data, then explore the optimal method to effectively leverage this pseudo data. Experiments show that using pseudo data for domain adaptation outperforms all existing methods, while also requiring a smaller model scale, reduced data size and lower training cost, highlighting its efficiency. Furthermore, our method shows a sustained improvement as the volume of pseudo data increases, revealing the great potential of pseudo data in advancing low-resource cross-modal molecule discovery.

1 January 2025
Verified
Conference Paper
Open access
PDF file
YJYi Jiang
Yi Jiang
Sendong ZhaoSendong Zhao
Sendong Zhao
JLJianbo Li
Jianbo Li
HWHaochun Wang
Haochun Wang
BQBing Qin
Bing Qin
Yi Jiang, Sendong Zhao, Jianbo Li, Haochun Wang, Bing Qin. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.