Xiaoqian Jiang

Xiaoqian Jiang

Auto-generated profile, based on publicly available information

Xiaoqian Jiang

McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston , Houston, TX 77030

Research Focus & Metrics

Academic Career Length

22Years (2005-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 January 2024 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
YHYan Hu
Yan Hu
QCQingyu Chen
Qingyu Chen
JDJingcheng Du
Jingcheng Du
XPXueqing Peng
Xueqing Peng
VKVipina Kuttichi Keloth
Vipina Kuttichi Keloth
HXHua Xu
Hua Xu
Importance: The study highlights the potential of large language models, specifically GPT-3.5 and GPT-4, in processing complex clinical data and extracting meaningful information with minimal training data. By developing and refining prompt-based strategies, we can significantly enhance the models’ performance, making them viable tools for clinical NER tasks and possibly reducing the reliance on extensive annotated datasets. Objectives: This study quantifies the capabilities of GPT-3.5 and GPT-4 for clinical named entity recognition (NER) tasks and proposes task-specific prompts to improve their performance. Materials and Methods: We evaluated these models on 2 clinical NER tasks: (1) to extract medical problems, treatments, and tests from clinical notes in the MTSamples corpus, following the 2010 i2b2 concept extraction shared task, and (2) to identify nervous system disorder-related adverse events from safety reports in the vaccine adverse event reporting system (VAERS). To improve the GPT models' performance, we developed a clinical task-specific prompt framework that includes (1) baseline prompts with task description and format specification, (2) annotation guideline-based prompts, (3) error analysis-based instructions, and (4) annotated samples for few-shot learning. We assessed each prompt's effectiveness and compared the models to BioClinicalBERT. Results: Using baseline prompts, GPT-3.5 and GPT-4 achieved relaxed F1 scores of 0.634, 0.804 for MTSamples and 0.301, 0.593 for VAERS. Additional prompt components consistently improved model performance. When all 4 components were used, GPT-3.5 and GPT-4 achieved relaxed F1 socres of 0.794, 0.861 for MTSamples and 0.676, 0.736 for VAERS, demonstrating the effectiveness of our prompt framework. Although these results trail BioClinicalBERT (F1 of 0.901 for the MTSamples dataset and 0.802 for the VAERS), it is very promising considering few training samples are needed. Discussion: The study’s findings suggest a promising direction in leveraging LLMs for clinical NER tasks. However, while the performance of GPT models improved with task-specific prompts, there's a need for further development and refinement. LLMs like GPT-4 show potential in achieving close performance to state-of-the-art models like BioClinicalBERT, but they still require careful prompt engineering and understanding of task-specific knowledge. The study also underscores the importance of evaluation schemas that accurately reflect the capabilities and performance of LLMs in clinical settings. Conclusion: While direct application of GPT models to clinical NER tasks falls short of optimal performance, our task-specific prompt framework, incorporating medical knowledge and training samples, significantly enhances GPT models' feasibility for potential clinical applications.

15 October 2018
Verified
Conference Paper
Open access
XJXiaoqian Jiang
Xiaoqian Jiang
MKMiran Kim
Miran Kim
KLKristin Lauter
Kristin Lauter
YSYongsoo Song
Yongsoo Song
Homomorphic Encryption (HE) is a powerful cryptographic primitive to address privacy and security issues in outsourcing computation on sensitive data to an untrusted computation environment. Comparing to secure Multi-Party Computation (MPC), HE has advantages in supporting non-interactive operations and saving on communication costs. However, it has not come up with an optimal solution for modern learning frameworks, partially due to a lack of efficient matrix computation mechanisms. In this work, we present a practical solution to encrypt a matrix homomorphically and perform arithmetic operations on encrypted matrices. Our solution includes a novel matrix encoding method and an efficient evaluation strategy for basic matrix operations such as addition, multiplication, and transposition. We also explain how to encrypt more than one matrix in a single ciphertext, yielding better amortized performance. Our solution is generic in the sense that it can be applied to most of the existing HE schemes. It also achieves reasonable performance for practical use; for example, our implementation takes 9.21 seconds to multiply two encrypted square matrices of order 64 and 2.56 seconds to transpose a square matrix of order 64. Our secure matrix computation mechanism has a wide applicability to our new framework EDM, which stands for encrypted data and encrypted model. To the best of our knowledge, this is the first work that supports secure evaluation of the prediction phase based on both encrypted data and encrypted model, whereas previous work only supported applying a plain model to encrypted data. As a benchmark, we report an experimental result to classify handwritten images using convolutional neural networks (CNN). Our implementation on the MNIST dataset takes 28.59 seconds to compute ten likelihoods of 64 input images simultaneously, yielding an amortized rate of 0.45 seconds per image.

1 March 2012 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
XJXiaoqian Jiang
Xiaoqian Jiang
MOMelanie Osl
Melanie Osl
JKJihoon Kim
Jihoon Kim
LOLucila Ohno-Machado
Lucila Ohno-Machado
Objective: Predictive models that generate individualized estimates for medically relevant outcomes are playing increasing roles in clinical care and

17 April 2018 in JMIR Medical Informatics
Verified
Journal Article
Open access
MKMiran Kim
Miran Kim
YSYongsoo Song
Yongsoo Song
SWShuang Wang
Shuang Wang
YXYuhou Xia
Yuhou Xia
XJXiaoqian Jiang
Xiaoqian Jiang
Clinical informatics, decision support for health professionals, electronic health records, and ehealth infrastructures.

13 April 2018 in JMIR Medical Informatics
Verified
Journal Article
Open access
JLJunghye Lee
Junghye Lee
JSJimeng Sun
Jimeng Sun
FWFei Wang
Fei Wang
SWShuang Wang
Shuang Wang
CJChi-Hyuck Jun
Chi-Hyuck Jun
XJXiaoqian Jiang
Xiaoqian Jiang
Clinical informatics, decision support for health professionals, electronic health records, and ehealth infrastructures.

1 September 2012 in Journal of the American Medical Informatics Association
Verified
Journal Article
Open access
PDF file
YWYuan Wu
Yuan Wu
XJXiaoqian Jiang
Xiaoqian Jiang
JKJihoon Kim
Jihoon Kim
LOLucila Ohno-Machado
Lucila Ohno-Machado
Objective The classification of complex or rare patterns in clinical and genomic data requires the availability of a large, labeled patient set. While