Xiaohui Tao

Xiaohui Tao

Auto-generated profile, based on publicly available information

Xiaohui Tao

University of Southern Queensland

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 May 2013 in World Wide Web
Verified
Journal Article
Closed access
PDF file
JZJi Zhang
Ji Zhang
XTXiaohui Tao
Xiaohui Tao
HWHua Wang
Hua Wang

13 November 2016
Verified
Book Chapter
Closed access
PDF file
XTXiaohui Tao
Xiaohui Tao
Xujuan ZhouXujuan Zhou
Xujuan Zhou
JZJi Zhang
Ji Zhang
JYJianming Yong
Jianming Yong

19 December 2023 in arXiv
Verified
Preprint
Open access
PDF file
LXLingling XU
Lingling XU
Haoran XieHaoran Xie
Haoran Xie
SQSi-Zhao Joe Qin
Si-Zhao Joe Qin
XTXiaohui Tao
Xiaohui Tao
Fu Lee WangFu Lee Wang
Fu Lee Wang
With the continuous growth in the number of parameters of transformer-based pretrained language models (PLMs), particularly the emergence of large language models (LLMs) with billions of parameters, many natural language processing (NLP) tasks have demonstrated remarkable success. However, the enormous size and computational demands of these models pose significant challenges for adapting them to specific downstream tasks, especially in environments with limited computational resources. Parameter Efficient Fine-Tuning (PEFT) offers an effective solution by reducing the number of fine-tuning parameters and memory usage while achieving comparable performance to full fine-tuning. The demands for fine-tuning PLMs, especially LLMs, have led to a surge in the development of PEFT methods, as depicted in Fig. 1. In this paper, we present a comprehensive and systematic review of PEFT methods for PLMs. We summarize these PEFT methods, discuss their applications, and outline future directions. Furthermore, we conduct experiments using several representative PEFT methods to better understand their effectiveness in parameter efficiency and memory efficiency. By offering insights into the latest advancements and practical applications, this survey serves as an invaluable resource for researchers and practitioners seeking to navigate the challenges and opportunities presented by PEFT in the context of PLMs.

18 November 2016 in Web Intelligence
Verified
Journal Article
Closed access
PDF file
RLRaid Lafta
Raid Lafta
JZJi Zhang
Ji Zhang
XTXiaohui Tao
Xiaohui Tao
YLYan Li
Yan Li
VTVincent S. Tseng
Vincent S. Tseng
FCFulong Chen
Fulong Chen
The use of intelligent technologies for providing useful recommendations to patients suffering chronic diseases may play a positive role in improving the general life quality of patients and help reduce the workload and cost involved in their daily h

18 August 2018 in International Journal of Data Science and Analytics
Verified
Journal Article
Closed access
PDF file
WGWee Pheng Goh
Wee Pheng Goh
XTXiaohui Tao
Xiaohui Tao
JZJi Zhang
Ji Zhang
JYJianming Yong
Jianming Yong
WZWenping Zhang
Wenping Zhang
Haoran XieHaoran Xie
Haoran Xie

2 July 2020 in Neural Processing Letters
Verified
Journal Article
Closed access
PDF file
WGWee Pheng Goh
Wee Pheng Goh
XTXiaohui Tao
Xiaohui Tao
JZJi Zhang
Ji Zhang
JYJianming Yong
Jianming Yong