KaShun Shum

KaShun Shum

Auto-generated profile, based on publicly available information

KaShun Shum

The Hong Kong University of Science and Technology

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2023
Verified
Conference Paper
Open access
PDF file
KSKashun Shum
Kashun Shum
SDShizhe Diao
Shizhe Diao
TZTong Zhang
Tong Zhang
Kashun Shum, Shizhe Diao, Tong Zhang. Findings of the Association for Computational Linguistics: EMNLP 2023. 2023.

27 February 2024 in arXiv
Verified
Preprint
Open access
PDF file
KSKaShun Shum
KaShun Shum
SDShizhe Diao
Shizhe Diao
TZTong Zhang
Tong Zhang
Chain-of-thought (CoT) advances the reasoning abilities of large language models (LLMs) and achieves superior performance in complex reasoning tasks. However, most CoT studies rely on carefully designed human-annotated rational chains to prompt LLMs, posing challenges for real-world applications where labeled data is available without rational chains. This paper proposes a new strategy, Automate-CoT (Automatic Prompt Augmentation and Selection with Chain-of-Thought), that can bypass human engineering of CoT by automatically augmenting rational chains from a small labeled dataset, and then pruning low-quality chains to construct a candidate pool of machine-generated rationale chains based on the labels. Finally, it selects the optimal combination of several rationale chains from the pool for CoT prompting by employing a variance-reduced policy gradient strategy to estimate the significance of each example. Automate-CoT enables a quick adaptation of the CoT technique to different tasks. Experimental results demonstrate the effectiveness of our method, where competitive results are achieved on arithmetic reasoning (+2.7%), commonsense reasoning (+3.4%), symbolic reasoning (+3.2%), and non-reasoning tasks (+2.5%). The code is available at https://github.com/SHUMKASHUN/Automate-CoT.