Ting-Hao Kenneth Huang

Ting-Hao Kenneth Huang

Auto-generated profile, based on publicly available information

Ting-Hao Kenneth Huang

Pennsylvania State University

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

11 May 2024
Verified
Conference Paper
Open access
ZHZeyu He
Zeyu He
CHChieh-Yang Huang
Chieh-Yang Huang
CDChien-Kuang Cornelia Ding
Chien-Kuang Cornelia Ding
SRShaurya Rohatgi
Shaurya Rohatgi
THTing-Hao Kenneth Huang
Ting-Hao Kenneth Huang
Recent studies indicated GPT-4 outperforms online crowd workers in data labeling accuracy, notably workers from Amazon Mechanical Turk (MTurk). However, these studies were criticized for deviating from standard crowdsourcing practices and emphasizing individual workers’ performances over the whole data-annotation process. This paper compared GPT-4 and an ethical and well-executed MTurk pipeline, with 415 workers labeling 3,177 sentence segments from 200 scholarly articles using the CODA-19 scheme. Two worker interfaces yielded 127,080 labels, which were then used to infer the final labels through eight label-aggregation algorithms. Our evaluation showed that despite best practices, MTurk pipeline’s highest accuracy was 81.5%, whereas GPT-4 achieved 83.6%. Interestingly, when combining GPT-4’s labels with crowd labels collected via an advanced worker interface for aggregation, 2 out of the 8 algorithms achieved an even higher accuracy (87.5%, 87.0%). Further analysis suggested that, when the crowd’s and GPT-4’s labeling strengths are complementary, aggregating them could increase labeling accuracy.


11 May 2024
Verified
Conference Paper
Open access
CHChieh-Yang Huang
Chieh-Yang Huang
JWJing Wei
Jing Wei
THTing-Hao Kenneth Huang
Ting-Hao Kenneth Huang
This study introduces the leveled-text generation task, aiming to rewrite educational materials to specific readability levels while preserving meaning. We assess the capability of GPT-3.5, LLaMA-2 70B, and Mixtral 8x7B, to generate content at various readability levels through zero-shot and few-shot prompting. Evaluating 100 processed educational materials reveals that few-shot prompting significantly improves performance in readability manipulation and information preservation. LLaMA-2 70B performs better in achieving the desired difficulty range, while GPT-3.5 maintains original meaning. However, manual inspection highlights concerns such as misinformation introduction and inconsistent edit distribution. These findings emphasize the need for further research to ensure the quality of generated educational content.

8 August 2023
Verified
Conference Paper
Open access
PVPranav Narayanan Venkit
Pranav Narayanan Venkit
SGSanjana Gautam
Sanjana Gautam
RPRuchi Panchanadikar
Ruchi Panchanadikar
THTing-Hao Huang
Ting-Hao Huang
SWShomir Wilson
Shomir Wilson