Xingyao Xiao

Ms. Xingyao Xiao

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 December 2023 in Journal of Safety Research
Verified
Journal Article
Closed access
JMJinfei Ma
Jinfei Ma
ZSZhuo Shen
Zhuo Shen
NWNing Wang
Ning Wang
XXXingyao Xiao
Xingyao Xiao
Jingyu ZhangJingyu Zhang
Jingyu Zhang

Verified
Journal Article
Open access
PDF file
XXXingyao Xiao
Xingyao Xiao
YCYihong Cheng
Yihong Cheng
Jong-Min KimJong-Min Kim
Jong-Min Kim
Unprecedented opportunities have been brought by advancements in machine learning in the prediction of the economic success of movies. The analysis of movie title keywords is one promising but rarely investigated direction of study. To address this gap, we performed a text mining and exploratory factor analysis (EFA) of the relationships between movie titles and their corresponding movies’ levels of success. Specifically, intragroup and intergroup analyses of 217 top hit movies in the United States and 245 top hit movies in China showed that successful movies in these two major movie markets with outstanding total lifetime grosses featured titles with similar and different patterns of most frequently used words, revealing useful information about viewers’ preferences in these countries. The findings of this study will serve to better inform the movie industry in giving more economically promising names to their products from a machine-learning perspective and inspire further studies.

17 August 2025 in Journal of Educational Measurement
Verified
Journal Article
Closed access
MXMingfeng Xue
Mingfeng Xue
YLYunting Liu
Yunting Liu
XXXingyao Xiao
Xingyao Xiao
MWMark Wilson
Mark Wilson

16 February 2026 in Educational and Psychological Measurement
Verified
Journal Article
Closed access
MXMingfeng Xue
Mingfeng Xue
XXXingyao Xiao
Xingyao Xiao
YLYunting Liu
Yunting Liu
MWMark Wilson
Mark Wilson
Large language models (LLMs) have shown great potential in automatic scoring. However, due to model characteristics and variation in training materials and pipelines, scoring inconsistency can exist within an LLM and across LLMs when rating the same response multiple times. This study investigates the intra-LLM and inter-LLM consistency in scoring with five LLMs (i.e., Claude, DeepSeek, Gemini, GPT, and Qwen), variability under different temperatures, and their relationship with scoring accuracy. Moreover, a voting strategy that assembles information from different LLMs was proposed to address inconsistent scoring. Using constructed-response items from a science education assessment and open-source data from the Automated Student Assessment Prize (ASAP), we find that: (a) LLMs generally exhibited almost perfect intra-LLM consistency regardless of temperature; (b) inter-LLM consistency was moderate, with higher agreement observed for items that were easier to score; (c) intra-LLM consistency consistently exceeded inter-LLM consistency, supporting the expectation that within-model consistency represents an upper bound for cross-model agreement; (d) intra-LLM consistency was not associated with scoring accuracy, whereas inter-LLM consistency showed a strong positive relationship with accuracy; and (e) majority voting across LLMs improved scoring accuracy by leveraging complementary strengths of different models.

4 October 2023 in Accident Analysis & Prevention
Verified
Journal Article
Closed access
JZJingyu Zhang
Jingyu Zhang
FLFangyan Liu
Fangyan Liu
ZCZhenqi Chen
Zhenqi Chen
ZYZhenhua Yu
Zhenhua Yu
XXXingyao Xiao
Xingyao Xiao
ZGZizheng Guo
Zizheng Guo

15 September 2025 in Suicide and Life-Threatening Behavior
Verified
Journal Article
Closed access
BSBinyuan Su
Binyuan Su
XXXingyao Xiao
Xingyao Xiao
YCYihong Cheng
Yihong Cheng
CLCanxia Liu
Canxia Liu
CYChunyan Yang
Chunyan Yang