Huan KUANG

Dr. Huan KUANG

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 August 2022 in Computers & Education
Verified
Journal Article
Closed access
WLWalter L. Leite
Walter L. Leite
HKHuan KUANG
Huan KUANG
ZJZeyuan Jing
Zeyuan Jing
WXWanli Xing
Wanli Xing
CCCatherine Cavanaugh
Catherine Cavanaugh
AHA. Corinne Huggins-Manley
A. Corinne Huggins-Manley

18 March 2022 in Structural Equation Modeling: A Multidisciplinary Journal
Verified
Journal Article
Closed access
ZJZeyuan Jing
Zeyuan Jing
HKHuan KUANG
Huan KUANG
WLWalter L. Leite
Walter L. Leite
KMKaterina Marcoulides
Katerina Marcoulides
CFCharles L. Fisk
Charles L. Fisk
Model specification is a crucial aspect of structural equation modeling (SEM), since a misspecified model may lead to biased parameter estimation and result in inaccurate conclusions. We propose the Hybrid Ant Colony Optimization Algorithm (hACO), an improved metaheuristic algorithm to conduct model specification searches in SEM. This data mining algorithm combines aspects of the Ant Colony Optimization algorithm with the Tabu search algorithm to increase both accuracy and efficiency. A Monte Carlo simulation study showed that the hACO algorithm provided accurate and efficient SEM specification searches across all designed simulation conditions. The hACO algorithm can help applied researchers conduct specification searches while avoiding potential model misspecifications.

9 June 2021 in Structural Equation Modeling: A Multidisciplinary Journal
Verified
Journal Article
Closed access
WLWalter L. Leite
Walter L. Leite
ZJZeyuan Jing
Zeyuan Jing
HKHuan KUANG
Huan KUANG
DKDongho Kim
Dongho Kim
AHA. Corinne Huggins-Manley
A. Corinne Huggins-Manley
With the growing use of virtual learning environments (VLE), innovative methods to evaluate their performance are increasingly needed. A key difficulty in evaluating VLE using system logs is the large heterogeneity of usage patterns. The current study demonstrates an approach to classify complex patterns of student-level and classroom-level usage with latent class analysis, then estimate average treatment effects (ATEs) of membership in student or classroom classes, as well as joint effects. The approach accounts for uncertainty of latent classes with a three-step method, and nonrandom selection into classes using inverse probability weighting. We demonstrate the approach with an analysis of usage of an Algebra VLE and estimate causal effects of latent class membership on a high-stakes Algebra I standardized assessment. Challenges of using system logs for evaluation of VLE are discussed with respect to measurement error, construct validity, latent classes enumeration, and comparison of classes with respect to distal outcomes.

8 February 2023 in Large-scale Assessments in Education
Verified
Journal Article
Open access
PDF file
HKHuan KUANG
Huan KUANG
FSFusun Sahin
Fusun Sahin
Background: Examinees may not make enough effort when responding to test items if the assessment has no consequence for them. These disengaged responses can be problematic in low-stakes, large-scale assessments because they can bias item parameter estimates. However, the amount of bias, and whether this bias is similar across administrations, is unknown. This study compares the degree of disengagement (i.e., fast and non-effortful responses) and the impact of disengagement on item parameter estimates in the Programme for International Student Assessment (PISA) across the 2015 and 2018 administrations. Method: We detected disengaged responses at the item level based on response times and response behaviors. We used data from the United States and analyzed 51 computer-based mathematics items administered in both PISA 2015 and PISA 2018. We compared the percentage of disengaged responses and the average scores of the disengaged responses for the 51 common items. We filtered disengaged responses at the response- and examinee-levels and compared item difficulty (P+ and b) and item discrimination (a) before and after filtering. Results: Our findings suggested that there were only slight differences in the amount of disengagement in the U.S. results for PISA 2015 and PISA 2018. In both years, the amount of disengagement was less than 5.2%, and the average scores of disengaged responses were lower than the average scores of engaged responses. We did not find any serious impact of disengagement on item parameter estimates when we applied response-level filtering; however, we found some bias, particularly on item difficulty, when we applied examinee-level filtering. Conclusions: This study highlights differences in the amount of disengagement in PISA 2015 and PISA 2018 as well as the implications of the decisions made for handling disengaged responses on item difficulty and discrimination. The results of this study provide important information for reporting trends across years.

13 September 2024 in Journal of Educational Measurement
Verified
Journal Article
Open access
JXJiawei Xiong
Jiawei Xiong
SWShiyu Wang
Shiyu Wang
CTCheng Tang
Cheng Tang
QLQidi Liu
Qidi Liu
RSRufei Sheng
Rufei Sheng
XXXinhui Xiong
Xinhui Xiong
The use of process data in assessment has gained attention in recent years as more assessments are administered by computers. Process data, recorded in computer log files, capture the sequence of examinees' response activities, for example, timestamped keystrokes, during the assessment. Traditional measurement methods are often inadequate for handling this type of data. In this paper, we proposed a sequential reservoir method (SRM) based on a reservoir computing model using the echo state network, with the particle swarm optimization and singular value decomposition as optimization. Designed to regularize features from process data through a computational self‐learning algorithm, this method has been evaluated using both simulated and empirical data. Simulation results suggested that, on one hand, the model effectively transforms action sequences into standardized and meaningful features, and on the other hand, these features are instrumental in categorizing latent behavioral groups and predicting latent information. Empirical results further indicate that SRM can predict assessment efficiency. The features extracted by SRM have been verified as related to action sequence lengths through the correlation analysis. This proposed method enhances the extraction and accessibility of meaningful information from process data, presenting an alternative to existing process data technologies.

29 November 2024 in Educational and Psychological Measurement
Verified
Journal Article
Closed access
ZLZiying Li
Ziying Li
JSJinnie Shin
Jinnie Shin
HKHuan KUANG
Huan KUANG
AHA. Corinne Huggins-Manley
A. Corinne Huggins-Manley
Evaluating differential item functioning (DIF) in assessments plays an important role in achieving measurement fairness across different subgroups, such as gender and native language. However, relying solely on the item response scores among traditional DIF techniques poses challenges for researchers and practitioners in interpreting DIF. Recently, response process data, which carry valuable information about examinees’ response behaviors, offer an opportunity to further interpret DIF items by examining differences in response processes. This study aims to investigate the potential of response process data features in improving the interpretability of DIF items, with a focus on gender DIF using data from the Programme for International Assessment of Adult Competencies (PIAAC) 2012 computer-based numeracy assessment. We applied random forest and logistic regression with ridge regularization to investigate the association between process data features and DIF items, evaluating the important features to interpret DIF. In addition, we evaluated model performance across varying percentages of DIF items to reflect practical scenarios with different percentages of DIF items. The results demonstrate that the combination of timing features and action-sequence features is informative to reveal the response process differences between groups, thereby enhancing DIF item interpretability. Overall, this study introduces a feasible procedure to leverage response process data to understand and interpret DIF items, shedding light on potential reasons for the low agreement between DIF statistics and expert reviews and revealing potential irrelevant factors to enhance measurement equity.