Xiuxiu Tang

Xiuxiu Tang

Auto-generated profile, based on publicly available information

Xiuxiu Tang

University of Notre Dame

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 June 2024 in Journal of Educational Measurement
Verified
Journal Article
Closed access
XTXiuxiu Tang
Xiuxiu Tang
YZYi Zheng
Yi Zheng
TWTong Wu
Tong Wu
KHKit‐Tai Hau
Kit‐Tai Hau
HCHua‐Hua Chang
Hua‐Hua Chang

12 September 2024
Verified
Conference Paper
Open access
PDF file
VLVy Le
Vy Le
BDBen Van Dusen
Ben Van Dusen
JNJayson M. Nissen
Jayson M. Nissen
XTXiuxiu Tang
Xiuxiu Tang
YZYuxiao Zhang
Yuxiao Zhang
JMJason Wade Morphew
Jason Wade Morphew
Physics instructors and education researchers use research-based assessments (RBAs) to evaluate students' preparation for physics courses. This preparation can cover a wide range of constructs, including mathematics and physics content. Using separate mathematics and physics RBAs consumes course time. We are developing a mechanics cognitive diagnostic (MCD) as an online test using both computerized adaptive testing and cognitive diagnostic models. This design allows the MCD to assess mathematics and physics content knowledge within a single assessment. Our work used an evidence-centered design framework to inform the extent to which our models of skills students develop in physics courses fit the data from three mathematics RBAs. Our dataset came from the LASSO platform and includes 3,491 responses from the Calculus Concept Assessment, Calculus Concept Inventory, and Pre-calculus Concept Assessment. Our model included five skills: apply vectors, conceptual relationships, algebra, visualizations, and calculus. The "deterministic inputs, noisy 'and' gate" (DINA) analyses demonstrated a good fit for the five skills. The classification accuracies for the skills were satisfactory. Including items of the three mathematics RBAs in the MCD's item bank will provide a flexible assessment of these skills across mathematics and physics content areas that can adapt to instructors' needs.

23 January 2026 in Psychometrika
Verified
Journal Article
Open access
PDF file
XTXiuxiu Tang
Xiuxiu Tang
YCYing Cheng
Ying Cheng
Various item selection algorithms have been proposed for cognitive diagnostic computerized adaptive testing (CD-CAT), with the goal of efficiently diagnosing examinees’ strengths and weaknesses. However, these algorithms often come with significant computational costs, which can hinder their practical implementation. A likelihood-based profile shrinkage (LBPS) algorithm is proposed to simplify the item selection process and reduce the computational cost in CD-CAT. Our simulation results indicate that incorporating LBPS into existing item selection methods yields substantial computational efficiency gains, with greater reductions in computation time as the number of attributes and test length increase. Additionally, LBPS maintains estimation accuracy at both the attribute and pattern levels. These findings suggest that LBPS is a scalable and effective solution for the item selection of CD-CAT in complex scenarios.

23 April 2026 in PsyArXiv
Verified
Preprint
Open access
XTXiuxiu Tang
Xiuxiu Tang
YLYikai Lu
Yikai Lu
JBJohn T. Behrens
John T. Behrens
YCYing Cheng
Ying Cheng
Large language models (LLMs) are increasingly used to generate synthetic data for research and evaluation, including simulating student responses to educational assessments. However, their validity for emulating authentic human performance remains unclear. This study evaluates whether LLMs can-generate assessment data that preserve the score distribution, subgroup relationships, item functioning, latent-variable model properties, and overall distributional similarity required for valid measurement. Using fourth-grade mathematics data from TIMSS 2011, we compare synthetic responses generated by GPT-4o and GPT-5 under multiple prompting conditions against empirical student responses and theory-driven simulated data from a cognitive diagnostic model (CDM). Across both LLM architectures, LLM-generated data exhibit systematic score inflation and variance compression, with distortions more pronounced for GPT-5. Item easiness is overestimated, item discriminations are attenuated, and alignment with empirical item properties is weak. Adding information on cognitive mastery profiles and personal background modestly increases variability but does not recover human-like psychometric structure. Although the CDM shows adequate fit to some LLM-generated datasets, item parameter recovery remains poor. In contrast, CDM-based simulations closely reproduce human score distributions, item properties, and latent structure. These results suggest that LLM-generated synthetic assessment data deviate systematically from human data, which limits their usefulness for inferences requiring structural fidelity. Caution is therefore warranted when using LLM-generated synthetic data in measurement contexts where variance, item functioning, and latent structure are central.