Xin Qiao

Prof. Xin Qiao

orcid

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 November 2018 in Frontiers in Psychology
Verified
Journal Article
Open access
PDF file
XQXin Qiao
Xin Qiao
HJHong Jiao
Hong Jiao
Due to increasing use of technology-enhanced educational assessment, data mining methods have been explored to analyse process data in log files from such assessment. However, most studies were limited to one data mining technique under one specific scenario. The current study demonstrates the usage of four frequently used supervised techniques, including Classification and Regression Trees (CART), gradient boosting, random forest, support vector machine (SVM), and two unsupervised methods, Self-organizing Map (SOM) and k-means, fitted to one assessment data. The USA sample (N = 426) from the 2012 Program for International Student Assessment (PISA) responding to problem-solving items is extracted to demonstrate the methods. After concrete feature generation and feature selection, classifier development procedures are implemented using the illustrated techniques. Results show satisfactory classification accuracy for all the techniques. Suggestions for the selection of classifiers are presented based on the research questions, the interpretability and the simplicity of the classifiers. Interpretations for the results from both supervised and unsupervised learning methods are provided.

1 December 2022 in Psychometrika
Verified
Journal Article
Closed access
PDF file
PZPeida Zhan
Peida Zhan
XQXin Qiao
Xin Qiao
Process data refer to data recorded in computer-based assessments (CBAs) that reflect respondents’ problem-solving processes and provide greater insight into how respondents solve problems, in addition to how well they solve them. Using the rich information contained in process data, this study proposed an item expansion method to analyze action-level process data from the perspective of diagnostic classification in order to comprehensively understand respondents’ problem-solving competence. The proposed method cannot only estimate respondents’ problem-solving ability along a continuum, but also classify respondents according to their problem-solving skills. To illustrate the application and advantages of the proposed method, a Programme for International Student Assessment (PISA) problem-solving item was used. The results indicated that (a) the estimated latent classes provided more detailed diagnoses of respondents’ problem-solving skills than the observed score categories; (b) although only one item was used, the estimated higher-order latent ability reflected the respondents’ problem-solving ability more accurately than the unidimensional latent ability estimated from the outcome data; and (c) interactions among problem-solving skills followed the conjunctive condensation rule, which indicated that the specific action sequence appeared only when a respondent mastered all required problem solving skills. In conclusion, the proposed diagnostic classification approach is feasible and promising analyzing process data.

7 December 2022 in Journal of Educational Measurement
Verified
Journal Article
Closed access
XQXin Qiao
Xin Qiao
HJHong Jiao
Hong Jiao
QHQiwei He
Qiwei He

1 December 2021 in Journal of Educational Measurement
Verified
Journal Article
Closed access
PDF file
XQXin Qiao
Xin Qiao
HJHong Jiao
Hong Jiao

22 June 2024 in Journal of Educational Measurement
Verified
Journal Article
Closed access
CPCornelis Potgieter
Cornelis Potgieter
XQXin Qiao
Xin Qiao
AKAkihito Kamata
Akihito Kamata
YKYusuf Kara
Yusuf Kara

13 July 2020 in PsyArXiv
Verified
Preprint
Open access
PZPeida Zhan
Peida Zhan
XQXin Qiao
Xin Qiao
Process data refers to data recorded by computer-based assessments (CBA) that reflect respondents’ problem-solving processes and provide greater insight into how respondents solve problems, instead of merely how well they solve them. Using the rich information contained in process data, this study proposed an item expansion method to analyze action-level process data from the perspective of diagnostic classification in order to comprehensively understand respondents’ problem-solving competence. The proposed method not only can estimate respondents’ problem-solving ability along a continuum, but also can classify respondents according to their problem-solving skills. To illustrate the application and advantages of the proposed method, a Programme for International Student Assessment (PISA) problem-solving task was used. The results indicate that (a) the estimated latent classes provided more detailed diagnoses of respondents’ problem-solving skills than the observed score classes; (b) although only one item was used, estimated higher-order latent ability reflected the respondents’ problem-solving ability more accurately than the estimated unidimensional latent ability taken from the outcome data; and (c) the interactions between problem-solving skills may follow the conjunctive condensation rule, which assumes that only when a respondent has mastered all the required problem-solving skills can the specific action sequence appear. Overall, the main conclusion drawn from this study was that using diagnostic classification is a feasible and promising method for analyzing process data.