Hyo Jeong Shin

Dr. Hyo Jeong Shin

orcid

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 September 2018 in Assessment in Education: Principles, Policy & Practice
Verified
Journal Article
Closed access
MDMatthias von Davier
Matthias von Davier
KYKentaro Yamamoto
Kentaro Yamamoto
HSHyo Jeong Shin
Hyo Jeong Shin
HCHenry Chen
Henry Chen
LKLale Khorramdel
Lale Khorramdel
MKMat Kandathil
Mat Kandathil
Based on concerns about the item response theory (IRT) linking approach used in the Programme for International Student Assessment (PISA) until 2012 as well as the desire to include new, more complex, interactive items with the introduction of computer-based assessments, alternative IRT linking methods were implemented in the 2015 PISA round. The new linking method represents a concurrent calibration using all available data, enabling us to find item parameters that maximize fit across all groups and allowing us to investigate measurement invariance across groups. Apart from the Rasch model that historically has been used in PISA operational analyses, we compared our method against more general IRT models that can incorporate item-by-country interactions. The results suggest that our proposed method holds promise not only to provide a strong linkage across countries and cycles but also to serve as a tool for investigating measurement invariance.

24 November 2020 in Educational Measurement: Issues and Practice
Verified
Journal Article
Closed access
PDF file
SJSeang‐Hwane Joo
Seang‐Hwane Joo
LKLale Khorramdel
Lale Khorramdel
KYKentaro Yamamoto
Kentaro Yamamoto
HSHyo Jeong Shin
Hyo Jeong Shin
FRFrederic Robin
Frederic Robin

4 March 2019 in Multivariate Behavioral Research
Verified
Journal Article
Closed access
HSHyo Jeong Shin
Hyo Jeong Shin
SRSophia Rabe-Hesketh
Sophia Rabe-Hesketh
MWMark Wilson
Mark Wilson
In this study we extend and assess the trifactor model ∼ for multiple-ratings data in which two different raters give independent scores for the same responses (e.g., in the GRE essay or to subset of PISA constructed-responses). The trifactor model was extended to incorporate a cross-classified data structure (e.g., items and raters) instead of a strictly hierarchical structure. we present a set of simulations to reflect ∼ the incompleteness and imbalance in real-world assessments. The effects of the rate of missingness in the data and of ignoring differences among raters are investigated using two sets of simulations. The use of the trifactor model is also illustrated with empirical data analysis using a well-known international large-scale assessment.

19 February 2023 in Journal of Educational Measurement
Verified
Journal Article
Closed access
JCJodi M. Casabianca
Jodi M. Casabianca
JDJohn R. Donoghue
John R. Donoghue
HSHyo Jeong Shin
Hyo Jeong Shin
SCSzu‐Fu Chao
Szu‐Fu Chao
ICIkkyu Choi
Ikkyu Choi

1 January 2022
Verified
Book Chapter
Closed access
PDF file
HJHui Jin
Hui Jin
DCDante Cisterna
Dante Cisterna
HSHyo Jeong Shin
Hyo Jeong Shin
MVMatthew Vonk
Matthew Vonk

6 July 2019
Verified
Book Chapter
Open access
PDF file
HSHyo Jeong Shin
Hyo Jeong Shin
MDMatthias von Davier
Matthias von Davier
KYKentaro Yamamoto
Kentaro Yamamoto
The present study investigates rater effects in international large-scale assessments to evaluate the construct validity of constructed-response items scored by human raters. Using the Programme for International Student Assessment data collected in 2015, we illustrate the methods and present the findings about rater effects on constructed-response items in the context of the first fully computer-based international student skill survey. By comparing the unidimensional and the two-dimensional multiple-group item response theory model, it was shown that the latent correlations between human- and machine-coded items were almost perfect. Country means of human- and machine-coded items were generally similar and their differences were small. Further investigation into individual rater effects mostly resulted in small random loadings, which implied that rater effects were negligible in most countries.