Hyeryung Lee

Ms. Hyeryung Lee

orcid

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 April 2023 in Psych
Verified
Journal Article
Open access
PDF file
WVWalter P. Vispoel
Walter P. Vispoel
HLHyeryung Lee
Hyeryung Lee
TCTingting Chen
Tingting Chen
HHHyeri Hong
Hyeri Hong
Generalizability theory provides a comprehensive framework for determining how multiple sources of measurement error affect scores from psychological assessments and using that information to improve those assessments. Although generalizability theory designs have traditionally been analyzed using analyses of variance (ANOVA) procedures, the same analyses can be replicated and extended using structural equation models. We collected multi-occasion data from inventories measuring numerous dimensions of personality, self-concept, and socially desirable responding to compare variance components, generalizability coefficients, dependability coefficients, and proportions of universe score and measurement error variance using structural equation modeling versus ANOVA techniques. We further applied structural equation modeling techniques to continuous latent response variable metrics and derived Monte Carlo-based confidence intervals for those indices on both observed score and continuous latent response variable metrics. Results for observed scores estimated using structural equation modeling and ANOVA procedures seldom varied. Differences in reliability between raw score and continuous latent response variable metrics were much greater for scales with dichotomous responses, thereby highlighting the value of doing analyses on both metrics to evaluate gains that might be achieved by increasing response options. We provide detailed guidelines for applying the demonstrated techniques using structural equation modeling and ANOVA-based statistical software.

7 September 2023 in Psychological Methods
Verified
Journal Article
Closed access
WVWalter P. Vispoel
Walter P. Vispoel
HLHyeryung Lee
Hyeryung Lee
HHHyeri Hong
Hyeri Hong
TCTingting Chen
Tingting Chen
Multivariate generalizability theory (GT) represents a comprehensive framework for quantifying score consistency, separating multiple sources contributing to measurement error, correcting correlation coefficients for such error, assessing subscale viability, and determining the best ways to change measurement procedures at different levels of score aggregation. Despite such desirable attributes, multivariate GT has rarely been applied when measuring psychological constructs and far less often than univariate techniques that are subsumed within that framework. Our purpose in this tutorial is to describe multivariate GT in a simple way and illustrate how it expands and complements univariate procedures. We begin with a review of univariate GT designs and illustrate how such designs serve as subcomponents of corresponding multivariate designs. Our empirical examples focus primarily on subscale and composite scores for objectively scored measures, but guidelines are provided for applying the same techniques to subjectively scored performance and clinical assessments. We also compare multivariate GT indices of score consistency and measurement error to those obtained using alternative GT-based procedures and across different software packages for analyzing multivariate GT designs. Our online supplemental materials include instruction, code, and output for common multivariate GT designs analyzed using mGENOVA and the gtheory, glmmTMB, lavaan, and related packages in R. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

13 June 2023 in Psych
Verified
Journal Article
Open access
PDF file
WVWalter P. Vispoel
Walter P. Vispoel
HLHyeryung Lee
Hyeryung Lee
TCTingting Chen
Tingting Chen
HHHyeri Hong
Hyeri Hong
In recent years, researchers have described how to analyze generalizability theory (GT) based univariate, multivariate, and bifactor designs using structural equation models. However, within GT studies of bifactor models, variance components have been limited to those reflecting relative differences in scores for norm-referencing purposes, with only limited guidance provided for estimating key indices when making changes to measurement procedures. In this article, we demonstrate how to derive variance components for multi-facet GT-based bifactor model designs that represent both relative and absolute differences in scores for norm- or criterion-referencing purposes using scores from selected scales within the recently expanded form of the Big Five Inventory (BFI-2). We further develop and apply prophecy formulas for determining how changes in numbers of items, numbers of occasions, and universes of generalization affect a wide variety of indices instrumental in determining the best ways to change measurement procedures for specific purposes. These indices include coefficients representing score generalizability and dependability; scale viability and added value; and proportions of observed score variance attributable to general factor effects, group factor effects, and individual sources of measurement error. To enable readers to apply these techniques, we provide detailed formulas, code in R, and sample data for conducting all demonstrated analyses within this article.

8 November 2023 in Journal of Personality Assessment
Verified
Journal Article
Closed access
WVWalter P. Vispoel
Walter P. Vispoel
HLHyeryung Lee
Hyeryung Lee
TCTingting Chen
Tingting Chen
HHHyeri Hong
Hyeri Hong
We demonstrate how to use structural equation models to represent generalizability theory-based univariate, multivariate, and bifactor model designs. Analyses encompassed multi-occasion data obtained from the recently expanded form of the Big Five Inventory (BFI-2) that measures the broad personality domain constructs Agreeableness, Conscientiousness, Extraversion, Negative Emotionality, and Open-Mindedness along with three nested subdomain facets within each global domain. Results overall highlighted the importance of taking both item and occasion effects into account but underscored additional benefits of the multivariate and bifactor designs in providing more appropriate indices of generalizability for composite scores and effective ways to gauge subscale added value. Bifactor models further extended partitioning of universe score variance to separate general and group factor effects at both composite and subscale levels, expanded score consistency indices to distinguish or combine such effects, and allowed for further evaluation of score dimensionality and subscale viability. We provide guidelines, formulas, and code in R for analyzing all illustrated designs within the article and extended online Supplemental Material.

21 August 2022 in The Journal of Experimental Education
Verified
Journal Article
Closed access
WVWalter P. Vispoel
Walter P. Vispoel
HLHyeryung Lee
Hyeryung Lee
GXGuanlan Xu
Guanlan Xu
HHHyeri Hong
Hyeri Hong
Although generalizability theory (GT) designs have traditionally been analyzed within an ANOVA framework, identical results can be obtained with structural equation models (SEMs) but extended to represent multiple sources of both systematic and measurement error variance, include estimation methods less likely to produce negative variance components, and correct for score coarseness. In research reported here, we integrated principles of bifactor modeling into a GT-SEM framework to partition systematic variance for subscale and composite scores into general and group factor effects and measurement error into multiple components. GT-bifactor modeling allowed for partitioning of variance at different levels of aggregation, clearer definitions of constructs within sampled domains, extended indices of score consistency, insights into composite and subscale score viability, and markers for best enhancing score consistency. Results for domain and facet scores from the recently updated form of the Big Five Inventory highlighted the importance of taking all sources of measurement error into account and the diagnostic benefits of GT-bifactor designs over conventional univariate and multivariate GT designs. Findings further revealed that corrections for scale coarseness noticeably enhanced overall score consistency by reducing specific-factor and random-response measurement error. We provide code in R for applying all illustrated designs in a detailed online supplement.

2 October 2023 in Applied Measurement in Education
Verified
Journal Article
Closed access
WVWalter P. Vispoel
Walter P. Vispoel
HHHyeri Hong
Hyeri Hong
HLHyeryung Lee
Hyeryung Lee
TJTerrence D. Jorgensen
Terrence D. Jorgensen