Hyeri Hong

Prof. Dr. Hyeri Hong

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 April 2023 in Psych
Verified
Journal Article
Open access
PDF file
WVWalter P. Vispoel
Walter P. Vispoel
HLHyeryung Lee
Hyeryung Lee
TCTingting Chen
Tingting Chen
HHHyeri Hong
Hyeri Hong
Generalizability theory provides a comprehensive framework for determining how multiple sources of measurement error affect scores from psychological assessments and using that information to improve those assessments. Although generalizability theory designs have traditionally been analyzed using analyses of variance (ANOVA) procedures, the same analyses can be replicated and extended using structural equation models. We collected multi-occasion data from inventories measuring numerous dimensions of personality, self-concept, and socially desirable responding to compare variance components, generalizability coefficients, dependability coefficients, and proportions of universe score and measurement error variance using structural equation modeling versus ANOVA techniques. We further applied structural equation modeling techniques to continuous latent response variable metrics and derived Monte Carlo-based confidence intervals for those indices on both observed score and continuous latent response variable metrics. Results for observed scores estimated using structural equation modeling and ANOVA procedures seldom varied. Differences in reliability between raw score and continuous latent response variable metrics were much greater for scales with dichotomous responses, thereby highlighting the value of doing analyses on both metrics to evaluate gains that might be achieved by increasing response options. We provide detailed guidelines for applying the demonstrated techniques using structural equation modeling and ANOVA-based statistical software.

1 December 2022 in Psychological Assessment
Verified
Journal Article
Closed access
WVWalter P. Vispoel
Walter P. Vispoel
HLHyeryung Lee
Hyeryung Lee
GXGuanlan Xu
Guanlan Xu
HHHyeri Hong
Hyeri Hong
Over the last decade, applications of bifactor modeling within clinical settings have increased markedly but typically rely on data collected on single occasions. A shortcoming of such research is that reliability coefficients are likely inflated because key sources of measurement error are inadequately modeled and/or confounded with construct variance. We address these problems using three variations of multi-occasion bifactor models with Bayesian-derived parameter estimates to separate systematic variance into general and group factor effects and measurement error into three subcomponents (transient, specific-factor, and random-response). Collectively, these models produce indices of reliability and validity aligned with both standard confirmatory factor models and generalizability designs that extend interpretations of results to the broader domains from which items and occasions are sampled. We demonstrate how these techniques can provide new insights into psychometric properties of scores using Negative Emotionality domain and facet scales from the newly updated Big Five Inventory (BFI-2; Soto & John, 2017). Overall, the two-occasion congeneric bifactor model provided the best fit to the data and most informative indices for revising measures, examining dimensionality of composite and subscale scores, and evaluating the viability of those scores. We include code in R for analyzing all models in our extended online Supplemental Material. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

7 September 2023 in Psychological Methods
Verified
Journal Article
Closed access
WVWalter P. Vispoel
Walter P. Vispoel
HLHyeryung Lee
Hyeryung Lee
HHHyeri Hong
Hyeri Hong
TCTingting Chen
Tingting Chen
Multivariate generalizability theory (GT) represents a comprehensive framework for quantifying score consistency, separating multiple sources contributing to measurement error, correcting correlation coefficients for such error, assessing subscale viability, and determining the best ways to change measurement procedures at different levels of score aggregation. Despite such desirable attributes, multivariate GT has rarely been applied when measuring psychological constructs and far less often than univariate techniques that are subsumed within that framework. Our purpose in this tutorial is to describe multivariate GT in a simple way and illustrate how it expands and complements univariate procedures. We begin with a review of univariate GT designs and illustrate how such designs serve as subcomponents of corresponding multivariate designs. Our empirical examples focus primarily on subscale and composite scores for objectively scored measures, but guidelines are provided for applying the same techniques to subjectively scored performance and clinical assessments. We also compare multivariate GT indices of score consistency and measurement error to those obtained using alternative GT-based procedures and across different software packages for analyzing multivariate GT designs. Our online supplemental materials include instruction, code, and output for common multivariate GT designs analyzed using mGENOVA and the gtheory, glmmTMB, lavaan, and related packages in R. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

25 January 2024 in Psych
Verified
Journal Article
Open access
PDF file
HHHyeri Hong
Hyeri Hong
WVWalter P. Vispoel
Walter P. Vispoel
AMAlfonso J. Martinez
Alfonso J. Martinez
Despite the importance of demonstrating and evaluating how structural equation modeling (SEM), exploratory structural equation modeling (ESEM), and Bayesian structural equation modeling (BSEM) work simultaneously, research comparing these analytic techniques is limited with few studies conducted to systematically compare them to each other using correlated-factor, hierarchical, and bifactor models of personality. In this study, we evaluate the performance of SEM, ESEM, and BSEM across correlated-factor, hierarchical, and bifactor structures and multiple estimation techniques (maximum likelihood, robust weighted least squares, and Bayesian estimation) to test the internal structure of personality. Results across correlated-factor, hierarchical, and bifactor models highlighted the importance of controlling for scale coarseness and allowing small off-target loadings when using maximum likelihood (ML) and robust weighted least squares estimation (WLSMV) and including informative priors (IP) when using Bayesian estimation. In general, Bayesian-IP and WLSMV ESEM models provided noticeably best model fits. This study is expected to serve as a guide for professionals and applied researchers, identify the most appropriate ways to represent the structure of personality, and provide templates for future research into personality and other multidimensional representations of psychological constructs. We provide Mplus code for conducting the demonstrated analyses in the online supplement.

13 June 2023 in Psych
Verified
Journal Article
Open access
PDF file
WVWalter P. Vispoel
Walter P. Vispoel
HLHyeryung Lee
Hyeryung Lee
TCTingting Chen
Tingting Chen
HHHyeri Hong
Hyeri Hong
In recent years, researchers have described how to analyze generalizability theory (GT) based univariate, multivariate, and bifactor designs using structural equation models. However, within GT studies of bifactor models, variance components have been limited to those reflecting relative differences in scores for norm-referencing purposes, with only limited guidance provided for estimating key indices when making changes to measurement procedures. In this article, we demonstrate how to derive variance components for multi-facet GT-based bifactor model designs that represent both relative and absolute differences in scores for norm- or criterion-referencing purposes using scores from selected scales within the recently expanded form of the Big Five Inventory (BFI-2). We further develop and apply prophecy formulas for determining how changes in numbers of items, numbers of occasions, and universes of generalization affect a wide variety of indices instrumental in determining the best ways to change measurement procedures for specific purposes. These indices include coefficients representing score generalizability and dependability; scale viability and added value; and proportions of observed score variance attributable to general factor effects, group factor effects, and individual sources of measurement error. To enable readers to apply these techniques, we provide detailed formulas, code in R, and sample data for conducting all demonstrated analyses within this article.

21 August 2022 in The Journal of Experimental Education
Verified
Journal Article
Closed access
WVWalter P. Vispoel
Walter P. Vispoel
HLHyeryung Lee
Hyeryung Lee
GXGuanlan Xu
Guanlan Xu
HHHyeri Hong
Hyeri Hong
Although generalizability theory (GT) designs have traditionally been analyzed within an ANOVA framework, identical results can be obtained with structural equation models (SEMs) but extended to represent multiple sources of both systematic and measurement error variance, include estimation methods less likely to produce negative variance components, and correct for score coarseness. In research reported here, we integrated principles of bifactor modeling into a GT-SEM framework to partition systematic variance for subscale and composite scores into general and group factor effects and measurement error into multiple components. GT-bifactor modeling allowed for partitioning of variance at different levels of aggregation, clearer definitions of constructs within sampled domains, extended indices of score consistency, insights into composite and subscale score viability, and markers for best enhancing score consistency. Results for domain and facet scores from the recently updated form of the Big Five Inventory highlighted the importance of taking all sources of measurement error into account and the diagnostic benefits of GT-bifactor designs over conventional univariate and multivariate GT designs. Findings further revealed that corrections for scale coarseness noticeably enhanced overall score consistency by reducing specific-factor and random-response measurement error. We provide code in R for applying all illustrated designs in a detailed online supplement.