The optimal number of responses categories (NRC) is among the most discussed, yet least decided, topic in self-report measures. In addition, there is a dearth of scoping reviews that summarize its impact on validity evidence (e.g., evidence-based on internal structure). To that end, we conducted a scoping review of methodological literature to provide self-report measures developers and applied researchers with evidence-based recommendations when selecting the optimal NRC. Given the inconsistent results reported in previous research, a key recommendation, when conducting cognitive interviews, is to investigate the interpretation of response options by a sample of potential participants who have varying perspectives. This procedure is paramount to ascertain that response options are accurately interpreted and function as intended. The present scoping review is expected to become a valuable resource for applied researchers and practitioners to make informed decisions about the optimal NRC, taking into account validity evidence, and therefore contributes to the literature of educational and psychological measurement and research methods.

The academic buoyancy scale (ABS) is one of the most widely used instruments for measuring academic buoyancy. To obtain meaningful and valid comparisons across groups using ABS, however, measurement invariance should be ascertained a priori. To that end, we examined its measurement invariance, validity evidence based on relations to other variables, and score reliability using categorical omega across culture and gender among Egyptian and Omani undergraduates. Participants were 345 college students: Egyptian sample (N=191) and Omani sample (N=154). To assess measurement invariance across culture and gender, multiple–group confirmatory factor analysis was performed with four successive invariance models: (a) configural, (b) metric, (c) scalar, and (d) residual. Results revealed that the unidimensional baseline model had adequate fit to the data in the full sample. Moreover, measurement invariance was found to hold across culture but not across gender and consequently the ABS could be used to yield valid cross-cultural comparisons between the Egyptian and Omani students. Conversely, it cannot be used to yield valid inferences related to comparing gender groups within each culture. Validity evidence based on relations to other variables was supported by the significantly moderate correlation between ABS and academic achievement (GPA; r =.435 and r = .457, P < .01) for the Egyptian and Omani samples, respectively. With regard to score reliability, categorical omega coefficients were moderate across both samples. Educational and psychological implications, limitations and suggestions for improving the scale are discussed.

Creative self-efficacy (CSE) has recently received much attention due to its association with student learning and creativity. To that end, a CSE scale was developed for undergraduates and sources of validity evidence based on scale content, response processes, and internal structure were collected. Score reliability, using categorical omega based on the categorical confirmatory factor analysis model and marginal reliability for response pattern scores based on item response theory (IRT), were estimated. After various revision iterations of the initial 28-item pool by 10 subject matter experts and 18 undergraduates, some items were revised, four items were dropped, and ultimately 24 items were field tested for measuring two hypothesized dimensions of CSE among 602 undergraduates. Categorical confirmatory factor analysis results indicated that the two-dimensional model had better fit. Similarly, between the two competing multidimensional IRT models, the two-dimensional graded response model had the best fit. Categorical omega coefficients and marginal reliability for response pattern scores were, respectively, 0.88 and 0.81 for the two underlying dimensions.

Learning and study strategies and student engagement are key factors in achieving the intended learning outcomes. However, relatively little is known about these two concepts among Egyptian undergraduates as a function of gender (males/females) and discipline (science/humanities). This study investigates gender and discipline differences in learning and study strategies and student engagement among 522 Egyptian undergraduates. An adapted Arabic version of the Learning and Study Strategies Inventory – Second Edition (LASSI-II) and a Student Engagement Scale (SES) are used. Multivariate analyses of variance reveal the existence of main effects for gender only on the anxiety strategy and for discipline on six LASS: information processing, anxiety, attitude, motivation, study aids, and time management. There are also statistically significant interactions between gender and discipline on three LASS: anxiety, motivation, and self-testing. Results also show there are no statistically significant differences in behavioural, emotional, or cognitive engagement subtypes due to gender and discipline. Educational implications, limitations, and directions for future research are discussed.

Although emotional engagement has received much attention in educational research, relatively little is known about its predictors among undergraduates. Accordingly, to predict emotional engagement, we used the learning and study strategies model, proposed and revised by Weinstein and Palmer, which has 10 strategies namely; information processing, selecting main ideas, test strategies, anxiety, attitude, motivation, concentration, self-testing, study aids, and time management. Thus, an adapted Arabic version of the learning and study strategies inventory-second edition and an emotional engagement scale were administered to 522 undergraduates. To ascertain the accuracy and generalizability of the final selected model in future samples, six candidate models were cross-validated using the leave-one-out approach. Results revealed that the final five-predictor model, which included information processing, anxiety, attitude, concentration, study aids, was the most parsimonious and had the lowest mean square error, explaining approximately 40% of the variation in undergraduates’ scores on emotional engagement. The study aids strategy was found to be the strongest predictor of emotional engagement. Educational implications, limitations, and directions for future research were also discussed.

We assessed measurement invariance (MI) and cohort trends for five social and emotional learning (SEL) measures across four administrations (2013, 2016, 2019, 2022) of a statewide student survey including grades 5, 8, 9, and 11 ( n = 626,082). The MI models were compared using conventional fit statistics and the root mean square error of approximation based on the chi-square difference test (RMSEA _D ) for nested model comparisons with ordinal items. We found that MI held for all measures across years for each grade using both criteria. We then computed standardized mean differences to identify SEL trends for the 2013 and 2016 cohorts for each measure. Overall, there were declines in SEL skills across administrations for both cohorts. Specifically, commitment to learning, family/community support, and teacher/school support SEL measures had notable declines (i.e., large effect size) from 2019–2022 (i.e., before and after the COVID-19 pandemic) for the 2016 cohort. Education implications and directions for future research for evaluating MI and measuring SEL skills and supports were also discussed.