Civic learning is increasingly recognized as important by the higher education and workforce communities. The development of high‐quality assessments that can be used to evaluate students' civic learning during the college years has become a priority. This paper presents a comprehensive review of existing frameworks, definitions, and assessments of civic‐related constructs from approximately 30 projects relevant to higher education, and includes a discussion of the challenges related to assessment design and implementation. Synthesizing information from the review, we propose an assessment framework to guide the design of a next‐generation assessment of individuals' civic learning that takes advantage of recent advances in assessment methods. The definition identifies 2 key domains within civic learning: civic competency and civic engagement. Civic competency encompasses 3 areas (civic knowledge; analytic skills; and participatory and involvement skills), and civic engagement also captures 3 areas (motivations, attitudes, and efficacy; democratic norms and values; and participation and activities). We discuss item formats and task types that would ensure fair and reliable scoring for the assessment. The review of definitions of civic learning and its components developed by organizations, the proposed assessment framework, and assessment considerations presented here have potential benefits for a range of higher education institutions. This includes institutions that currently have students engaged in relevant curricular or cocurricular activities and also institutions that would find assessments of civic competency and engagement helpful in program development or in evaluating students' accomplishments.
This study examines learning gains of college students’ performance in critical thinking, reading, writing, and mathematics as assessed by the ETS Proficiency Profile (EPP). In this study, students’ college learning gain was estimated by calculating the score differences between their first and last test administrations. Results revealed that (a) after being in college for one or two years, students did not demonstrate significant learning gains, (b) after three or more years, students made small to moderate gains on the EPP total score, and reading and mathematics subscales, (c) after four or five years, students made small to moderate learning gains on EPP total score and all four subscales, and (d) among various demographic and college-level variables, college experience was the largest significant predictor of students’ learning gain, followed by first-year GPA. Implications of these results are discussed.
29 December 2018 in Assessment & Evaluation in Higher Education
Twenty-first century and higher-learning skills such as critical thinking are highly desired for new college graduates entering the workplace, especially with rapid changing technology and a more globalized economy. As a result, the importance of critical thinking development at higher education institutions has increased. The purpose of this study was to examine the effect of student and institutional variables on the difference in critical thinking scores between first-year and third/fourth-year students at higher education institutions. We examined the extent to which institutional variables moderate the relationship between student variables and the critical thinking score difference. We used a multi-level modeling approach to account for the clustering of students in institutions. Results of this study showed that: (a) institutional variability accounted for 15% of the variance in estimated critical thinking scores, (b) third/fourth-year students had higher critical thinking scores as compared to their first-year peers even when controlling for college admissions score, and (c) in the final model, the main effects of college admission scores, student-faculty ratio, and percent Black/African American were statistically significant; however, retention was the only significant moderator of the relationship between critical thinking scores and class level. Implications and future research are discussed.
Test accommodations for English learners (ELs) are intended to reduce the language barrier and level the playing field, allowing ELs to better demonstrate their true proficiencies. Computer-based accommodations for ELs show promising results for leveling that field while also providing us with additional data to more closely investigate the validity and effectiveness of those accommodations. In this study, we evaluate differences across non-ELs and two EL groups in their decision to use either of two computer-based accommodations on high school history and math assessments. We also evaluate differences in response times across these groups. Results showed that ELs used accommodations more than non-ELs; however, many students did not use any accommodations, and use decreased as the assessment progressed. In addition, students had longer response time for items with accommodations in history but not mathematics. Recommendations for future research in accommodations for ELs are discussed.
Quantitative literacy has been recognized as an important skill in the higher education and workforce communities, focusing on problem solving, reasoning, and real‐world application. As a result, there is a need by various stakeholders in higher education and workforce communities to evaluate whether college students receive sufficient training on quantitative skills throughout their postsecondary education. To determine the key aspects of quantitative literacy, the first part of this report provides a comprehensive review of the existing frameworks and definitions by national and international organizations, higher education institutions, and other key stakeholders. It also examines existing assessments and discusses challenges in assessing quantitative literacy. The second part of this report proposes an approach for developing a next‐generation quantitative literacy assessment in higher education with an operational definition and key assessment considerations. This report has important implications for higher education institutions currently using or planning to develop or adopt assessments of quantitative literacy.