Peer assessment has been widely applied to actively engage students in learning to write. However, sometimes students resist peer assessment. This study explores reviewers’ attitudes and other underlying factors that influence students’ participation in online peer assessment. Participants were 234 Chinese undergraduates from two different academic backgrounds: engineering majors (n = 168) and English majors (n = 66). Gender, academic background and prior experience with peer assessment were all related to participation levels. Moreover, factor analyses revealed three attitudinal factors: (1) positive attitude (a general endorsement of the benefits of peer assessment), (2) interpersonal negative (concerns about the negative effects on interpersonal relationships), and (3) procedural negative (doubts about the procedural rationality of peer assessment). Among the attitudinal factors, procedural negative was negatively associated with participation, as expected. Interestingly, interpersonal negative was associated with greater participation, and positive attitude was associated with lower participation, in part because students worked hard on each review rather than doing many reviews superficially. Implications for instruction are discussed.
7 February 2020 in Assessment & Evaluation in Higher Education
Although a variety of learning benefits of peer assessment have been documented, many concerns remain regarding its reliability and validity, especially for peers at early learning stages and for English as a foreign language (EFL) learners in general. Such concerns may prevent adoption of peer assessment for instruction. To help localize the appropriate contexts for peer assessment, this study examined whether reliability and validity of peer assessment changes over years in a program either for overall scores or specifically for high-level dimensions or language conventions. Participants were 118 English major undergraduates in a comprehensive university in Northeast China. We found that the peer assessments for both 1st year and 4th year students had high reliability, similar to reliability levels shown by teachers. However, the validity of peer assessment showed developmental growth: the peer assessments of 1st year EFL students had low validity, especially for assessments of language conventions, but relatively strong validity of assessments of higher-level dimensions in both 1st and 4th year students. This study suggests peer assessment may be valid for assessments of higher-level concerns across broad developmental levels, but may require stronger supports when used for assessing lower levels of language, particularly for students early on in their language development.