This article reports on findings of a qualitative study that investigated the difficulties teachers encounter while designing formative assessment plans and the strategies experienced teachers use to avoid those pitfalls. The pitfalls were identified through an analysis of formative assessment plans that searched for potential threats to alignment, decision-driven data collection, and room for adjustment and improvement. The main pitfalls in the design process occurred when teachers did not explicitly and coherently link all elements of their formative assessment plan or when they did not plan to effectively use information about student learning to improve teaching and learning. Through interviews with experienced teachers, we identified seven design strategies they used to design formative assessment plans that were aligned, consisted of decision-driven data collection, and left room for adjustment and improvement. However, these experienced teachers still encountered difficulties in determining how to formulate the right decisions for decision-driven data collection and how to provide students with enough room for improvement. Lessons learned from the design strategies of these experienced teachers are incorporated in design steps for formative assessment plans all teachers can use.
Formal diplomas and certificates have been accepted as proof that students may receive exemption for parts of their educational programme. Nowadays, though, it is socially desirable that informal and non-formal learning experiences are also recognised. Assessment of prior learning (APL) addresses this issue. In APL, the candidate's knowledge, skills or competences required in informal and non-formal learning are measured against a standard to determine whether they match the learning objectives. Although APL is frequently used in workplaces and vocational education, it is practised less in universities, and research is lacking in this context. This study aims to evaluate the first APL procedure in an academic computer science programme, and an adjusted APL procedure in an educational science masters programme. This is done from the perspective of the APL candidates, tutors and assessors, using the theoretical framework by Baartman et al. (2006). The computer science participants comprised 23 candidates from a police software company, four tutors and four assessors. From educational science, nine candidates, two tutors and two assessors participated. The results show that the APL procedure in educational science is viewed significantly more positively than that in computer science; further, the computer science assessors differ considerably from the other participants in their perceptions relating to the quality criterion ‘cognitive complexity’. Explanations for the difference between the two programmes are discussed in this article and assessor and tutor training highly recommended.
Students form expectations and perceptions about assessment quality, and they experience the consequences of inferior assessment quality. These expectations and perceptions influence how students use assessment and the information it provides in educational practice. Unfortunately, little is known about students’ expectations and perceptions of assessment quality, and no evaluation tool is available to measure students’ expectations and perceptions of assessment quality to obtain more insight into their perspectives. Therefore, this study aims to construct two questionnaires: the Students’ Expectations of Assessment Quality Questionnaire (SEAQQ) and the Students’ Perceptions of Assessment Quality Questionnaire (SPAQQ). Both questionnaires were analysed using principal axis factoring with direct oblimin rotation of the data (213 higher education students). This resulted in 39 items spread over six factors: (1) effects of assessment on learning, (2) fairness of assessment, (3) conditions of assessment, (4) interpretation of test scores, (5) authenticity of assessment, and (6) credibility of assessment. Cronbach’s alphas varied from α = .76 to α = .94. Educational organisations can use these questionnaires to evaluate assessment quality from a students’ perspective to improve assessment practice.
15 May 2009 in Assessment & Evaluation in Higher Education
In an effort to gain better understanding of the assessment of prior informal and non‐formal learning, this article explores assessors’ approaches to portfolio assessment. Through this portfolio assessment, candidates had requested exemptions from specific courses within an educational programme or admission to the programme based on their prior learning. The assessors judged the portfolios according to set rating criteria, and subsequently discussed their approaches. Their decision‐making processes, perception of portfolio use in the Assessment of Prior Learning (APL), deciding factors in portfolio assessment and use of the rating criteria were key elements in this discussion. The results show that they do use the rating criteria as an indicator in decision‐making, but have mixed perceptions regarding the fairness of APL portfolio assessment. They perceive the portfolio evidence in combination with sound argumentation as the deciding elements in portfolio assessment.