Ackermans Kevin

Dr. Ackermans Kevin

orcid

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 November 2024 in Computers & Education
Verified
Journal Article
Open access
AKAckermans Kevin
Ackermans Kevin
MBMarjoke Bakker
Marjoke Bakker
ALAnne-Marieke van Loon
Anne-Marieke van Loon
MKMarijke Kral
Marijke Kral
GCGino Camp
Gino Camp

20 July 2021 in Educational Technology Research and Development
Verified
Journal Article
Open access
PDF file
RNRob J. Nadolski
Rob J. Nadolski
HHHans Hummel
Hans Hummel
EREllen Rusman
Ellen Rusman
AKAckermans Kevin
Ackermans Kevin
Acquiring complex oral presentation skills is cognitively demanding for students and demands intensive teacher guidance. The aim of this study was twofold: (a) to identify and apply design guidelines in developing an effective formative assessment method for oral presentation skills during classroom practice, and (b) to develop and compare two analytic rubric formats as part of that assessment method. Participants were first-year secondary school students in the Netherlands (n = 158) that acquired oral presentation skills with the support of either a formative assessment method with analytic rubrics offered through a dedicated online tool (experimental groups), or a method using more conventional (rating scales) rubrics (control group). One experimental group was provided text-based and the other was provided video-enhanced rubrics. No prior research is known about analytic video-enhanced rubrics, but, based on research on complex skill development and multimedia learning, we expected this format to best capture the (non-verbal aspects of) oral presentation performance. Significant positive differences on oral presentation performance were found between the experimental groups and the control group. However, no significant differences were found between both experimental groups. This study shows that a well-designed formative assessment method, using analytic rubric formats, outperforms formative assessment using more conventional rubric formats. It also shows that higher costs of developing video-enhanced analytic rubrics cannot be justified by significant more performance gains. Future studies should address the generalizability of such formative assessment methods for other contexts, and for complex skills other than oral presentation, and should lead to more profound understanding of video-enhanced rubrics.

10 May 2019 in Educational Technology Research and Development
Verified
Journal Article
Open access
PDF file
AKAckermans Kevin
Ackermans Kevin
EREllen Rusman
Ellen Rusman
SBSaskia Brand-Gruwel
Saskia Brand-Gruwel
MSMarcus Specht
Marcus Specht
For learners, it can be difficult to imagine how to perform a complex skill based on textual information from solely a text-based analytic rubric. Rubrics lack (1) the contextual information needed to convey real-world attributes (2) the dynamic information (such as gesturing in the complex skill of presenting) (3) the procedural information required to support the automation of constituent skills. We propose to address the text-based rubric’s deficiencies by adding video-modeling examples, self-explanation prompts, an intertwined educational- and instructional narrative, natural segmentation, and a non-verbal script. With the resulting Video Enhanced Rubric, we aim to improve the formative assessment of complex skills by fostering learner’s mental model development, feedback quality, and complex skill mastery. Designing multimedia to support the formative assessment of complex skills using can cause dilemmas for instructional designers. For example, is learner control needed to foster intrinsic motivation or is it deemed to create extraneous cognitive load? Is it wise to use a video modeling example of peer-aged learners when the model does not display perfect performance? We found seven dilemmas around proven complex skill development, motivational design, and multimedia design guidelines. This paper presents a theoretical contribution to instructional design by introducing a framework to address dilemmas regarding such design dilemmas. As a practical contribution, we support educational researchers and practitioners by presenting six practical guidelines for designing a Video Enhanced Rubric. A use case of the Viewbrics-project provides insight into the practical application of the framework within the context of Dutch pre-university education.

20 January 2021 in Journal of Computer Assisted Learning
Verified
Journal Article
Open access
PDF file
AKAckermans Kevin
Ackermans Kevin
EREllen Rusman
Ellen Rusman
RNRob Nadolski
Rob Nadolski
MSMarcus Specht
Marcus Specht
SBSaskia Brand‐Gruwel
Saskia Brand‐Gruwel
Learners in the process of developing complex skills need a rich mental model of what such skills entail. Textual analytics rubrics (TR) are a widely used instrument to support formative assessment of complex skills, supporting feedback, reflection, and thus mental model development of complex skills. However, the textual nature of a rubric limits the possibility to deliver contextual and dynamic (time‐and behaviour‐oriented) information. In the Viewbrics online tool, we developed a version supporting the delivery of contextual and dynamic information by adding video‐modelling examples with embedded self‐explanation prompts to textual analytics rubrics. We called this combination as video‐enhanced rubrics (VERs). Our current study investigates whether the Viewbrics online tool supports complex skills development and whether either textual‐ or video‐enhanced rubrics best support complex skills' mastery. The study was a three‐group (VERS n = 49, TR n = 54, control n = 50) within‐subjects design. Learners' performance of complex skills was measured through expert, peer, and self‐assessment using the Viewbrics online tool. A multilevel regression analysis shows learners in the TR and VERS conditions consistently outperforming the control condition to varying degrees across skills. However, no differences have been found between the two experimental conditions. Positive results across different complex skills indicate the Viewbrics online tool can be used to support the development of a wide range of complex skills in secondary education.

1 December 2019 in Computers in Human Behavior
Verified
Journal Article
Open access
AKAckermans Kevin
Ackermans Kevin
EREllen Rusman
Ellen Rusman
RNRob Nadolski
Rob Nadolski
MSMarcus Specht
Marcus Specht
SBSaskia Brand-Gruwel
Saskia Brand-Gruwel

25 December 2023 in Journal of Computer Assisted Learning
Verified
Journal Article
Open access
AKAckermans Kevin
Ackermans Kevin
MBMarjoke Bakker
Marjoke Bakker
PGPierre Gorissen
Pierre Gorissen
ALAnne‐Marieke van Loon
Anne‐Marieke van Loon
MKMarijke Kral
Marijke Kral
GCGino Camp
Gino Camp
Background: A practical test that measures the information and communication technology (ICT) skills students need for effectively using ICT in primary education has yet to be developed (Oh et al., 2021). This paper reports on the development, validation, and reliability of a test measuring primary school students' ICT skills required for effectively using ICT (the ECC‐ICT test).Objectives: Based on existing literature, three ICT use domains were identified for effectively using ICT: Effective, collaborative, and creative use of ICT. For these three domains, 24 corresponding teaching objectives were identified from a widely used digital literacy framework. Thirty‐four test items cover these teaching objectives in an online test.Methods: A mixed‐method approach was used for the ECC‐ICT test. Four pilot rounds (n=25) implemented qualitative interviews for cognitive validity and refining the test items, followed by a qualitative usability study(n=6). Confirmatory factor analysis and ANOVA provided quantitative insight into the large‐scale test administration(n=575).Results and Conclusions: Composite reliability of our conceptual 3‐factor confirmatory model showed that the test reliably measured primary school effective use of ICT (ω = 0.82), collaborative use of ICT (ω = 0.80) and creative use of ICT (ω = 0.64). Convergent validity (ranging from 0.41 to 0.46) was acceptable. Internal consistency (ranging from 0.84 to 0.91) and discriminant validity (HTMT values below 0.90) are good. ANOVA results show that mean test scores are higher for students in higher grade levels (p < 0.001). The post hoc Bonferroni results show that most grade‐by‐grade comparisons are significant (p < 0.001).