Jolanta Kisielewska

Dr. Jolanta Kisielewska


Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 October 2023 in MedEdPublish
Verified
Journal Article
Open access
SBSteven Burr
Steven Burr
TGThomas Gale
Thomas Gale
JKJolanta Kisielewska
Jolanta Kisielewska
PMPaul Millin
Paul Millin
JPJosé Pêgo
José Pêgo
DZDaniel Zahra
Daniel Zahra
Adaptive testing has a long but largely unrecognized history. The advent of computer-based testing has created new opportunities to incorporate adaptive testing into conventional programmes of study. Relatively recently software has been developed that can automate the delivery of summative assessments that adapt by difficulty or content. Both types of adaptive testing require a large item bank that has been suitably quality assured. Adaptive testing by difficulty enables more reliable evaluation of individual candidate performance, although at the expense of transparency in decision making, and requiring unidirectional navigation. Adaptive testing by content enables reduction in compensation and targeted individual support to enable assurance of performance in all the required outcomes, although at the expense of discovery learning. With both types of adaptive testing, candidates are presented a different set of items to each other, and there is the potential for that to be perceived as unfair. However, when candidates of different abilities receive the same items, they may receive too many they can answer with ease, or too many that are too difficult to answer. Both situations may be considered unfair as neither provides the opportunity to demonstrate what they know. Adapting by difficulty addresses this. Similarly, when everyone is presented with the same items, but answer different items incorrectly, not providing individualized support and opportunity to demonstrate performance in all the required outcomes by revisiting content previously answered incorrectly could also be considered unfair; a point addressed when adapting by content. We review the educational rationale behind the evolution of adaptive testing and consider its inherent strengths and limitations. We explore the continuous pursuit of improvement of examination methodology and how software can facilitate personalized assessment. We highlight how this can serve as a catalyst for learning and refinement of curricula; fostering engagement of learner and educator alike.

25 October 2023 in Education and Information Technologies
Verified
Journal Article
Open access
PDF file
JKJolanta Kisielewska
Jolanta Kisielewska
PMPaul Millin
Paul Millin
NRNeil Rice
Neil Rice
JPJosé Pêgo
José Pêgo
SBSteven Burr
Steven Burr
TGThomas Gale
Thomas Gale
Between 2018–2021, eight European medical schools took part in a study to develop a medical knowledge Online Adaptive International Progress Test. Here we discuss participants’ self-perception to evaluate the acceptability of adaptive vs non-adaptive testing. Study participants, students from across Europe at all stages of undergraduate medical education with varying levels of prior experience with progress testing, sat remotely invigilated tests using the online QuizOne® platform. Participants completed online feedback questionnaires on their experiences and perceptions of adaptive and non-adaptive tests. Overall satisfaction with the organisation and delivery of remote online tests was high regardless of previous experience with progress testing, differences in stages, programmes, and to some degree language. In statements probing the appropriateness of the level and the length of testing, differences were observed between adaptive and non-adaptive tests. There was a high level of agreement that the adaptive test was a good measure of personal knowledge and increased participants’ motivation for study. Students’ self-perception of the assessment is an important factor in evaluation of acceptability of the exam and its further development. In our study, the adaptive test algorithm adjusted the level of difficulty for the individual student in real-time, leading to positive perceptions of the length of the test and promoting students’ engagement. The assessment increases student motivation for learning and in turn, has the potential to improve their performance.

28 April 2025 in MedEdPublish
Verified
Journal Article
Open access
ADAdele Drew-Hill
Adele Drew-Hill
JKJolanta Kisielewska
Jolanta Kisielewska
JEJames Edwards
James Edwards
SESam Evans
Sam Evans
SBSteven Burr
Steven Burr
ARAnn Rigby-Jones
Ann Rigby-Jones
Background Physician associates (PAs) are medical associate professionals who work under the supervision of a doctor within multi-disciplinary teams. Though newly qualified PAs are expected to perform at the same level as newly qualified doctors, no studies have compared the level of medical knowledge upon graduation. The aim of this analysis was to determine the knowledge of PAs in comparison to medical students and Foundation Year 1 (FY1) doctors in the UK. Methods We undertook a retrospective analysis of assessment data from identical medical knowledge progress tests taken by PA students, medical students, and FY1 doctors. Student performance data were collated for each of the 88 identical items, from all cohorts, across all stages of the PA and medical programmes, as well as all cohorts of FY1 doctors sitting the exam. Results Analysis showed that PA student performance was comparable to medical students and FY1 doctors. At Stage 1 end, PA student mean performance was consistent with Stage 3 medicine (36.35%, 34.81%, respectively), whereas at Stage 2 end, PA performance was consistent with Stage 4 medicine (51.63%, 49.92%, respectively). Growth between Stage 1 and 2 PA, and Stage 3 and 4 medicine was almost identical. Significantly, many Stage 2 PA students met or exceeded Stage 5 medicine and FY1 performance upon graduation. Conclusions This is the first UK analysis that directly compares PA medical knowledge to medical students and FY1 doctors, provides evidence of the standard of PA knowledge, and reassurance that graduates are achieving the required standard.