Séverin Lions

Dr. Séverin Lions

orcid

Research Focus & Metrics

Academic Career Length

16Years (2011-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 August 2011 in Proteomics
Verified
Journal Article
Closed access
PDF file
CTCécile Thirant
Cécile Thirant
PVPascale Varlet
Pascale Varlet
JLJoanna Lipecka
Joanna Lipecka
MGMorgane Le Gall
Morgane Le Gall
CBCédric Broussard
Cédric Broussard
HCHervé Chneiweiss
Hervé Chneiweiss

3 April 2022 in Applied Measurement in Education
Verified
Journal Article
Closed access
SLSéverin Lions
Séverin Lions
CMCarlos Monsalve
Carlos Monsalve
PDPablo Dartnell
Pablo Dartnell
MBMaría Paz Blanco
María Paz Blanco
GOGabriel Ortega
Gabriel Ortega
JLJulie Lemarié
Julie Lemarié
Multiple-choice tests are widely used in education, often for high-stakes assessment purposes. Consequently, these tests should be constructed following the highest standards. Many efforts have been undertaken to advance item-writing guidelines intended to improve tests. One important issue is the unwanted effects of the options’ position on test outcomes. Any possible effects should be controlled through an adequate response options placement strategy. However, literature is not straightforward about how test developers arrange options. Therefore, this research synthesis systematically reviewed studies examining adherence to options placement guidelines. Relevant item features, such as the item source (standardized or teacher-made tests) and the number of options were considered. Results show that answer keys’ distribution across tests is often biased, which might provide examinees with clues to select correct options. Findings also show that options are not always arranged in a “logical” fashion (numerically, alphabetically…) despite being suited to be so arranged. The reasons underlying non-adherence to options placement guidelines are discussed, as is the appropriateness of observed response options placement strategies. Suggestions are provided to help developers better arrange items options.

28 October 2021 in Frontiers in Education
Verified
Journal Article
Open access
SLSéverin Lions
Séverin Lions
CMCarlos Monsalve
Carlos Monsalve
PDPablo Dartnell
Pablo Dartnell
MGMaría Inés Godoy
María Inés Godoy
NCNora Córdova
Nora Córdova
JLJulie Lemarié
Julie Lemarié
Middle bias has been reported for responses to multiple-choice test items used in educational assessment. It has been claimed that this response bias probably occurs because test developers tend to place correct responses among middle options, tests thus presenting a middle-biased distribution of answer keys. However, this response bias could be driven by strong distractors being more frequently located among middle options. In this study, the frequency of responses to a Chilean national examination used to rank students wanting to access higher education was used to categorize distractors based on attractiveness level. The distribution of different distractor types (best distractor, non-functioning distractors…) was analyzed across 110 tests of 80 five-option items administered to assess several disciplines in five consecutive years. Results showed that the strongest distractors were more frequently found among middle options, most commonly at option C. In contrast, the weakest distractors were more frequently found at the last option (E). This pattern did not substantially vary across disciplines or years. Supplementary analyses revealed that a similar position bias for distractors could be observed in tests administered in countries other than Chile. Thus, the location of different types of distractors might provide an alternative explanation for the middle bias reported in literature for tests’ responses. Implications for test developers, test takers, and researchers in the field are discussed.

12 November 2022 in Educational and Psychological Measurement
Verified
Journal Article
Closed access
SLSéverin Lions
Séverin Lions
PDPablo Dartnell
Pablo Dartnell
GTGabriela Toledo
Gabriela Toledo
MGMaría Inés Godoy
María Inés Godoy
NCNora Córdova
Nora Córdova
JLJulie Lemarié
Julie Lemarié
Even though the impact of the position of response options on answers to multiple-choice items has been investigated for decades, it remains debated. Research on this topic is inconclusive, perhaps because too few studies have obtained experimental data from large-sized samples in a real-world context and have manipulated the position of both correct response and distractors. Since multiple-choice tests’ outcomes can be strikingly consequential and option position effects constitute a potential source of measurement error, these effects should be clarified. In this study, two experiments in which the position of correct response and distractors was carefully manipulated were performed within a Chilean national high-stakes standardized test, responded by 195,715 examinees. Results show small but clear and systematic effects of options position on examinees’ responses in both experiments. They consistently indicate that a five-option item is slightly easier when the correct response is in A rather than E and when the most attractive distractor is after and far away from the correct response. They clarify and extend previous findings, showing that the appeal of all options is influenced by position. The existence and nature of a potential interference phenomenon between the options’ processing are discussed, and implications for test development are considered.

1 October 2024 in Applied Measurement in Education
Verified
Journal Article
Closed access
SLSéverin Lions
Séverin Lions
MBMaría Paz Blanco
María Paz Blanco
PDPablo Dartnell
Pablo Dartnell
CMCarlos Monsalve
Carlos Monsalve
GOGabriel Ortega
Gabriel Ortega
JLJulie Lemarié
Julie Lemarié

1 September 2023
Verified
Book Chapter
Closed access
PDF file
DRDiego Reyes
Diego Reyes
AJAbelino Jimenez
Abelino Jimenez
PDPablo Dartnell
Pablo Dartnell
SLSéverin Lions
Séverin Lions
SRSebastian A. Rios
Sebastian A. Rios