Validity evidence based on response processes was first introduced explicitly as a source of validity evidence in the latest edition of Standards for Educational and Psychological Testing. In this paper, we present the theory, the relationship with other sources of validity evidence, and the methods available for validation studies aimed at obtaining validity evidence about response processes. A comprehensive review of the literature along with theoretical and practical proposals. The articles provides arguments for determining when validity evidence based on response processes is critical for supporting the use of the test for a particular purpose, and examples of how to perform a validation study to obtain such validity evidence. There are methods for obtaining validity evidence based on response processes. Special attention should be paid to validation studies using the cognitive interview method given its features and possibilities. Future research problems pose how to combine data from different methods -qualitative and quantitative-, to develop complete validity arguments that support the use of the test for a particular purpose.
The Multidimensional Driving Style Inventory (MDSI; Taubman - Ben-Ari et al., 2004) is a well-known and useful instrument that allows us to identify not only "maladaptive" Driving Styles (DS) in order to modify them, but also "adaptive" DS to encourage safe driving. The aim of this study was to adapt the MDSI to the Spanish spoken in Spain and to the rules and driving habits of Spaniards. The Argentinian version of the MDSI was taken as the source version. The sample consisted of 1173 drivers, who completed the Spanish version of the MDSI. The factor structure was analysed by means of an Exploratory Factor Analysis (AFE) and a Confirmatory Factor Analysis (AFC). The 6-factor structure of the Argentinian version of the MDSI was replicated with higher internal consistency values for each of the DS. The original Argentinian and the Spanish versions share 23 items, indicating a relevant overlap in the construct. A cluster analysis grouped the DS into two groups: maladaptive and adaptive. Significant associations were found between DS measures and demographic variables (gender, age, and education level), driving history and theoretically related constructs like the Domain-Specific Risk-Taking Scale (DOSPERT); Lapses, Errors, Violations; Angry Driving; and Sensitivity to Rewards. The Spanish MDSI provides valid measures that could help us understand complex driving behaviours and promote safe driving.
The aim of the current study is to develop and obtain valid evidence for a hazard perception test suitable for the Spanish driving population. To obtain valid evidence to support the use of the test, the effect of hazardous and quasi-hazardous situations on the participants' hazard prediction is analyzed and the pattern of results for drivers with different driving experience--that is, learner, novice, and expert drivers and reoffender vs. nonoffender drivers--is compared. Potentially hazardous situations are those that develop without involving any real hazard (i.e., the driver did not actually have to decelerate or make any evasive maneuver to avoid a potential collision). The current study analyzed repeat offender drivers attending compulsory reeducation programs as a result of reaching the maximum number of penalty points on their driving license due to repeated violations of traffic laws. A new video-based hazard perception test was developed, using a total of 20 hazardous situation videos plus 8 quasi-hazardous situation videos. They were selected from 167 recordings of natural hazards in real Spanish driving settings. The test showed adequate psychometric properties and evidence of validity, distinguishing between different types of drivers. Psychometric results confirm a final version of the hazard perception test composed of 11 video clips of hazards and 6 video clips of quasi-hazards, for which an overall Cronbach's alpha coefficient of.77 was obtained. A lack of ability to detect quasi-hazards and distinguish them from hazardous situations was also found for learner, novice, and reoffender drivers. Learner drivers obtained lower average scores than novice and experienced drivers with the hazardous situation videos, and learner drivers obtained lower average scores than experienced drivers with the quasi-hazardous situation videos, suggesting that the ability to correctly identify hazardous traffic situations may develop early by accumulating initial driving experience. However, the ability to correctly identify quasi-hazardous situations may develop later with the accumulation of further driving experience. Developing this ability is also difficult for reoffender drivers. The test has adequate psychometric properties and is useful in distinguishing between learner, novice, and expert drivers. In addition, it is useful in that it analyzes the performance of both safe and unsafe drivers (reoffenders who have already lost their driving license).