1 October 2013 in Personality and Individual Differences
28 October 2020 in Journal of Behavioral Decision Making
The cognitive reflection test (CRT) became popular for its impressive power to predict how well people reason and make decisions. Despite the popularity of the CRT, a major issue complicates its interpretation: The numerical nature of the CRT confounds reflection ability with mathematical ability. We have addressed this issue by developing the verbal CRT (CRT‐V), a novel 10‐item measure of cognitive reflection (https://osf.io/xehbv/), using nonmathematical problems with good statistical and psychometric properties and with low familiarity. First, we selected suitable items with relatively low familiarity and optimal difficulty as identified in two different populations (Studies 1 and 2) and with high content validity as judged by an expert panel (Study 3). Second, we demonstrated good criterion and construct validity for the test in different populations with a wide range of variables (Studies 4–6, 8) and a good internal consistency (Studies 4–8) and test–retest reliability (Study 7). The CRT‐V was less associated with math anxiety, objective and subjective numeracy than the original CRT, and it was test equivalent across gender, age groups and administration setting. In contrast with the original CRT (Hedge's g = 0.29, 95% confidence interval [CI] [0.17, 0.40]), the CRT‐V showed no gender differences (Hedge's g = −0.06, 95% CI [−0.18, 0.06]). The CRT‐V can complement existing, numerical, tests of cognitive reflection.
1 November 2010 in Acta Psychologica
This research focuses on what determines speakers' choice of positive and negative probability phrases (e.g., "a chance" vs. "not certain") in a legal context. We argue that choice of phrase to describe an event's probability of occurrence can be determined by the contrast between its current p value and an earlier p value, and not by that current value alone. Three experiments were conducted describing scenarios where profilers communicated a suspect's probability of guilt to the police. In the first study, a probability estimate is revised upwards or downwards. In the second one, the probability estimate of a speaker is higher or lower than that given by a previous speaker. In both cases, participants expected upward trends to lead to positive phrases, whereas downward trends were associated with negative phrases. In a third study, participants had to select probability phrases to characterize two different suspects. No contrast effects were found. We conclude that verbal probability directionality has primarily an argumentative function, where positive phrases are selected when probabilities are contrasted with smaller p values, and negative when contrasted with higher p values.
1 May 2012 in Organizational Behavior and Human Decision Processes
1 April 2013 in Cognition
1 January 2014 in Quarterly Journal of Experimental Psychology
Previous studies of verbal probabilities have tried to place expressions like a chance, possible, and certain on 0–1 numerical probability scales. We ask instead, out of a range of outcomes, which outcome a verbal probability suggests. When, for instance, a sample of laptop batteries lasts from 1.5 to 3.5 hours, what is a certain and what is a possible duration? Experiment 1 showed that speakers associate certain with low values and possible with (unlikely) high or maximal values. In Experiment 2, this methodology was applied to several positive and negative verbal probability phrases, showing a preference for high rather than low or middle values in a distribution. Experiment 3 showed that such maxima are not universally described by large numbers. For instance, maximum speed is often described in terms of a small number of time units. What can ( possibly) happen is accordingly sometimes described with very low and sometimes with very high values, depending upon focus of interest. Finally, participants in Experiment 4 were given the role of hearers rather than speakers and were asked to infer outcome ranges from verbal probabilities. Hearers appeared to be partly aware of speakers' tendencies to describe outcomes at the top of the range.