We provide a novel Bayesian treatment of the eyewitness identification problem as it relates to various system variables, such as instruction effects, lineup presentation format, lineup-filler similarity, lineup administrator influence, and show-ups versus lineups. We describe why eyewitness identification is a natural Bayesian problem and how numerous important observations require careful consideration of base rates. Moreover, we argue that the base rate in eyewitness identification should be construed as a system variable (under the control of the justice system). We then use prior-by-posterior curves and information-gain curves to examine data obtained from a large number of published experiments. Next, we show how information-gain curves are moderated by system variables and by witness confidence and we note how information-gain curves reveal that lineups are consistently more proficient at incriminating the guilty than they are at exonerating the innocent. We then introduce a new type of analysis that we developed called base rate effect-equivalency (BREE) curves. BREE curves display how much change in the base rate is required to match the impact of any given system variable. The results indicate that even relatively modest changes to the base rate can have more impact on the reliability of eyewitness identification evidence than do the traditional system variables that have received so much attention in the literature. We note how this Bayesian analysis of eyewitness identification has implications for the question of whether there ought to be a reasonable-suspicion criterion for placing a person into the jeopardy of an identification procedure.
1 December 2015 in Journal of Applied Research in Memory and Cognition
Some researchers have been arguing that eyewitness identification data from lineups should be analyzed using Receiver Operating Characteristic (ROC) analysis because it purportedly measures underlying discriminability. But ROC analysis, which was designed for 2 × 2 tasks, does not fit the 3 × 2 structure of lineups. Accordingly, ROC proponents force lineup data into a 2 × 2 structure by treating false-positive identifications of lineup fillers as though they were rejections. Using data from lineups versus showups, we illustrate how this approach misfires as a measure of underlying discriminability. Moreover, treating false-positive identifications of fillers as if they were rejections hides one of the most important phenomena in eyewitness lineups, namely filler siphoning. Filler siphoning reduces the risk of mistaken identification by drawing false-positive identifications away from the innocent suspect and onto lineup fillers. We show that ROC analysis confuses filler siphoning with an improvement in underlying discriminability, thereby fostering misleading theoretical conclusions about how lineups work.
This research provided the first empirical test of the hypothesis that stereotypes bias evaluations of forensic evidence. A pilot study (N = 107) assessed the content and consensus of 20 criminal stereotypes by identifying perpetrator characteristics (e.g., sex, race, age, religion) that are stereotypically associated with specific crimes. In the main experiment (N = 225), participants read a mock police incident report involving either a stereotyped crime (child molestation) or a nonstereotyped crime (identity theft) and judged whether a suspect's fingerprint matched a fingerprint recovered at the crime scene. Accompanying the suspect's fingerprint was personal information about the suspect of the type that is routinely available to fingerprint analysts (e.g., race, sex) and which could activate a stereotype. Participants most often perceived the fingerprints to match when the suspect fit the criminal stereotype, even though the prints did not actually match. Moreover, participants appeared to be unaware of the extent to which a criminal stereotype had biased their evaluations. These findings demonstrate that criminal stereotypes are a potential source of bias in forensic evidence analysis and suggest that suspects who fit criminal stereotypes may be disadvantaged over the course of the criminal justice process. (PsycINFO Database Record
1 December 2015 in Journal of Applied Research in Memory and Cognition
Our previous article (Wells et al., 2015a. Journal of Applied Research in Memory and Cognition ) showed how ROC analysis of lineups does not measure underlying discriminability or control for response bias. Wixted and Mickes (2015. Journal of Applied Research in Memory and Cognition ) concede these points. Hence, in this article we focus more on how forcing the 3 × 2 lineup into the 2 × 2 structure required for ROC analysis obscures important underlying phenomena of theoretical value. Moreover, ROC analysis fails to account for the unique diagnostic properties of exonerating eyewitness behaviors (filler identifications and rejections). We describe how an examination of the full 3 × 2 structure helps reveal the critical underlying phenomena that ROC analysis hides. We also show how a Bayesian approach yields a family of diagnosticity functions that exposes the unique diagnosticity of all three eyewitness behaviors (suspect identifications, filler identifications, and rejections). Moreover, we show how Bayesian methods can examine diagnosticity as a function of witness confidence for all three eyewitness behaviors, which gives it a significant applied advantage over ROC analysis.
Suspects have a preexisting vulnerability to make short-sighted confession decisions, giving disproportionate weight to proximal, rather than distal, consequences. The findings of the current research provided evidence that this preexisting vulnerability is exacerbated by factors that are associated with the immediate interrogation situation. In Experiment 1 (N = 118), a lengthy interview exacerbated participants' tendency to temporally discount a distal consequence when deciding whether or not to admit to criminal and unethical behaviors. This effect was especially pronounced among less serious behaviors. In Experiment 2 (N = 177), participants' tendency to temporally discount a distal consequence when making admission decisions was exacerbated by the expectation of a lengthy interview; an effect that became stronger the longer the interview continued. These findings suggest that conditions of the immediate interrogation situation may capitalize on an already-present vulnerability among suspects to make short-sighted confession decisions, thereby increasing the chances that even innocent suspects might confess.
We assessed recent policy recommendations to collect eyewitnesses' confidence statements in witnesses' own words as opposed to numerically. We conducted an experiment to test whether eyewitnesses' free-report verbal confidence statements are as diagnostic of eyewitness accuracy as their numeric confidence statements and whether the diagnostic utility of eyewitnesses' verbal and numeric confidence statements varies across witnessing conditions. We hypothesized that eyewitnesses' verbal and numeric confidence statements are both significantly associated with identification accuracy among choosers and that their diagnostic utility holds across varying witnessing conditions. In the first phase of the experiment, eyewitnesses (N = 4,795 MTurkers; 48.8% female; 50.8% male; .3% other; age M = 36.9) viewed a videotaped mock-crime and made an identification decision from a culprit-present or culprit-absent lineup. We manipulated witnessing conditions at encoding and retrieval to obtain varied levels of memory performance. In the second phase of the experiment, evaluators (N = 456 MTurkers; 35.5% female; 62.7% male .4% other; age M = 36.5) translated witnesses' verbal confidence statements to a numeric estimate and we used calibration and confidence-accuracy characteristic analyses to compare the diagnosticity of witnesses' verbal and numeric confidence statements across the two levels of memory performance. Witnesses' verbal and numeric confidence statements were significantly and nondifferentially diagnostic of eyewitness accuracy for both choosers and nonchoosers, and their diagnostic utility held across variations in witnessing conditions. These findings suggest the applied utility of collecting either verbal or numeric confidence statements from eyewitnesses immediately following an identification decision. (PsycInfo Database Record (c) 2021 APA, all rights reserved).