6 May 2024 in American Political Science Review
In 2020, support for Joe Biden among Latina/o/x voters was 8 percentage points lower than support for Hillary Clinton in 2016, the largest drop of any racial/ethnic group. While much media and academic attention has focused on understanding the impact of misinformation, COVID-19 concerns, and racial animus on Latino voters in 2020, we take a step back and clarify the demographic and core ideological characteristics of Latino voters who voted for Donald Trump in 2020. Using a mix of national survey data, precinct returns, and voter file records, we disaggregate components of electoral change. We find evidence of an increasing alignment between Latinos’ ideology, issue positions, and vote choice. Correspondingly, we observe significant pro-Trump shifts among working-class Latinos and modest evidence of a pro-Trump shift among Latinos closer to the immigration experience. These findings, coupled with an analysis of the 2022 CES, point to a more durable Republican shift than currently assumed.
15 March 2023 in Royal Society Open Science
What can be done to reduce misperceptions about COVID-19 vaccines? We present results from experiments conducted simultaneously on YouGov samples in 10 countries ( N = 10 600), which reveal that factual corrections consistently reduce false beliefs about vaccines. With results from these 10 countries, we find that exposure to corrections increases belief accuracy by 0.16 on a 4-point scale, while exposure to misinformation decreases belief accuracy by 0.09 on the same scale. We are unable to find evidence that either misinformation or factual corrections affect intent to vaccinate or vaccine attitudes. Our findings on effect duration are less conclusive; when we recontacted participants two weeks later, we observed 39% of the initial accuracy increase, yet this result narrowly misses conventional thresholds of statistical significance ( p = 0.06). Taken together, our results illustrate both the possibilities and limitations of factual corrections. Evidence from 10 highly diverse populations shows that exposure to factual information reduces belief in falsehoods about vaccines, but has minimal influence on subsequent behaviours and attitudes.
6 August 2024 in American Political Science Review
A long-standing debate in political psychology considers whether individuals update their beliefs and attitudes in the direction of evidence or grow more confident in their convictions when confronted with counter-attitudinal arguments. Though recent studies have shown that instances of the latter tendency, which scholars have termed attitude polarization and “belief backfire,” are rarely observed in settings involving hot-button issues or viral misinformation, we know surprisingly little about how participants respond to information targeting deeply held attitudes, a key condition for triggering attitude polarization. We develop a tailored experimental design that measures participants’ core issue positions and exposes them to personalized counter-attitudinal information using the large language model GPT-3. We find credible evidence of attitude polarization, but only when arguments are contentious and vitriolic. For lower valence counter-attitudinal arguments, attitude polarization is not detected. We conclude by discussing implications for the study of political cognition and the measurement of attitudes.
14 June 2021 in Political Analysis
Although placebo conditions are ubiquitous in survey experiments, little evidence guides common practices for their use and selection. How should scholars choose and construct placebos? First, we review the role of placebos in published survey experiments, finding that placebos are used inconsistently. Then, drawing on the medical literature, we clarify the role that placebos play in accounting for nonspecific effects (NSEs), or the effects of ancillary features of experiments. We argue that, in the absence of precise knowledge of NSEs that placebos are adjusting for, researchers should average over a corpus of many placebos. We demonstrate this agnostic approach to placebo construction through the use of GPT-2, a generative language model trained on a database of over 1 million internet news pages. Using GPT-2, we devise 5,000 distinct placebos and administer two experiments (N = 2,975). Our results illustrate how researchers can minimize their role in placebo selection through automated processes. We conclude by offering tools for incorporating computer-generated placebo text vignettes into survey experiments and developing recommendations for best practice.
2 August 2023 in APSA Preprints
In 2020, support for Joe Biden among Latina/o/x voters was 8 percentage points lower than support for Hillary Clinton in 2016, the largest drop of any racial/ethnic group. While much media and academic attention has (rightly) focused on understanding the impact of misinformation, COVID concerns, and racial animus on Latino voters in 2020, we take a step back and clarify the demographic and core ideological characteristics of Latino voters who voted for Donald Trump in 2020. Using a mix of national survey data, precinct returns, and voter file records, and disaggregating components of electoral change, we find evidence of an increasing alignment between issue positions and vote choice among Latinos. Moreover, we observe significant pro-Trump shifts among working-class Latinos and modest evidence of a pro-Trump shift among newly-engaged U.S.-born Latino children of immigrants and Catholic Latinos. The results point to a more durable Republican shift than currently assumed.
12 February 2025 in Political Analysis
Public opinion surveys are vital for informing democratic decision-making, but responding to rapidly changing information environments and measuring beliefs within hard-to-reach communities can be challenging for traditional survey methods. This paper introduces a crowdsourced adaptive survey methodology (CSAS) that unites advances in natural language processing and adaptive algorithms to produce surveys that evolve with participant input. The CSAS method converts open-ended text provided by participants into survey items and applies a multi-armed bandit algorithm to determine which questions should be prioritized in the survey. The method’s adaptive nature allows new survey questions to be explored and imposes minimal costs in survey length. Applications in the domains of misinformation, issue salience, and local politics showcase CSAS’s ability to identify topics that might otherwise escape the notice of survey researchers. I conclude by highlighting CSAS’s potential to bridge conceptual gaps between researchers and participants in survey research.