27 December 2018 in American Political Science Review
How have Donald Trump’s rhetoric and policies affected Arab and Muslim American behavior? We provide evidence that the de facto effects of President Trump’s campaign rhetoric and vague policy positions extended beyond the direct effects of his executive orders. We present findings from three data sources—television news coverage, social media activity, and a survey—to evaluate whether Arab and Muslim Americans reduced their online visibility and retreated from public life. Our results provide evidence that they withdrew from public view: (1) Shared locations on Twitter dropped approximately 10 to 20% among users with Arabic-sounding names after major campaign and election events and (2) Muslim survey respondents reported increased public space avoidance.
19 January 2022 in Proceedings of the National Academy of Sciences
Significance: We study the impact of crisis on information seeking in authoritarian regimes. Using digital trace data from China during the COVID-19 crisis, we show that crisis motivates citizens to seek out crisis-related information, which subsequently exposes them to unrelated and potentially regime-damaging information. This gateway to both current and historically sensitive content is not found for individuals in countries without extensive online censorship. While information seeking increases during crisis under all forms of governance, the added gateway to previously unknown and sensitive content is disproportionate in authoritarian contexts.
16 August 2022 in Proceedings of the National Academy of Sciences
Following the 2020 general election, Republican elected officials, including then-President Donald Trump, promoted conspiracy theories claiming that Joe Biden’s close victory in Georgia was fraudulent. Such conspiratorial claims could implicate participation in the Georgia Senate runoff election in different ways—signaling that voting doesn’t matter, distracting from ongoing campaigns, stoking political anger at out-partisans, or providing rationalizations for (lack of) enthusiasm for voting during a transfer of power. Here, we evaluate the possibility of any on-average relationship with turnout by combining behavioral measures of engagement with election conspiracies online and administrative data on voter turnout for 40,000 Twitter users registered to vote in Georgia. We find small, limited associations. Liking or sharing messages opposed to conspiracy theories was associated with higher turnout than expected in the runoff election, and those who liked or shared tweets promoting fraud-related conspiracy theories were slightly less likely to vote.
7 September 2023 in Political Behavior
13 March 2023 in Proceedings of the National Academy of Sciences
In 2004 through 2016, three studies in the national Midlife in the United States (MIDUS) project asked participants the open-ended question “What do you do to make life go well?”. We use verbatim responses to this question to evaluate the relative importance of psychological traits and circumstances for predicting self-reported, subjective well-being. The use of an open-ended question allows us to test the hypothesis that psychological traits are more strongly associated with self-reported well-being than objective circumstances because psychological traits and well-being are similarly self-rated—meaning that they both ask respondents to decide how to place themselves on provided and unfamiliar survey scales. For this, we use automated zero-shot classification to score statements about well-being without training on existing survey measures, and we evaluate this scoring through subsequent hand-labeling. We then assess associations of this measure and closed-ended measures for health behaviors, socioeconomic circumstances, biomarkers for inflammation and glycemic control, and mortality risk over follow-up. Although the closed-ended measures were far more strongly associated with other multiple-choice self-ratings, including Big 5 personality traits, the closed- and open-ended measures were similarly associated with relatively objective indicators of health, wealth, and social connectedness. The findings suggest that psychological traits, when collected through self-ratings, predict subjective reports of well-being so strongly because of a measurement advantage—and that circumstance matters just as much when assessed using a fairer comparison.
24 January 2025 in Political Analysis
Past work on closed-ended survey responses demonstrates that inferring stable political attitudes requires separating signal from noise in “top of the head” answers to researchers’ questions. We outline a corresponding theory of the open-ended response, in which respondents make narrow, stand-in statements to convey more abstract, general attitudes. We then present a method designed to infer those attitudes. Our approach leverages co-variation with words used relatively frequently across respondents to infer what else they could have said without substantively changing what they meant—linking narrow themes to each other through associations with contextually prevalent words. This reflects the intuition that a respondent may use different specific statements at different points in time to convey similar meaning. We validate this approach using panel data in which respondents answer the same open-ended questions (concerning healthcare policy, most important problems, and evaluations of political parties) at multiple points in time, showing that our method’s output consistently exhibits higher within-subject correlations than hand-coding of narrow response categories, topic modeling, and large language model output. Finally, we show how large language models can be used to complement—but not, at present, substitute—our “implied word” method.