Justin Grimmer

Justin Grimmer

Auto-generated profile, based on publicly available information

Justin Grimmer

Social Science Initiative Princeton University Intel Labs Stanford University Princeton University Princeton University

Research Focus & Metrics

Academic Career Length

15Years (2012-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2013 in Political Analysis
Verified
Journal Article
Closed access
PDF file
JGJustin Grimmer
Justin Grimmer
BSBrandon M. Stewart
Brandon M. Stewart
Politics and political conflict often occur in the written and spoken word. Scholars have long recognized this, but the massive costs of analyzing even moderately sized collections of texts have hindered their use in political science research. Here lies the promise of automated text analysis: it substantially reduces the costs of analyzing large collections of text. We provide a guide to this exciting new area of research and show how, in many instances, the methods have already obtained part of their promise. But there are pitfalls to using automated methods—they are no substitute for careful thought and close reading and require extensive and problem-specific validation. We survey a wide range of new methods, provide guidance on how to validate the output of the models, and clarify misconceptions and errors in the literature. To conclude, we argue that for automated text methods to become a standard tool for political scientists, methodologists must contribute new methods and new methods of validation.

24 October 2012 in American Political Science Review
Verified
Journal Article
Closed access
PDF file
JGJustin Grimmer
Justin Grimmer
SMSolomon Messing
Solomon Messing
SWSean J. Westwood
Sean J. Westwood
Particularistic spending, a large literature argues, builds support for incumbents. This literature equates money spent in the district with the credit constituents allocate. Yet, constituents lack the necessary information and motivation to allocate credit in this way. We use extensive observational and experimental evidence to show how legislators’ credit claiming messages—and not just money spent in the district—affect how constituents allocate credit. Legislators use credit claiming messages to influence the expenditures they receive credit for and to affect how closely they are associated with spending in the district. Constituents are responsive to credit claiming messages—they build more support than other nonpartisan messages. But contrary to expectations from other studies, constituents are more responsive to the total number of messages sent rather than the amount claimed. Our results have broad implications for political representation, the personal vote, and the study of U.S. Congressional elections.

21 October 2022 in Science Advances
Verified
Journal Article
Open access
NENaoki Egami
Naoki Egami
CFChristian J. Fong
Christian J. Fong
JGJustin Grimmer
Justin Grimmer
MRMargaret E. Roberts
Margaret E. Roberts
BSBrandon M. Stewart
Brandon M. Stewart
Text as data techniques offer a great promise: the ability to inductively discover measures that are useful for testing social science theories with large collections of text. Nearly all text-based causal inferences depend on a latent representation of the text, but we show that estimating this latent representation from the data creates underacknowledged risks: we may introduce an identification problem or overfit. To address these risks, we introduce a split-sample workflow for making rigorous causal inferences with discovered measures as treatments or outcomes. We then apply it to estimate causal effects from an experiment on immigration attitudes and a study on bureaucratic responsiveness.

1 January 2017 in Political Analysis
Verified
Journal Article
Closed access
PDF file
JGJustin Grimmer
Justin Grimmer
SMSolomon Messing
Solomon Messing
SWSean J. Westwood
Sean J. Westwood
Randomized experiments are increasingly used to study political phenomena because they can credibly estimate the average effect of a treatment on a population of interest. But political scientists are often interested in how effects vary across subpopulations—heterogeneous treatment effects—and how differences in the content of the treatment affects responses—the response to heterogeneous treatments. Several new methods have been introduced to estimate heterogeneous effects, but it is difficult to know if a method will perform well for a particular data set. Rather than using only one method, we show how an ensemble of methods—weighted averages of estimates from individual models increasingly used in machine learning—accurately measure heterogeneous effects. Building on a large literature on ensemble methods, we show how the weighting of methods can contribute to accurate estimation of heterogeneous treatment effects and demonstrate how pooling models lead to superior performance to individual methods across diverse problems. We apply the ensemble method to two experiments, illuminating how the ensemble method for heterogeneous treatment effects facilitates exploratory analysis of treatment effects.

2 November 2021 in Proceedings of the National Academy of Sciences
Verified
Journal Article
Open access
PDF file
AEAndrew C. Eggers
Andrew C. Eggers
HGHaritz Garro
Haritz Garro
JGJustin Grimmer
Justin Grimmer
Significance: President Donald Trump claimed that the 2020 US presidential election was stolen; millions of Americans apparently believed him. We assess the most prominent statistical claims offered by Trump and his allies as evidence of election fraud, including claims about Dominion voting machines switching votes from Trump to Biden, suspiciously high turnout in Democratic strongholds, and the supposedly inexplicable failure of Biden to win “bellwether counties.” We use a combination of statistical reasoning and original data analysis to assess these claims. We hope our analysis contributes to public discussion about the integrity of the 2020 election and broader challenges of election security and election administration.

9 September 2021 in American Journal of Political Science
Verified
Journal Article
Closed access
PDF file
CFChristian Fong
Christian Fong
JGJustin Grimmer
Justin Grimmer