28 October 2022 in Proceedings of the National Academy of Sciences
This study explores how researchers’ analytical choices affect the reliability of scientific findings. Most discussions of reliability problems in science focus on systematic biases. We broaden the lens to emphasize the idiosyncrasy of conscious and unconscious decisions that researchers make during data analysis. We coordinated 161 researchers in 73 research teams and observed their research decisions as they used the same data to independently test the same prominent social science hypothesis: that greater immigration reduces support for social policies among the public. In this typical case of social science research, research teams reported both widely diverging numerical findings and substantive conclusions despite identical start conditions. Researchers’ expertise, prior beliefs, and expectations barely predict the wide variation in research outcomes. More than 95% of the total variance in numerical results remains unexplained even after qualitative coding of all identifiable decisions in each team’s workflow. This reveals a universe of uncertainty that remains hidden when considering a single study in isolation. The idiosyncratic nature of how researchers’ results and conclusions varied is a previously underappreciated explanation for why many scientific hypotheses remain contested. These results call for greater epistemic humility and clarity in reporting scientific findings.
30 September 2016 in Journal of Peace Research
Research suggests that nonviolent resistance (NVR) campaigns are more successful in deposing dictators than armed rebellions. However, ousting dictators is only the first step in the process of democratization. After deposing an autocratic regime, societies enter a transition phase where they must learn to consolidate the gains of democracy and bargain about the new rules of the democratic regime. But even if free, fair, and competitive elections are held, indicating a successful transition to democratic rule, uncertainty about its stability remains salient. In the period that follows, either democracy survives and proves to be resilient, or an autocratic backslide occurs. In this article, we analyze the effect of NVR campaigns on the survival of democratic regimes. Building on the literature on modes of transitions and nonviolent resistance, we argue that those democratic regimes that come into being as a result of a NVR campaign are less prone to democratic breakdown. The main mechanism which produces this effect is that the organizational culture of NVR campaigns spills over to the subsequent democratic regime fostering conditions favorable for democratic survival. We test the effect of NVR campaigns on democratic regime survival using survival analysis and propensity score matching. The results show that democratic regimes that experience NVR during the transition phase survive substantially longer than regimes without NVR.
18 January 2013 in Journal of International Relations and Development
5 July 2019 in Conflict Management and Peace Science
Previous research has shown that successful non-violent resistance (NVR) campaigns promote democracy compared with violent revolutions and top-down liberalization. However, research to date has not examined the character and quality of the democratic regimes following NVR campaigns, or evaluated the mechanisms that produce this effect. In this paper, we address this gap by analyzing the effect of NVR on the quality of democracy, using the Polyarchy index from the Varieties of Democracies project and its sub-components: (1) elected executive; (2) free and fair elections; (3) freedom of expression; (4) associational autonomy; and (5) inclusive citizenship. Using kernel matching and differences-in-differences estimation we find that initiating a democratic transition through NVR improves democratic quality after transition significantly and substantially relative to cases without this characteristic. Our analysis of the Polyarchy index’s sub-components reveals that this positive effect comes about primarily owing to improvements in freedom of expression and associational autonomy. This finding speaks to the strength of NVR in promoting expressive dimensions of democracy.
2 October 2020 in Zeitschrift für Friedens- und Konfliktforschung
In response to the COVID-19 pandemic, a majority of countries worldwide have introduced severe limitations on the freedom of assembly, if not an outright lockdown, in many cases complemented by restrictions on further civil and political rights. Although restrictions were generally considered necessary to save lives and protect health care systems from overburdening, they also pose the risk of government overreach, that is, governments may use the pandemic as a convenient opportunity and justification to impose restrictions for political purposes. In this sense, COVID-19 may give yet another substantial boost to a global trend that has been unfolding since the early 2000s: the shrinking of civic spaces, which is characterized by an increase in government restrictions that target civil society actors and limit their freedoms of assembly, association, and expression. The aim of the paper is to assess civic space restrictions that have been imposed in response to the COVID-19 pandemic with a view to exploring their immediate consequences as well as their potential mid-term implications for civil society organizations in general and contentious civic activism in particular. We do so by, first, providing evidence from multiple data sources about the global spread of COVID-19-related restrictions over time and across countries. Second, we identify key dynamics at work in order to assess the immediate consequences and the potential mid-term implications of these restrictions. These dynamics are illustrated by looking at experiences from individual countries (including Cambodia, Germany, Hungary, and Lebanon).
12 December 2024 in International Studies Quarterly
Does public opinion on international affairs affect elites’ policy preferences? Most research assumes that it does, but this key assumption is difficult to test empirically given limited research access to elite decision-makers. We examine elite responsiveness to public opinion on sanctioning Russia during the 2022 Russian invasion of Ukraine. We fielded a preregistered experiment within the 2022 TRIP survey of US foreign policy practitioners, offering a rare opportunity for a fairly large elite survey experiment ($N = 253$). We used contemporary public polling highly supportive of increasing sanctions as an information treatment. Our research design, involving a salient issue and real-world treatment, substantially expands on previous work. Exposure to the treatment raises elite support for increasing sanctions from 68.0 percent to 76.3 percent (+8.3 pp.). While meaningful, this effect is smaller than those identified elsewhere. We argue that this difference is driven by pretreatment dynamics related to issue salience and ceiling effects and is therefore all the more notable. We provide evidence for substantial treatment effect heterogeneity depending on subject-matter expertise, degree of involvement in political decision-making, and gender, but not party identification. While our results support previous research, they highlight issues of external validity and the context-dependence of elite responsiveness.