Paul E. Smaldino

Dr. Paul E. Smaldino


Research Focus & Metrics

Academic Career Length

28Years (1999-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 September 2016 in Royal Society Open Science
Verified
Journal Article
Open access
PSPaul E. Smaldino
Paul E. Smaldino
RMRichard McElreath
Richard McElreath
Poor research design and data analysis encourage false-positive findings. Such poor methods persist despite perennial calls for improvement, suggesting that they result from something more than just misunderstanding. The persistence of poor methods results partly from incentives that favour them, leading to the natural selection of bad science. This dynamic requires no conscious strategizing—no deliberate cheating nor loafing—by scientists, only that publication is a principal factor for career advancement. Some normative methods of analysis have almost certainly been selected to further publication instead of discovery. In order to improve the culture of science, a shift must be made away from correcting misunderstandings and towards rewarding understanding. We support this argument with empirical evidence and computational modelling. We first present a 60-year meta-analysis of statistical power in the behavioural sciences and show that power has not improved despite repeated demonstrations of the necessity of increasing power. To demonstrate the logical consequences of structural incentives, we then present a dynamic model of scientific communities in which competing laboratories investigate novel or previously published hypotheses using culturally transmitted research methods. As in the real world, successful labs produce more ‘progeny,’ such that their methods are more often copied and their students are more likely to start labs of their own. Selection for high output leads to poorer methods and increasingly high false discovery rates. We additionally show that replication slows but does not stop the process of methodological deterioration. Improving the quality of research requires change at the institutional level.

28 October 2014 in Behavioral and Brain Sciences
Verified
Journal Article
Closed access
PDF file
PRPeter Richerson
Peter Richerson
RBRyan Baldini
Ryan Baldini
ABAdrian V. Bell
Adrian V. Bell
KDKathryn Demps
Kathryn Demps
KFKarl Frost
Karl Frost
MZMatthew Zefferman
Matthew Zefferman
Human cooperation is highly unusual. We live in large groups composed mostly of non-relatives. Evolutionists have proposed a number of explanations for this pattern, including cultural group selection and extensions of more general processes such as reciprocity, kin selection, and multi-level selection acting on genes. Evolutionary processes are consilient; they affect several different empirical domains, such as patterns of behavior and the proximal drivers of that behavior. In this target article, we sketch the evidence from five domains that bear on the explanatory adequacy of cultural group selection and competing hypotheses to explain human cooperation. Does cultural transmission constitute an inheritance system that can evolve in a Darwinian fashion? Are the norms that underpin institutions among the cultural traits so transmitted? Do we observe sufficient variation at the level of groups of considerable size for group selection to be a plausible process? Do human groups compete, and do success and failure in competition depend upon cultural variation? Do we observe adaptations for cooperation in humans that most plausibly arose by cultural group selection? If the answer to one of these questions is “no,” then we must look to other hypotheses. We present evidence, including quantitative evidence, that the answer to all of the questions is “yes” and argue that we must take the cultural group selection hypothesis seriously. If culturally transmitted systems of rules (institutions) that limit individual deviance organize cooperation in human societies, then it is not clear that any extant alternative to cultural group selection can be a complete explanation.

27 June 2014 in Behavioral and Brain Sciences
Verified
Journal Article
Closed access
PDF file
PSPaul E. Smaldino
Paul E. Smaldino
Many of the most important properties of human groups – including properties that may give one group an evolutionary advantage over another – are properly defined only at the level of group organization. Yet at present, most work on the evolution of culture has focused solely on the transmission of individual-level traits. I propose a conceptual extension of the theory of cultural evolution, particularly related to the evolutionary competition between cultural groups. The key concept in this extension is the emergent group-level trait. This type of trait is characterized by the structured organization of differentiated individuals and constitutes a unit of selection that is qualitatively different from selection on groups as defined by traditional multilevel selection (MLS) theory. As a corollary, I argue that the traditional focus on cooperation as the defining feature of human societies has missed an essential feature of cooperative groups. Traditional models of cooperation assume that interacting with one cooperator is equivalent to interacting with any other. However, human groups involve differential roles, meaning that receiving aid from one individual is often preferred to receiving aid from another. In this target article, I discuss the emergence and evolution of group-level traits and the implications for the theory of cultural evolution, including ramifications for the evolution of human cooperation, technology, and cultural institutions, and for the equivalency of multilevel selection and inclusive fitness approaches.

26 August 2015 in PLOS ONE
Verified
Journal Article
Open access
PDF file
RMRichard McElreath
Richard McElreath
PSPaul E. Smaldino
Paul E. Smaldino
Many published research results are false (Ioannidis, 2005), and controversy continues over the roles of replication and publication policy in improving the reliability of research. Addressing these problems is frustrated by the lack of a formal framework that jointly represents hypothesis formation, replication, publication bias, and variation in research quality. We develop a mathematical model of scientific discovery that combines all of these elements. This model provides both a dynamic model of research as well as a formal framework for reasoning about the normative structure of science. We show that replication may serve as a ratchet that gradually separates true hypotheses from false, but the same factors that make initial findings unreliable also make replications unreliable. The most important factors in improving the reliability of research are the rate of false positives and the base rate of true hypotheses, and we offer suggestions for addressing each. Our results also bring clarity to verbal debates about the communication of research. Surprisingly, publication bias is not always an obstacle, but instead may have positive impacts—suppression of negative novel findings is often beneficial. We also find that communication of negative replications may aid true discovery even when attempts to replicate have diminished power. The model speaks constructively to ongoing debates about the design and conduct of science, focusing analysis and discussion on precise, internally consistent models, as well as highlighting the importance of population dynamics.

22 March 2023 in Journal of The Royal Society Interface
Verified
Journal Article
Closed access
MGMirta Galesic
Mirta Galesic
DBDaniel Barkoczi
Daniel Barkoczi
ABAndrew M. Berdahl
Andrew M. Berdahl
DBDora Biro
Dora Biro
GCGiuseppe Carbone
Giuseppe Carbone
DSDaniel L. Stein
Daniel L. Stein
We develop a conceptual framework for studying collective adaptation in complex socio-cognitive systems, driven by dynamic interactions of social integration strategies, social environments and problem structures. Going beyond searching for ‘intelligent’ collectives, we integrate research from different disciplines and outline modelling approaches that can be used to begin answering questions such as why collectives sometimes fail to reach seemingly obvious solutions, how they change their strategies and network structures in response to different problems and how we can anticipate and perhaps change future harmful societal trajectories. We discuss the importance of considering path dependence, lack of optimization and collective myopia to understand the sometimes counterintuitive outcomes of collective adaptation. We call for a transdisciplinary, quantitative and societally useful social science that can help us to understand our rapidly changing and ever more complex societies, avoid collective disasters and reach the full potential of our ability to organize in adaptive collectives.

1 April 2019 in Behavioural Processes
Verified
Journal Article
Open access
PSPaul E. Smaldino
Paul E. Smaldino
I discuss the function of social identity signaling in facilitating cooperative group formation, and how the nature of that function changes with the structure of social organization. I propose that signals of social identity facilitate assortment for successful coordination in large-scale societies, and that the multidimensional, context-dependent nature of social identity is crucial for successful coordination when individuals have to cooperate in different contexts. Furthermore, the structure of social identity is tied to the structure of society, so that as societies grow larger and more interconnected, the landscape of social identities grows more heterogeneous. This discussion bears directly on the need to articulate the dynamics of emergent, ephemeral groups as a major factor in human cultural evolution.