Beth Clarke

Beth Clarke

Auto-generated profile, based on publicly available information

Beth Clarke

Melbourne School of Psychological Sciences, University of Melbourne

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 October 2023 in Journal of Personality and Social Psychology
Verified
Journal Article
Closed access
BCBeth Clarke
Beth Clarke
SSSarah Schiavone
Sarah Schiavone
SVSimine Vazire
Simine Vazire
Every research project has limitations. The limitations that authors acknowledge in their articles offer a glimpse into some of the concerns that occupy a field's attention. We examine the types of limitations authors discuss in their published articles by categorizing them according to the four validities framework and investigate whether the field's attention to each of the four validities has shifted from 2010 to 2020. We selected one journal in social and personality psychology (Social Psychological and Personality Science; SPPS), the subfield most in the crosshairs of psychology's replication crisis. We sampled 440 articles (with half of those articles containing a subsection explicitly addressing limitations), and we identified and categorized 831 limitations across the 440 articles. Articles with limitations sections reported more limitations than those without (avg. 2.6 vs. 1.2 limitations per article). Threats to external validity were the most common type of reported limitation (est. 52% of articles), and threats to statistical conclusion validity were the least common (est. 17% of articles). Authors reported slightly more limitations over time. Despite the extensive attention paid to statistical conclusion validity in the scientific discourse throughout psychology's credibility revolution, our results suggest that concerns about statistics-related issues were not reflected in social and personality psychologists' reported limitations. The high prevalence of limitations concerning external validity might suggest it is time that we improve our practices in this area, rather than apologizing for these limitations after the fact. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

14 July 2024 in Social and Personality Psychology Compass
Verified
Journal Article
Open access
BCBeth Clarke
Beth Clarke
LALindsay J. Alley
Lindsay J. Alley
SGSakshi Ghai
Sakshi Ghai
JFJessica K. Flake
Jessica K. Flake
JRJulia M. Rohrer
Julia M. Rohrer
SVSimine Vazire
Simine Vazire
The replication crisis and subsequent credibility revolution in psychology have highlighted many suboptimal research practices such as p ‐hacking, overgeneralizing, and a lack of transparency. These practices may have been employed reflexively but upon reflection, they are hard to defend. We suggest that current practices for reporting and discussing study limitations are another example of an area where there is much room for improvement. In this article, we call for more rigorous reporting of study limitations in social and personality psychology articles, and we offer advice for how to do this. We recommend that authors consider what the best argument is against their conclusions (which we call the “steel‐person principle”). We consider limitations as threats to construct, internal, external, and statistical conclusion validity (Shadish et al., 2002), and offer some examples for better practice reporting of common study limitations. Our advice has its own limitations — both our representation of current practices and our recommendations are largely based on our own metaresearch and opinions. Nevertheless, we hope that we can prompt researchers to write more deeply and clearly about the limitations of their research, and to hold each other to higher standards when reviewing each other's work.

1 October 2024 in Advances in Methods and Practices in Psychological Science
Verified
Journal Article
Open access
THTom E. Hardwicke
Tom E. Hardwicke
RTRobert T. Thibault
Robert T. Thibault
BCBeth Clarke
Beth Clarke
NMNicholas Moodie
Nicholas Moodie
SCSophia Crüwell
Sophia Crüwell
SVSimine Vazire
Simine Vazire
More than a decade of advocacy and policy reforms have attempted to increase the uptake of transparent research practices in the field of psychology; however, their collective impact is unclear. We estimated the prevalence of transparent research practices in (a) all psychology journals (i.e., field-wide), and (b) prominent psychology journals, by manually examining two random samples of 200 empirical articles ( N = 400) published in 2022. Most articles had an open-access version (field-wide: 74%, 95% confidence interval [CI] = [67%, 79%]; prominent: 71% [64%, 77%]) and included a funding statement (field-wide: 76% [70%, 82%]; prominent: 76% [70%, 82%]) or conflict-of-interest statement (field-wide: 76% [70%, 82%]; prominent: 73% [67%, 79%]). Relatively few articles had a preregistration (field-wide: 7% [2.5%, 12%]; prominent: 14% [8.5%, 19%]), materials (field-wide: 16% [9%, 24%]; prominent: 19% [12%, 27%]), raw/primary data (field-wide: 14% [7%, 21%]; prominent: 16% [9.5%, 24%]), or analysis scripts (field-wide: 8.5% [4.5%, 13%]; prominent: 14% [9.5%, 19%]) that were immediately accessible without contacting authors or third parties. In conjunction with prior research, our results suggest transparency increased moderately from 2017 to 2022. Overall, despite considerable infrastructure improvements, bottom-up advocacy, and top-down policy initiatives, research transparency continues to be widely neglected in psychology.

1 February 2026 in American Psychologist
Verified
Journal Article
Closed access
BCBeth Clarke
Beth Clarke
PLPui Yu (Katherine) Lee
Pui Yu (Katherine) Lee
SSSarah R. Schiavone
Sarah R. Schiavone
MRMijke Rhemtulla
Mijke Rhemtulla
SVSimine Vazire
Simine Vazire
Despite lip service about replication being a cornerstone of science, replications have historically received little real estate in the published literature. Following psychology's recent replication crisis, we assessed the prevalence of one type of replication contribution: direct replication articles-articles where a direct or close replication of a previously published study is one of the main contributions of the article. This prevalence provides one indicator of how much the field values and incentivizes this type of self-correction. We used a keyword search combined with manual checking to identify direct replication articles that were published from 2010 to 2021 in the 100 highest impact psychology journals. In total, only 0.2% of articles (169 articles out of 84,834) were direct replication articles. There was a small suggestive increase in the prevalence of direct replication articles over time. Additionally, journals with a stated policy of considering replication submissions (31% of journals) were 7.85 times more likely to publish direct replication articles than those without such a policy. Fifty-four out of 88 journals did not publish any direct replication articles in the 11 years surveyed. Our estimate is not the same as the prevalence of direct replication studies overall (direct replication results can be shared in many ways other than as direct replication articles in top journals). Ultimately, direct replication articles are still rare, with a few journals doing most of the heavy lifting. Based on these findings, we argue it would be premature to declare that psychology's replication crisis is over. (PsycInfo Database Record (c) 2025 APA, all rights reserved).

16 December 2023 in PsyArXiv
Verified
Preprint
Open access
BCBeth Clarke
Beth Clarke
PLPui Yu Lee
Pui Yu Lee
SSSarah R. Schiavone
Sarah R. Schiavone
MRMijke Rhemtulla
Mijke Rhemtulla
SVSimine Vazire
Simine Vazire
Despite lip service about replication being a cornerstone of science, replications have historically received little real estate in the published literature. Following psychology’s recent replication crisis, we assessed the prevalence of one type of replication contribution: direct replication articles — articles where a direct or close replication of a previously published study is one of the main contributions of the article. This prevalence provides one indicator of how much the field values and incentivizes this type of self-correction. We used a keyword search combined with manual checking to identify direct replication articles that were published from 2010 – 2021 in the 100 highest-impact psychology journals. In total, only 0.2% of articles (169 articles out 84,834) were direct replication articles. There was a small suggestive increase in the prevalence of direct replication articles over time. Additionally, journals with a stated policy of considering replication submissions (31% of journals) were 7.85 times more likely to publish direct replication articles than those without such a policy. Fifty-four out of 88 journals did not publish any direct replication articles in the eleven years surveyed. Our estimate is not the same as the prevalence of direct replication studies overall (direct replication results can be shared in many ways other than as direct replication articles in top journals). Ultimately, direct replication articles are still rare, with a few journals doing most of the heavy lifting. Based on these findings, we argue it would be premature to declare that psychology’s replication crisis is over.

11 June 2024 in PsyArXiv
Verified
Preprint
Open access
THTom Elis Hardwicke
Tom Elis Hardwicke
RTRobert T. Thibault
Robert T. Thibault
BCBeth Clarke
Beth Clarke
NMNicholas Moodie
Nicholas Moodie
SCSophia Crüwell
Sophia Crüwell
SVSimine Vazire
Simine Vazire
Over a decade of advocacy and policy reforms have attempted to increase the uptake of transparent research practices in the field of psychology; however, their collective impact is unclear. We estimated the prevalence of transparent research practices in (a) all psychology journals (i.e., field-wide); and (b) prominent psychology journals, by manually examining two random samples of 200 empirical articles (N = 400) published in 2022. Most articles had an open access version (field-wide: 74%, 95% confidence intervals [67%-79%]; prominent: 71% [64%-77%]) and included a funding statement (field-wide: 76% [70%-82%]; prominent: 76% [70%-82%]); or conflict of interest statement (field-wide: 76% [70%-82%]; prominent: 73% [67%-79%]). Relatively few articles had a preregistration (field-wide: 7% [2.5%-12%]; prominent: 14% [8.5%-19%]); materials (field-wide: 16% [9%-24%]; prominent: 19% [12%-27%]); raw/primary data (field-wide: 14% [7%-21%]; prominent: 16% [9.5%-24%]); or analysis scripts (field-wide: 8.5% [4.5%-13%]; prominent: 14% [9.5%-19%]) that were immediately accessible without contacting authors or third parties. In conjunction with prior research (Hardwicke et al., 2022), our results suggest transparency increased moderately from 2017 to 2022. Overall, despite considerable infrastructure improvements, bottom-up advocacy, and top-down policy initiatives, research transparency continues to be widely neglected in psychology.