Angelika Marlene Stefan

Angelika Marlene Stefan

Auto-generated profile, based on publicly available information

Angelika Marlene Stefan

Department of Psychology, University of Liverpool, Liverpool, UK

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 February 2019 in Behavior Research Methods
Verified
Journal Article
Open access
PDF file
ASAngelika M. Stefan
Angelika M. Stefan
QGQuentin F. Gronau
Quentin F. Gronau
FSFelix D. Schönbrodt
Felix D. Schönbrodt
EWEric-Jan Wagenmakers
Eric-Jan Wagenmakers
Well-designed experiments are likely to yield compelling evidence with efficient sample sizes. Bayes Factor Design Analysis (BFDA) is a recently developed

8 February 2023 in Royal Society Open Science
Verified
Journal Article
Closed access
ASAngelika M. Stefan
Angelika M. Stefan
FSFelix D. Schönbrodt
Felix D. Schönbrodt
In many research fields, the widespread use of questionable research practices has jeopardized the credibility of scientific results. One of the most prominent questionable research practices isp-hacking. Typically,p-hacking is defined as a compound of strategies targeted at rendering non-significant hypothesis testing results significant. However, a comprehensive overview of thesep-hacking strategies is missing, and current meta-scientific research often ignores the heterogeneity of strategies. Here, we compile a list of 12p-hacking strategies based on an extensive literature review, identify factors that control their level of severity, and demonstrate their impact on false-positive rates using simulation studies. We also use our simulation results to evaluate several approaches that have been proposed to mitigate the influence of questionable research practices. Our results show that investigatingp-hacking at the level of strategies can provide a better understanding of the process ofp-hacking, as well as a broader basis for developing effective countermeasures. By making our analyses available through a Shiny app and R package, we facilitate future meta-scientific research aimed at investigating the ramifications ofp-hacking across multiple strategies, and we hope to start a broader discussion about different manifestations ofp-hacking in practice.

23 January 2019 in PsyArXiv
Verified
Preprint
Open access
JDJohnny van Doorn
Johnny van Doorn
DBDon van Den Bergh
Don van Den Bergh
UBUdo Bohm
Udo Bohm
FDFabian Dablander
Fabian Dablander
KDKoen Derks
Koen Derks
EWEric-Jan Wagenmakers
Eric-Jan Wagenmakers
Despite the increasing popularity of Bayesian inference in empirical research, few practical guidelines provide detailed recommendations for how to apply Bayesian procedures and interpret the results. Here we offer specific guidelines for four different stages of Bayesian statistical reasoning in a research setting: planning the analysis, executing the analysis, interpreting the results, and reporting the results. The guidelines for each stage are illustrated with a running example. Although the guidelines are geared toward analyses performed with the open-source statistical software JASP, most guidelines extend to Bayesian inference in general.

1 April 2022 in Psychological Methods
Verified
Journal Article
Closed access
ASAngelika M. Stefan
Angelika M. Stefan
NENathan J. Evans
Nathan J. Evans
EWEric-Jan Wagenmakers
Eric-Jan Wagenmakers
The Bayesian statistical framework requires the specification of prior distributions, which reflect predata knowledge about the relative plausibility of different parameter values. As prior distributions influence the results of Bayesian analyses, it is important to specify them with care. Prior elicitation has frequently been proposed as a principled method for deriving prior distributions based on expert knowledge. Although prior elicitation provides a theoretically satisfactory method of specifying prior distributions, there are several implicit decisions that researchers need to make at different stages of the elicitation process, each of them constituting important researcher degrees of freedom. Here, we discuss some of these decisions and group them into 3 categories: decisions about (a) the setup of the prior elicitation; (b) the core elicitation process; and (c) combination of elicited prior distributions from different experts. Importantly, different decision paths could result in greatly varying priors elicited from the same experts. Hence, researchers who wish to perform prior elicitation are advised to carefully consider each of the practical decisions before, during, and after the elicitation process. By explicitly outlining the consequences of these practical decisions, we hope to raise awareness for methodological flexibility in prior elicitation and provide researchers with a more structured approach to navigate the decision paths in prior elicitation. Making the decisions explicit also provides the foundation for further research that can identify evidence-based best practices that may eventually reduce the methodologically flexibility in prior elicitation. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

4 April 2022 in Psychonomic Bulletin & Review
Verified
Journal Article
Open access
PDF file
ASAngelika M. Stefan
Angelika M. Stefan
DKDimitris Katsimpokis
Dimitris Katsimpokis
QGQuentin F. Gronau
Quentin F. Gronau
EWEric-Jan Wagenmakers
Eric-Jan Wagenmakers
Bayesian inference requires the specification of prior distributions that quantify the pre-data uncertainty about parameter values. One way to specify prior distributions is through prior elicitation, an interview method guiding field experts through the process of expressing their knowledge in the form of a probability distribution. However, prior distributions elicited from experts can be subject to idiosyncrasies of experts and elicitation procedures, raising the spectre of subjectivity and prejudice. Here, we investigate the effect of interpersonal variation in elicited prior distributions on the Bayes factor hypothesis test. We elicited prior distributions from six academic experts with a background in different fields of psychology and applied the elicited prior distributions as well as commonly used default priors in a re-analysis of 1710 studies in psychology. The degree to which the Bayes factors vary as a function of the different prior distributions is quantified by three measures of concordance of evidence: We assess whether the prior distributions change the Bayes factor direction, whether they cause a switch in the category of evidence strength, and how much influence they have on the value of the Bayes factor. Our results show that although the Bayes factor is sensitive to changes in the prior distribution, these changes do not necessarily affect the qualitative conclusions of a hypothesis test. We hope that these results help researchers gauge the influence of interpersonal variation in elicited prior distributions in future psychological studies. Additionally, our sensitivity analyses can be used as a template for Bayesian robustness analyses that involve prior elicitation from multiple experts.

11 November 2019 in PsyArXiv
Verified
Preprint
Open access
DBDon van Den Bergh
Don van Den Bergh
JDJohnny van Doorn
Johnny van Doorn
MMMaarten Marsman
Maarten Marsman
TDTim Draws
Tim Draws
EKErik-Jan van Kesteren
Erik-Jan van Kesteren
EWEric-Jan Wagenmakers
Eric-Jan Wagenmakers
Analysis of variance (ANOVA) is the standard procedure for statistical inference in factorial designs. Typically, ANOVAs are executed using frequentist statistics, where p-values determine statistical significance in an all-or-none fashion. In recent years, the Bayesian approach to statistics is increasingly viewed as a legitimate alternative to the p-value. However, the broad adoption of Bayesian statistics –and Bayesian ANOVA in particular– is frustrated by the fact that Bayesian concepts are rarely taught in applied statistics courses. Consequently, practitioners may be unsure how to conduct a Bayesian ANOVA and interpret the results. Herewe provide a guide for executing and interpreting a Bayesian ANOVA with JASP, an open-source statistical software program with a graphical user interface. We explain the key concepts of the Bayesian ANOVA using twoempirical examples.