Contributor Roles Taxonomy (CRediT) has recently changed how author contributions are acknowledged. To extend and complement CRediT, we propose MeRIT, a new way of writing the Methods section using the author’s initials to further clarify contributor roles for reproducibility and replicability. Lack of information on authors’ contribution to specific aspects of a study hampers reproducibility and replicability. Here, the authors propose a new, easily implemented reporting system to clarify contributor roles in the Methods section of an article.
31 July 2024 in Proceedings Of The Royal Society B-Biological Sciences
In a growing digital landscape, enhancing the discoverability and resonance of scientific articles is essential. Here, we offer 10 recommendations to amplify the discoverability of studies in search engines and databases. Particularly, we argue that the strategic use and placement of key terms in the title, abstract and keyword sections can boost indexing and appeal. By surveying 230 journals in ecology and evolutionary biology, we found that current author guidelines may unintentionally limit article findability. Our survey of 5323 studies revealed that authors frequently exhaust abstract word limits—particularly those capped under 250 words. This suggests that current guidelines may be overly restrictive and not optimized to increase the dissemination and discoverability of digital publications. Additionally, 92% of studies used redundant keywords in the title or abstract, undermining optimal indexing in databases. We encourage adopting structured abstracts to maximize the incorporation of key terms in titles, abstracts and keywords. In addition, we encourage the relaxation of abstract and keyword limitations in journals with strict guidelines, and the inclusion of multilingual abstracts to broaden global accessibility. These recommendations to editors are designed to improve article engagement and facilitate evidence synthesis, thereby aligning scientific publishing with the modern needs of academic research.
Per- and polyfluoroalkyl substances (PFAS) threaten ecosystems worldwide due to their persistence, bioaccumulation, and toxicity. Through a global-scale meta-analysis of 119 aquatic and terrestrial food webs from 64 studies, we analyse 1009 trophic magnification factors (TMFs) for 72 PFAS and identify key variability drivers. On average, PFAS concentrations double with each trophic level increase (mean TMF = 2.00, 95% CI:1.64-2.45), though magnification varies considerably by compound. Notably, the industrial alternative F-53B exhibits the highest magnification (TMF = 3.07, 95% CI:2.41-3.92), a critical finding given its expanding use and minimal regulatory scrutiny. Methodological disparities across studies emerge as the dominant source of TMF variability. Our models explain 85% of the variation in TMFs, underscoring predictive capacity. This synthesis establishes PFAS as persistent trophic multipliers and provides a framework to prioritise high-risk compounds and harmonise biomagnification assessments. Our results call for consideration of stricter PFAS regulation to curb cascading ecological and health impacts.
Meta‐analysis produces a quantitative synthesis of evidence‐based knowledge, shaping not only research trends but also policies and practices in biology. However, two statistical issues, selective reporting and statistical dependence, can severely distort meta‐analytic parameter estimation and inference. Here, we re‐analyse 448 meta‐analyses to demonstrate a new two‐step procedure to deal with two common challenges in biological meta‐analyses that often occur simultaneously: publication bias and non‐independence. First, we employ bias‐robust weighting schemes under the generalized least square estimator to obtain average effect sizes that are more robust to selective reporting. We then use cluster‐robust variance estimation to account for statistical dependence, reducing bias in estimating standard errors and ensuring valid statistical inference. The first step of our approach demonstrates comparable performance in estimating average effect sizes to the existing publication‐bias adjustment methods in the presence of selective reporting. This equivalence holds across two publication bias selection processes. The second step achieves estimates of standard errors consistent with the multilevel meta‐analytic model, a benchmark method with adequate control of Type I error rates for multiple, statistically dependent effect sizes. Re‐analyses of 448 meta‐analyses show that ignoring these two issues tends to overestimate effect sizes by an average of 110% and underestimate standard errors by 120%. To facilitate implementation, we have developed a website including a step‐by‐step tutorial. Complementing current meta‐analytic workflows with the proposed method as a sensitivity analysis can facilitate a transition to a more robust approach in quantitative evidence synthesis.
30 September 2024 in Methods in Ecology and Evolution
Simulation studies are essential tools to assess statistical methods. Functioning as controlled experiments, simulations generate data from known underlying processes. However, unclear or incomplete reporting of simulation studies can impact their interpretability and reproducibility, potentially leading to the misuse of statistical methods. While Morris et al. (2019, Stat Med, 38, p. 2074) recently provided guidance on the planning and conduct of simulation studies for statistical method evaluation, there is currently no comprehensive set of reporting guidelines in ecology and evolutionary biology. Here, we propose 11 reporting items for statistical simulation studies extending on Morris and colleagues' guidance. These items span across three stages: planning, coding and analysis. We also clarify the terminology related to statistical components and the broad purposes of statistical simulation studies. To highlight our proposed reporting items with current practices, we surveyed 100 articles in ecology and evolution journals that included a simulation study evaluating a statistical method. Our survey found room for improvement in more transparent reporting to ensure clear evaluation of statistical methods. Most notably, only a small proportion of articles reported a Monte Carlo uncertainty (17%; 17 out of 98), and 32% (32 out of 100) articles did not provide code. Beyond the proposed reporting items, we discuss the benefits of open science tools to enhance the reproducibility of simulation studies. Specifically, we propose the registration of statistical simulation studies to enhance planning, reporting and collaboration. We aim to instigate discussions to improve the reporting of simulation studies for statistical method research. The reporting items we propose, along with open science tools, serve as a template for developing standards and guidelines for simulation studies evaluating statistical methods. These reporting guidelines will help enhance reproducibility and indirectly encourage more consideration in the design and conduct of these simulation studies.
Heterogeneity is a defining feature of ecological and evolutionary meta‐analyses. While conventional meta‐analysis and meta‐regression methods acknowledge heterogeneity in effect sizes, they typically assume this heterogeneity is constant across studies and levels of moderators (i.e., homoscedasticity). This assumption could mask potentially informative patterns in the data. Here, we introduce and develop a location‐scale meta‐analysis and meta‐regression framework that models both the mean (location) and variance (scale) of effect sizes. Such a framework explicitly accommodates heteroscedasticity (differences in variance), thereby revealing when and why heterogeneity itself changes. This capability, we argue, is crucial for understanding responses to global environmental change, where complex, context‐dependent processes may shape both the average magnitude and the variability of biological responses. For example, differences in study design, measurement protocols, environmental factors, or even evolutionary history can lead to systematic shifts in variance. By incorporating hierarchical (multilevel) structures and phylogenetic relationships, location‐scale models can disentangle the contributions from different levels to both location and scale parts. We further attempt to extend the concepts of relative heterogeneity and publication bias into the scale part of meta‐regression. With these methodological advances, we can identify patterns and processes that remain obscured under the constant variance assumption, thereby enhancing the biological interpretability and practical relevance of meta‐analytic results. Notably, almost all published ecological and evolutionary meta‐analytic data can be re‐analysed using our proposed analytic framework to gain new insights. Altogether, location‐scale meta‐analysis and meta‐regression provide a rich and holistic lens through which to view and interpret the intricate tapestry woven with ecological and evolutionary data. The proposed approach, thus, ultimately leads to more informed and context‐specific conclusions about environmental changes and their impacts.