2 April 2018 in BMC Health Services Research
Little is known about the contextual factors affecting the uptake of evidence-based chronic disease interventions in the United States and in other countries. This study sought to better understand the contextual similarities and differences influencing the dissemination and implementation of evidence-based chronic disease prevention (EBCDP) in Australia, Brazil, China, and the United States. Between February and July 2015, investigators in each country conducted qualitative, semi-structured interviews (total N = 50) with chronic disease prevention practitioners, using interview guides that covered multiple domains (e.g., use of and access to EBCDP interventions, barriers and facilitators to the implementation of EBCDP interventions). Practitioners across the four countries reported only a few programmatic areas in which repositories of EBCDP interventions were used within their workplace. Across countries, academic journals were the most frequently cited channels for accessing EBCDP interventions, though peers were commonly cited as the most useful. Lack of time and heavy workload were salient personal barriers among practitioners in Australia and the United States, while lack of expertise in developing and implementing EBCDP interventions was more pertinent among practitioners from Brazil and China. Practitioners in all four countries described an organizational culture that was unsupportive of EBCDP. Practitioners in Brazil, China and the United States cited an inadequate number of staff support to implement EBCDP interventions. A few practitioners in Australia and China cited lack of access to evidence. Partnerships were emphasized as key facilitators to implementing EBCDP interventions across all countries. This study is novel in its cross-country qualitative exploration of multilevel constructs of EBCDP dissemination and implementation. The interviews produced rich findings about many contextual similarities and differences with EBCDP that can inform both cross-country and country-specific research and practice to address barriers and improve EBCDP implementation among the four countries long-term.
25 July 2023 in BMJ Evidence-Based Medicine
Background Some have argued that pilot trials have little value for informing the expected effect size of a subsequent large trial. This study aims to empirically evaluate the roles of pilot trials in informing the effect and sample size estimates of a full-scale trial. Methods We conducted a search in PubMed on 19 February 2022, for all pilot trials published between 2005 and 2018 and their subsequent full-scale trials. We analysed the agreement in results by comparing the direction and magnitude of the effect size in the pilot trial and full-scale trial. Logistic regression was used to explore whether a significant pilot trial and other characteristics were associated with a significant full-scale trial. Results A total of 248 pairs of pilot and full-scale trials were analysed. Full-scale trials with a significant pilot trial were 2.72 times more likely to find a significant result for the primary efficacy outcome than those with a non-significant pilot trial (95% CI 1.52 to 4.86, p=0.001). The association remained significant irrespective of changes made to the trial design. In 73% of the pairs, the pilot trial produced a larger point estimate than the subsequent full-scale trial, but 87% of pairs had a 95% CI estimated by the pilot trial that covered the full-scale trial point estimate. Full-scale trials with a sample size estimated using the SD from the pilot trial were less likely to yield a significant result (OR=0.26, 95% CI 0.10 to 0.65, p=0.004). Conclusion Pilot trials can provide strong signals on intervention efficacy. When determining the sample size for full-scale trials, using the CI bounds from the pilot trials instead of the point estimate may improve power estimation.
31 March 2026 in MetaArXiv
Defining outcomes completely before conducting clinical trials helps to mitigate reporting biases; however, there is limited guidance to help investigators define outcomes completely. We aimed to develop a structured approach for defining trial outcomes completely and consistently.We reviewed literature, developed preliminary rules for defining outcomes, and refined them iteratively. We randomly selected randomized controlled trials (RCTs) on ClinicalTrials.gov that registered before their start dates and posted results by January 4, 2024. The 225 included RCTs evaluated 3,424 outcomes. Two raters independently applied preliminary rules to define each outcome. When raters encountered outcomes they could not define, we refined the rules. We continued this process until no further changes were needed. We discussed and finalized our approach in a consensus meeting.We define an “outcome” as a value for each participant that will be used in analysis to generate study results. A complete outcome definition includes six elements: outcome domain, specific measurement, specific metric, cutoff, variable type, and timepoint. We developed rules for naming specific measurements for both subjective and objective outcomes. We expanded on prior work by developing more comprehensive categories for specific metrics. We introduced "cutoff" as a distinct element with three subelements. To clarify the boundary between outcome definitions and statistical methods, we replaced a previously described element, "method of aggregation," with "variable type," which refers to whether the value for each individual is continuous or categorical.Trialists and sponsors could use this approach alongside other guidelines to define outcomes in trial registrations, protocols, and result reports.