There is limited guidance on the design of stepped wedge cluster randomised trials. Current methodological literature focuses mainly on trials with cross-sectional data collection at discrete times, yet many recent stepped wedge trials do not follow this design. In this article, we present a typology to characterise the full range of stepped wedge designs, and offer guidance on several other design aspects. We developed a framework to define and report the key characteristics of a stepped wedge trial, including cluster allocation and individual participation. We also considered the relative strengths and weaknesses of trials according to this framework. We classified recently published stepped wedge trials using this framework and identified illustrative case studies. We identified key design choices and developed guidance for each. We identified three main stepped wedge designs: those with a closed cohort, an open cohort, and a continuous recruitment short exposure design. In the first two designs, many individuals experience both control and intervention conditions. In the final design, individuals are recruited in continuous time as they become eligible and experience either the control or intervention condition, but not both, and then provide an outcome measurement at follow-up. While most stepped wedge trials use simple randomisation, stratification and restricted randomisation are often feasible and may be useful. Some recent studies collect outcome information from individuals exposed a long time before or after the rollout period, but this contributes little to the primary analysis. Incomplete designs should be considered when the intervention cannot be implemented quickly. Carry-over effects can arise in stepped wedge trials with closed and open cohorts. Stepped wedge trial designs should be reported more clearly. Researchers should consider the use of stratified and/or restricted randomisation. Trials should generally not commit resources to collect outcome data from individuals exposed a long time before or after the rollout period. Though substantial carry-over effects are uncommon in stepped wedge trials, researchers should consider their possibility before conducting a trial with closed or open cohorts.
In a stepped wedge, cluster randomised trial, clusters receive the intervention at different time points, and the order in which they received it is randomised. Previous systematic reviews of stepped wedge trials have documented a steady rise in their use between 1987 and 2010, which was attributed to the design’s perceived logistical and analytical advantages. However, the interventions included in these systematic reviews were often poorly reported and did not adequately describe the analysis and/or methodology used. Since 2010, a number of additional stepped wedge trials have been published. This article aims to update previous systematic reviews, and consider what interventions were tested and the rationale given for using a stepped wedge design. We searched PubMed, PsychINFO, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), the Web of Science, the Cochrane Library and the Current Controlled Trials Register for articles published between January 2010 and May 2014. We considered stepped wedge randomised controlled trials in all fields of research. We independently extracted data from retrieved articles and reviewed them. Interventions were then coded using the functions specified by the Behaviour Change Wheel, and for behaviour change techniques using a validated taxonomy. Our review identified 37 stepped wedge trials, reported in 10 articles presenting trial results, one conference abstract, 21 protocol or study design articles and five trial registrations. These were mostly conducted in developed countries (n = 30), and within healthcare organisations (n = 28). A total of 33 of the interventions were educationally based, with the most commonly used behaviour change techniques being ‘instruction on how to perform a behaviour’ (n = 32) and ‘persuasive source’ (n = 25). Authors gave a wide range of reasons for the use of the stepped wedge trial design, including ethical considerations, logistical, financial and methodological. The adequacy of reporting varied across studies: many did not provide sufficient detail regarding the methodology or calculation of the required sample size. The popularity of stepped wedge trials has increased since 2010, predominantly in high-income countries. However, there is a need for further guidance on their reporting and analysis.
Stepped wedge cluster randomised trials introduce interventions to groups of clusters in a random order and have been used to evaluate interventions for health and wellbeing. Standardised guidance for reporting stepped wedge trials is currently absent, and a range of potential analytic approaches have been described. We systematically identified and reviewed recently published (2010 to 2014) analyses of stepped wedge trials. We extracted data and described the range of reporting and analysis approaches taken across all studies. We critically appraised the strategy described by three trials chosen to reflect a range of design characteristics. Ten reports of completed analyses were identified. Reporting varied: seven of the studies included a CONSORT diagram, and only five also included a diagram of the intervention rollout. Seven assessed the balance achieved by randomisation, and there was considerable heterogeneity among the approaches used. Only six reported the trend in the outcome over time. All used both ‘horizontal’ and ‘vertical’ information to estimate the intervention effect: eight adjusted for time with a fixed effect, one used time as a condition using a Cox proportional hazards model, and one did not account for time trends. The majority used simple random effects to account for clustering and repeat measures, assuming a common intervention effect across clusters. Outcome data from before and after the rollout period were often included in the primary analysis. Potential lags in the outcome response to the intervention were rarely investigated. We use three case studies to illustrate different approaches to analysis and reporting. There is considerable heterogeneity in the reporting of stepped wedge cluster randomised trials. Correct specification of the time-trend underlies the validity of the analytical approaches. The possibility that intervention effects vary by cluster or over time should be considered. Further work should be done to standardise the reporting of the design, attrition, balance, and time-trends in stepped wedge trials.
Secondary education among lower caste adolescent girls living in rural Karnataka, South India, is characterized by high rates of school drop‐out and absenteeism. A cross‐sectional baseline survey (N=2275) was conducted in 2014 as part of a cluster‐randomized control trial among adolescent girls (13‐14 year) and their families from marginalized communities in two districts of north Karnataka. Bivariate and multivariate logistic regression models were used. Overall, 8.7% girls reported secondary school dropout and 8.1% reported frequent absenteeism (past month). In adjusted analyses, economic factors (household poverty; girls' work‐related migration), social norms and practices (child marriage; value of girls' education), and school‐related factors (poor learning environment and bullying/harassment at school) were associated with an increased odds of school dropout and absenteeism. Interventions aiming to increase secondary school retention among marginalized girls may require a multi‐level approach, with synergistic components that address social, structural and economic determinants of school absenteeism and dropout.
Researchers should consider five questions before starting a stepped wedge trial. Why are you planning one? Researchers sometimes think that stepped wedge trials are useful when there is little doubt about the benefit of the intervention being tested. However, if the primary reason for an intervention is to measure its effect, without equipoise there is no ethical justification for delaying implementation in some clusters. By contrast, if you are undertaking pragmatic research, where the primary reason for rolling out the intervention is for it to exert its benefits, and if phased implementation is inevitable, a stepped wedge trial is a valid option and provides better evidence than most non-randomized evaluations. What design will you use? Two common stepped wedge designs are based on the recruitment of a closed or open cohort. In both, individuals may experience both control and intervention conditions and you should be concerned about carry-over effects. In a third, continuous-recruitment, short-exposure design, individuals are recruited as they become eligible and experience either control or intervention condition, but not both. How will you conduct the primary analysis? In stepped wedge trials, control of confounding factors through secular variation is essential. ‘Vertical’ approaches preserve randomization and compare outcomes between randomized groups within periods. ‘Horizontal’ approaches compare outcomes before and after crossover to the intervention condition. Most analysis models used in practice combine both types of comparison. The appropriate analytic strategy should be considered on a case-by-case basis. How large will your trial be? Standard sample size calculations for cluster randomized trials do not accommodate the specific features of stepped wedge trials. Methods exist for many stepped wedge designs, but simulation-based calculations provide the greatest flexibility. In some scenarios, such as when the intracluster correlation coefficient is moderate or high, or the cluster size is large, a stepped wedge trial may require fewer clusters than a parallel cluster trial. How will you report your trial? Stepped wedge trials are currently challenging to report using CONSORT principles. Researchers should consider how to demonstrate balance achieved by randomization and how to describe trends for outcomes in both intervention and control clusters.
22 July 2019 in Journal of the International AIDS Society
Introduction: UNAIDS’ goal of ending AIDS by 2030 is unreachable without better targeting of testing, prevention and care. Female sex workers (FSW) in Zimbabwe are at high risk of HIV acquisition and transmission. Here, we report on collated programme and research data from Zimbabwe's national sex work programme. We also assess the potential for wider population impact of FSW programmes by modelling the impact on HIV incidence of eliminating transmission through FSW (i.e. calculate the population attributable fraction of incidence attributable to sex work).Methods: Descriptive analyses of individual‐level programme data collected from FSW between 2009 and June 2018 are triangulated with data collected through 37 respondent driven sampling surveys from 19 sites in Zimbabwe 2011 to 2017. We describe programme coverage, uptake, retention and patterns of sex work behaviour and gaps in service provision. An individual‐level stochastic simulation model is used to reconstruct the epidemic and then the incidence compared with the counter‐factual trend in incidence from 2010 had transmission through sex work been eliminated from that date.Results: Sisters has reached >67,000 FSW since 2009, increasing attendance as number of sites, programme staff and peer educators were increased. Over 57% of all FSW estimated to be working in Zimbabwe in 2017 (n = 40,000) attended the programme at least once. The proportion of young FSW reached has increased with introduction of the “Young Sisters programme.” There are no clear differences in pattern of sex work across settings. Almost all women report condom use with clients at last sex (95%); however, consistent condom use with clients in the last month varies from 52% to 95% by site. Knowledge of HIV‐positive status has increased from 48 to 78% between 2011 and 2016, as has prevalence of ART use among diagnosed women (29 to 67%). Although subject to uncertainty, modelling suggests that 70% (90% range: 32%, 93%) of all new infections in Zimbabwe from 2010 are directly or indirectly attributable to transmission via sex work.Conclusions: It is feasible to increase coverage and impact of sex work programming through community‐led scale‐up of evidence‐based interventions. Eliminating transmission through commercial sex would likely have a substantial impact on new infections occurring more widely across Zimbabwe.