25 September 2017 in Clinical Pharmacology & Therapeutics
17 December 2020 in Circulation
Background: Regulators are evaluating the use of non-interventional real-world evidence (RWE) studies to assess the effectiveness of medical products. The RCT-DUPLICATE initiative uses a structured process to design RWE studies emulating randomized controlled trials (RCTs) and compare results. Here, we report findings of the first 10 trial emulations, evaluating cardiovascular outcomes of antidiabetic or antiplatelet medications. Methods: We selected 3 active-controlled and 7 placebo-controlled RCTs for replication. Using patient-level claims data from US commercial and Medicare payers, we implemented inclusion/exclusion criteria, selected primary endpoints, and comparator populations to emulate those of each corresponding RCT. Within the trial-mimicking populations, we conducted propensity score matching to control for >120 pre-exposure confounders. All study parameters were prospectively defined and protocols registered before hazard ratios (HRs) and 95% confidence intervals (CIs) were computed. Success criteria for the primary analysis were pre-specified for each replication. Results: Despite attempts to emulate RCT design as closely as possible, differences between the RCT and corresponding RWE study populations remained. The regulatory conclusions were equivalent in 6 of 10. The RWE emulations achieved a HR estimate that was within the 95% CI from the corresponding RCT in 8 of 10 studies. In 9 of 10, either the regulatory or estimate agreement success criteria were fulfilled. The largest differences in effect estimates were found for RCTs where second-generation sulfonylureas were used as a proxy for placebo regarding cardiovascular effects. Nine of 10 replications had a standardized difference between effect estimates of <2, which suggests differences within expected random variation. Conclusions: Agreement between RCT and RWE findings varies depending on which agreement metric is used. Interim findings indicate that selection of active comparator therapies with similar indications and use patterns enhances the validity of RWE. Even in the context of active comparators, concordance between RCT and RWE findings is not guaranteed, partially because trials are not emulated exactly. More trial emulations are needed to understand how often and in what contexts RWE findings match RCTs. Clinical Trial Registration: URL: https://clinicaltrials.gov Unique Identifiers: NCT03936049, NCT04215523, NCT04215536, NCT03936010, NCT03936036, NCT03936062, NCT03936023, NCT03648424, NCT04237935, NCT04237922
9 December 2013 in Statistics in Medicine
1 September 2016 in American Journal of Obstetrics and Gynecology
1 September 2013 in Medical Care
Background: Classifying medication adherence is important for efficiently targeting adherence improvement interventions. The purpose of this study was to evaluate the use of a novel method, group-based trajectory models, for classifying patients by their long-term adherence. Research Design: We identified patients who initiated a statin between June 1, 2006 and May 30, 2007 in prescription claims from CVS Caremark and evaluated adherence over the subsequent 15 months. We compared several adherence summary measures, including proportion of days covered (PDC) and trajectory models with 2–6 groups, with the observed adherence pattern, defined by monthly indicators of full adherence (defined as having ≥24 d covered of 30). We also compared the accuracy of adherence prediction based on patient characteristics when adherence was defined by either a trajectory model or PDC. Results: In 264,789 statin initiators, the 6-group trajectory model summarized long-term adherence best (C=0.938), whereas PDC summarized less well (C=0.881). The accuracy of adherence predictions was similar whether adherence was classified by PDC or by trajectory model. Conclusions: Trajectory models summarized adherence patterns better than traditional approaches and were similarly predicted by covariates. Group-based trajectory models may facilitate targeting of interventions and may be useful to adjust for confounding by health-seeking behavior.
1 May 2013 in Epidemiology
Nonrandomized pharmacoepidemiology generally compares one medication with another. For many conditions, clinicians can benefit from comparing the safety and effectiveness of three or more appropriate treatment options. We sought to compare three treatment groups simultaneously by creating 1:1:1 propensity score-matched cohorts. We developed a technique that estimates generalized propensity scores and then creates 1:1:1 matched sets. We compared this methodology with two existing approaches—construction of matched cohorts through a common-referent group and a pairwise match for each possible contrast. In a simulation, we varied unmeasured confounding, presence of treatment effect heterogeneity, and the prevalence of treatments and compared each method’s bias, variance, and mean squared error (MSE) of the treatment effect. We applied these techniques to a cohort of rheumatoid arthritis patients treated with nonselective nonsteroidal anti-inflammatory drugs, COX-2 selective inhibitors, or opioids. We performed 1000 simulation runs. In the base case, we observed an average bias of 0.4% (MSE × 100 = 0.2) in the three-way matching approach and an average bias of 0.3% (MSE × 100 = 0.2) with the pairwise technique. The techniques showed differing bias and MSE with increasing treatment effect heterogeneity and decreasing propensity score overlap. With highly unequal exposure prevalences, strong heterogeneity, and low overlap, we observed a bias of 6.5% (MSE × 100 = 10.8) in the three-way approach and 12.5% (MSE × 100 = 12.3) in the pairwise approach. The empirical study displayed better covariate balance using the pairwise approach. Point estimates were substantially similar. Our matching approach offers an effective way to study the safety and effectiveness of three treatment options. We recommend its use over the pairwise or common-referent approaches.