22 January 2013 in Medical Decision Making
Background. In health technology assessments (HTAs) of interventions that affect survival, it is essential to accurately estimate the survival benefit associated with the new treatment. Generally, trial data must be extrapolated, and many models are available for this purpose. The choice of extrapolation model is critical because different models can lead to very different cost-effectiveness results. A failure to systematically justify the chosen model creates the possibility of bias and inconsistency between HTAs. Objective. To demonstrate the limitations and inconsistencies associated with the survival analysis component of HTAs and to propose a process guide that will help exclude these from future analyses. Methods. We reviewed the survival analysis component of 45 HTAs undertaken for the National Institute for Health and Clinical Excellence (NICE) in the cancer disease area. We drew upon our findings to identify common limitations and to develop a process guide. Results. The chosen survival models were not systematically justified in any of the HTAs reviewed. The range of models considered was usually insufficient, and the rationale for the chosen model was universally limited: In particular, the plausibility of the extrapolated portion of fitted survival curves was very rarely explicitly considered. Limitations. We do not seek to describe and review all methods available for performing survival analysis—several approaches exist that are not mentioned in this article. Instead we seek to analyze methods commonly used in HTAs and limitations associated with their application. Conclusions. Survival analysis has not been conducted systematically in HTAs. A systematic approach such as the one proposed here is required to reduce the possibility of bias in cost-effectiveness results and inconsistency between technology assessments.
11 January 2011 in BMC Medical Research Methodology
We investigate methods used to analyse the results of clinical trials with survival outcomes in which some patients switch from their allocated treatment to another trial treatment. These included simple methods which are commonly used in medical literature and may be subject to selection bias if patients switching are not typical of the population as a whole. Methods which attempt to adjust the estimated treatment effect, either through adjustment to the hazard ratio or via accelerated failure time models, were also considered. A simulation study was conducted to assess the performance of each method in a number of different scenarios.
21 November 2014 in Statistical Methods in Medical Research
Estimates of the overall survival benefit of new cancer treatments are often confounded by treatment switching in randomised controlled trials (RCTs) – whereby patients randomised to the control group are permitted to switch onto the experimental treatment upon disease progression. In health technology assessment, estimates of the unconfounded overall survival benefit associated with the new treatment are needed. Several switching adjustment methods have been advocated in the literature, some of which have been used in health technology assessment. However, it is unclear which methods are likely to produce least bias in realistic RCT-based scenarios. We simulated RCTs in which switching, associated with patient prognosis, was permitted. Treatment effect size and time dependency, switching proportions and disease severity were varied across scenarios. We assessed the performance of alternative adjustment methods based upon bias, coverage and mean squared error, related to the estimation of true restricted mean survival in the absence of switching in the control group. We found that when the treatment effect was not time-dependent, rank preserving structural failure time models (RPSFTM) and iterative parameter estimation methods produced low levels of bias. However, in the presence of a time-dependent treatment effect, these methods produced higher levels of bias, similar to those produced by an inverse probability of censoring weights method. The inverse probability of censoring weights and structural nested models produced high levels of bias when switching proportions exceeded 85%. A simplified two-stage Weibull method produced low bias across all scenarios and provided the treatment switching mechanism is suitable, represents an appropriate adjustment method.
21 January 2014 in Medical Decision Making
Background. Treatment switching commonly occurs in clinical trials of novel interventions in the advanced or metastatic cancer setting. However, methods to adjust for switching have been used inconsistently and potentially inappropriately in health technology assessments (HTAs). Objective. We present recommendations on the use of methods to adjust survival estimates in the presence of treatment switching in the context of economic evaluations. Methods. We provide background on the treatment switching issue and summarize methods used to adjust for it in HTAs. We discuss the assumptions and limitations associated with adjustment methods and draw on results of a simulation study to make recommendations on their use. Results. We demonstrate that methods used to adjust for treatment switching have important limitations and often produce bias in realistic scenarios. We present an analysis framework that aims to increase the probability that suitable adjustment methods can be identified on a case-by-case basis. We recommend that the characteristics of clinical trials, and the treatment switching mechanism observed within them, should be considered alongside the key assumptions of the adjustment methods. Key assumptions include the “no unmeasured confounders” assumption associated with the inverse probability of censoring weights (IPCW) method and the “common treatment effect” assumption associated with the rank preserving structural failure time model (RPSFTM). Conclusions. The limitations associated with switching adjustment methods such as the RPSFTM and IPCW mean that they are appropriate in different scenarios. In some scenarios, both methods may be prone to bias; “2-stage” methods should be considered, and intention-to-treat analyses may sometimes produce the least bias. The data requirements of adjustment methods also have important implications for clinical trialists.