26 August 2003 in Biometrics
Summary. Accurate diagnosis of disease is a critical part of health care. New diagnostic and screening tests must be evaluated based on their abilities to discriminate diseased from nondiseased states. The partial area under the receiver operating characteristic (ROC) curve is a measure of diagnostic test accuracy. We present an interpretation of the partial area under the curve (AUC), which gives rise to a nonparametric estimator. This estimator is more robust than existing estimators, which make parametric assumptions. We show that the robustness is gained with only a moderate loss in efficiency. We describe a regression modeling framework for making inference about covariate effects on the partial AUC. Such models can refine knowledge about test accuracy. Model parameters can be estimated using binary regression methods. We use the regression framework to compare two prostate‐specific antigen biomarkers and to evaluate the dependence of biomarker accuracy on the time prior to clinical diagnosis of prostate cancer.
1 August 2008 in Journal of Clinical Oncology
Progression-free survival is an important end point in advanced disease settings. Blinded independent central review (BICR) of progression in randomized clinical trials has been advocated to control bias that might result from errors in progression assessments. However, although BICR lessens some potential biases, it does not remove all biases from evaluations of treatment effectiveness. In fact, as typically conducted, BICRs may introduce bias because of informative censoring, which results from having to censor unconfirmed locally determined progressions. In this article, we discuss the rationale for BICR and different ways of implementing independent review. We discuss the limitations of these approaches and review published trials that report implementing BICR. We demonstrate the existence of informative censoring using data from a randomized phase II trial. We conclude that double-blinded trials with consistent application of measurement criteria are the best means of ensuring unbiased trial results. When such designs are not practical, BICR is not recommended as a general strategy for reducing bias. However, BICR may be useful as an auditing tool to assess the reliability of marginally positive results.
1 January 2009 in European Journal of Cancer
16 July 2020 in Clinical Trials
Background: Endpoint choice for randomized controlled trials of treatments for novel coronavirus-induced disease (COVID-19) is complex. Trials must start rapidly to identify treatments that can be used as part of the outbreak response, in the midst of considerable uncertainty and limited information. COVID-19 presentation is heterogeneous, ranging from mild disease that improves within days to critical disease that can last weeks to over a month and can end in death. While improvement in mortality would provide unquestionable evidence about the clinical significance of a treatment, sample sizes for a study evaluating mortality are large and may be impractical, particularly given a multitude of putative therapies to evaluate. Furthermore, patient states in between “cure” and “death” represent meaningful distinctions. Clinical severity scores have been proposed as an alternative. However, the appropriate summary measure for severity scores has been the subject of debate, particularly given the variable time course of COVID-19. Outcomes measured at fixed time points, such as a comparison of severity scores between treatment and control at day 14, may risk missing the time of clinical benefit. An endpoint such as time to improvement (or recovery) avoids the timing problem. However, some have argued that power losses will result from reducing the ordinal scale to a binary state of “recovered” versus “not recovered.” Methods: We evaluate statistical power for possible trial endpoints for COVID-19 treatment trials using simulation models and data from two recent COVID-19 treatment trials. Results: Power for fixed time-point methods depends heavily on the time selected for evaluation. Time-to-event approaches have reasonable statistical power, even when compared with a fixed time-point method evaluated at the optimal time. Discussion: Time-to-event analysis methods have advantages in the COVID-19 setting, unless the optimal time for evaluating treatment effect is known in advance. Even when the optimal time is known, a time-to-event approach may increase power for interim analyses.
1 April 2004 in Academic Radiology
11 February 2016 in The Journal of Infectious Diseases
Background. Unique challenges posed by emerging infectious diseases often expose inadequacies in the conventional phased investigational therapeutic development paradigm. The recent Ebola outbreak in West Africa presents a critical case-study highlighting barriers to faster development. During the outbreak, clinical trials were implemented with unprecedented speed. Yet, in most cases, this fast-tracked approach proved too slow for the rapidly evolving epidemic. Controversy abounded as to the most appropriate study designs to yield safety and efficacy data, potentially causing delays in pivotal studies. Preparation for research during future outbreaks may require acceptance of a paradigm that circumvents, accelerates, or reorders traditional phases, without losing sight of the traditional benchmarks by which drug candidates must be assessed for activity, safety and efficacy. Methods. We present the design of an adaptive, parent protocol, ongoing in West Africa until January 2016. The exigent circumstances of the outbreak and limited prior clinical experience with experimental treatments, led to more direct bridging from preclinical studies to human trials than the conventional paradigm would typically have sanctioned, and required considerable design flexibility. Results. Preliminary evaluation of the “barely Bayesian” design was provided through computer simulation studies. The understanding and public discussion of the study design will help its future implementation.