There has been an increasing interest in using expected value of information (EVI) theory in medical decision making, to identify the need for further research to reduce uncertainty in decision and as a tool for sensitivity analysis. Expected value of sample information (EVSI) has been proposed for determination of optimum sample size and allocation rates in randomized clinical trials. This article derives simple Monte Carlo, or nested Monte Carlo, methods that extend the use of EVSI calculations to medical decision applications with multiple sources of uncertainty, with particular attention to the form in which epidemiological data and research findings are structured. In particular, information on key decision parameters such as treatment efficacy are invariably available on measures of relative efficacy such as risk differences or odds ratios, but not on model parameters themselves. In addition, estimates of model parameters and of relative effect measures in the literature may be heterogeneous, reflecting additional sources of variation besides statistical sampling error. The authors describe Monte Carlo procedures for calculating EVSI for probability, rate, or continuous variable parameters in multi parameter decision models and approximate methods for relative measures such as risk differences, odds ratios, risk ratios, and hazard ratios. Where prior evidence is based on a random effects meta-analysis, the authors describe different ESVI calculations, one relevant for decisions concerning a specific patient group and the other for decisions concerning the entire population of patient groups. They also consider EVSI methods for new studies intended to update information on both baseline treatment efficacy and the relative efficacy of 2 treatments. Although there are restrictions regarding models with prior correlation between parameters, these methods can be applied to the majority of probabilistic decision models. Illustrative worked examples of EVSI calculations are given in an appendix.
31 August 2005 in Journal of the Royal Statistical Society Series A: Statistics in Society
Network meta‐analysis (NMA) is an extension of pairwise meta‐analysis (PMA) which combines evidence from trials on multiple treatments in connected networks. NMA delivers internally consistent estimates of relative treatment efficacy, needed for rational decision making. Over its first 20 years NMA's use has grown exponentially, with applications in both health technology assessment (HTA), primarily re‐imbursement decisions and clinical guideline development, and clinical research publications. This has been a period of transition in meta‐analysis, first from its roots in educational and social psychology, where large heterogeneous datasets could be explored to find effect modifiers, to smaller pairwise meta‐analyses in clinical medicine on average with less than six studies. This has been followed by narrowly‐focused estimation of the effects of specific treatments at specific doses in specific populations in sparse networks, where direct comparisons are unavailable or informed by only one or two studies. NMA is a powerful and well‐established technique but, in spite of the exponential increase in applications, doubts about the reliability and validity of NMA persist. Here we outline the continuing controversies, and review some recent developments. We suggest that heterogeneity should be minimized, as it poses a threat to the reliability of NMA which has not been fully appreciated, perhaps because it has not been seen as a problem in PMA. More research is needed on the extent of heterogeneity and inconsistency in datasets used for decision making, on formal methods for making recommendations based on NMA, and on the further development of multi‐level network meta‐regression.
Immune correlates of protection from COVID-19 are incompletely understood. 2,826 keyworkers had T-SPOT ®Discovery SARS-CoV-2 tests (measuring interferon-γ secreting, SARS-CoV-2 responsive T cells, Oxford Immunotec Ltd), and anti-Spike S1 domain IgG antibody levels (EuroImmun AG) performed on recruitment into a cohort study. 285/2,826 (10.1%) of participants had positive SARS-CoV-2 RT-PCR tests, predominantly associated with symptomatic illness, during 200 days followup. T cell responses to Spike, Nucleoprotein and Matrix proteins (SNM responses) were detected in some participants at recruitment, as were anti-Spike S1 IgG antibodies; higher levels of both were associated with protection from subsequent SARS-CoV-2 test positivity. In volunteers with moderate antibody responses, who represented 39% (252/654) of those with detectable anti-Spike IgG, protection was partial, and higher with higher circulating T cell SNM responses. SARS-CoV-2 responsive T cell numbers predict protection in individuals with low anti-Spike IgG responses; serology alone underestimates the proportion of the population protected after infection.