1 November 2015 in Health Technology Assessment
Background: Determination of the presence or absence of bacterial infection is important to guide appropriate therapy and reduce antibiotic exposure. Procalcitonin (PCT) is an inflammatory marker that has been suggested as a marker for bacterial infection.Objectives: To assess the clinical effectiveness and cost-effectiveness of adding PCT testing to the information used to guide antibiotic therapy in adults and children (1) with confirmed or highly suspected sepsis in intensive care and (2) presenting to the emergency department (ED) with suspected bacterial infection.Methods: Twelve databases were searched to June 2014. Randomised controlled trials were assessed for quality using the Cochrane Risk of Bias tool. Summary relative risks (RRs) and weighted mean differences (WMDs) were estimated using random-effects models. Heterogeneity was assessed visually using forest plots and statistically using theI2andQstatistics and investigated through subgroup analysis. The cost-effectiveness of PCT testing in addition to current clinical practice was compared with current clinical practice using a decision tree with a 6 months’ time horizon.Results: Eighteen studies (36 reports) were included in the systematic review. PCT algorithms were associated with reduced antibiotic duration [WMD –3.19 days, 95% confidence interval (CI) –5.44 to –0.95 days,I2 = 95.2%; four studies], hospital stay (WMD –3.85 days, 95% CI –6.78 to –0.92 days,I2 = 75.2%; four studies) and a trend towards reduced intensive care unit (ICU) stay (WMD –2.03 days, 95% CI –4.19 to 0.13 days,I2 = 81.0%; four studies). There were no differences for adverse clinical outcomes. PCT algorithms were associated with a reduction in the proportion of adults (RR 0.77, 95% CI 0.68 to 0.87; seven studies) and children (RR 0.86, 95% CI 0.80 to 0.93) receiving antibiotics, reduced antibiotic duration (two studies). There were no differences for adverse clinical outcomes. All but one of the studies in the ED were conducted in people presenting with respiratory symptoms.Cost-effectiveness: the base-case analyses indicated that PCT testing was cost-saving for (1) adults with confirmed or highly suspected sepsis in an ICU setting; (2) adults with suspected bacterial infection presenting to the ED; and (3) children with suspected bacterial infection presenting to the ED. Cost-savings ranged from £368 to £3268. Moreover, PCT-guided treatment resulted in a small quality-adjusted life-year (QALY) gain (ranging between < 0.001 and 0.005). Cost-effectiveness acceptability curves showed that PCT-guided treatment has a probability of ≥ 84% of being cost-effective for all settings and populations considered (at willingness-to-pay thresholds of £20,000 and £30,000 per QALY).Conclusions: The limited available data suggest that PCT testing may be effective and cost-effective when used to guide discontinuation of antibiotics in adults being treated for suspected or confirmed sepsis in ICU settings and initiation of antibiotics in adults presenting to the ED with respiratory symptoms and suspected bacterial infection. However, it is not clear that observed costs and effects are directly attributable to PCT testing, are generalisable outside people presenting with respiratory symptoms (for the ED setting) and would be reproducible in the UK NHS. Further studies are needed to assess the effectiveness of adding PCT algorithms to the information used to guide antibiotic treatment in children with suspected or confirmed sepsis in ICU settings. Additional research is needed to examine whether the outcomes presented in this report are fully generalisable to the UK.Study registration: This study is registered as PROSPERO CRD42014010822.Funding: The National Institute for Health Research Health Technology Assessment programme.
1 December 2011 in Respiratory Research
Interactions between spirometry and patient-reported outcomes in COPD are not well understood. This systematic review and study-level analysis investigated the relationship between changes in FEV1 and changes in health status with bronchodilator therapy.
24 October 2017 in BMC Medicine
This study has attempted to assess the effectiveness of quantitative faecal immunochemical tests (FIT) for triage of people presenting with lower abdominal symptoms, where a referral to secondary care for investigation of suspected colorectal cancer (CRC) is being considered, particularly when the 2-week criteria are not met. We conducted a systematic review following published guidelines for systematic reviews of diagnostic tests. Twenty-one resources were searched up until March 2016. Summary estimates were calculated using a bivariate model or a random-effects logistic regression model. Nine studies are included in this review. One additional study, included in our systematic review, was provided as ‘academic in confidence’ and cannot be described herein. When FIT was based on a single faecal sample and a cut-off of 10 μg Hb/g faeces, sensitivity estimates indicated that a negative result using either the OC-Sensor or HM-JACKarc may be adequate to rule out nearly all CRC; the summary estimate of sensitivity for the OC-Sensor was 92.1% (95% confidence interval, CI 86.9–95.3%), based on four studies (n = 4091 participants, 176 with CRC), and the only study of HM-JACKarc to assess the 10 μg Hb/g faeces cut-off (n = 507 participants, 11 with CRC) reported a sensitivity of 100% (95% CI 71.5–100%). The corresponding specificity estimates were 85.8% (95% CI 78.3–91.0%) and 76.6% (95% CI 72.6–80.3%), respectively. When the diagnostic criterion was changed to include lower grades of neoplasia, i.e. the target condition included higher risk adenoma (HRA) as well as CRC, the rule-out performance of both FIT assays was reduced. There is evidence to suggest that triage using FIT at a cut-off around 10 μg Hb/g faeces has the potential to correctly rule out CRC and avoid colonoscopy in 75–80% of symptomatic patients. PROSPERO 42016037723
1 September 2013 in Health Technology Assessment
Background Premature birth is defined as birth of before 37 completed weeks' gestation. Not all pregnant women showing symptoms of preterm labour will go on to deliver before 37 weeks' gestation. Hence, addition of fetal fibronectin (fFN) testing to the diagnostic workup of women with suspected preterm labour may help to identify those women who do not require active management, and thus avoid unnecessary interventions, hospitalisations and associated costs. Objective To assess the clinical effectiveness and cost-effectiveness of rapid fFN testing in predicting preterm birth (PTB) in symptomatic women. Data sources Bibliographic databases (including EMBASE, Cochrane Database of Systematic Reviews and Cochrane Central Register of Controlled Trials) were searched from 2000 to September/November 2011. Trial registers were also searched. Review methods Systematic review methods followed published guidance; we assessed clinical effectiveness and updated a previous systematic review of test accuracy. Risk of bias was assessed using the Cochrane tool (randomised controlled trials; RCTs) and a modification of QUADAS-2 (diagnostic test accuracy studies; DTAs). Summary risk ratios or weighted mean difference were calculated using random-effects models. Summary sensitivity and specificity used a bivariate summary receiver operating characteristic model. Heterogeneity was investigated using subgroup and sensitivity analyses. Health economic analysis focused on cost consequences. The time horizon was hospital admission for observation. A main structural assumption was that, compared with usual care, fFN testing doesn't increase adverse events or negative pregnancy outcomes. Results Five RCTs and 15 new DTAs were identified. No RCT reported significant effects of fFN testing on maternal or neonatal outcomes. One study reported a subgroup analysis of women with negative fFN test observed > 6 hours, which showed a reduction in length of hospital stay where results were known to clinicians. Combining data from new studies and the previous systematic review, the pooled estimates of sensitivity and specificity were: 76.7% and 82.7% for delivery within 7–10 days of testing; 69.1% and 84.4% for delivery < 34 weeks' gestation; and 60.8% and 82.3% for delivery < 37 weeks' gestation. Estimates were similar across all subgroups sensitivity analyses. The base-case cost analysis resulted in a cost saving of £23.87 for fFN testing compared with usual care. The fFN testing was cost-neutral at an approximate cost of £45. Probabilistic sensitivity analysis gave an incremental cost (saving) of –£25.59 (97.5% confidence interval –£304.96 to £240.06), indicating substantial uncertainty. Sensitivity analyses indicated that admission rate had the largest impact on results. Conclusions Fetal fibronectin testing has moderate accuracy for predicting PTB. The main potential role is likely to be reducing health-care resource usage by identifying women not requiring intervention. Evidence from RCTs suggests that fFN does not increase adverse outcomes and may reduce resource use. The base-case analysis showed a modest cost difference in favour of fFN testing, which is largely dependent on whether or not fFN testing reduces hospital admission. Currently, there are no high-quality studies and the existing trials were generally underpowered. Hence, there is a need for high-quality adequately powered trials using appropriate study designs to confirm the findings presented. Study registration PROSPERO 2011:CRD42011001468. Available from www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42011001468. Funding The National Institute for Health Research Health Technology Assessment programme.
1 April 2026 in Annals of Internal Medicine
Assessing risk of bias and applicability is critical in diagnostic test accuracy reviews to ensure valid, relevant findings that can inform decision making and policy. This article introduces QUADAS-3, an updated version of the widely used QUADAS-2 tool that was developed in response to the latest evidence, feedback from users of QUADAS-2, and comprehensive piloting. The QUADAS-3 tool comprises 6 phases: 1) define the systematic review synthesis question, 2) define the ideal test accuracy trial for each synthesis question, 3) draw a flow diagram, 4) identify estimates of accuracy for assessment, 5) assess risk of bias and applicability, and 6) make an overall judgment. Risk of bias is assessed across 4 domains: Participants, Index Test, Target Condition, and Analysis. The first 3 domains are also assessed in terms of concerns regarding applicability to the synthesis question. Signaling questions are included to help judge risk of bias. The QUADAS-3 tool incorporates several changes compared with the previous version (QUADAS-2) which will ideally improve its validity, usability, and usefulness. Key changes from QUADAS-2 include introduction of the concept of an ideal test accuracy trial, assessment at the estimate level rather than the study level, replacement of the "Flow and Timing" domain with a new "Analysis" domain, introduction of sections on the rationale for judgments, and formal introduction of overall judgment of risk of bias and concerns regarding applicability. Some changes to domains and signaling questions have also been made.
13 December 2012 in Systematic Reviews
The aim of this systematic review was to systematically assess the potential patient-relevant benefit (primary aim) and diagnostic and prognostic accuracy (secondary aim) of positron emission tomography (PET) and PET/computed tomography (CT) in primary staging of malignant melanoma. This systematic review updates the previous evidence for PET(/CT) in malignant melanoma. For the first aim, randomized controlled trials (RCTs) investigating patient-relevant outcomes and comparing PET and PET(/CT) with each other or with conventional imaging were considered. For the secondary aim, a review of reviews was conducted, which was amended by an update search for primary studies. MEDLINE, EMBASE and four databases of the Cochrane Library were searched. The risk of bias was assessed using a modified QUADAS tool. No RCTs investigating the patient-relevant benefit of PET(/CT) and no prognostic accuracy studies were found. Seventeen diagnostic accuracy studies of varying quality were identified. For patients with American Joint Committee on Cancer (AJCC) stages I and II, sensitivity mostly ranged from 0 to 67%. Specificity ranged from 77 to 100%. For AJCC stages III and IV, sensitivity ranged from 68 to 87% and specificity from 92 to 98%. There is currently no evidence of a patient-relevant benefit of PET(/CT) in the primary staging of malignant melanoma. RCTs investigating patient-relevant outcomes are therefore required. The diagnostic accuracy of PET(/CT) appears to increase with higher AJCC stages.