11 July 2022 in International Journal of Technology Assessment in Health Care
Objectives: To investigate the test–retest reliability of the Costs for Patients Questionnaire (CoPaQ).Methods: Through an online survey, individuals were invited to participate in a two-step study to assess the test–retest reliability of the CoPaQ. Participants to the first step were invited to complete the questionnaire a second time 2 weeks after. Reliability was assessed by calculating Cohen’s Kappa coefficients and intraclass correlation coefficients (ICC) for discrete and continuous data, respectively. A sensitivity analysis was carried out.Results: From a total of 1,200 participants who completed the first test, 403 completed the second test. The ICC varied from −0.00 to 0.98 with poor, moderate, good, and excellent results. The Kappa coefficients varied from −0.004 to 0.65 and were poor, slight, fair, moderate, and substantial. The sensitivity analysis showed the median value of ICC and Kappa coefficients for each category before and after the outliers’ exclusion. The median value of ICC changed from 0.30 (before) to 0.70 (after), and from 0.12 (before) to 0.04 (after), respectively, for each category. The median value of the Cohen’s Kappa coefficient increased from 0.44 (before) to 0.46 (after) and decreased from 0.32 (before) to 0.30 (after), respectively.Conclusions: Test–retest reliability results indicated that the CoPaQ has a moderate reliability in terms of ICC and Kappa coefficients. The moderate reliability observed gives additional support for the applicability of this tool in economic evaluations of health interventions. Additional studies including on other properties and a cultural adaptation could further enhance the use of the tool.
5 July 2020 in Medical Decision Making
Background. Observational economic evaluations (i.e., economic evaluations in which treatment allocation is not randomized) are prone to confounding bias. Prior reviews published in 2013 have shown that adjusting for confounding is poorly done, if done at all. Although these reviews raised awareness on the issues, it is unclear if their results improved the methodological quality of future work. We therefore aimed to investigate whether and how confounding was accounted for in recently published observational economic evaluations in the field of cardiology. Methods. We performed a systematic review of PubMed, Embase, Cochrane Library, Web of Science, and PsycInfo databases using a set of Medical Subject Headings and keywords covering topics in “observational economic evaluations in health within humans” and “cardiovascular diseases.” Any study published in either English or French between January 1, 2013, and December 31, 2017, addressing our search criteria was eligible for inclusion in our review. Our protocol was registered with PROSPERO (CRD42018112391). Results. Forty-two (0.6%) out of 7523 unique citations met our inclusion criteria. Fewer than half of the selected studies adjusted for confounding (n = 19 [45.2%]). Of those that adjusted for confounding, propensity score matching (n = 8 [42.1%]) and other matching-based approaches were favored (n = 8 [42.1%]). Our results also highlighted that most authors who adjusted for confounding rarely justified their methodological choices. Conclusion. Our results indicate that adjustment for confounding is often ignored when conducting an observational economic evaluation. Continued knowledge translation efforts aimed at improving researchers’ knowledge regarding confounding bias and methods aimed at addressing this issue are required and should be supported by journal editors.
15 June 2026 in BMJ Quality & Safety
Background: Low-value practices, defined as tests or treatments that are used in practice despite not being supported by evidence, account for 20%–30% of healthcare expenditure; moreover, some identified low-value practices represent 16%–26% of primary care clinical services. Given the growing financial constraints healthcare systems face, evaluating the cost-effectiveness of interventions designed to reduce these practices is becoming urgent. Objective: We aimed to synthesise data on the economic value of deimplementation interventions. Methods: We evaluated the cost-effectiveness of interventions targeting the deimplementation of low-value practices among healthcare professionals and organisations (clinicians, hospitals and medical centres). Our comparator was either no intervention or a deimplementation intervention limited to a subset of the intervention components. Outcomes were incremental cost-effectiveness ratios, incremental cost-utility ratios and benefit-to-cost ratios. Studies where the intervention was dominant or dominated by the comparator were also considered. We developed search strategies for Cochrane, EMBASE, MEDLINE, CINAHL and Web of Science to February 2025. Pairs of independent reviewers sequentially screened titles, abstracts and full texts for eligibility and extracted data using a prepiloted extraction sheet. Methodological quality was assessed by two reviewers using the 19-item Consensus on Health Economic Criteria (CHEC), and results were synthesised visually using permutation matrices globally and for predefined subgroups. Results: Of the 35 575 unique records identified, 19 met our eligibility criteria. Deimplementation interventions were found to be dominant (ie, effective with lower cost) in 10 evaluations (53%), potentially favourable (more effective with higher cost) in 8 (42%) and unfavourable in 1 (5%). Deimplementation interventions were more likely to be economically favourable in studies accounting for both medical and intervention costs, those targeting healthcare professionals and those with high methodological quality. Conclusion: Our findings suggest that deimplementation interventions targeting low-value practices are highly likely to be cost-effective. However, the results should be interpreted with caution due to the low methodological quality of the studies and the lack of consideration of the societal perspective.