Bogdan Grigore

Bogdan Grigore

Auto-generated profile, based on publicly available information

Bogdan Grigore

Exeter Test Group, University of Exeter, Exeter, UK

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
23 June 2020 in PharmacoEconomics
Verified
Journal Article
Open access
PDF file
BGBogdan Grigore
Bogdan Grigore
OCORIANA CIANI
ORIANA CIANI
FDFlorian Dams
Florian Dams
CFCarlo Baldassarre Federici
Carlo Baldassarre Federici
SGSaskia de Groot
Saskia de Groot
RTRod S. Taylor
Rod S. Taylor
In the drive towards faster patient access to treatments, health technology assessment (HTA) agencies are increasingly faced with reliance on evidence from surrogate endpoints, leading to increased decision uncertainty. This study undertook an updated survey of methodological guidance for using surrogate endpoints across international HTA agencies. We reviewed HTA and economic evaluation methods guidance from European, Australian and Canadian HTA agencies. We considered how guidelines addressed the methods for handling surrogate endpoints, including (1) level of evidence, (2) methods of validation, and (3) thresholds of acceptability. Across the 73 HTA agencies surveyed, 29 (40%) had methodological guidelines that made specific reference to consideration of surrogate outcomes. Of the 45 methods documents analysed, the majority [27 (60%)] were non-technology specific, 15 (33%) focused on pharmaceuticals and three (7%) on medical devices. The principles of the European network for Health Technology Assessment (EUnetHTA) guidelines published in 2015 on the handling of surrogate endpoints appear to have been adopted by many European HTA agencies, i.e. preference for final patient-relevant outcomes and reliance on surrogate endpoints with biological plausibility and epidemiological evidence of the association between the surrogate and final endpoint. Only a small number of HTA agencies (UK National Institute for Care and Excellence; the German Institute for Medical Documentation and Information and Institute for Quality and Efficiency in Health Care; the Australian Pharmaceutical Benefits Advisory Committee; and the Canadian Agency for Drugs and Technologies in Health) have developed more detailed prescriptive criteria for the acceptance of surrogate endpoints, e.g. meta-analyses of randomised controlled trials showing strong association between the treatment effect on the surrogate and final outcomes. As the decision uncertainty associated with reliance on surrogate endpoints carries a risk to patients and society, there is a need for HTA agencies to develop more detailed methodological guidance for consistent selection and evaluation of health technologies that lack definitive final patient-relevant outcome evidence at the time of the assessment.

26 July 2016 in BMC Medical Research Methodology
Verified
Journal Article
Open access
PDF file
BGBogdan Grigore
Bogdan Grigore
JPJaime Peters
Jaime Peters
CHChristopher Hyde
Christopher Hyde
KSKen Stein
Ken Stein
When data needed to inform parameters in decision models are lacking, formal elicitation of expert judgement can be used to characterise parameter uncertainty. Although numerous methods for eliciting expert opinion as probability distributions exist, there is little research to suggest whether one method is more useful than any other method. This study had three objectives: (i) to obtain subjective probability distributions characterising parameter uncertainty in the context of a health technology assessment; (ii) to compare two elicitation methods by eliciting the same parameters in different ways; (iii) to collect subjective preferences of the experts for the different elicitation methods used. Twenty-seven clinical experts were invited to participate in an elicitation exercise to inform a published model-based cost-effectiveness analysis of alternative treatments for prostate cancer. Participants were individually asked to express their judgements as probability distributions using two different methods – the histogram and hybrid elicitation methods – presented in a random order. Individual distributions were mathematically aggregated across experts with and without weighting. The resulting combined distributions were used in the probabilistic analysis of the decision model and mean incremental cost-effectiveness ratios and the expected values of perfect information (EVPI) were calculated for each method, and compared with the original cost-effectiveness analysis. Scores on the ease of use of the two methods and the extent to which the probability distributions obtained from each method accurately reflected the expert’s opinion were also recorded. Six experts completed the task. Mean ICERs from the probabilistic analysis ranged between £162,600–£175,500 per quality-adjusted life year (QALY) depending on the elicitation and weighting methods used. Compared to having no information, use of expert opinion decreased decision uncertainty: the EVPI value at the £30,000 per QALY threshold decreased by 74–86 % from the original cost-effectiveness analysis. Experts indicated that the histogram method was easier to use, but attributed a perception of more accuracy to the hybrid method. Inclusion of expert elicitation can decrease decision uncertainty. Here, choice of method did not affect the overall cost-effectiveness conclusions, but researchers intending to use expert elicitation need to be aware of the impact different methods could have.

10 March 2021 in Medical Decision Making
Verified
Journal Article
Open access
PDF file
OCORIANA CIANI
ORIANA CIANI
BGBogdan Grigore
Bogdan Grigore
HBHedwig Blommestein
Hedwig Blommestein
SGSaskia de Groot
Saskia de Groot
MMMeilin Möllenkamp
Meilin Möllenkamp
RTRod S. Taylor
Rod S. Taylor
Surrogate endpoints (i.e., intermediate endpoints intended to predict for patient-centered outcomes) are increasingly common. However, little is known about how surrogate evidence is handled in the context of health technology assessment (HTA). 1) To map methodologies for the validation of surrogate endpoints and 2) to determine their impact on acceptability of surrogates and coverage decisions made by HTA agencies. We sought HTA reports where evaluation relied on a surrogate from 8 HTA agencies. We extracted data on the methods applied for surrogate validation. We assessed the level of agreement between agencies and fitted mixed-effects logistic regression models to test the impact of validation approaches on the agency’s acceptability of the surrogate endpoint and their coverage recommendation. Of the 124 included reports, 61 (49%) discussed the level of evidence to support the relationship between the surrogate and the patient-centered endpoint, 27 (22%) reported a correlation coefficient/association measure, and 40 (32%) quantified the expected effect on the patient-centered outcome. Overall, the surrogate endpoint was deemed acceptable in 49 (40%) reports (k-coefficient 0.10, P = 0.004). Any consideration of the level of evidence was associated with accepting the surrogate endpoint as valid (odds ratio [OR], 4.60; 95% confidence interval [CI], 1.60–13.18, P = 0.005). However, we did not find strong evidence of an association between accepting the surrogate endpoint and agency coverage recommendation (OR, 0.71; 95% CI, 0.23–2.20; P = 0.55). Handling of surrogate endpoint evidence in reports varied greatly across HTA agencies, with inconsistent consideration of the level of evidence and statistical validation. Our findings call for careful reconsideration of the issue of surrogacy and the need for harmonization of practices across international HTA agencies.

1 November 2020 in Health Technology Assessment
Verified
Journal Article
Closed access
AMAntonieta Medina-Lara
Antonieta Medina-Lara
BGBogdan Grigore
Bogdan Grigore
RLRuth Lewis
Ruth Lewis
JPJaime Peters
Jaime Peters
SPSarah Price
Sarah Price
ASAnne E Spencer
Anne E Spencer
Background: Tools based on diagnostic prediction models are available to help general practitioners diagnose cancer. It is unclear whether or not tools expedite diagnosis or affect patient quality of life and/or survival.Objectives: The objectives were to evaluate the evidence on the validation, clinical effectiveness, cost-effectiveness, and availability and use of cancer diagnostic tools in primary care.Methods: Two systematic reviews were conducted to examine the clinical effectiveness (review 1) and the development, validation and accuracy (review 2) of diagnostic prediction models for aiding general practitioners in cancer diagnosis. Bibliographic searches were conducted on MEDLINE, MEDLINE In-Process, EMBASE, Cochrane Library and Web of Science) in May 2017, with updated searches conducted in November 2018. A decision-analytic model explored the tools’ clinical effectiveness and cost-effectiveness in colorectal cancer. The model compared patient outcomes and costs between strategies that included the use of the tools and those that did not, using the NHS perspective. We surveyed 4600 general practitioners in randomly selected UK practices to determine the proportions of general practices and general practitioners with access to, and using, cancer decision support tools. Association between access to these tools and practice-level cancer diagnostic indicators was explored.Results: Systematic review 1 – five studies, of different design and quality, reporting on three diagnostic tools, were included. We found no evidence that using the tools was associated with better outcomes. Systematic review 2 – 43 studies were included, reporting on prediction models, in various stages of development, for 14 cancer sites (including multiple cancers). Most studies relate to QCancer®(ClinRisk Ltd, Leeds, UK) and risk assessment tools.Decision model: In the absence of studies reporting their clinical outcomes, QCancer and risk assessment tools were evaluated against faecal immunochemical testing. A linked data approach was used, which translates diagnostic accuracy into time to diagnosis and treatment, and stage at diagnosis. Given the current lack of evidence, the model showed that the cost-effectiveness of diagnostic tools in colorectal cancer relies on demonstrating patient survival benefits. Sensitivity of faecal immunochemical testing and specificity of QCancer and risk assessment tools in a low-risk population were the key uncertain parameters.Survey: Practitioner- and practice-level response rates were 10.3% (476/4600) and 23.3% (227/975), respectively. Cancer decision support tools were available in 83 out of 227 practices (36.6%, 95% confidence interval 30.3% to 43.1%), and were likely to be used in 38 out of 227 practices (16.7%, 95% confidence interval 12.1% to 22.2%). The mean 2-week-wait referral rate did not differ between practices that do and practices that do not have access to QCancer or risk assessment tools (mean difference of 1.8 referrals per 100,000 referrals, 95% confidence interval –6.7 to 10.3 referrals per 100,000 referrals).Limitations: There is little good-quality evidence on the clinical effectiveness and cost-effectiveness of diagnostic tools. Many diagnostic prediction models are limited by a lack of external validation. There are limited data on current UK practice and clinical outcomes of diagnostic strategies, and there is no evidence on the quality-of-life outcomes of diagnostic results. The survey was limited by low response rates.Conclusion: The evidence base on the tools is limited. Research on how general practitioners interact with the tools may help to identify barriers to implementation and uptake, and the potential for clinical effectiveness.Future work: Continued model validation is recommended, especially for risk assessment tools. Assessment of the tools’ impact on time to diagnosis and treatment, stage at diagnosis, and health outcomes is also recommended, as is further work to understand how tools are used in general practitioner consultations.Study registration: This study is registered as PROSPERO CRD42017068373 and CRD42017068375.Funding: This project was funded by the National Institute for Health Research (NIHR) Health Technology programme and will be published in full inHealth Technology Assessment; Vol. 24, No. 66. See the NIHR Journals Library website for further project information.

9 October 2013 in PharmacoEconomics
Verified
Journal Article
Closed access
PDF file
BGBogdan Grigore
Bogdan Grigore
JPJaime Peters
Jaime Peters
CHChristopher Hyde
Christopher Hyde
KSKen Stein
Ken Stein