18 September 2023 in PLOS Computational Biology
In May 2022, a cluster of mpox cases were detected in the UK that could not be traced to recent travel history from an endemic region. Over the coming months, the outbreak grew, with over 3000 total cases reported in the UK, and similar outbreaks occurring worldwide. These outbreaks appeared linked to sexual contact networks between gay, bisexual and other men who have sex with men. Following the COVID-19 pandemic, local health systems were strained, and therefore effective surveillance for mpox was essential for managing public health policy. However, the mpox outbreak in the UK was characterised by substantial delays in the reporting of the symptom onset date and specimen collection date for confirmed positive cases. These delays led to substantial backfilling in the epidemic curve, making it challenging to interpret the epidemic trajectory in real-time. Many nowcasting models exist to tackle this challenge in epidemiological data, but these lacked sufficient flexibility. We have developed a nowcasting model using generalised additive models that makes novel use of individual-level patient data to correct the mpox epidemic curve in England. The aim of this model is to correct for backfilling in the epidemic curve and provide real-time characteristics of the state of the epidemic, including the real-time growth rate. This model benefited from close collaboration with individuals involved in collecting and processing the data, enabling temporal changes in the reporting structure to be built into the model, which improved the robustness of the nowcasts generated. The resulting model accurately captured the true shape of the epidemic curve in real time.
12 April 2025 in International Journal of Epidemiology
Background: Seasonal respiratory viruses cause substantial pressure on healthcare systems, particularly over winter. System managers can mitigate the impact on patient care when they anticipate hospital admissions due to these viruses. Hospitalization forecasts were used widely during the SARS-CoV-2 pandemic. Now, resurgent seasonal respiratory pathogens add complexity to system planning. We describe how a suite of forecasts for respiratory pathogens, embedded in national and regional decision-making structures, were used to mitigate the impact on hospital systems and patient care. Methods: We developed forecasting models to predict hospital admissions and bed occupancy 2 weeks ahead for COVID-19, influenza, and respiratory syncytial virus (RSV) in England over winter 2023–4. Bed occupancy forecasts were informed by the ensemble admissions models. Forecasts were delivered in real time at multiple scales. The use of sample-based forecasting allowed effective reconciliation and trend interpretation. Results: Admission forecasts, particularly RSV and influenza, showed high efficacy at regional levels. Bed occupancy forecasts had well-calibrated coverage owing to informative admissions forecasts and slower moving trends. National admissions forecasts had mean absolute percentage errors of 27.3%, 30.9%, and 15.7% for COVID-19, influenza, and RSV, respectively, with corresponding 90% coverages of 0.439, 0.807, and 0.779. Conclusion: These real-time winter infectious disease forecasts produced by the UK Health Security Agency for healthcare system managers played an informative role in mitigating seasonal pressures. The models were delivered regularly and shared widely across the system to key users. This was achieved by producing reliable, fast, and epidemiologically informed ensembles of models, though a higher diversity of model approaches could have improved forecast accuracy.
12 August 2026 in PLOS Computational Biology
Background: Epidemic forecasting research often assesses ensembles and their component models using probabilistic scoring rules. Quantifying how individual models affect ensemble performance is challenging, particularly across multiple targets and spatial scales. Methods: We present Winter 2024–25 forecasts of Influenza and COVID-19 hospital admissions in England and conduct a retrospective simulation using the operational component models. Forecasts were scored using the per capita weighted interval score (pcWIS) for counts and the ranked probability score (RPS) for ordinal trend direction. We compared retrospective forecasts, used generalised additive models (GAMs) to estimate the expected change in score from the inclusion of a model in a sub-ensemble (an ensemble formed from a subset of available models), and used Pareto analysis to understand which sub-ensembles were Pareto-optimal across scoring rules. Results: Nationally, there was a 47% improvement in Influenza pcWIS versus sub-ensembles. However, Influenza operational ensembles were on average 22% worse than sub-ensembles, when measured by RPS. For COVID-19, operational ensembles were 43% and 280% worse on average, than retrospective sub-ensembles by pcWIS and RPS, respectively. However, COVID-19 operational ensembles were on average 2% (pcWIS) and 13% (RPS) better than individual operational models. For influenza, operational ensembles were, on average, 58% (pcWIS) and 41% (RPS) better than individual models. The sub-ensemble simulation showed how individual models influenced the ensemble scores during different epidemic phases. The Pareto analysis demonstrated that there can be a trade-off between relative direction and absolute count score optimisation.