Background: Disability progression is a key milestone in the disease evolution of people with multiple sclerosis (PwMS). Prediction models of the probability of disability progression have not yet reached the level of trust needed to be adopted in the clinic. A common benchmark to assess model development in multiple sclerosis is also currently lacking. Methods: Data of adult PwMS with a follow-up of at least three years from 146 MS centers, spread over 40 countries and collected by the MSBase consortium was used. With basic inclusion criteria for quality requirements, it represents a total of 15, 240 PwMS. External validation was performed and repeated five times to assess the significance of the results. Transparent Reporting for Individual Prognosis Or Diagnosis (TRIPOD) guidelines were followed. Confirmed disability progression after two years was predicted, with a confirmation window of six months. Only routinely collected variables were used such as the expanded disability status scale, treatment, relapse information, and MS course. To learn the probability of disability progression, state-of-the-art machine learning models were investigated. The discrimination performance of the models is evaluated with the area under the receiver operator curve (ROC-AUC) and under the precision recall curve (AUC-PR), and their calibration via the Brier score and the expected calibration error. All our preprocessing and model code are available at https://gitlab.com/edebrouwer/ms_benchmark, making this task an ideal benchmark for predicting disability progression in MS. Findings: Machine learning models achieved a ROC-AUC of 0⋅71 ± 0⋅01, an AUC-PR of 0⋅26 ± 0⋅02, a Brier score of 0⋅1 ± 0⋅01 and an expected calibration error of 0⋅07 ± 0⋅04. The history of disability progression was identified as being more predictive for future disability progression than the treatment or relapses history. Conclusions: Good discrimination and calibration performance on an external validation set is achieved, using only routinely collected variables. This suggests machine-learning models can reliably inform clinicians about the future occurrence of progression and are mature for a clinical impact study.
Background and aim: Disease-modifying therapies (DMTs) used in multiple sclerosis (MS) have distinct safety profiles. In this paper, we report preliminary results of an on-going pharmacovigilance project (the FASM study). Results: Neurologists working at involved multiple sclerosis centers collected 272 Individual Case Safety Reports (ICSRs). Adverse drug reactions (ADRs) mainly occurred in adult patients and in a higher percentage of women compared to men. No difference was found in ADRs distribution by seriousness. The outcome was reported as favorable in 61% of ICSRs. Out of 272 ICSRs, almost 53% reported dimethyl fumarate, fingolimod and IFN beta 1a as suspected. These medications were commonly associated to the occurrence of ADRs related hematological, gastrointestinal, general, infective or cancer disorders. The median time to event (days) was 177 for dimethyl fumarate, 1058 for fingolimod and 413 for IFN beta 1a. The median time to event for the remaining suspected drugs was 226. Conclusion: We believe that our results, together with those that will be presented at the end of the study, may bring new knowledge concerning the safety profile of DMTs and their proper use. This will provide the opportunity to draw new recommendations both for neurologists and patients.
Background: Natalizumab and fingolimod are used as high-efficacy treatments in relapsing–remitting multiple sclerosis. Several observational studies comparing these two drugs have shown variable results, using different methods to control treatment indication bias and manage censoring. The objective of this empirical study was to elucidate the impact of methods of causal inference on the results of comparative effectiveness studies. Methods: Data from three observational multiple sclerosis registries (MSBase, the Danish MS Registry and French OFSEP registry) were combined. Four clinical outcomes were studied. Propensity scores were used to match or weigh the compared groups, allowing for estimating average treatment effect for treated or average treatment effect for the entire population. Analyses were conducted both in intention-to-treat and per-protocol frameworks. The impact of the positivity assumption was also assessed. Results: Overall, 5,148 relapsing–remitting multiple sclerosis patients were included. In this well-powered sample, the 95% confidence intervals of the estimates overlapped widely. Propensity scores weighting and propensity scores matching procedures led to consistent results. Some differences were observed between average treatment effect for the entire population and average treatment effect for treated estimates. Intention-to-treat analyses were more conservative than per-protocol analyses. The most pronounced irregularities in outcomes and propensity scores were introduced by violation of the positivity assumption. Conclusions: This applied study elucidates the influence of methodological decisions on the results of comparative effectiveness studies of treatments for multiple sclerosis. According to our results, there are no material differences between conclusions obtained with propensity scores matching or propensity scores weighting given that a study is sufficiently powered, models are correctly specified and positivity assumption is fulfilled.
1 October 2020 in Journal of Clinical Neuroscience
Background: Apathy is relatively frequent and significantly associated with clinical and cognitive outcomes in Multiple Sclerosis (MS), even if previous research has produced mixed results. This varied picture could be due to most studies treating apathy as a unitary construct, despite the evidence showing that apathy is a multifaceted syndrome including three different sub-domains (i.e., cognitive, affective, and behavioral). This study aims to investigate the neuropsychological correlates of apathy fractionated into its three sub-domains in participants with MS. Methods: Eighty-five participants with MS underwent a comprehensive neuropsychological battery. The severity of apathy symptoms was assessed by the self-report version of the Apathy Evaluation Scale. Results: Correlational analysis showed that cognitive apathy sub-domain scores had a high correlation with the performances obtained at cognitive tests tapping into inhibitory control (i.e., IML and Strop test-interference task), whereas the affective apathy sub-domain scores had a high correlation with the performances obtained at cognitive test tapping into the use of executive functions in visuospatial abilities (i.e., Clock Drawing Test). Moreover, linear regression analysis results showed that the cognitive apathy sub-domain scores predicted executive functioning domain scores and that the cognitive and affective apathy sub-domains scores predicted visuospatial abilities domain scores. Conclusion: These results confirm that apathy is a multidimensional concept with important neuropsychological correlates, visible only when it is fractionated into its sub-domains.