Background: We aimed to develop the first machine learning models to predict citation counts and the translational impact, defined as inclusion in guidelines or policy documents, of headache research, and assess which factors are most predictive. Methods: Bibliometric data and the titles, abstracts, and keywords from 8600 publications in three headache-oriented journals from their inception to 31 December 2017 were used. A series of machine learning models were implemented to predict three classes of 5-year citation count intervals (0–5, 6–14 and, >14 citations); and the translational impact of a publication. Models were evaluated out-of-sample with area under the receiver operating characteristics curve (AUC). Results: The top performing gradient boosting model predicted correct citation count class with an out-of-sample AUC of 0.81. Bibliometric data such as page count, number of references, first and last author citation counts and h-index were among the most important predictors. Prediction of translational impact worked optimally when including both bibliometric data and information from the title, abstract and keywords, reaching an out-of-sample AUC of 0.71 for the top performing random forest model. Conclusion: Citation counts are best predicted by bibliometric data, while models incorporating both bibliometric data and publication content identifies the translational impact of headache research.
This narrative review introduces key concepts in artificial intelligence (AI), data science, and wearable devices aimed at headache clinicians and researchers. PubMed and IEEEXplore were searched to identify relevant studies, and these were reviewed systematically. We identified six primary research topics. First, the most common application of AI and data science is in the diagnosis of headache disorders, with reported accuracies of up to 90%. Second, AI and data science are used for predicting headache disease trajectories and forecasting attacks. Third, prediction of treatment effects and data-driven individualization of treatment prescription demonstrate promising results, with accuracies ranging from 40% to 83%. Fourth, AI and data science can uncover hidden information within headache datasets, offering clinicians deeper insights. Fifth, wearables, combined with AI and data science, can improve remote monitoring and migraine management. Lastly, user experience studies indicate strong interest from both clinicians and patients in adopting these technologies. The potential applications of AI, data science, and wearable device technologies in headache research are vast. However, many studies are small pilot studies, and models often suffer from poor performance, limited reporting, and lack of external validation, which impede generalizability and clinical implementation.