Nemanja Vaci

Nemanja Vaci

Auto-generated profile, based on publicly available information

Nemanja Vaci

Department of Psychology, University of Sheffield, Sheffield, UK

Research Focus & Metrics

Academic Career Length

14Years (2013-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 August 2021 in Artificial Intelligence in Medicine
Verified
Journal Article
Closed access
AKAndrey Kormilitzin
Andrey Kormilitzin
NVNemanja Vaci
Nemanja Vaci
QLQiang Liu
Qiang Liu
ANAlejo Nevado-Holgado
Alejo Nevado-Holgado

11 February 2020 in Evidence Based Mental Health
Verified
Journal Article
Closed access
PDF file
NVNemanja Vaci
Nemanja Vaci
QLQiang Liu
Qiang Liu
AKAndrey Kormilitzin
Andrey Kormilitzin
FCFranco De Crescenzo
Franco De Crescenzo
AKAyse Kurtulmus
Ayse Kurtulmus
ANAlejo Nevado-Holgado
Alejo Nevado-Holgado
Background Utilisation of routinely collected electronic health records from secondary care offers unprecedented possibilities for medical science research but can also present difficulties. One key issue is that medical information is presented as free-form text and, therefore, requires time commitment from clinicians to manually extract salient information. Natural language processing (NLP) methods can be used to automatically extract clinically relevant information. Objective Our aim is to use natural language processing (NLP) to capture real-world data on individuals with depression from the Clinical Record Interactive Search (CRIS) clinical text to foster the use of electronic healthcare data in mental health research. Methods We used a combination of methods to extract salient information from electronic health records. First, clinical experts define the information of interest and subsequently build the training and testing corpora for statistical models. Second, we built and fine-tuned the statistical models using active learning procedures. Findings Results show a high degree of accuracy in the extraction of drug-related information. Contrastingly, a much lower degree of accuracy is demonstrated in relation to auxiliary variables. In combination with state-of-the-art active learning paradigms, the performance of the model increases considerably. Conclusions This study illustrates the feasibility of using the natural language processing models and proposes a research pipeline to be used for accurately extracting information from electronic health records. Clinical implications Real-world, individual patient data are an invaluable source of information, which can be used to better personalise treatment.

15 April 2020 in Frontiers in Psychiatry
Verified
Journal Article
Open access
PDF file
MSMorwenna Senior
Morwenna Senior
MBMatthias Burghart
Matthias Burghart
RYRongqin Yu
Rongqin Yu
AKAndrey Kormilitzin
Andrey Kormilitzin
QLQiang Liu
Qiang Liu
SFSeena B. Fazel
Seena B. Fazel
Background: Oxford Mental Illness and Suicide tool (OxMIS) is a brief, scalable, freely available, structured risk assessment tool to assess suicide risk in patients with severe mental illness (schizophrenia-spectrum disorders or bipolar disorder). OxMIS requires further external validation, but a lack of large-scale cohorts with relevant variables makes this challenging. Electronic health records provide possible data sources for external validation of risk prediction tools. However, they contain large amounts of information within free-text that is not readily extractable. In this study, we examined the feasibility of identifying suicide predictors needed to validate OxMIS in routinely collected electronic health records. Methods: In study 1, we manually reviewed electronic health records of 57 patients with severe mental illness to calculate OxMIS risk scores. In study 2, we examined the feasibility of using natural language processing to scale up this process. We used anonymized free-text documents from the Clinical Record Interactive Search database to train a named entity recognition model, a machine learning technique which recognizes concepts in free-text. The model identified eight concepts relevant for suicide risk assessment: medication (antidepressant/antipsychotic treatment), violence, education, self-harm, benefits receipt, drug/alcohol use disorder, suicide, and psychiatric admission. We assessed model performance in terms of precision (similar to positive predictive value), recall (similar to sensitivity) and F1 statistic (an overall performance measure). Results: In study 1, we estimated suicide risk for all patients using the OxMIS calculator, giving a range of 12 month risk estimates from 0.1-3.4%. For 13 out of 17 predictors, there was no missing information in electronic health records. For the remaining 4 predictors missingness ranged from 7-26%; to account for these missing variables, it was possible for OxMIS to estimate suicide risk using a range of scores. In study 2, the named entity recognition model had an overall precision of 0.77, recall of 0.90 and F1 score of 0.83. The concept with the best precision and recall was medication (precision 0.84, recall 0.96) and the weakest were suicide (precision 0.37), and drug/alcohol use disorder (recall 0.61). Conclusions: It is feasible to estimate suicide risk with the OxMIS tool using predictors identified in routine clinical records. Predictors could be extracted using natural language processing. However, electronic health records differ from other data sources, particularly for family history variables, which creates methodological challenges.

26 August 2019 in Proceedings of the National Academy of Sciences
Verified
Journal Article
Closed access
PDF file
NVNemanja Vaci
Nemanja Vaci
PEPeter Edelsbrunner
Peter Edelsbrunner
ESElsbeth Stern
Elsbeth Stern
ANAljoscha Neubauer
Aljoscha Neubauer
MBMerim Bilalic
Merim Bilalic
Roland H. GrabnerRoland H. Grabner
Roland H. Grabner
The relative importance of different factors in the development of human skills has been extensively discussed. Research on expertise indicates that focused practice may be the sole determinant of skill, while intelligence researchers underline the relative importance of abilities at even the highest level of skill. There is indeed a large body of research that acknowledges the role of both factors in skill development and retention. It is, however, unknown how intelligence and practice come together to enable the acquisition and retention of complex skills across the life span. Instead of focusing on the 2 factors, intelligence and practice, in isolation, here we look at their interplay throughout development. In a longitudinal study that tracked chess players throughout their careers, we show that both intelligence and practice positively affect the acquisition and retention of chess skill. Importantly, the nonlinear interaction between the 2 factors revealed that more intelligent individuals benefited more from practice. With the same amount of practice, they acquired chess skill more quickly than less intelligent players, reached a higher peak performance, and arrested decline in older age. Our research demonstrates the futility of scrutinizing the relative importance of highly intertwined factors in human development.

27 July 2020 in The British Journal of Psychiatry
Verified
Journal Article
Closed access
PDF file
NVNemanja Vaci
Nemanja Vaci
IKIvan Koychev
Ivan Koychev
CKChi-Hun Kim
Chi-Hun Kim
AKAndrey Kormilitzin
Andrey Kormilitzin
QLQiang Liu
Qiang Liu
ANAlejo Nevado-Holgado
Alejo Nevado-Holgado
Background: The efficacy of acetylcholinesterase inhibitors and memantine in the symptomatic treatment of Alzheimer's disease is well-established. Randomised trials have shown them to be associated with a reduction in the rate of cognitive decline.Aims: To investigate the real-world effectiveness of acetylcholinesterase inhibitors and memantine for dementia-causing diseases in the largest UK observational secondary care service data-set to date.Method: We extracted mentions of relevant medications and cognitive testing (Mini-Mental State Examination (MMSE) and Montreal Cognitive Assessment (MoCA) scores) from de-identified patient records from two National Health Service (NHS) trusts. The 10-year changes in cognitive performance were modelled using a combination of generalised additive and linear mixed-effects modelling.Results: The initial decline in MMSE and MoCA scores occurs approximately 2 years before medication is initiated. Medication prescription stabilises cognitive performance for the ensuing 2–5 months. The effect is boosted in more cognitively impaired cases at the point of medication prescription and attenuated in those taking antipsychotics. Importantly, patients who are switched between agents at least once do not experience any beneficial cognitive effect from pharmacological treatment.Conclusions: This study presents one of the largest real-world examination of the efficacy of acetylcholinesterase inhibitors and memantine for symptomatic treatment of dementia. We found evidence that 68% of individuals respond to treatment with a period of cognitive stabilisation before continuing their decline at the pre-treatment rate.

25 January 2019 in Behavior Research Methods
Verified
Journal Article
Open access
PDF file
NVNemanja Vaci
Nemanja Vaci
DCDijana Cocić
Dijana Cocić
BGBartosz Gula
Bartosz Gula
MBMerim Bilalić
Merim Bilalić
Researchers interested in changes that occur as people age are faced with a number of methodological problems, starting with the immense time scale they ar