Objective.: The National Neuropsychology Network (NNN) is a multicenter clinical research initiative funded by the National Institute of Mental Health (NIMH; R01 MH118514) to facilitate neuropsychology’s transition to contemporary psychometric assessment methods with resultant improvement in test validation and assessment efficiency.Method: The NNN includes four clinical research sites (Emory University; Medical College of Wisconsin; University of California, Los Angeles (UCLA); University of Florida) and Pearson Clinical Assessment. Pearson Q-interactive (Q-i) is used for data capture for Pearson published tests; web-based data capture tools programmed by UCLA, which serves as the Coordinating Center, are employed for remaining measures.Results: NNN is acquiring item-level data from 500–10,000 patients across 47 widely used Neuropsychology (NP) tests and sharing these data via the NIMH Data Archive. Modern psychometric methods (e.g., item response theory) will specify the constructs measured by different tests and determine their positive/negative predictive power regarding diagnostic outcomes and relationships to other clinical, historical, and demographic factors. The Structured History Protocol for NP (SHiP-NP) helps standardize acquisition of relevant history and self-report data.Conclusions: NNN is a proof-of-principle collaboration: by addressing logistical challenges, NNN aims to engage other clinics to create a national and ultimately an international network. The mature NNN will provide mechanisms for data aggregation enabling shared analysis and collaborative research. NNN promises ultimately to enable robust diagnostic inferences about neuropsychological test patterns and to promote the validation of novel adaptive assessment strategies that will be more efficient, more precise, and more sensitive to clinical contexts and individual/cultural differences.
Major obstacles to data harmonization in neuropsychology include lack of consensus about what constructs and tests are most important and invariant across healthy and clinical populations. This study addressed these challenges using data from the National Neuropsychology Network (NNN). Data were obtained from 5,000 NNN participants and Pearson standardization samples. Analyses included variables from four instruments: Wechsler Adult Intelligence Scale, 4th Edition (WAIS-IV); Wechsler Memory Scale, 4th Edition (WMS-IV); California Verbal Learning Test, 3rd Edition (CVLT3); and Delis-Kaplan Executive Function System (D-KEFS). We used confirmatory factor analysis to evaluate models suggested by prior work and examined fit statistics and measurement invariance across samples. We examined relations of factor scores to demographic and clinical characteristics. For each instrument, we identified four first-order and one second-order factor. Optimal models in patients generally paralleled the best-fitting models in the standardization samples, including task-specific factors. Analysis of the NNN data prompted specification of a Recognition-Familiarity factor on the WMS-IV and an Inhibition-Switching factor on the D-KEFS. Analyses showed strong to strict factorial invariance across samples with expected differences in factor means and variances. The Recognition-Familiarity factor correlated with age more strongly in NNN than in the standardization sample. Factor models derived from healthy groups generally fit well in patients. NNN data helped identify novel Recognition-Familiarity and Inhibition-Switching factors that were also invariant across samples and may be clinically useful. The findings support efforts to identify evidence-based and optimally efficient measurements of neuropsychological constructs that are valid across groups. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
16 June 2021 in Journal of the International Neuropsychological Society
Objectives: Mild cognitive impairment (MCI) types may have distinct neuropathological substrates with hippocampal atrophy particularly common in amnestic MCI (aMCI). However, depending on the MCI classification criteria applied to the sample (e.g., number of abnormal test scores considered or thresholds for impairment), volumetric findings between MCI types may change. Additionally, despite increased clinical use, no prior research has examined volumetric differences in MCI types using the automated volumetric software, Neuroreader™.Methods: The present study separately applied the Petersen/Winblad and Jak/Bondi MCI criteria to a clinical sample of older adults (N= 82) who underwent neuropsychological testing and brain MRI. Volumetric data were analyzed using Neuroreader™ and hippocampal volumes were compared between aMCI and non-amnestic MCI (naMCI).Results: T-tests revealed that regardless of MCI classification criteria, hippocampal volumez-scores were significantly lower in aMCI compared to naMCI (p’s < .05), and hippocampal volumez-scores significantly differed from 0 (Neuroreader™ normative mean) in the aMCI group only (p’s < .05). Additionally, significant, positive correlations were found between measures of delayed recall and hippocampalz-scores in aMCI using either MCI classification criteria (p’s < .05).Conclusions: We provide evidence of correlated neuroanatomical changes associated with memory performance for two commonly used neuropsychological MCI classification criteria. Future research should investigate the clinical utility of hippocampal volumes analyzed via Neuroreader™ in MCI.
Background/Objectives: The interplay between the gut microbiome (GMB) and neurovascular function in neurodegeneration is unclear. The goal of this proof-of-concept, cross-sectional study is to identify relationships between the GMB, neurovascular functioning, and cognition in amnestic mild cognitive impairment (aMCI), the prototypical prodromal symptomatic stage of Alzheimer’s disease (AD). Methods: Participants (n = 14 aMCI and 10 controls) provided fecal samples for GMB sequencing (16S and shotgun metagenomics), underwent MRI, and completed cognitive testing. Cerebral vascular reactivity (CVR), cerebral blood flow (CBF), and arterial transit time (ATT) were assessed. Statistical analyses evaluated the relationships between discriminatory taxa, cerebrovascular metrics, and cognition. Results: Sequencing revealed differentially abundant bacterial and viral taxa distinguishing aMCI from controls. Spearman correlations revealed that bacteria known to induce inflammation were negatively associated with CVR, CBF, and cognition, and positively associated with ATT. A reciprocal pattern emerged for the association of taxa with gut health. Conclusions: Our results provide preliminary evidence that pro-inflammatory gut bacterial and viral taxa are associated with neurovascular dysfunction and cognitive impairment in prodromal AD, highlighting their potential as candidate microbial biomarkers and targets for early intervention.
28 April 2020 in Journal of the International Neuropsychological Society
Objective: This study examined the relationship between patient performance on multiple memory measures and regional brain volumes using an FDA-cleared quantitative volumetric analysis program – Neuroreader™.Method: Ninety-two patients diagnosed with mild cognitive impairment (MCI) by a clinical neuropsychologist completed cognitive evaluations and underwent MR Neuroreader™ within 1 year of testing. Select brain regions were correlated with three widely used memory tests. Regression analyses were conducted to determine if using more than one memory measures would better predict hippocampal z-scores and to explore the added value of recognition memory to prediction models.Results: Memory performances were most strongly correlated with hippocampal volumes than other brain regions. After controlling for encoding/Immediate Recall standard scores, statistically significant correlations emerged between Delayed Recall and hippocampal volumes (rs ranging from .348 to .490). Regression analysis revealed that evaluating memory performance across multiple memory measures is a better predictor of hippocampal volume than individual memory performances. Recognition memory did not add further predictive utility to regression analyses.Conclusions: This study provides support for use of MR Neuroreader™ hippocampal volumes as a clinically informative biomarker associated with memory performance, which is a critical diagnostic feature of MCI phenotype.
21 July 2023 in Journal of the International Neuropsychological Society
Objective: Most neuropsychological tests were developed without the benefit of modern psychometric theory. We used item response theory (IRT) methods to determine whether a widely used test – the 26-item Matrix Reasoning subtest of the WAIS-IV – might be used more efficiently if it were administered using computerized adaptive testing (CAT).Method: Data on the Matrix Reasoning subtest from 2197 participants enrolled in the National Neuropsychology Network (NNN) were analyzed using a two-parameter logistic (2PL) IRT model. Simulated CAT results were generated to examine optimal short forms using fixed-length CATs of 3, 6, and 12 items and scores were compared to the original full subtest score. CAT models further explored how many items were needed to achieve a selected precision of measurement (standard error ≤ .40).Results: The fixed-length CATs of 3, 6, and 12 items correlated well with full-length test results (with r = .90, .97 and .99, respectively). To achieve a standard error of .40 (approximate reliability = .84) only 3–7 items had to be administered for a large percentage of individuals.Conclusions: This proof-of-concept investigation suggests that the widely used Matrix Reasoning subtest of the WAIS-IV might be shortened by more than 70% in most examinees while maintaining acceptable measurement precision. If similar savings could be realized in other tests, the accessibility of neuropsychological assessment might be markedly enhanced, and more efficient time use could lead to broader subdomain assessment.