The Functional Activities Questionnaire (FAQ) is a collateral-report measure of difficulties in activities of daily living. Despite its widespread use, psychometric analyses have been limited in scope, piecemeal across samples, and limited primarily to classical test theory. This article consolidated and expanded psychometric analyses using tools from generalizability and item response theories among 27,916 individuals from the National Alzheimer’s Coordinating Center database who completed the FAQ. Reliability was evaluated with internal consistency, test–retest, and generalizability analyses. Validity was assessed via convergence with neurocognitive measures, classification accuracy with impairment stage, and confirmatory factor and item response theory analyses. Demographics did not impact scores and there was strong evidence for reliability (0.52-0.95), though coefficients were attenuated when restricted in range to diagnostic groups (e.g., normal cognition). There were strong correlations with neurocognitive measures (rs: −.30 to −.59), strong classification accuracy (areas under the curve: .81-.99), and a single-factor model had excellent fit. All items evidenced strong item response theory discrimination and provided significant information regarding functional disability, albeit within a relatively restricted range. The FAQ is a reliable and valid measure of activities of daily living concerns for use in clinical/research settings. It best assesses mild levels of functional difficulty, which is helpful in distinguishing normal cognition from mild cognitive impairment and dementia.
Objective: This study cross-validated the Dot Counting Test (DCT) as a performance validity test (PVT) among a mixed clinical veteran sample. Completion time and error patterns also were examined by validity group and cognitive impairment status. Method: This cross-sectional study included 77 veterans who completed the DCT during clinical evaluation. Seventy-four percent (N = 57) were classified as valid and 26% as noncredible (N = 20) via the Word Memory Test (WMT) and Test of Memory Malingering (TOMM). Among valid participants, 47% (N = 27) were cognitively impaired, and 53% (N = 30) were unimpaired. Results: DCT performance was not significantly associated with age, education, or bilingualism. Seventy-five percent of the overall sample committed at least one error across the 12 stimulus cards; however, valid participants had a 27% higher rate of 0 errors, while noncredible participants had a 35% higher rate of ≥4 errors. Overall, noncredible individuals had significantly longer completion times, more errors, and higher E-scores. Conversely, those with cognitive impairment had longer completion times, but comparable errors to their unimpaired counterparts. Finally, DCT E-scores significantly predicted group membership with 83.1% classification accuracy and an area under the curve of .87 for identifying invalid performance. The optimal cut-score of 15 was associated with 70% sensitivity and 88% specificity. Conclusion: The DCT demonstrated good classification accuracy and sensitivity/specificity for identifying noncredible performance in this mixed clinical veteran sample, suggesting utility as a non-memory-based PVT with this population. Moreover, cognitive impairment significantly contributed to slower completion times, but not reduced accuracy.
1 January 2021 in Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring
Introduction: Cognitive screening measures often lack sensitivity and are hampered by inequities across ethnoracial groups. A multitrait multimethod (MTMM) classification may attenuate these shortcomings. Methods: A sample of 7227 participants across the diagnostic spectrum were selected from the National Alzheimer's Coordinating Center cohort. Random forest ensemble methods were used to predict diagnosis across the sample and within Black American ( n = 1025) and non‐Hispanic White groups ( n = 5263) based on: (1) a demographically corrected Montreal Cognitive Assessment (MoCA), (2) MoCA and Functional Assessment Questionnaire (FAQ), (3) MoCA and FAQ with demographic correction. Results: The MTMM approach with demographic correction had the highest diagnostic accuracy for the cognitively unimpaired (area under curve [AUC] [95% confidence interval (CI)]): 0.906 [0.892, 0.920]) and mild cognitive impairment (AUC: 0.835 [0.810, 0.860]) groups and reduced racial disparities. Discussion: With further validation, the MTMM approach combining cognitive screening and functional status assessment may serve to improve diagnostic accuracy and extend opportunities for early intervention with greater equity.
24 September 2023 in The Clinical Neuropsychologist
Objective: To evaluate the latent structure, internal consistency, convergent and discriminant validity, diagnostic accuracy, and criterion validity of the Montreal Cognitive Assessment's auditory items (MoCA-22), which has previously been evaluated in small samples if at all. Methods: 11,284 participants completed the MoCA over 1-2 visits to an Alzheimer Disease Research Center (Mage = 69.2, Meducation = 15.9, 57.6% women, 92.4% non-Hispanic white). MoCA-22 items were probed with alpha, omega, confirmatory factor analysis, and test-retest correlations. Scores were related to measures of neurocognition, daily functioning, behavioral-psychological symptoms (BPS), and vision performance for convergent-discriminant and criterion validity. Dementia stage was used to calculate area under the receiver operating characteristic (AUC-ROC) curves and cutoffs for mild cognitive impairment (MCI) and dementia. Results: A single-factor had good fit (CFI = .961; TLI = .945; RMSEA = .061; SRMR = .031), with good internal consistency (Omega total = .83) and test-retest consistency (ICC = .92 at 2.7 years). The strongest convergent correlations were with general cognition and executive functioning, while discriminant validity was demonstrated with its weakest and negative correlations being with BPS. There was strong classification accuracy in distinguishing MCI from normal cognition (AUC = .79; optimal cutoff point < 18), and mild-to-moderate dementia from MCI (AUC = .85; optimal cutoff point < 13). Furthermore, the MoCA-22 had negligible-to-small differences among those with and without vision limitations. Conclusions: These findings add to the evidence of the MoCA-22's utility and it serves as a useful cognitive screening tool with sound reliability and validity.
30 October 2024 in The American Journal of Geriatric Psychiatry