Primary objective: To determine whether the psychometrics of the BRIEF-A are adequate for individuals diagnosed with TBI. Research design: A prospective observational study in which the BRIEF-A was collected as part of a larger study. Methods and procedures: Informant ratings of the 75-item BRIEF-A on 89 individuals diagnosed with TBI were examined to determine items level psychometrics for each of the two BRIEF-A indexes: Behaviour Rating Index (BRI) and Metacognitive Index (MI). Patients were either outpatients or at least 1 year post-injury. Main outcomes and results: Each index measured a latent trait, separating individuals into five-to-six ability levels and demonstrated good reliability (0.94 and 0.96). Four items were identified that did not meet the infit criteria. Conclusions: The results provide support for the use of the BRIEF-A as a supplemental assessment of executive function in TBI populations. However, further validation is needed with other measures of executive function. Recommendations include use of the index scores over the Global Executive Composite score and use of the difficulty hierarchy for setting therapy goals.
28 April 2015 in Neuropsychological Rehabilitation
Social problem-solving deficits characterise individuals with traumatic brain injury (TBI), and poor social problem solving interferes with daily functioning and productive lifestyles. Therefore, it is of vital importance to use the appropriate instrument to identify deficits in social problem solving for individuals with TBI. This study investigates factor structure and item-level psychometrics of the Social Problem Solving Inventory – Revised: Short Form (SPSI-R:S), for adults with moderate and severe TBI. Secondary analysis of 90 adults with moderate and severe TBI who completed the SPSI-R:S was performed. An exploratory factor analysis (EFA), principal components analysis (PCA) and Rasch analysis examined the factor structure and item-level psychometrics of the SPSI-R:S. The EFA showed three dominant factors, with positively worded items represented as the most definite factor. The other two factors are negative problem-solving orientation and skills; and negative problem-solving emotion. Rasch analyses confirmed the three factors are each unidimensional constructs. It was concluded that the total score interpretability of the SPSI-R:S may be challenging due to the multidimensional structure of the total measure. Instead, we propose using three separate SPSI-R:S subscores to measure social problem solving for the TBI population.
23 January 2019 in Applied Psychological Measurement
The purpose of this simulation study was to investigate the effect of several different item exposure control procedures in computerized adaptive testing (CAT) with variable-length stopping rules using the partial credit model. Previous simulation studies on CAT exposure control methods with polytomous items rarely considered variable-length tests. The four exposure control techniques examined were the randomesque with a group of three items, randomesque with a group of six items, progressive-restricted standard error (PR-SE), and no exposure control. The two variable-length stopping rules included were the SE and predicted standard error reduction (PSER), along with three item pools of varied sizes (43, 86, and 172 items). Descriptive statistics on number of nonconvergent cases, measurement precision, testing burden, item overlap, item exposure, and pool utilization were calculated. Results revealed that the PSER stopping rule administered fewer items on average while maintaining measurement precision similar to the SE stopping rule across the different item pool sizes and exposure controls. The PR-SE exposure control procedure surpassed the randomesque methods by further reducing test overlap, maintaining maximum exposure rates at the target rate or lower, and utilizing all items from the pool with a minimal increase in number of items administered and nonconvergent cases.
1 May 2020 in Archives of Physical Medicine and Rehabilitation
To conduct the first item-level exploration of scale and index structure of the self-report Behavior Rating Inventory of Executive Function-Adult version (BRIEF-A) in traumatic brain injury (TBI). This was an observational cross-sectional study design using secondary data. We conducted exploratory factor analyses (EFA) to explore the index structure and scale structure of the BRIEF-A. We conducted EFA with all 70 items of the BRIEF-A to examine the index structure. Based on the finding of index structure, we conducted EFA on the 30 items of the Behavioral Regulation Index (BRI) and the 40 items of the Metacognitive Index (MI). Data were collected through 5 studies in outpatient and community settings in the southeast United States. Individuals (N=338) aged 18-89 years with a history of mild to severe TBI who were able to speak English fluently. Not applicable. The BRIEF-A. The 2-factor structure aligned with the BRIEF-A manual at the index level. Scale structure for the MI (40 items) resulted in 1 factor, whereas the BRI (30 items) could be represented by either a 2- or 3-factor structure. The 2-factor structure of the BRI is more parsimonious and matched other factor analyses derived from the sum of scale items. We confirmed the manual designated index structure (BRI and MI) of the BRIEF-A but took precautions against using the 9 scales. Instead, we recommend using the 2 designated index scores and 2 newly identified composite scores representing Behavioral Control Trait and Emotional Control Trait.
7 July 2023 in Frontiers in Rehabilitation Sciences
Objective: We tested Goal Management Training (GMT), which has been recommended as an executive training protocol that may improve the deficits in the complex tasks inherent in life role participation experienced by those with chronic mild traumatic brain injury and post-traumatic stress disease (mTBI/PTSD). We assessed, not only cognitive function, but also life role participation (quality of life).Methods: We enrolled and treated 14 individuals and administered 10 GMT sessions in-person and provided the use of the Veterans Task Manager (VTM), a Smartphone App, which was designed to serve as a “practice-buddy” device to ensure translation of in-person learning to independent home and community practice of complex tasks. Pre-/post-treatment primary measure was the NIH Examiner, Unstructured Task. Secondary measures were as follows: Tower of London time to complete (cTOL), Community Reintegration of Service Members (CRIS) three subdomains [Extent of Participation; Limitations; Satisfaction of Life Role Participation (Satisfaction)]. We analyzed pre-post-treatment, t-test models to explore change, and generated descriptive statistics to inspect given individual patterns of change across measures.Results: There was statistically significant improvement for the NIH EXAMINER Unstructured Task (p < .02; effect size = .67) and cTOL (p < .01; effect size = .52. There was a statistically significant improvement for two CRIS subdomains: Extent of Participation (p < .01; effect size = .75; Limitations (p < .05; effect size = .59). Individuals varied in their treatment response, across measures.Conclusions and Clinical Significance: In Veterans with mTBI/PTSD in response to GMT and the VTM learning support buddy, there was significant improvement in executive cognition processes, sufficiently robust to produce significant improvement in community life role participation. The individual variations support need for precision neurorehabilitation. The positive results occurred in response to treatment advantages afforded by the content of the combined GMT and the employment of the VTM learning support buddy, with advantages including the following: manualized content of the GMT; incremental complex task difficulty; GMT structure and flexibility to incorporate individualized functional goals; and the VTM capability of ensuring translation of in-person instruction to home and community practice, solidifying newly learned executive cognitive processes. Study results support future study, including a potential randomized controlled trial, the manualized GMT and availability of the VTM to ensure future clinical deployment of treatment, as warranted.