Our objective was to investigate the validity of four-item and six-item versions of the National Aeronautics and Space Administration Task Load Index (NASA-TLX, or TLX for short) for measuring workload over a whole day in the repeated measures context. We analysed data on 51 people with type 1 diabetes from whom we collected ecological momentary assessment and daily diary data over 14 days. The TLX was administered at the last survey of every day. Confirmatory factor analysis fit statistics indicated that neither the TLX-6 nor TLX-4 were a unidimensional representation of whole day workload. In exploratory analyses, another set of TLX items we refer to as TLX-4v2 was sufficiently unidimensional. Raw sum scores from the TLX-6 and TLX-4v2 had plausible relationships with other measures, as evidenced by intra-person correlations and mixed-effects models. TLX-6 appears to capture multiple factors contributing to workload, while TLX-4v2 assesses the single factor of ‘mental strain’. Practitioner Summary: Using within-person longitudinal data, we found evidence supporting the validity of a measure evaluating whole-day workload (i.e. workload derived from all sources, not only paid employment) derived from the NASA-TLX. This measure may be useful to assess how day-to-day variations in workload impact quality of life among adults. Abbreviations: NASA-TLX or TLX: National Aeronautics and Space Administration Task Load Index; TLX-6: six item version of the NASA-TLX; TLX-4: four item version of the NASA-TLX, TLX-4v2: four item NASA-TLX version two; NIOSH: National Institute for Occupational Safety and Health; CFA: confirmatory factor analysis; T1D: type 1 diabetes; EMA: ecological momentary assessment; BG: blood glucose; SD: standard deviation; CV: coefficient of variation; RMSEA: root mean square error of approximation; CFI: comparative fit index; TLI: Tucker-Lewis Index; SRMR: standardized root mean square residual; AIC: Akaike information criterion; BIC: Bayesian information criterion; χ2: Chi-square statistic
Background: Although short-term blood glucose levels and variability are thought to underlie diminished function and emotional well-being in people with type 1 diabetes (T1D), these relationships are poorly understood. The Function and Emotion in Everyday Life with T1D (FEEL-T1D) study focuses on investigating these short-term dynamic relationships among blood glucose levels, functional ability, and emotional well-being in adults with T1D. Objective: The aim of this study is to present the FEEL-T1D study design, methods, and study progress to date, including adaptations necessitated by the COVID-19 pandemic to implement the study fully remotely. Methods: The FEEL-T1D study will recruit 200 adults with T1D in the age range of 18-75 years. Data collection includes a comprehensive survey battery, along with 14 days of intensive longitudinal data using blinded continuous glucose monitoring, ecological momentary assessments, ambulatory cognitive tasks, and accelerometers. All study procedures are conducted remotely by mailing the study equipment and by using videoconferencing for study visits. Results: The study received institutional review board approval in January 2019 and was funded in April 2019. Data collection began in June 2020 and is projected to end in December 2021. As of June 2021, after 12 months of recruitment, 124 participants have enrolled in the FEEL-T1D study. Approximately 87.6% (7082/8087) of ecological momentary assessment surveys have been completed with minimal missing data, and 82.0% (82/100) of the participants provided concurrent continuous glucose monitoring data, ecological momentary assessment data, and accelerometer data for at least 10 of the 14 days of data collection. Conclusions: Thus far, our reconfiguration of the FEEL-T1D protocol to be implemented remotely during the COVID-19 pandemic has been a success. The FEEL-T1D study will elucidate the dynamic relationships among blood glucose levels, emotional well-being, cognitive function, and participation in daily activities. In doing so, it will pave the way for innovative just-in-time interventions and produce actionable insights to facilitate tailoring of diabetes treatments to optimize the function and well-being of individuals with T1D. International Registered Report Identifier (IRRID): DERR1-10.2196/30901
Occupational health and safety is experiencing a paradigm shift from focusing only on health at the workplace toward a holistic approach and worker well-being framework that considers both work and non-work factors. Aligned with this shift, the purpose of this pilot study was to examine how, within a person, frequencies of high-workload and recovery activities from both work and non-work periods were associated with same day well-being measures. We analyzed data on 45 workers with type 1 diabetes from whom we collected activity data 5–6 times daily over 14 days. More frequent engagement in high-workload activities was associated with lower well-being on multiple measures including higher stress. Conversely, greater recovery activity frequency was mostly associated with higher well-being indicated by lower stress and higher positive affect. Overall, our results provide preliminary validity evidence for measures of high-workload and recovery activity exposure covering both work and non-work periods that can inform and support evaluations of worker well-being.
Background: Various populations with chronic conditions are at risk for decreased cognitive performance, making assessment of their cognition important. Formal mobile cognitive assessments measure cognitive performance with greater ecological validity than traditional laboratory-based testing but add to participant task demands. Given that responding to a survey is considered a cognitively demanding task itself, information that is passively collected as a by-product of ecological momentary assessment (EMA) may be a means through which people’s cognitive performance in their natural environment can be estimated when formal ambulatory cognitive assessment is not feasible. We specifically examined whether the item response times (RTs) to EMA questions (eg, mood) can serve as approximations of cognitive processing speed. Objective: This study aims to investigate whether the RTs from noncognitive EMA surveys can serve as approximate indicators of between-person (BP) differences and momentary within-person (WP) variability in cognitive processing speed. Methods: Data from a 2-week EMA study investigating the relationships among glucose, emotion, and functioning in adults with type 1 diabetes were analyzed. Validated mobile cognitive tests assessing processing speed (Symbol Search task) and sustained attention (Go-No Go task) were administered together with noncognitive EMA surveys 5 to 6 times per day via smartphones. Multilevel modeling was used to examine the reliability of EMA RTs, their convergent validity with the Symbol Search task, and their divergent validity with the Go-No Go task. Other tests of the validity of EMA RTs included the examination of their associations with age, depression, fatigue, and the time of day. Results: Overall, in BP analyses, evidence was found supporting the reliability and convergent validity of EMA question RTs from even a single repeatedly administered EMA item as a measure of average processing speed. BP correlations between the Symbol Search task and EMA RTs ranged from 0.43 to 0.58 (P<.001). EMA RTs had significant BP associations with age (P<.001), as expected, but not with depression (P=.20) or average fatigue (P=.18). In WP analyses, the RTs to 16 slider items and all 22 EMA items (including the 16 slider items) had acceptable (>0.70) WP reliability. After correcting for unreliability in multilevel models, EMA RTs from most combinations of items showed moderate WP correlations with the Symbol Search task (ranged from 0.29 to 0.58; P<.001) and demonstrated theoretically expected relationships with momentary fatigue and the time of day. The associations between EMA RTs and the Symbol Search task were greater than those between EMA RTs and the Go-No Go task at both the BP and WP levels, providing evidence of divergent validity. Conclusions: Assessing the RTs to EMA items (eg, mood) may be a method of approximating people’s average levels of and momentary fluctuations in processing speed without adding tasks beyond the survey questions.
Objectives This paper examined the magnitude of differences in performance across domains of cognitive functioning between participants who attrited from studies and those who did not, using data from longitudinal ageing studies where multiple cognitive tests were administered. Design Individual participant data meta-analysis. Participants Data are from 10 epidemiological longitudinal studies on ageing (total n=209 518) from several Western countries (UK, USA, Mexico, etc). Each study had multiple waves of data (range of 2–17 waves), with multiple cognitive tests administered at each wave (range of 4–17 tests). Only waves with cognitive tests and information on participant dropout at the immediate next wave for adults aged 50 years or older were used in the meta-analysis. Measures For each pair of consecutive study waves, we compared the difference in cognitive scores (Cohen’s d) between participants who dropped out at the next study wave and those who remained. Note that our operationalisation of dropout was inclusive of all causes (eg, mortality). The proportion of participant dropout at each wave was also computed. Results The average proportion of dropouts between consecutive study waves was 0.26 (0.18 to 0.34). People who attrited were found to have significantly lower levels of cognitive functioning in all domains (at the wave 2–3 years before attrition) compared with those who did not attrit, with small-to-medium effect sizes (overall d=0.37 (0.30 to 0.43)). Conclusions Older adults who attrited from longitudinal ageing studies had lower cognitive functioning (assessed at the timepoint before attrition) across all domains as compared with individuals who remained. Cognitive functioning differences may contribute to selection bias in longitudinal ageing studies, impeding accurate conclusions in developmental research. In addition, examining the functional capabilities of attriters may be valuable for determining whether attriters experience functional limitations requiring healthcare attention.
Monitoring of cognitive abilities in large-scale survey research is receiving increasing attention. Conventional cognitive testing, however, is often impractical on a population level highlighting the need for alternative means of cognitive assessment. We evaluated whether response times (RTs) to online survey items could be useful to infer cognitive abilities. We analyzed >5 million survey item RTs from >6000 individuals administered over 6.5 years in an internet panel together with cognitive tests (numerical reasoning, verbal reasoning, task switching/inhibitory control). We derived measures of mean RT and intraindividual RT variability from a multilevel location-scale model as well as an expanded version that separated intraindividual RT variability into systematic RT adjustments (variation of RTs with item time intensities) and residual intraindividual RT variability (residual error in RTs). RT measures from the location-scale model showed weak associations with cognitive test scores. However, RT measures from the expanded model explained 22–26% of the variance in cognitive scores and had prospective associations with cognitive assessments over lag-periods of at least 6.5 years (mean RTs), 4.5 years (systematic RT adjustments) and 1 year (residual RT variability). Our findings suggest that RTs in online surveys may be useful for gaining information about cognitive abilities in large-scale survey research.