2 November 2021 in JMIR Formative Research
Background: Technology can benefit older adults in many ways, including by facilitating remote access to services, communication, and socialization for convenience or out of necessity when individuals are homebound. As people, especially older adults, self-quarantined and sheltered in place during the COVID-19 pandemic, the importance of usability-in-place became clear. To understand the remote use of technology in an ecologically valid manner, researchers and others must be able to test usability remotely. Objective: Our objective was to review practical approaches for and findings about remote usability testing, particularly remote usability testing with older adults. Methods: We performed a rapid review of the literature and reported on available methods, their advantages and disadvantages, and practical recommendations. This review also reported recommendations for usability testing with older adults from the literature. Results: Critically, we identified a gap in the literature—a lack of remote usability testing methods, tools, and strategies for older adults, despite this population’s increased remote technology use and needs (eg, due to disability or technology experience). We summarized existing remote usability methods that were found in the literature as well as guidelines that are available for conducting in-person usability testing with older adults. Conclusions: We call on the human factors research and practice community to address this gap to better support older adults and other homebound or mobility-restricted individuals.
4 March 2021 in JMIR mHealth and uHealth
Background: The COVID-19 pandemic necessitated “going remote” with the delivery, support, and assessment of a study intervention targeting older adults enrolled in a clinical trial. While remotely delivering and assessing technology is not new, there are few methods available in the literature that are proven to be effective with diverse populations, and none for older adults specifically. Older adults comprise a diverse population, including in terms of their experience with and access to technology, making this a challenging endeavor. Objective: Our objective was to remotely deliver and conduct usability testing for a mobile health (mHealth) technology intervention for older adult participants enrolled in a clinical trial of the technology. This paper describes the methodology used, its successes, and its limitations. Methods: We developed a conceptual model for remote operations, called the Framework for Agile and Remote Operations (FAR Ops), that combined the general requirements for spaceflight operations with Agile project management processes to quickly respond to this challenge. Using this framework, we iteratively created care packages that differed in their contents based on participant needs and were sent to study participants to deliver the study intervention—a medication management app—and assess its usability. Usability data were collected using the System Usability Scale (SUS) and a novel usability questionnaire developed to collect more in-depth data. Results: In the first 6 months of the project, we successfully delivered 21 care packages. We successfully designed and deployed a minimum viable product in less than 6 weeks, generally maintained a 2-week sprint cycle, and achieved a 40% to 50% return rate for both usability assessment instruments. We hypothesize that lack of engagement due to the pandemic and our use of asynchronous communication channels contributed to the return rate of usability assessments being lower than desired. We also provide general recommendations for performing remote usability testing with diverse populations based on the results of our work, including implementing screen sharing capabilities when possible, and determining participant preference for phone or email communications. Conclusions: The FAR Ops model allowed our team to adopt remote operations for our mHealth trial in response to interruptions from the COVID-19 pandemic. This approach can be useful for other research or practice-based projects under similar circumstances or to improve efficiency, cost, effectiveness, and participant diversity in general. In addition to offering a replicable approach, this paper tells the often-untold story of practical challenges faced by mHealth projects and practical strategies used to address them. Trial Registration: ClinicalTrials.gov NCT04121858; https://clinicaltrials.gov/ct2/show/NCT04121858
19 March 2018 in IISE Transactions on Healthcare Systems Engineering
The ability to monitor physiological parameters of individuals remotely while they work or live in an extreme environment is useful for promoting health and safety. There is limited demonstration of real-time, remote ambulatory physiological monitoring during field science tasks with readily available, Commercial-Off-The-Shelf, or COTS, products. In order to investigate physiological responses to tasks approximating those that will be performed during planetary exploration, the Zephyr BioHarnessTM was integrated into NASA’s BASALT Mars Analog field deployment for real-time, remote extravehicular crew monitoring during field traverses and sample collection tasks at the Craters of the Moon National Monument in Idaho, and Hawai’i Volcanoes National Park. This opportunity was leveraged to assess the feasibility of using COTS physiological monitors to stream live data and develop protocols for real-time health status determination under remote networking conditions in a field geology setting. Physiological monitoring data was transmitted from a field setting to a remote monitoring site at a resolution of 1 Hz in 23 out of 28 simulated EVAs. Outages were generally attributed to the difficulties of implementing a field network in an environment such as the ones in which BASALT operated rather than inherent issues with the COTS instrumentation. Conclusions were drawn that this application of COTS physiological monitoring is potentially applicable to a range of field research tasks, and requires detailed understanding of tasks and individuals when determining health status and performance limits.
15 March 2023 in The Gerontologist
Background and Objectives: Informal (or family) caregivers to older adults with Alzheimer’s disease or other related dementias (ADRD) could greatly benefit from innovative telecaregiving systems that support caregiving from a distance. The objective of this review is to better understand (a) who is involved in telecaregiving and their experiences; (b) the interventions currently available to support ADRD telecaregiving; and (c) the outcomes measured to assess the effects of ADRD telecaregiving interventions.Research Design and Methods: A mapping review was conducted by systematically searching MEDLINE, CINAHL, Embase, and PsycINFO for all works published in English from 2002 to 2022. References of included publications were searched to identify additional empirical publications for inclusion.Results: Sixty-one publications (describing 48 studies and 5 nonstudy sources) were included in the review. Currently available information on the demographics, experiences, challenges, and benefits of ADRD telecaregivers is summarized. We found that interventions to support telecaregiving could be classified into 7 categories of technological interventions and 3 categories of nontechnological interventions. Empirical studies on ADRD telecaregiving interventions investigated a variety of outcomes, the most prevalent being user experience.Discussion and Implications: We conclude that (a) the paucity of literature on telecaregiving does not allow for a comprehensive understanding of the needs and day-to-day activities of ADRD telecaregivers; (b) interventions developed to support ADRD telecaregiving may not fully meet the needs of caregivers or care recipients; and (c) there is insufficient rigorous research establishing the effects of telecaregiving interventions on key ADRD-related outcomes.
10 October 2025 in Journal of Medical Internet Research
As digital and remote research methods become more prevalent, the risk of fraudulent participants—individuals who deliberately misrepresent themselves to gain access to studies and associated incentives—has emerged as a significant challenge. These inauthentic participants threaten data validity, obscure treatment effects, and may lead to interventions being developed based on inaccurate representations of target populations. Despite the growing recognition of this issue, researchers have limited guidance on how to detect and respond to fraud when it occurs, particularly when committed by real people rather than automated systems. We present 3 case studies from our own research where participants engaged in deception to gain study incentives. We identify recurring patterns of behavior as “red” (clear signs of inauthenticity) and “yellow” (ambiguous behavior common among fraudulent participants) flags, describe how our team responded, and share lessons learned for future studies. This work aims to support researchers in identifying fraudulent participants more effectively, helping to ensure the validity and credibility of data collected in online research.