Background: User-centered design (UCD) is a powerful framework for creating useful, easy-to-use, and satisfying mobile health (mHealth) apps. However, the literature seldom reports the practical challenges of implementing UCD, particularly in the field of mHealth. Objective: This study aims to characterize the practical challenges encountered and propose strategies when implementing UCD for mHealth. Methods: Our multidisciplinary team implemented a UCD process to design and evaluate a mobile app for older adults with heart failure. During and after this process, we documented the challenges the team encountered and the strategies they used or considered using to address those challenges. Results: We identified 12 challenges, 3 about UCD as a whole and 9 across the UCD stages of formative research, design, and evaluation. Challenges included the timing of stakeholder involvement, overcoming designers’ assumptions, adapting methods to end users, and managing heterogeneity among stakeholders. To address these challenges, practical recommendations are provided to UCD researchers and practitioners. Conclusions: UCD is a gold standard approach that is increasingly adopted for mHealth projects. Although UCD methods are well-described and easily accessible, practical challenges and strategies for implementing them are underreported. To improve the implementation of UCD for mHealth, we must tell and learn from these traditionally untold stories.
Human factors and ergonomics (HFE) and related approaches can be used to enhance research and development of consumer-facing health information technology (IT) systems, including technologies supporting the needs of people with chronic disease. A multiphase HFE study of health IT supporting self-care of chronic heart failure by older adults is described. The study was based on HFE frameworks of “patient work” and incorporated the three broad phases of user-centered design: study or analysis, design, and evaluation. In the study phase, data from observations, interviews, surveys, and other methods were analyzed to identify gaps in and requirements for supporting heart failure self-care. The design phase applied findings from the study phase throughout an iterative process, culminating in the design of the Engage application, a product intended for continuous use over 30 days to stimulate self-care engagement, behavior, and knowledge. During the evaluation phase, a variety of usability issues through expert heuristic evaluation and laboratory-based usability testing were identified. The implications of our findings regarding heart failure self-care in older adults and the methodological challenges of rapid translational field research and development in this domain are discussed.
28 September 2017 in Proceedings of the Human Factors and Ergonomics Society Annual Meeting
Many older adults living with heart failure struggle to follow recommended self-management routines. To help older adults with heart failure more effectively and efficiently self-manage their disease, we developed Engage, a mobile health application promoting the performance, logging, and sharing of routine self-management behaviors. This paper reports on the usability evaluation of the Engage system with 15 older adults with heart failure and informal caregivers. In two phases, participants used Engage during a task-based usability test (n=5) and a scenario-based usability test (n=10). Usability and performance data were assessed through video-recorded observation and the administration of the system usability scale (SUS) and NASA Task Load Index (TLX). We found that task-based testing was useful in quickly identifying problems within our application, but scenario-based testing elicited more valuable feedback from older adults. A comparison of the different evaluation methods used and the discussion of the challenges encountered provide multiple implications for the practice of usability testing of mobile health products with older adults.