22 August 2024 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
μEMA is a data collection method that prompts research participants with quick, answer-at-a-glance, single-multiple-choice self-report behavioral questions, thus enabling high-temporal-density self-report of up to four times per hour when implemented on a smartwatch. However, due to the small watch screen, μEMA is better used to select among 2 to 5 multiple-choice answers versus allowing the collection of open-ended responses. We introduce an alternative and novel form of micro-interaction self-report using speech input - audio-μEMA- where a short beep or vibration cues participants to verbally report their behavioral states, allowing for open-ended, temporally dense self-reports. We conducted a one-hour usability study followed by a within-subject, 6-day to 21-day free-living feasibility study in which participants self-reported their physical activities and postures once every 2 to 5 minutes. We qualitatively explored the usability of the system and identified factors impacting the response rates of this data collection method. Despite being interrupted 12 to 20 times per hour, participants in the free-living study were highly engaged with the system, with an average response rate of 67.7% for audio-μEMA for up to 14 days. We discuss the factors that impacted feasibility; some implementation, methodological, and participant challenges we observed; and important considerations relevant to deploying audio-μEMA in real-time activity recognition systems.
2 December 2025 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Measuring activities and postures is an important area of research in ubiquitous computing, human-computer interaction, and personal health informatics. One approach that researchers use to collect large amounts of labeled data to develop models for activity recognition and measurement is asking participants to self-report their daily activities. Although participants can typically recall their sequence of daily activities, remembering the precise start and end times of each activity is significantly more challenging. ACAI is a novel, context-assisted Activity Annotation Inttivity Annotation Interface that enables participants to efficiently label their activities by accepting or adjusting system-generated activity suggestions while explicitly expressing uncertainty about temporal boundaries. We evaluated ACAI using two complementary studies: a usability study with 11 participants and a two-week, free-living study with 14 participants. We compared our activity annotation system with the current gold-standard methods for activity recall in health sciences research: 24PAR and its computerized version, ACT24. Our system reduced annotation time and perceived effort while significantly improving data validity and fidelity compared to both standard human-supervised and unsupervised activity recall approaches. We discuss the limitations of our design and implications for developing adaptive, human-in-the-loop activity recognition systems used to collect self-report data on activity.
1 July 2025 in Journal of Rehabilitation and Assistive Technologies Engineering
Introduction: We report findings from two feasibility studies with persons with SCI that aimed to leverage social support to increase PA: a two-week study with nine participants and a four-week study with six participants. Method: We recruited a total of 17 participants across two phases (10 participants in Phase 1 and seven participants in Phase 2). In dyads, participants used a smartphone-smartwatch application that we iteratively developed based on participant feedback. The application delivered just-in-time support based on measured PA and encouraged reciprocal self-disclosure to increase closeness within dyads. Results: Participants found the delivery of messages during detected PA to be motivational. Some liked automatically sharing tracked PA with others and did not have privacy concerns about doing so, and most preferred exchanging real-time messages more than context- or activity-triggered messages. Participants also expressed that feeling connected to their partner increased motivation to engage in PA. Conclusion: Participants expressed that they liked being able to connect with individuals with shared life experience to exchange encouraging messages. There are, however, challenges that need to be addressed before a large-scale deployment of this technology, including user concerns about automatically detected activity.
1 October 2021 in Archives of Physical Medicine and Rehabilitation