Parkinson’s disease (PD) is a neurodegenerative disorder characterised by motor symptoms such as gait dysfunction and postural instability. Technological tools to continuously monitor outcomes could capture the hour-by-hour symptom fluctuations of PD. Development of such tools is hampered by the lack of labelled datasets from home settings. To this end, we propose REMAP (REal-world Mobility Activities in Parkinson’s disease), a human rater-labelled dataset collected in a home-like setting. It includes people with and without PD doing sit-to-stand transitions and turns in gait. These discrete activities are captured from periods of free-living (unobserved, unstructured) and during clinical assessments. The PD participants withheld their dopaminergic medications for a time (causing increased symptoms), so their activities are labelled as being “on” or “off” medications. Accelerometry from wrist-worn wearables and skeleton pose video data is included. We present an open dataset, where the data is coarsened to reduce re-identifiability, and a controlled dataset available on application which contains more refined data. A use-case for the data to estimate sit-to-stand speed and duration is illustrated.
Delivering effortless interactions and appropriate interventions through pervasive systems requires making sense of multiple streams of sensor data. This is particularly challenging when these concern people’s natural behaviours in the real world. This paper takes a multidisciplinary perspective of annotation and draws on an exploratory study of 12 people, who were encouraged to use a multi-modal annotation app while living in a prototype smart home. Analysis of the app usage data and of semi-structured interviews with the participants revealed strengths and limitations regarding self-annotation in a naturalistic context. Handing control of the annotation process to research participants enabled them to reason about their own data, while generating accounts that were appropriate and acceptable to them. Self-annotation provided participants an opportunity to reflect on themselves and their routines, but it was also a means to express themselves freely and sometimes even a backchannel to communicate playfully with the researchers. However, self-annotation may not be an effective way to capture accurate start and finish times for activities, or location associated with activity information. This paper offers new insights and recommendations for the design of self-annotation tools for deployment in the real world.
SPHERE is a large multidisciplinary project to research and develop a sensor network to facilitate home healthcare by activity monitoring, specifically towards activities of daily living. It aims to use the latest technologies in low powered sensors, internet of things, machine learning and automated decision making to provide benefits to patients and clinicians. This dataset comprises data collected from a SPHERE sensor network deployment during a set of experiments conducted in the ‘SPHERE House’ in Bristol, UK, during 2016, including video tracking, accelerometer and environmental sensor data obtained by volunteers undertaking both scripted and non-scripted activities of daily living in a domestic residence. Trained annotators provided ground-truth labels annotating posture, ambulation, activity and location. This dataset is a valuable resource both within and outside the machine learning community, particularly in developing and evaluating algorithms for identifying activities of daily living from multi-modal sensor data in real-world environments. A subset of this dataset was released as a machine learning competition in association with the European Conference on Machine Learning (ECML-PKDD 2016).
11 November 2022 in Parkinsonism & Related Disorders
Turning in gait digital parameters may be useful in measuring disease progression in Parkinson's disease (PD), however challenges remain over algorithm validation in real-world settings. The influence of clinician observation on turning outcomes is poorly understood. Our objective is to describe a unique in-home video dataset and explore the use of turning parameters as biomarkers in PD. 11 participants with PD, 11 control participants stayed in a home-like setting living freely for 5 days (with two sessions of clinical assessment), during which high-resolution video was captured. Clinicians watched the videos, identified turns and documented turning parameters. From 85 hours of video 3869 turns were evaluated, averaging at 22.7 turns per hour per person. 6 participants had significantly different numbers of turning steps and/or turn duration between “ON” and “OFF” medication states. Positive Spearman correlations were seen between the Movement Disorders Society-sponsored revision of the Unified Parkinson's Disease Rating Scale III score with a) number of turning steps (rho = 0.893, p < 0.001), and b) duration of turn (rho = 0.744, p = 0.009) “OFF” medications. A positive correlation was seen “ON” medications between number of turning steps and clinical rating scale score (rho = 0.618, p = 0.048). Both cohorts took more steps and shorter durations of turn during observed clinical assessments than when free-living. This study shows proof of concept that real-world free-living turn duration and number of turning steps recorded can distinguish between PD medication states and correlate with gold-standard clinical rating scale scores. It illustrates a methodology for ecological validation of real-world digital outcomes.
Ubiquitous eHealth systems based on sensor technologies are seen as key enablers in the effort to reduce the financial impact of an ageing society. At the heart of such systems sit activity recognition algorithms, which need sensor data to reason over, and a ground truth of adequate quality used for training and validation purposes. The large set up costs of such research projects and their complexity limit rapid developments in this area. Therefore, information sharing and reuse, especially in the context of collected datasets, is key in overcoming these barriers. One approach which facilitates this process by reducing ambiguity is the use of ontologies. This article presents a hierarchical ontology for activities of daily living (ADL), together with two use cases of ground truth acquisition in which this ontology has been successfully utilised. Requirements placed on the ontology by ongoing work are discussed.
Background: Parkinson disease (PD) symptoms are complex, gradually progressive, and fluctuate hour by hour. Home-based technological sensors are being investigated to measure symptoms and track disease progression. A smart home sensor platform, with cameras and wearable devices, could be a useful tool to use to get a fuller picture of what someone’s symptoms are like. High-resolution video can capture the ground truth of symptoms and activities. There is a paucity of information about the acceptability of such sensors in PD. Objective: The primary objective of our study was to explore the acceptability of living with a multimodal sensor platform in a naturalistic setting in PD. Two subobjectives are to identify any suggested limitations and to explore the sensors’ impact on participant behaviors. Methods: A qualitative study was conducted with an inductive approach using semistructured interviews with a cohort of PD and control participants who lived freely for several days in a home-like environment while continuously being sensed. Results: This study of 24 participants (12 with PD) found that it is broadly acceptable to use multimodal sensors including wrist-worn wearables, cameras, and other ambient sensors passively in free-living in PD. The sensor that was found to be the least acceptable was the wearable device. Suggested limitations on the platform for home deployment included camera-free time and space. Behavior changes were noted by the study participants, which may have related to being passively sensed. Recording high-resolution video in the home setting for limited periods of time was felt to be acceptable to all participants. Conclusions: The results broaden the knowledge of what types of sensors are acceptable for use in research in PD and what potential limitations on these sensors should be considered in future work. The participants’ reported behavior change in this study should inform future similar research design to take this factor into account. Collaborative research study design, involving people living with PD at every stage, is important to ensure that the technology is acceptable and that the data outcomes produced are ecologically valid and accurate. International Registered Report Identifier (IRRID): RR2-10.1136/bmjopen-2020-041303