Objective This paper presents an automatic, active learning-based system for the extraction of medical concepts from clinical free-text reports. Specifically, (1) the contribution of active learning in reducing the annotation effort and (2) the robustness of incremental active learning framework across different selection criteria and data sets are determined. Materials and methods The comparative performance of an active learning framework and a fully supervised approach were investigated to study how active learning reduces the annotation effort while achieving the same effectiveness as a supervised approach. Conditional random fields as the supervised method, and least confidence and information density as 2 selection criteria for active learning framework were used. The effect of incremental learning vs standard learning on the robustness of the models within the active learning framework with different selection criteria was also investigated. The following 2 clinical data sets were used for evaluation: the Informatics for Integrating Biology and the Bedside/Veteran Affairs (i2b2/VA) 2010 natural language processing challenge and the Shared Annotated Resources/Conference and Labs of the Evaluation Forum (ShARe/CLEF) 2013 eHealth Evaluation Lab. Results The annotation effort saved by active learning to achieve the same effectiveness as supervised learning is up to 77%, 57%, and 46% of the total number of sequences, tokens, and concepts, respectively. Compared with the random sampling baseline, the saving is at least doubled. Conclusion Incremental active learning is a promising approach for building effective and robust medical concept extraction models while significantly reducing the burden of manual annotation.
1 October 2017 in International Journal of Medical Informatics
Social isolation (SI) and loneliness are ‘invisible enemies’. They affect older people’s health and quality of life and have significant impact on aged care resources. While in-person screening tools for SI and loneliness exist, staff shortages and psycho-social challenges fed by stereotypes are significant barriers to their implementation in routine care. Autonomous sensor-based approaches can be used to overcome these challenges by enabling unobtrusive and privacy-preserving assessments of SI and loneliness. This paper presents a comprehensive overview of sensor-based tools to assess social isolation and loneliness through a structured critical review of the relevant literature. The aim of this survey is to identify, categorise, and synthesise studies in which sensing technologies have been used to measure activity and behavioural markers of SI and loneliness in older adults. This survey identified a number of feasibility studies using ambient sensors for measuring SI and loneliness activity markers. Time spent out of home and time spent in different parts of the home were found to show strong associations with SI and loneliness scores derived from standard instruments. This survey found a lack of long-term, in-depth studies in this area with older populations. Specifically, research gaps on the use of wearable and smart phone sensors in this population were identified, including the need for co-design that is important for effective adoption and practical implementation of sensor-based SI and loneliness assessment in older adults.
This study investigated Australian older adults’ response to the conditions of the COVID-19 pandemic, the adjustments they made to their activities, technology use, and social relations, to inform how technology design could be inspired by these adaptations. Online interviews revealed that some sorely missed social interactions, however, most enjoyed having a greater agency to curate their own activities and slowing down as a result of lockdown. These findings prompted us to rethink the design space of temporal design from the perspective of those craving an ongoing impact of slowness in their lives. We suggest that designing for a slower pace of life can be inspired by people’s response to life circumstances in lockdown, complementing the original concept of slow technology which seeks to intervene in a fast-paced life to encourage people to slow down and reflect. We conclude by proposing three new design pathways based on this new standpoint.