COVID-19 heavily affects breathing and voice and causes symptoms that make patients’ voices distinctive, creating recognizable audio signatures. Initial studies have already suggested the potential of using voice as a screening solution. In this article we present a dataset of voice, cough and breathing audio recordings collected from individuals infected by SARS-CoV-2 virus, as well as non-infected subjects via large scale crowdsourced campaign. We describe preliminary results for detection of COVID-19 from cough patterns using standard acoustic features sets, wavelet scattering features and deep audio embeddings extracted from low-level feature representations (VGGish and OpenL3). Our models achieve accuracy of 88.52%, sensitivity of 88.75% and specificity of 90.87%, confirming the applicability of audio signatures to identify COVID-19 symptoms. We furthermore provide an in-depth analysis of the most informative acoustic features and try to elucidate the mechanisms that alter the acoustic characteristics of coughs of people with COVID-19.
New language technologies are coming, thanks to the huge and competing private investment fuelling rapid progress; we can either understand and foresee their effects, or be taken by surprise and spend our time trying to catch up. This report scketches out some transformative new technologies that are likely to fundamentally change our use of language. Some of these may feel unrealistically futuristic or far-fetched, but a central purpose of this report - and the wider LITHME network - is to illustrate that these are mostly just the logical development and maturation of technologies currently in prototype. But will everyone benefit from all these shiny new gadgets? Throughout this report we emphasise a range of groups who will be disadvantaged and issues of inequality. Important issues of security and privacy will accompany new language technologies. A further caution is to re-emphasise the current limitations of AI. Looking ahead, we see many intriguing opportunities and new capabilities, but a range of other uncertainties and inequalities. New devices will enable new ways to talk, to translate, to remember, and to learn. But advances in technology will reproduce existing inequalities among those who cannot afford these devices, among the world’s smaller languages, and especially for sign language. Debates over privacy and security will flare and crackle with every new immersive gadget. We will move together into this curious new world with a mix of excitement and apprehension - reacting, debating, sharing and disagreeing as we always do. Plug in, as the human-machine era dawns.
In recent years, human activity recognition (HAR) has gained importance in several domains such as surveillance, recognizing indoor and outdoor activities, and providing active and assisted living environments in smart homes and healthcare services. In all these scenarios, audio-, video- and image-based processing algorithms have been applied as well as systems using wearable sensors. This scoping review focuses on audio- and video-based activity recognition systems for healthcare applications. We provide a comprehensive overview of these systems and technologies and discuss their complexity, performance, robustness, stage of development, scalability as well as achievable privacy and security levels. Additionally, we present and discuss datasets that are designed for the evaluation of these activity recognition systems. Although a number of robust approaches have already been proposed, they still pose challenges when it comes to integrating them in larger systems or into clinical practice. We identify challenges for application of audio- and video-based HAR systems in real-word healthcare scenarios, draw recommendations and conclusions based on comparisons of existing approaches, and analyze future trends.
10 February 2021 in Journal of the Croatian Association of Civil Engineers