The learning of programming is a field of research with relevant studies and publications for more than 25 years. Since its inception, it has been shown that its difficulty lies in the high level of abstraction required to understand certain programming concepts. However, this level can be reduced by using tools and graphic representations that motivate students and facilitate their understanding, associating real-world elements with specific programming concepts. Thus, this paper proposes the use of an intelligent tutoring system (ITS) that helps during the learning of programming by using a notation based on a metaphor of roads and traffic signs represented by 3D graphics in an augmented reality (AR) environment. These graphic visualizations can be generated automatically from the source code of the programs thanks to the modular and scalable design of the system. Students can use them by leveraging the available feedback system, and teachers can also use them in order to explain programming concepts during the classes. This work highlights the flexibility and extensibility of the proposal through its application in different use cases that we have selected as examples to show how the system could be exploited in a multitude of real learning scenarios.
Mixed reality is the combination of virtual and augmented reality to interactively and believably merge physical and computer-generated environments. This paper discusses the design of Health-5G, a scalable mixed reality-based system that facilitates and supports emergency response by medical emergency teams. Health-5G is supported by a distributed architecture divided into four interrelated applications responsible for advanced computer-human interaction, effective real-time videoconference, medical device integration, and communication infrastructure, respectively. The mixed reality layer is provided by the headset Microsoft Hololens 2™. Health-5G is based on scenarios in which emergency personnel wear mixed reality glasses that can transmit audio, video, and data streams bidirectionally over a 5G network to medical specialists stationed in a hospital at any distance. Thanks to Health-5G, the specialist will be able to access the emergency team’s point of view at any time and provide verbal and visual instructions, including gestures and positioning of graphical markers in 3D space. In this way, emergency personnel can provide the best possible care to the patient without having to wait for them to arrive at the hospital, saving a lot of time in scenarios where every second can make a difference. Health-5G also addresses the integration of medical devices and the collection of the patient’s medical data in a scalable way through optical character recognition. A case study is discussed where Health-5G is used to attend a patient in the street suffering from syncope due to third-degree atrioventricular block. Latency and performance tests over a 5G network are also discussed. To the best of our knowledge, there is no comprehensive solution in the literature that provides all the capabilities offered by Health-5G in terms of functionality and advanced interaction mechanisms within the context of remote, immersive support in emergency situations.
Physical rehabilitation aims at improving the functional ability and quality of life of patients affected by physical impairments or disabilities. Neurological diseases represent the largest cause of disability worldwide. For many, there is no cure and physiotherapy allows symptoms to be managed. Physiotherapy is based on the daily execution of exercises, traditionally under the supervision of a therapist. However, performing these exercises requires that both the patient and the physiotherapist are together so that the physiotherapist can assist the patient while exercising. For patients with a neurological condition, rehabilitation is a long term process, lasting months or even years. Not withstanding the personal costs, the cost of care / physiotherapy is high and represents C27,711 per year in Spain. This is compounded by a shortage of qualified therapists, often cited as one reason why stroke survivors do not received the recommended amount of therapy. The challenge is even greater in low to mid-income countries where there is a lack of trained personnel as well as under-served and remote regions. Technology can be employed to alleviate these problems by remotely monitoring a rehabilitation session taking place at home or anywhere in the community. This paper presents a computer vision-based system for home-use that automatically assesses how well the patient performs the exercises and transmits the information back to the clinic. The patient and physiotherapist do not need to be co-located. Gamification methods and techniques are used to engage patients when carrying out the rehabilitation routines. To this end, we propose a distributed gamified system that automatically evaluates the performance of exercises by analyzing and comparing motion curves using the DTW (Dynamic Time Warping) algorithm.
3 September 2020 in Multimedia Tools and Applications