The technological evolution allowed the use of a single camera for precise and effective body tracking, reducing the cost and increasing the accessibility of applications in places where depth cameras and wearable sensors are not available. This paper describes and implements a supervised machine learning process consisting of a mobile application used as a motion capture device which also transforms the data into an input for a machine learning model that classifies upper and lower limbs movements (24 types of human movements). The user performs movements in front of the camera, and the trained model classifies them. We designed the system to work in a motor-rehabilitation context to assist the professional while the patient does physical exercises. The implementation can summarize the movements made during the rehabilitation sessions by counting the repetitions and classifying them when done completely or reached a specific range of motion.
This work presents a mixed reality system for lower limb exercise that detects the user’s gait and synchronizes the Street View navigation in the display. It uses an accessible RGB camera with a computer vision approach to detect the body. 11 Elderly volunteers tested the system for 5 minutes each session while therapists analyzed their physical and cognitive activity. In the meantime, the system stores the motion capture data for later use. We analyzed their behaviors in 20 recorded sessions.
5 June 2024 in Biomedical Signal Processing and Control
There is a great deal of interest in developing virtual reality and augmented reality applications that require data storage, with which developers can interact and create intelligent systems for various purposes, such as applications for neuromotor rehabilitation. These applications provide the benefits of traditional rehabilitation without becoming overwhelming, as they allow the user to be immersed in various scenarios and situations. In addition, the way these applications interact makes it possible to retrieve and analyze the data generated by users’ movements during treatment. However, it is tough to find datasets of body movements, and those that do exist do not include movements specific to the rehabilitation context. This paper, therefore, presents ReBase, a framework that provides a standardized storage system for body movement data. ReBase was designed to allow the collection of data generated by any application, regardless of the form of body tracking used. This paper presents an open API that can be used to communicate with the ReBase database, a package for the Unity game engine, and a library for the Python programming language, which facilitates the integration of new applications into the system. In addition, two applications are shown as case studies within and outside the health area, developed using the tool.