Musculoskeletal disorders (MSDs) can significantly impact individuals’ quality of life (QoL), often requiring effective rehabilitation strategies to promote recovery. However, traditional rehabilitation methods can be expensive and may lack engagement, leading to poor adherence to therapy exercise routines. An exergame system can be a solution to this problem. In this paper, we investigate appropriate hand gestures for controlling video games in a rehabilitation exergame system. The Mediapipe Python library is adopted for the real-time recognition of gestures. We choose 10 easy gestures among 32 possible simple gestures. Then, we specify and compare the best and the second-best groups used to control the game. Comprehensive experiments are conducted with 16 students at Andalas University, Indonesia, to find appropriate gestures and evaluate user experiences of the system using the System Usability Scale (SUS) and User Experience Questionnaire (UEQ). The results show that the hand gestures in the best group are more accessible than in the second-best group. The results suggest appropriate hand gestures for game controls and confirm the proposal’s validity. In future work, we plan to enhance the exergame system by integrating a diverse set of video games, while expanding its application to a broader and more diverse sample. We will also study other practical applications of the hand gesture control function.

Currently, as an increasing number of people have been addicted to using cellular phones, smartphone tenosynovitis has become common from long-term use of fingers for their operations. Hand exercise while playing video games, which is called exergame, can be a good solution to provide enjoyable daily exercise opportunities for its prevention, particularly, for young people. In this paper, we implemented a simple exergame system with a hand gesture recognition program made in Python using the Mediapipe library. We designed three sets of hand gestures to control the key operations to play the games as different exercises useful for tenosynovitis prevention. For evaluations, we prepared five video games running on a web browser and asked 10 students from Okayama and Hiroshima Universities, Japan, to play them and answer 10 questions in the questionnaire. Their playing results and System Usability Scale (SUS) scores confirmed the usability of the proposal, although we improved one gesture set to reduce its complexity. Moreover, by measuring the angles for maximum wrist movements, we found that the wrist flexibility was improved by playing the games, which verifies the effectiveness of the proposal.

JAIT is a scientific open access journal which focuses on empirical research results and critical analysis of technology development, use, management and impacts in information technology.