Speech rehabilitation software is usually aimed at people with hearing impairment that implies the need to exercise some speech abilities. Such abilities depend on the language and the context of the disability. In the case of children with hearing loss diagnosed at an early age (before 2 years), and who have been treated correctly and in an opportune manner (with a cochlear implant, for example), the abilities that need to be developed vary from the very basic (elementary productions, such as single sounds, or vowels), to more complex, such as spontaneous productions of meaningful words and phrases. Such rehabilitation therapy is accomplished with the help of a therapist, but software that allows the autonomous exercising of these abilities would help children with difficulties in affording such sessions. We introduce a video game prototype for speech rehabilitation of children with an early diagnosed hearing disability and who are using some kind of aid, such as a cochlear implant. The application relies on the auditory-verbal therapy theory and educational objectives such as the accurate assessment and reinforcement of voice production. It also relies on verbal interaction with the children through the intensive use of speech recognition technology and on visual feedback. An initial prototype was implemented which offers challenges in the field of voice interaction such as the latency of the speech recognition module, and feedback consistent with the recognition rates it provides.
2 July 2024 in IEEE Computer Graphics and Applications
-Learning space for children with different sensory needs, nowadays, can be interactive, multisensory experiences, designed collaboratively by (i) specialists in special-needs learning, (ii) Extended Realities (XR)-technologists and (iii) sensorial-diverse children, to provide the motivation, challenge and development of key skills. While traditional audio and visual sensors in XR is challenging for XR-applications to meet the needs of visually and hearing impaired sensorial-diverse children, our research goes a step ahead by integrating sensory technologies including haptic, tactile, kinaesthetic and olfactory feedback that was well received by the children. Our research also demonstrates the protocols for (i) development of a suite of XR-applications; (ii) methods for experiments and evaluation; and (iii) tangible improvements in XR learning experience. Our research considered and is in compliance with the ethical and social implications and has the necessary approval for accessibility, user safety, and privacy.
The rehabilitation of spoken and written language in children with hearing impairment is a process that must be done not only in rehabilitation centers but also at home. This type of rehabilitation must be customized based on the needs of each patient. Besides, it is essential that patients at home do the activities assigned by therapists. However, in order to achieve the desired goals in their work at home, patients must follow the instructions defined by the therapist when they do the activities. For this reason, proposals of software systems that support these activities at home promise to be a solution. This article reports the progress we have done so far developing SATReLO. SATReLO is a software system that supports the rehabilitation process of oral language, and it is composed of a software product line of custom-made video games and two web portals. SATReLO offers customized activities for the therapies and guidance when the video game is played at home. Moving these activities to the software scope generates several advantages including greater accessibility for patients, better monitoring of the development of the activities, and personalized activities according to the specific needs of patients.