Automatic sign language recognition (SLR) is a current area of research as this is meant to serve as a substitute for sign language interpreters. In this paper, we present the design of a continuous SLR system that can extract out the meaningful signs and consequently recognize them. Here, we have used height of the hand trajectory as a salient feature for separating out the meaningful signs from the movement epenthesis patterns. Further, we have incorporated a unique set of spatial and temporal features for efficient recognition of the signs encapsulated within the continuous sequence. The implementation of an efficient hand segmentation and hand tracking technique makes our system robust to complex background as well as background with multiple signers. Experiments have established that our proposed system can identify signs from a continuous sign stream with a 92.8% spotting rate.
31 March 2021 in Multimedia Tools and Applications
Human Computer Interaction (HCI) has become very important in today's world. Existing HCI techniques like keyboard, mouse, joysticks etc. limit the speed and naturalness of our interaction. Hand gestures provide a more natural way of communicating with the computer. Hand segmentation is the most crucial step in every hand gesture recognition system. All subsequent steps greatly depend on the quality of segmentation. If data is lost due to improper segmentation, it can hardly be recovered in the later stages of gesture recognition process. In this paper, we present a robust and effective method of hand segmentation which overcomes problems such as skin color detection, complex background removal, complexity from multiple gesturers in front of the camera and variable lighting condition.