Computerized recognition of the home based physiotherapy exercises has many benefits and it has attracted considerable interest among the computer vision community. However, most methods in the literature view this task as a special case of motion recognition. In contrast, we propose to employ the three main components of a physiotherapy exercise (the motion patterns, the stance knowledge, and the exercise object) as different recognition tasks and embed them separately into the recognition system. The low level information about each component is gathered using machine learning methods. Then, we use a generative Bayesian network to recognize the exercise types by combining the information from these sources at an abstract level, which takes the advantage of domain knowledge for a more robust system. Finally, a novel postprocessing step is employed to estimate the exercise repetitions counts. The performance evaluation of the system is conducted with a new dataset which contains RGB (red, green, and blue) and depth videos of home-based exercise sessions for commonly applied shoulder and knee exercises. The proposed system works without any body-part segmentation, bodypart tracking, joint detection, and temporal segmentation methods. In the end, favorable exercise recognition rates and encouraging results on the estimation of repetition counts are obtained.
1 January 1999 in IEEE Transactions on Medical Imaging
Computerized analysis of the tongue surface movement can provide valuable information to speech and swallowing research. Ultrasound technology is currently the most attractive modality for the tongue imaging mainly because of its high video frame rate. However, problems with ultrasound imaging, such as noise and echo artifacts, refractions, and unrelated reflections pose significant challenges for computer analysis of the tongue images and hence specific methods must be developed. This paper presents a system that is developed for automatic extraction and tracking of the tongue surface movements from ultrasound image sequences. The ultrasound images are supplied by the head and transducer support system (HATS), which was developed in order to fix the head and support the transducer under the chin in a known position without disturbing speech. In this work, we propose a novel scheme for the analysis of the tongue images using deformable contours. We incorporate novel mechanisms to 1) impose speech related constraints on the deformations; 2) perform spatiotemporal smoothing using a contour postprocessing stage; 3) utilize optical flow techniques to speed up the search process; and 4) propagate user supplied information to the analysis of all image frames. We tested the system's performance qualitatively and quantitatively in consultation with speech scientists. Our system produced contours that are within the range of manual measurement variations. The results of our system are extremely encouraging and the system can be used in practical speech and swallowing research in the field of otolaryngology.
Most of the common driver assistant systems for detection of obstacles work on unstructured environments. These environments generally include many non-planar surfaces which pose a big challenge for vision systems. Similar problems exist for railroad environments which often contain complex shapes and surfaces like hills and vegetation along railroad tracks. In railroad transportation, the main task of a train driver is to carefully focus on the track. Therefore the field of view of a train driver must contain the space between two rails in front of the train and the near lateral area (left and right side) of these rails. In this paper, we present an algorithm to extract the train course and railroad track space in front of the train using dynamic programming in railroad environments. We use dynamic programming to compute the optimal path which gives the minimum cost to extract the railroad track space. The proposed algorithm extracts the left and right rails using dynamic programming simultaneously. Our method does not need any static calibration process. For this purpose, a camera system was installed in front of a locomotive. Experimental results show the effectiveness of the algorithm.
2 April 2013 in IEEE Transactions on Biomedical Engineering
This paper presents a method for localizing and labeling the lumbar vertebrae and intervertebral discs in mid-sagittal MR image slices. The approach is based on a Markov-chain-like graphical model of the ordered discs and vertebrae in the lumbar spine. The graphical model is formulated by combining local image features and semiglobal geometrical information. The local image features are extracted from the image by employing pyramidal histogram of oriented gradients (PHOG) and a novel descriptor that we call image projection descriptor (IPD). These features are trained with support vector machines (SVM) and each pixel in the target image is locally assigned a score. These local scores are combined with the semiglobal geometrical information like the distance ratio and angle between the neighboring structures under the Markov random field (MRF) framework. An exact localization of discs and vertebrae is inferred from the MRF by finding a maximum a posteriori solution efficiently using dynamic programming. As a result of the novel features introduced, our system can scale-invariantly localize discs and vertebra at the same time even in the existence of missing structures. The proposed system is tested and validated on a clinical lumbar spine MR image dataset containing 80 subjects of which 64 have disc- and vertebra-related diseases and abnormalities. The experiments show that our system is successful even in abnormal cases and our results are comparable to the state of the art.
1 October 2014 in Computerized Medical Imaging and Graphics