24 November 2014 in IEEE Transactions on Multimedia
This paper presents a new superpixel-based hand gesture recognition system based on a novel superpixel earth mover's distance metric, together with Kinect depth camera. The depth and skeleton information from Kinect are effectively utilized to produce markerless hand extraction. The hand shapes, corresponding textures and depths are represented in the form of superpixels, which effectively retain the overall shapes and color of the gestures to be recognized. Based on this representation, a novel distance metric, superpixel earth mover's distance (SP-EMD), is proposed to measure the dissimilarity between the hand gestures. This measurement is not only robust to distortion and articulation, but also invariant to scaling, translation and rotation with proper preprocessing. The effectiveness of the proposed distance metric and recognition algorithm are illustrated by extensive experiments with our own gesture dataset as well as two other public datasets. Simulation results show that the proposed system is able to achieve high mean accuracy and fast recognition speed. Its superiority is further demonstrated by comparisons with other conventional techniques and two real-life applications.
30 July 2021 in IEEE Journal of Biomedical and Health Informatics
Quantitative ultrasound (QUS), which attempts to extract quantitative features from the US radiofrequency (RF) or envelope data for tissue characterization, is becoming a promising technique for noninvasive assessments of liver fibrosis. However, the number of feature variables examined and finally used in the existing QUS methods is typically small, limiting the diagnostic performance. Therefore, this paper devises a new multiparametric QUS (MP-QUS) method which enables the extraction of a large number of feature variables from US RF signals and allows for the use of feature-engineering and machine-learning based algorithms for liver fibrosis assessment. In the MP-QUS, eighty-four feature variables were extracted from multiple QUS parametric maps derived from the RF signals and the envelope data. Afterwards, feature reduction and selection were performed in turn to remove the feature redundancy and identify the best combination of features in the reduced feature set. Finally, a variety of machine-learning algorithms were tested for fibrosis classification with the selected features, based on the results of which the optimal classifier was established. The performance of the proposed MP-QUS method for staging liver fibrosis was evaluated on an animal model, with histologic examination as the reference standard. The mean accuracy, sensitivity, specificity and area under the receiver-operating-characteristic curve achieved by MP-QUS are respectively 83.38%, 86.04%, 80.82%, and 0.891 for recognizing significant liver fibrosis, and 85.50%, 88.92%, 85.24%, and 0.924 for diagnosing liver cirrhosis. The proposed MP-QUS method paves a way for its future extension to assess liver fibrosis in human subjects.
21 March 2022 in Hepatology International
25 June 2020 in IEEE Access
This paper proposes an adaptive fading Bayesian unscented Kalman filter (AF-BUKF) and explores its application for state estimation of unmanned aircraft systems (UASs). In the AF-BUKF, the state and noise densities are approximated as finite Gaussian mixtures, in which the mean and covariance for each component are recursively estimated using the UKF. To avoid the prohibitive computational complexity caused by the exponential growth of mixture components, a Gaussian mixture simplification algorithm is employed. Moreover, the AF-BUKF algorithm employs a novel adaptive fading strategy to recursively update the Gaussian components, so that the adverse effect of inexact knowledge of the state and measurement noise covariance can be mitigated. An AF-BUK Smoother (AF-BUKS) is also proposed by extending the AF-BUKF algorithm using the concept of optimal Bayesian smoothing and the Rauch-Tung-Striebel Smoother to improve estimation accuracy. Experimental results on simulated and real UAS data show that the proposed AF-BUKF/S algorithms can achieve better performance compared with the conventional methods. Thus, they can serve as attractive alternative approaches for nonlinear state estimation of UASs and other problems.
30 October 2017 in IEEE Transactions on Multimedia
This paper proposes a new multi-view human body tracking and model-based rendering system with a textured deformable human body model and explores its practical application to view transfer in image-based rendering (IBR). The proposed approach first reconstructs an initial 3D model of the human subject offline using Kinect depth cameras or from a general 3D model if such information is unavailable in the original data. The human pose of the subject is then tracked with multi-view videos using an Annealed Particle Filter (APF)-based tracker with a new Color-based Likelihood (CbL) function and a Bayesian Kalman filter smoother (BKFS) so as to deform the previous captured model to the new position for model-based rendering. An immediate application of the proposed approach is to support fly-over effects in view transfer in IBR systems with limited cameras since it avoids reconstructing the complete dynamic 3D model where large number of cameras may be required. Moreover, for static background, the background can be rendered using the IBR with pre-captured depth maps to further enhance user's experience. To reduce the artifacts during fly-over caused by tracking errors and model deformation, a novel morphing technique utilizing a new Free-form Deformation-based artifacts suppression (FFD-AS) method and other user interface design techniques are also proposed for smooth transition between the original view and the model rendered views. The performance of the proposed algorithm is evaluated using the publicly available HumanEva dataset and our captured RGB-D multi-view dataset. Experimental results show that the proposed APF-based tracker offered improved tracking performance compared with the conventional bi-directional silhouette (BiS) likelihood criterion. The proposed morphing approach is also shown to be effective in mitigating the rendering artifacts during view transfer.
20 July 2023 in IEEE Journal of Biomedical and Health Informatics
The accurate diagnosis of significant liver fibrosis ( $\rm \geq$ F2) in patients with chronic liver disease (CLD) is critical, as $\pmb \mathrm{\geq }$ F2 is a crucial factor that should be considered in selecting an antiviral therapy for these patients. This paper proposes a handcrafted-feature-assisted deep convolutional neural network (HFA-DCNN) that helps pathologists automatically and accurately diagnose significant liver fibrosis from ultrasound (US) brightness (B)-mode images. The HFA-DCNN model has three main branches: one for automatic region of interest (ROI) segmentation in the US images, another for attention deep feature learning from the segmented ROI, and the third for handcrafted feature extraction. The attention deep learning features and handcrafted features are fused in the back end of the model to enable more accurate diagnosis of significant liver fibrosis. The usefulness and effectiveness of the proposed model were validated on a dataset built upon 321 CLD patients with liver fibrosis stages confirmed by pathological evaluations. In a fivefold cross validation (FFCV), the proposed model achieves accuracy, sensitivity, specificity, and area under the receiver-operating-characteristic (ROC) curve (AUC) values of 0.863 (95% confidence interval (CI) 0.820–0.899), 0.879 (95% CI 0.823–0.920), 0.872 (95% CI 0.800–0.925), and 0.925 (95% CI 0.891–0.952), which are significantly better than those obtained by the comparative methods. Given its excellent performance, the proposed HFA-DCNN model can serve as a promising tool for the noninvasive and accurate diagnosis of significant liver fibrosis in CLD patients.