Existing smart vehicles heavily depend on success of precise positioning, optical radar, visual detection and recognition to determine their road conditions and perfect routes. The visual-based approach is the simplest and most effective enabling technology to reach the goal. In performing such an overtaking maneuver, this vision-based driving assistant system must be able to precisely recognize the lane marks first. The traditional approach needs a classifier with hand-crafted features and an adjusted threshold to achieve a robust lane detection in various environment conditions. In this paper, we adopt the deep learning approach to achieve the robust lane detection. The proposed lane detection network inspired by LaneNet model, which uses semantic segmentation concepts utilizes multiple level features of the encoder and designs enhanced binary segmentation and reduced pixel embedding branches. By reduction of computation in decoders, the proposed network effectively utilizes multilevel features to precisely predict the high quality lane maps. The experiments on Tusimple and CuLane datasets verify that the proposed lane detection network achieves better accuracy performance than LaneNet and faster computation than the existed methods for real-time applications.
20 March 2024 in IEEE Open Journal of Engineering in Medicine and Biology
Goal : The early diagnosis and treatment of hepatitis is essential to reduce hepatitis-related liver function deterioration and mortality. One component of the widely-used Ishak grading system for the grading of periportal interface hepatitis is based on the percentage of portal borders infiltrated by lymphocytes. Thus, the accurate detection of lymphocyte-infiltrated periportal regions is critical in the diagnosis of hepatitis. However, the infiltrating lymphocytes usually result in the formation of ambiguous and highly-irregular portal boundaries, and thus identifying the infiltrated portal boundary regions precisely using automated methods is challenging. This study aims to develop a deep-learning-based automatic detection framework to assist diagnosis. Methods : The present study proposes a framework consisting of a Structurally-REfined Deep Portal Segmentation module and an Infiltrated Periportal Region Detection module based on heterogeneous infiltration features to accurately identify the infiltrated periportal regions in liver Whole Slide Images. Results : The proposed method achieves 0.725 in F1-score of lymphocyte-infiltrated periportal region detection. Moreover, the statistics of the ratio of the detected infiltrated portal boundary have high correlation to the Ishak grade (Spearman's correlations more than 0.87 with p-values less than 0.001) and medium correlation to the liver function index aspartate aminotransferase and alanine aminotransferase (Spearman's correlations more than 0.63 and 0.57 with p-values less than 0.001). Conclusions : The study shows the statistics of the ratio of infiltrated portal boundary have correlation to the Ishak grade and liver function index. The proposed framework provides pathologists with a useful and reliable tool for hepatitis diagnosis.
12 August 2019 in IEEE Transactions on Circuits and Systems for Video Technology
To deliver three-dimension (3D) video services through the current two-dimension (2D) broadcasting systems, the frame compatible packing formats of views with depth maps will be an effective approach. With texture and depth information, the 3D videos with a depth image-based rendering engine can easily support all glasses and glasses-free 3D displays. In this paper, we propose a new YCbCr color depth packing method based on the centralized texture-depth packing (CTDP) formats to deliver effective 3D video services. Simulations show that the CTDP formats with YCbCr color depth packing method can achieve better objective and subjective texture and depth quality than the 2D-plus-depth packing (2DDP) formats. The benefits from using CTDP include light complexity and maturity and wide application of existing video codec. The packing scheme is compatible with any video codecs. Before the 3D-HEVC-based video broadcasting system, the proposed CTDP formats with YCbCr color depth packing method could help to deliver 3D videos in the current 2D broadcasting systems simply and efficiently.
Face images with partially-occluded areas create huge deteriorated problems for face recognition systems. Linear regression classification (LRC) is a simple and powerful approach for face recognition, of course, it cannot perform well under occlusion situations as well. By segmenting the face image into small subfaces, called modules, the LRC system could achieve some improvements by selecting the best non-occluded module for face classification. However, the recognition performance will be deteriorated due to the usage of the module, a small portion of the face image. We could further enhance the performance if we can properly identify the occluded modules and utilize all the non-occluded modules as many as possible. In this chapter, we first analyze the texture histogram (TH) of the module and then use the HT difference to measure its occlusion tendency. Thus, based on TH difference, we suggest a general concept of the weighted module face recognition to solve the occlusion problem. Thus, the weighted module linear regression classification method, called WMLRC-TH, is proposed for partially-occluded fact recognition. To evaluate the performances, the proposed WMLRC-TH method, which is tested on AR and FRGC2.0 face databases with several synthesized occlusions, is compared to the well-known face recognition methods and other robust face recognition methods. Experimental results show that the proposed method achieves the best performance for recognize occluded faces. Due to its simplicity in both training and testing phases, a face recognition system based on the WMLRC-TH method is realized on Android phones for fast recognition of occluded faces.
Precision depth estimation plays a key role in many applications, including 3D scene reconstruction, virtual reality, autonomous driving and human-computer interaction. Recent advancements in deep learning technologies, the monocular depth estimation has surpassed the traditional stereo camera systems, bringing new possibilities in 3D sensing. In this paper, by using single camera, we propose an end-to-end supervised monocular depth estimation autoencoder which contains a CNN-ViT encoder and an adaptive fusion decoder, to obtain high-precision depth maps. In the CNN-ViT encoder, we construct a multi-scale feature extractor by mixing residual configurations of vision transformers to enhance both local and global information. In the adaptive fusion decoder, we introduce adaptive fusion modules to effectively merge features of the encoder and decoder together. Lastly, the model is trained using a loss function that aligns with human perception to enable it to focus on the depth values of foreground objects. Experimental results demonstrate the effective prediction of the depth map from a single-view color image by the proposed RVTAF autoencoder.
16 October 2023 in IEEE Transactions on Artificial Intelligence
Convolutional neural networks with encoder and decoder structures, generally referred to as autoencoders, are used in many pixel- wise transformation, detection, segmentation and estimation applications, for example, which can be applied for face swapping, lane detection, semantic segmentation, and depth estimation, respectively. However, traditional autoencoders, which are based on single-frame inputs, ignore the temporal consistency between consecutive frames, and may hence produce unsatisfactory results. Accordingly, in this paper, a video-based depth estimation (VDE) autoencoder is proposed to improve the quality of depth estimation through the inclusion of two weighted temporal feature (WTF) modules in the encoder and a single spatial edge guided (SEG) module in the decoder. The WTF modules designed with channel weighted block (CWB) submodule effectively extract the temporal similarities in consecutive frames, while the SEG module provides spatial edge guidance of the object contours. Through the collaboration of the proposed modules, the accuracy of the depth estimation is greatly improved. The experimental results confirm that the proposed VDE autoencoder achieves a better monocular depth estimation performance than the existing autoencoders with only a slight increase in the computational cost.