Scoliosis is a common disease of the spine and requires regular monitoring due to its progressive properties. A preferred indicator to assess scoliosis is by the Cobb angle, which is currently measured either manually by the relevant medical staff or semi-automatically, aided by a computer. These methods are not only labor-intensive but also vary in precision by the inter-observer and intra-observer. Therefore, a reliable and convenient method is urgently needed. With the development of computer vision and deep learning, it is possible to automatically calculate the Cobb angles by processing X-ray or CT/MR/US images. In this paper, the research progress of Cobb angle measurement in recent years is reviewed from the perspectives of computer vision and deep learning. By comparing the measurement effects of typical methods, their advantages and disadvantages are analyzed. Finally, the key issues and their development trends are also discussed.
The failure of an insulator may compromise the safety of the entire power transmission system. Therefore, insulator defect detection is vital for the safe operation of power systems. However, insulator defects in an insulator image may have varying sizes, and several currently available methods do not have satisfactory detection accuracy for small defects. To address this issue, we propose an improved detection network for small insulator defects with a batch normalization convolutional block attention module (BN-CBAM) and a feature fusion module. The BN-CBAM is designed to better exploit channel information and enhance the effect of different channels on the feature map. In addition, we propose a feature fusion module that fuses multi-scale features from different layers to improve small object detection performance. Moreover, to address the scarcity of aerial images, a data augmentation method based on the fusion of the target segment and background is introduced. Experiments demonstrate that the proposed method achieves better small insulator defect detection performance than other state-of-the-art approaches. In addition, data augmentation methods enrich sample diversity and enhance the generalizability of the network.
9 April 2020 in IEEE Transactions on Neural Networks and Learning Systems
The hybrid-structured flexible manipulator has a complex structure and strong coupling between state variables. Meanwhile, the natural frequency of the hybrid-structured flexible manipulator varies with the motion of the telescopic joint, so it is difficult to suppress the vibration quickly. In this article, the tip state signal of the hybrid-structured flexible manipulator is decomposed into elastic vibration signal and tip vibration equilibrium position signal, and a combined control method is proposed to improve tip positioning accuracy and trajectory tracking accuracy. In the proposed combined control method, an improved nominal model-based sliding mode controller (NMBSMC) is used as the main controller to output the driving torque, and an actor-critic-based reinforcement learning controller (ACBRLC) is used as an auxiliary controller to output small compensation torque. The improved NMBSMC can be divided into a nominal model-based sliding mode robust controller and a practical model-based integral sliding mode controller. Two sliding mode controllers with different structures make full use of the mathematical model and the measured data of the actual system to improve the vibration equilibrium position tracking accuracy. The ACBRLC uses the tip elastic vibration signal and the prioritized experience replay method to obtain the small reverse compensation torque, which is superimposed with the output of the NMBSMC to suppress tip vibration and improve the positioning accuracy of the hybrid-structured flexible manipulator. Finally, several groups of experiments are designed to verify the effectiveness and robustness of the proposed combined control method.
24 September 2020 in IEEE Transactions on Instrumentation and Measurement
Welding quality detection is a critical link in modern manufacturing, and the weld bead location is a prerequisite for the high-precision assessment of welding quality. It is generally necessary for weld bead detection to be accomplished in the context of complex industrial environments. However, the conventional detection and location methods based on specific detection conditions or prior knowledge lack accuracy and adaptability. To precisely detect and locate the weld beads in real industrial environments, a novel weld bead detection and location algorithm is proposed based on deep convolutional neural networks. Because there is no open data set of weld beads and the samples in real industrial applications are insufficient for effective model training of the deep convolutional neural network, a novel data augmentation method based on a deep semantic segmentation network is proposed to increase the sample diversity and enlarge the data set. Then, a dynamic sample updating strategy is put forward to cover more welding situations. Finally, faced with the weak-feature and weak-texture characteristics of weld beads, a simplified YOLOV3 model is proposed to realize end-to-end weld bead location. Experiments demonstrate that the proposed method could effectively satisfy the robustness and precision requirements for weld bead detection and location combined with deep semantic segmentation network and simplified YOLOV3 model.
Image-based segmentation of overhead power lines is critical for power line inspection. Real-time segmentation helps the inspection robot avoid obstacles or land on the wire during the inspection task. It is challenging for several studies to achieve real-time overhead power line segmentation with high accuracy. In addition, cluttered background brings great difficulties to overhead power lines segmentation. To address these issues, an efficient parallel branch network for real-time overhead power line segmentation is proposed. Our framework combines a context branch that generates useful global information with a spatial branch that preserves high-resolution segmentation details. The asymmetric factorized depth-wise bottleneck (AFDB) module is designed in the context branch to achieve more efficient short-range feature extraction and provide a large receptive field. Furthermore, the subnetwork-level skip connections in the classifier are proposed to fuse long-range features and lead to high accuracy. Experiments demonstrate that our framework achieves more than 90% segmentation accuracy.