Breast lesion is a malignant tumor that occurs in the epithelial tissue of the breast. The early detection of breast lesions can make patients for treatment and improve survival rate. Thus, the accurate and automatic segmentation of breast lesions from ultrasound images is a fundamental task. However, the effectively segmentation of breast lesions is still faced with two challenges. One is the characteristics of breast lesions’ multi-scale and the other one is blurred edges making segmentation difficult. To solve these problems, we propose a deep learning architecture, named Multi-scale Fusion U-Net (MF U-Net), which extracts the texture features and edge features of the image. It includes two novel modules and a new focal loss: 1) the Fusion Module (WFM) which segmenting irregular and fuzzy breast lesions, 2) the Multi-Scale Dilated Convolutions Module (MDCM) which overcoming the segmentation difficulties caused by large-scale changes in breast lesions, and 3) focal-DSC loss is proposed to solve the class imbalance problems in breast lesions segmentation. Moreover, there are some convolutional layers with different receptive fields in MDCM, which improves the network’s ability to extract multi-scale features. Comparative experiments reveal that the MF U-Net proposed in this paper outperforms other segmentation methods, and the proposed MF U-Net achieves state-of-the-art breast lesions segmentation results with 0.9421 Recall, 0.9345 Precision, 0.0694 FPs/image, 0.9535 DSC and 0.9112 IOU on Benchmark for Breast Ultrasound Image Segmentation (BUSIS) dataset.
Manual interpretation of CT images for bone metastasis (BM) detection in primary cancer remains challenging. We present an automated Bone Lesion Detection System (BLDS) developed using CT scans from 2518 patients (9177 BMs; 12,824 non-BM lesions) across five hospitals. The system, developed on 1271 patients and tested on 1247 multicenter cases, demonstrates 89.1% lesion-wise sensitivity (1.40 false-positives/case [FPPC]) in detecting bone lesions on non-contrast CT scans, with 92.3% and 91.1% accuracy in classifying BM/non-BM lesions for internal and external test sets, respectively. Outperforming radiologists in lesion detection (40.5% sensitivity; 0.65 FPPC), BLDS shows lower BM detection sensitivity than junior radiologists, though comparable to trainees. BLDS improves radiologists’ lesion-wise sensitivity by 22.2% in BM detection and reduces reading time by 26.4%, while maintaining 90.2% patient-wise sensitivity and 98.2% negative predictive value in real-world validation (n = 54,610). The system demonstrates significant potential to enhance CT-based BM interpretation, particularly benefiting trainees.
A video-based method to quantify animal posture movement is a powerful way to analyze animal behavior. Both humans and fish can judge the physiological state through the skeleton framework. However, it is challenging for farmers to judge the breeding state in the complex underwater environment. Therefore, images can be transmitted by the underwater camera and monitored by a computer vision model. However, it lacks datasets in artificial intelligence and is unable to train deep neural networks. The main contributions of this paper include: (1) the world’s first fish posture database is established. 10 key points of each fish are manually marked. The fish flock images were taken in the experimental tank and 1000 single fish images were separated from the fish flock. (2) A two-stage attitude estimation model is used to detect fish key points. The evaluation of the algorithm performance indicates the precision of detection reaches 90.61%, F1-score reaches 90%, and Fps also reaches 23.26. We made a preliminary exploration on the pose estimation of fish and provided a feasible idea for fish pose estimation.
Due to memory and computing resources limitations, deploying convolutional neural networks on embedded and mobile devices is challenging. However, the redundant use of the 1 × 1 convolution in traditional light-weight networks, such as MobileNetV1, has increased the computing time. By utilizing the 1 × 1 convolution that plays a vital role in extracting local features more effectively, a new lightweight network, named PlaneNet, is introduced. PlaneNet can improve the accuracy and reduce the numbers of parameters and multiply-accumulate operations (Madds). Our model is evaluated on classification and semantic segmentation tasks. In the classification tasks, the CIFAR-10, Caltech-101, and ImageNet2012 datasets are used. In the semantic segmentation task, PlaneNet is tested on the VOC2012 datasets. The experimental results demonstrate that PlaneNet (74.48%) can obtain higher accuracy than MobileNetV3-Large (73.99%) and GhostNet (72.87%) and achieves state-of-the-art performance with fewer network parameters in both tasks. In addition, compared with the existing models, it has reached the practical application level on mobile devices. The code of PlaneNet on GitHub: https://github.com/LinB203/planenet.
With the rapid development of computer vision, the application of computer vision to precision farming in animal husbandry is currently a hot research topic. Due to the scale of goose breeding continuing to expand, there are higher requirements for the efficiency of goose farming. To achieve precision animal husbandry and to avoid human influence on breeding, real-time automated monitoring methods have been used in this area. To be specific, on the basis of instance segmentation, the activities of individual geese are accurately detected, counted, and analyzed, which is effective for achieving traceability of the condition of the flock and reducing breeding costs. We trained QueryPNet, an advanced model, which could effectively perform segmentation and extraction of geese flock. Meanwhile, we proposed a novel neck module that improved the feature pyramid structure, making feature fusion more effective for both target detection and instance individual segmentation. At the same time, the number of model parameters was reduced by a rational design. This solution was tested on 639 datasets collected and labeled on specially created free-range goose farms. With the occlusion of vegetation and litters, the accuracies of the target detection and instance segmentation reached 0.963 (mAP@0.5) and 0.963 (mAP@0.5), respectively.