Stroke is an acute cerebral vascular disease that is likely to cause long-term disabilities and death. Immediate emergency care with accurate diagnosis of computed tomographic (CT) images is crucial for dealing with a hemorrhagic stroke. However, due to the high variability of a stroke's location, contrast, and shape, it is challenging and time-consuming even for experienced radiologists to locate them. In this paper, we propose a U-net based deep learning framework to automatically detect and segment hemorrhage strokes in CT brain images. The input of the network is built by concatenating the flipped image with the original CT slice which introduces symmetry constraints of the brain images into the proposed model. This enhances the contrast between hemorrhagic areas and normal brain tissue. Various Deep Learning topologies are compared by varying the layers, batch normalization, dilation rates, and pre-train models. This could increase the respective filed and preserves more information on lesion characteristics. Besides, the adversarial training is also adopted in the proposed network to improve the accuracy of the segmentation. The proposed model is trained and evaluated on two different datasets, which achieve the competitive performance with human experts with the highest location accuracy 0.9859 for detection, 0.8033 Dice score, and 0.6919 IoU for segmentation. The results demonstrate the effectiveness, robustness, and advantages of the proposed deep learning model in automatically hemorrhage lesion diagnosis, which make it possible to be a clinical decision support tool in stroke diagnosis.
13 November 2024 in IEEE Transactions on Geoscience and Remote Sensing
Remote sensing image change captioning (RSICC) aims to articulate the changes in objects of interest within bi-temporal remote sensing images using natural language. Given the limitations of current RSICC methods in expressing general features across multi-temporal and spatial scenarios, and their deficiency in providing granular, robust, and precise change descriptions, we introduce a novel change captioning (CC) method based on the foundational knowledge and semantic guidance, which we term Semantic-CC. Semantic-CC alleviates the dependency of high-generalization algorithms on extensive annotations by harnessing the latent knowledge of foundation models, and it generates more comprehensive and accurate change descriptions guided by pixel-level semantics from change detection (CD). Specifically, we propose a bi-temporal SAM-based encoder for dual-image feature extraction; a multi-task semantic aggregation neck for facilitating information interaction between heterogeneous tasks; a straightforward multi-scale change detection decoder to provide pixel-level semantic guidance; and a change caption decoder based on the large language model (LLM) to generate change description sentences. Moreover, to ensure the stability of the joint training of CD and CC, we propose a three-stage training strategy that supervises different tasks at various stages. We validate the proposed method on the LEVIR-CC and LEVIR-CD datasets. The experimental results corroborate the complementarity of CD and CC, demonstrating that Semantic-CC can generate more accurate change descriptions and achieve optimal performance across both tasks.
An efficient fusion algorithm for the rotary-wing flying robot is presented for solving path planning problem in the 3D mountain environment. This fusion algorithm combines A*algorithm with artificial potential field method both improved and optimized for 3D environment. Firstly, A*algorithm is adopted to plan the preliminary path in the environmental model established by grid method. This A* algorithm is optimized in the heuristic function according to the 3D environment. Then, we select and save the key nodes in the preliminary path. Finally artificial potential field algorithm is used to do the path smoothing processing on the basis of these key nodes. We carried out the simulation in MATLAB of the proposed algorithm, single A*algorithm and artificial potential field method respectively in the 3D map consisting of random irregular surface and defined peak. The simulation results indicates that the fusion algorithm is feasible in 3D path planning and superior in smoothness performance, which can satisfy the property of real-time tracking for rotary-wing flying robots.
20 November 2017 in IEEE Transactions on Intelligent Transportation Systems
Pedestrian segmentation in infrared images is a challenging problem due to low SNR and inhomogeneous luminance distribution. In this paper, we first introduce background prior and object-center prior into infrared pedestrian segmentation, and propose a robust and efficient saliency-based scheme, which aims to obtain the accurate pedestrian object. First, background likelihood is developed to abstract the object representation based on the Gaussian mixture model soft decomposition. Second, by combining the shape information and the infrared character of the pedestrians, kernel density estimation-based foreground estimation is proposed to obtain the saliency iteratively with better adaptable for the fuzzy contour of the infrared object. Third, pedestrian boundary weight is employed to integrate the above two saliency maps for more intact and accurate results. Finally, pedestrians can be easily segmented from the infrared images, through any existing segmentation methods, as simple as the Otsu threshold method, on the obtained final saliency map. Extensive experiments on real infrared images captured by intelligent transportation systems demonstrate that our saliency algorithm consistently outperforms the state-of-the-art saliency detection methods, in terms of higher precision, F-measure, and lower mean absolute error. The effectiveness of our proposed segmentation algorithm is also evaluated by comparisons with the existing infrared segmentation methods and yields more precise and intact pedestrian regions.
7 January 2025 in IEEE Transactions on Geoscience and Remote Sensing
The segmentation and interpretation of the Martian surface play a pivotal role in Mars exploration, providing essential data for the trajectory planning and obstacle avoidance of rovers. However, the complex topography, self-similar surface features, and the lack of extensive annotated data pose significant challenges to the high-precision semantic segmentation of the Martian surface. To address these challenges, we propose a novel encoder-decoder-based Mars segmentation network, termed MarsSeg. To facilitate a high-level semantic understanding across the multi-level feature maps, we introduce a feature enhancement module, which incorporates Multi-scale Feature Pyramid (MFP) and Strip Attention Pyramid Pooling Module (SAPPM). The MFP is specifically designed for shallow feature enhancement, thereby enabling the expression of local details and small objects. Conversely, the SAPPM is employed for deep feature enhancement, facilitating the extraction of high-level semantic category-related information. To effectively fuse features from different levels, we propose a feature fusion module, which contains Mars Polarized Self Attention (Mars-PSA) and Pixel Attention Head (PA-Head). Mars-PSA enables the fusion of multi-level information while directing the model’s attention to salient features. The PA-Head focuses on detailed information at the pixel level. Experimental results derived from the MarsSeg and AI4Mars datasets prove that the proposed MarsSeg outperforms other state-of-the-art methods in segmentation performance, validating the efficacy of each proposed component.
Saliency detection is important in computer vision. However, most of the existing saliency models are designed for visible images. It is still a challenging problem to apply saliency detection algorithms on infrared images. In this paper, an effective propagation based saliency detection method for infrared pedestrian images is proposed. Firstly, based on the thermal characteristics of infrared images and thermal radiation models, a thermal analysis based saliency (TAS) is introduced. TAS measures the stableness of pedestrians based on maximally stable extremal regions, which is further improved by an intensity filter. Then, by taking into account the appearance characteristic of pedestrians, an appearance analysis weighted saliency (AAS) is proposed which combines the intensity and shape features of pedestrians to improve the intensity contrast. Finally, besides the commonly used intra-scale neighborhood, an inter-scale neighborhood is introduced to jointly construct a mutual guidance-based saliency propagation model. This model could simultaneously integrate the saliency features and improve the saliency performance. Two datasets DIP and IMS with 600 infrared pedestrian images are published. Then, extensive experiments and comparisons with state-of-the-art methods demonstrate the effectiveness of the proposed saliency method for infrared pedestrian images.