With the development of earth observation technology, hyperspectral image (HSI) and light detection and ranging (LiDAR) data collaborative monitoring has shown great potential in the ecological protection and restoration of coastal wetlands. However, due to the different working principle adopted by the HSI sensor and LiDAR sensor, the data obtained by them has different distribution characteristics. The distribution difference limits the fusion of HSI and LiDAR data, bringing a great challenge for coastal wetland classification. To tackle this problem, a multi-source feature embedding and interaction fusion network is proposed for coastal wetland classification, named MsFE-IFN. First, the HSI and LiDAR data are embedded in the same feature space, where the feature distribution of multi-source remote sensing are aligned to alleviate data distribution differences. Second, the aligned HSI and LiDAR features interact information in channels and pixels, which is able to establish the relationship of spectral, elevation and geospatial. Third, the HSI and LiDAR feature are sent into the feature fusion network, in which the low-frequency residual is retained to enrich intra-class features. Finally, the fused feature is applied for final class prediction. Experiments conducted on three coastal wetland HSI-LiDAR datasets created by ourselves demonstrate the superiority of the proposed MsFE-IFN for coastal wetland classification. The codes will be available from the website:https://github.com/bigshot-g/IEEE_TGRS_MsFE-IFN.
In recent years, concern has increased about the depletion of marine resources caused by the overexploitation of fisheries and the degradation of ecosystems. The Automatic Identification System (AIS) is a powerful tool increasingly used for monitoring marine fishing activity. In this paper, identification of the type of fishing vessel (trawlers, gillnetters and seiners) was carried out using 150 million AIS tracking points in April, June and September 2018 in the northern South China Sea (SCS). The vessels’ spatial and temporal distribution, duration of fishing time and other activity patterns were analyzed in different seasons. An identification model for fishing vessel types was developed using a Light Gradient Boosting Machine (LightGBM) approach with three categories with a total of 60 features: speed and heading, location changes, and speed and displacement in multiple states. The accuracy of this model reached 95.68%, which was higher than other advanced algorithms such as XGBoost. It was found that the activity hotspots of Chinese fishing vessels, especially trawlers, showed a tendency to move northward through the year in the northern SCS. Furthermore, Chinese fishing vessels showed low fishing intensity during the fishing moratorium months and traditional Chinese holidays. This research work indicates the value of AIS data in providing decision-making assistance for the development of fishery resources and marine safety management in the northern SCS.
Recently, hyperspectral image (HSI) classification has attracted increasing attention in the remote sensing field. Plenty of CNN-based methods with diverse attention mechanisms (AMs) have been proposed for HSI classification due to AMs being able to improve the quality of feature representations. However, some of the previous AMs squeeze global spatial or channel information directly by pooling operations to yield feature descriptors, which inadequately utilize global contextual information. Besides, some AMs cannot exploit the interactions among channels or positions with the aid of nonlinear transformation well. In this article, a spectral-spatial network with channel and position global context (GC) attention (SSGCA) is proposed to capture discriminative spectral and spatial features. Firstly, a spectral-spatial network is designed to extract spectral and spatial features. Secondly, two novel GC attentions are proposed to optimize the spectral and spatial features respectively for feature enhancement. The channel GC attention is used to capture channel dependencies to emphasize informative features while the position GC attention focuses on position dependencies. Both GC attentions aggregate global contextual features of positions or channels adequately, following a nonlinear transformation. Experimental results on several public HSI datasets demonstrate that the spectral-spatial network with GC attentions outperforms other related methods.
Marine oil spills are an emergency of great harm and have become a hot topic in marine environmental monitoring research. Optical remote sensing is an important means to monitor marine oil spills. Clouds, weather, and light control the amount of available data, which often limit feature characterization using a single classifier and therefore difficult to accurate monitoring of marine oil spills. In this paper, we develop a decision fusion algorithm to integrate deep learning methods and shallow learning methods based on multi-scale features for improving oil spill detection accuracy in the case of limited samples. Based on the multi-scale features after wavelet transform, two deep learning methods and two classical shallow learning algorithms are used to extract oil slick information from hyperspectral oil spill images. The decision fusion algorithm based on fuzzy membership degree is introduced to fuse multi-source oil spill information. The research shows that oil spill detection accuracy using the decision fusion algorithm is higher than that of the single detection algorithms. It is worth noting that oil spill detection accuracy is affected by different scale features. The decision fusion algorithm under the first-level scale features can further improve the accuracy of oil spill detection. The overall classification accuracy of the proposed method is 91.93%, which is 2.03%, 2.15%, 1.32%, and 0.43% higher than that of SVM, DBN, 1D-CNN, and MRF-CNN algorithms, respectively.
9 June 2023 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Reasonable fusion of multimodal data can increase the accuracy of remote sensing classification. In this article, an effective morphological convolution and attention calibration network is proposed for the joint classification of hyperspectral image (HSI) and light detection and ranging (LiDAR). Firstly, we devise a morphological convolution block, which combines the dilation and erosion operations in morphology with convolution to better capture the feature from HSI and LiDAR. Next, we designed a dual attention module that uses self attention to calibrate features and cross attention to combine multisource complementary information, respectively. Finally, considering the features of semantic inconsistency and different scales, the adaptive feature fusion module is introduced to dynamically fuse multimodal features. To verify the progressiveness of proposed network, we experiment on three common datasets and one self-made dataset. The result shows that our network performs better than the state-of-the-art models.
Marine oil spills are one of the most serious problems of marine environmental pollution. Hyperspectral remote sensing has been proven to be an effective tool for monitoring marine oil spills. To make full use of spectral and spatial features, this study proposes a spectral-spatial features integrated network (SSFIN) and applies it for hyperspectral detection of a marine oil spill. Specifically, 1-D and 2-D convolutional neural network (CNN) models have been employed for the extraction of the spectral and spatial features, respectively. During the stage of spatial feature extraction, three consecutive convolution layers are concatenated to achieve the fusion of multilevel spatial features. Next, the extracted spectral and spatial features are concatenated and fed to the fully connected layer so as to obtain the joint spectral-spatial features. In addition, L2 regularization is applied to the convolution layer to prevent overfitting, and dropout operation is employed to the full connection layer to improve the network performance. The effectiveness of the method proposed here has firstly been verified on the Pavia University dataset with competitive classification experimental results. Eventually, the experimental results upon oil spill datasets demonstrate the strong capacity of oil spill detection by this method, which can effectively distinguish thick oil film, thin oil film, and seawater.