In the context of fast progress in deep learning, convolutional neural networks (CNNs) have been extensively applied to the semantic segmentation of remote sensing images and have achieved significant progress. However, certain limitations exist in capturing global contextual information due to the characteristics of convolutional local properties. Recently, Transformer has become a focus of research in computer vision and has shown great potential in extracting global contextual information, further promoting the development of semantic segmentation tasks. In this paper, we use ResNet50 as an encoder, embed the hybrid attention mechanism into Transformer, and propose a Transformer-based decoder. The Channel-Spatial Transformer Block (CSTB) further aggregates features by integrating the local feature maps extracted by the encoder with their associated global dependencies. At the same time, an adaptive approach is employed to reweight the interdependent channel maps to enhance the feature fusion. The Global Cross-Fusion Module (GCFM) combines the extracted complementary features to obtain more comprehensive semantic information. Extensive comparative experiments were conducted on the ISPRS Potsdam and Vaihingen datasets, where mIoU reached 78.06% and 76.37%, respectively. The outcomes of multiple ablation experiments also validate the effectiveness of the proposed method.

The combination of the multispectral imaging and the 3D imaging in one system would render possible varieties of applications in different fields. In this work a method is proposed for the registration of multispectral data and 3D point cloud, in which the number of spectral bands is increased by combining different multispectral images through 3D information. Based on this method, a 3D multispectral imaging system consisting of two filter wheel cameras and a digital projector is developed. This system can provide maximally 23 spectral bands with a short acquisition duration of ca. 1.5 seconds and achieve a data fusion accuracy of 15 µm for a measurement field of 128 mm × 145 mm. Furthermore, there exists a significant potential to extend the spectral range and raise the spectral resolution by integrating additional cameras with the proposed data fusion principle.

Adding an attention module to the deep convolution semantic segmentation network has significantly enhanced the network performance. However, the existing channel attention module focusing on the channel dimension neglects the spatial relationship, causing location noise to transmit to the decoder. In addition, the spatial attention module exemplified by self-attention has a high training cost and challenges in execution efficiency, making it unsuitable to handle large-scale remote sensing data. We propose an efficient vector pooling attention (VPA) module for building the channel and spatial location relationship. The module can locate spatial information better by performing a unique vector average pooling in the vertical and horizontal dimensions of the feature maps. Furthermore, it can also learn the weights directly by using the adaptive local cross-channel interaction. Multiple weight learning ablation studies and comparison experiments with the classical attention modules were conducted by connecting the VPA module to a modified DeepLabV3 network using ResNet50 as the encoder. The results show that the mIoU of our network with the addition of an adaptive local cross-channel interaction VPA module increases by 3% compared to the standard network on the MO-CSSSD. The VPA-based semantic segmentation network can significantly improve precision efficiency compared with other conventional attention networks. Furthermore, the results on the WHU Building dataset present an improvement in IoU and F1-score by 1.69% and 0.97%, respectively. Our network raises the mIoU by 1.24% on the ISPRS Vaihingen dataset. The VPA module can also significantly improve the network’s performance on small target segmentation.

The PM2.5 index is an important basis for measuring the degree of air pollution. The accurate prediction of PM2.5 concentration has an important guiding role in air pollution prevention and control. The Pearson Correlation Coefficient (PCC) is a common index used to mine the correlation between meteorological factors and other air pollutants. However, this index cannot be used to mine non-linear correlations, nor can it quantitatively analyze the weight of each related attribute. In order to accurately explore the correlation between meteorological factors and other air pollutants and to achieve an accurate prediction of PM2.5 concentration, this paper proposes a short- and long-time memory (LSTM) network prediction model based on Copula entropy (CE) and the adaptive genetic algorithm (AGA). By calculating CE, the correlation between multiple meteorological factors and various atmospheric pollutants and PM2.5 was analyzed. The correlation of influencing factors was sorted according to the size of the correlation coefficients. The contribution rate of meteorological factors and atmospheric pollutants to PM2.5 concentration was determined, used as the weight of each influencing factor and predicted as the input data of the prediction model. In this paper, a long- and short-term memory network (LSTM) suitable for time series data was selected as the prediction model, while the selection of model parameters was taken into account, and the relevant parameters were sought by an adaptive genetic algorithm (AGA). The air pollutant data and meteorological data of Beijing from 1 January 2016 to 31 December 2016 were selected, and MAE and RMSE were used as evaluation indexes. By comparing the experimental results of the CE-AGA-LSTM with those of other eight prediction models (LR, SVM, RF, ARMA, ST-LSTM, LSTM, CE-LSTM and CE-RNN), we found that among the models, the CE-AGA-LSTM model provided the lowest MAE and RMSE values, i.e., 14.5 and 21.88, respectively. At the same time, the loss rate and accuracy of the CE-AGA-LSTM model were evaluated, and the experimental results verified the validity of the model.

Feature selection is an important method of data preprocessing in data mining. In this paper, a novel feature selection method based on multi-fractal dimension and harmony search algorithm is proposed. Multi-fractal dimension is adopted as the evaluation criterion of feature subset, which can determine the number of selected features. An improved harmony search algorithm is used as the search strategy to improve the efficiency of feature selection. The performance of the proposed method is compared with that of other feature selection algorithms on UCI data-sets. Besides, the proposed method is also used to predict the daily average concentration of PM2.5 in China. Experimental results show that the proposed method can obtain competitive results in terms of both prediction accuracy and the number of selected features.

Convolutional neural networks have attracted much attention for their use in the semantic segmentation of remote sensing imagery. The effectiveness of semantic segmentation of remote sensing images is significantly influenced by contextual information extraction. The traditional convolutional neural network is constrained by the size of the convolution kernel and mainly concentrates on local contextual information. We suggest a new lightweight global context semantic segmentation network, LightFGCNet, to fully utilize the global context data and to further reduce the model parameters. It uses an encoder–decoder architecture and gradually combines feature information from adjacent encoder blocks during the decoding upsampling stage, allowing the network to better extract global context information. Considering that the frequent merging of feature information produces a significant quantity of redundant noise, we build a unique and lightweight parallel channel spatial attention module (PCSAM) for a few critical contextual features. Additionally, we design a multi-scale fusion module (MSFM) to acquire multi-scale feature target information. We conduct comprehensive experiments on the two well-known datasets ISPRS Vaihingen and WHU Building. The findings demonstrate that our suggested strategy can efficiently decrease the number of parameters. Separately, the number of parameters and FLOPs are 3.12 M and 23.5 G, respectively, and the mIoU and IoU of our model on the two datasets are 70.45% and 89.87%, respectively, which is significantly better than what the conventional convolutional neural networks for semantic segmentation can deliver.