In this paper, we address the hyperspectral image (HSI) classification task with a generative adversarial network and conditional random field (GAN-CRF)-based framework, which integrates a semisupervised deep learning and a probabilistic graphical model, and make three contributions. First, we design four types of convolutional and transposed convolutional layers that consider the characteristics of HSIs to help with extracting discriminative features from limited numbers of labeled HSI samples. Second, we construct semisupervised generative adversarial networks (GANs) to alleviate the shortage of training samples by adding labels to them and implicitly reconstructing real HSI data distribution through adversarial training. Third, we build dense conditional random fields (CRFs) on top of the random variables that are initialized to the softmax predictions of the trained GANs and are conditioned on HSIs to refine classification maps. This semisupervised framework leverages the merits of discriminative and generative models through a game-theoretical approach. Moreover, even though we used very small numbers of labeled training HSI samples from the two most challenging and extensively studied datasets, the experimental results demonstrated that spectral-spatial GAN-CRF (SS-GAN-CRF) models achieved top-ranking accuracy for semisupervised HSI classification.

In this study, a convolutional neural network (CNN) is used to estimate sea ice concentration using synthetic aperture radar (SAR) scenes acquired during freeze-up in the Gulf of St. Lawrence on the east coast of Canada. The ice concentration estimates from the CNN are compared to those from a neural network (multi-layer perceptron or MLP) that uses hand-crafted features as input and a single layer of hidden nodes. The CNN is found to be less sensitive to pixel level details than the MLP and produces ice concentration that is less noisy and in closer agreement with that from image analysis charts. This is due to the multi-layer (deep) structure of the CNN, which enables abstract image features to be learned. The CNN ice concentration is also compared with ice concentration estimated from passive microwave brightness temperature data using the ARTIST sea ice (ASI) algorithm. The bias and RMS of the difference between the ice concentration from the CNN and that from image analysis charts is reduced as compared to that from either the MLP or ASI algorithm. Additional results demonstrate the impact of varying the input patch size, varying the number of CNN layers, and including the incidence angle as an additional input.

Ice concentration estimates are typically acquired from algorithms using passive microwave satellite data, and from image analysis charts, but these have limitations. Estimates acquired from passive microwave data have coarse spatial resolution, may have errors due to atmospheric contamination, and often perform poorly in marginal ice zones. Image analysis charts are not as precise, subject to analyst interpretation, and only available over specific geographic areas. We have implemented a U-net with synthetic aperture radar images as inputs and use ice concentration estimates retrieved from passive microwave data as training labels. The U-net, due to not being sensitive to patch size, is shown to be an improvement over previous work with convolutional neural networks that use fully connected layers at the output. Data augmentation and an L1 loss function were applied along with a novel training scheme that leverages curriculum learning. In this training scheme, the model is first trained with samples from open water and consolidated ice regions before incorporating samples from marginal ice regions. In a tenfold cross validation experiment, we achieve 3-4% mean absolute error comparing to estimates using passive microwave data and observe curriculum learning models having more stable training. Predictions on four with-held SAR scenes with difficult ice conditions were evaluated with image analysis charts. A mean absolute error of 7.18% is achieved, which is lower than errors associated with passive microwave data alone. Qualitative improvements in marginal ice zone estimates are achieved, while still preserving smooth consolidated ice regions, and openings in ice cover.

The problem of limited labeled training samples is challenging for the classification of remote sensing imagery. We develop a joint classification and segmentation algorithm to address this problem. Our algorithm combines semisupervised learning and conditional random fields (CRFs) into a single framework. The multimodal Gaussian maximum-likelihood classifier is used to estimate the probabilities for the unary potentials of the CRF. Unlike traditional methods based on random fields, region merging is concatenated with the CRF inference to reduce the number of nodes iteratively. Moreover, a semisupervised technique called self-training is used, which iteratively enlarges the training sample set and retrains the classifier. The selection of training samples is based on the region information, so that the risk of assigning wrong labels is largely reduced. The proposed algorithm is applied to hyperspectral image classification, and results on benchmark data sets show that the proposed algorithm significantly improves classification performance after using self-training, and outperforms state-of-the-art spectral-spatial methods for limited labeled training samples.

Changes to ice cover on lakes throughout the northern landscape has been established as an indicator of climate change and variability, expected to have implications for both human and environmental systems. Monitoring lake ice cover is also required to enable more reliable weather forecasting across lake-rich northern latitudes. Currently, the Canadian Ice Service (CIS) monitors lakes using synthetic aperture radar (SAR) and optical imagery through visual interpretation, with total lake ice cover reported weekly as a fraction out of ten. An automated method of classification would allow for more detailed records to be delivered operationally. In this research, we present an automatic ice-mapping approach which integrates unsupervised segmentation from the Iterative Region Growing using Semantics (IRGS) algorithm with supervised random forest (RF) labeling. IRGS first locally segments homogeneous regions in an image, then merges similar regions into classes across the entire scene. Recently, these output regions were manually labeled by the user to generate ice maps, or were labeled using a Support Vector Machine (SVM) classifier. Here, three labeling methods (Manual, SVM, and RF) are applied after IRGS segmentation to perform ice-water classification on 36 RADARSAT-2 scenes of Great Bear Lake (Canada). SVM and RF classifiers are also tested without integration with IRGS. An accuracy assessment has been performed on the results, comparing outcomes with author-generated reference data, as well as the reported ice fraction from CIS. The IRGS-RF average classification accuracy for this dataset is 95.8%, demonstrating the potential of this automated method to provide detailed and reliable lake ice cover information operationally.

Bayesian neural networks (BNNs) have been demonstrated to be effective in accurate retrieval of sea ice concentration (SIC) from multi-source data, while providing estimates of uncertainty, which are essential for downstream services. However, uncertainty obtained by BNNs are intrinsically uncalibrated, which indicates that it may not correlate well with model error. To address this issue, we investigate a new approach that combines an auxiliary prediction interval (PI) estimator with the BNN-based SIC mean estimator to develop a well-calibrated SIC retrieval model that is both accurate and reliable. We adopt a training strategy called “uncertainty matching" to train the model, which ensures that the estimated uncertainties match the estimated PIs. We use a subset of AMSR2 brightness temperature data and ERA5 atmospheric data collected from 2014 to 2015 in the Baffin Bay area as input features of the model. Comparison between model inference and SIC labels obtained from the enhanced NASA Team (NT2) algorithm shows that the proposed approach is able to produce well-calibrated uncertainty with more accurate predictions in marginal ice zones.