Earth observation through remote sensing images allows the accurate characterization and identification of materials on the surface from space and airborne platforms. Multiple and heterogeneous image sources can be available for the same geographical region: multispectral, hyperspectral, radar, multitemporal, and multiangular images can today be acquired over a given scene. These sources can be combined/fused to improve classification of the materials on the surface. Even if this type of systems is generally accurate, the field is about to face new challenges: the upcoming constellations of satellite sensors will acquire large amounts of images of different spatial, spectral, angular, and temporal resolutions. In this scenario, multimodal image fusion stands out as the appropriate framework to address these problems. In this paper, we provide a taxonomical view of the field and review the current methodologies for multimodal classification of remote sensing images. We also highlight the most recent advances, which exploit synergies with machine learning and signal processing: sparse methods, kernel-based fusion, Markov modeling, and manifold alignment. Then, we illustrate the different approaches in seven challenging remote sensing applications: 1) multiresolution fusion for multispectral image classification; 2) image downscaling as a form of multitemporal image fusion and multidimensional interpolation among sensors of different spatial, spectral, and temporal resolutions; 3) multiangular image classification; 4) multisensor image fusion exploiting physically-based feature extractions; 5) multitemporal image classification of land covers in incomplete, inconsistent, and vague image sources; 6) spatiospectral multisensor fusion of optical and radar images for change detection; and 7) cross-sensor adaptation of classifiers. The adoption of these techniques in operational settings will help to monitor our planet from space in the very near future.

In recent years, airborne and spaceborne hyperspectral imaging systems have advanced in terms of spectral and spatial resolution, which makes the data sets they produce a valuable source for land cover classification. The availability of hyperspectral data with fine spatial resolution has revolutionized hyperspectral image (HSI) classification techniques by taking advantage of both spectral and spatial information in a single classification framework.

The availability of synthetic aperture radar (SAR) data offers great potential for environmental monitoring due to the insensitiveness of SAR imagery to atmospheric and sunlight-illumination conditions. In addition, the short revisit time provided by future SAR-based missions will allow a huge amount of multitemporal SAR data to become systematically available for monitoring applications. In this paper, the problem of detecting the changes that occurred on the ground by analyzing SAR imagery is addressed by a completely unsupervised approach, i.e., by developing an automatic thresholding technique. The image-ratioing approach to SAR change detection is adopted, and the Kittler and Illingworth minimum-error thresholding algorithm is generalized to take into account the non-Gaussian distribution of the amplitude values of SAR images. In particular, a SAR-specific parametric modeling approach for the ratio image is proposed and integrated into the thresholding process. Experimental results, which confirm the accuracy of the method for real X-band SAR and spaceborne imaging radar C-band images, are presented

A general problem of supervised remotely sensed image classification assumes prior knowledge to be available for all the thematic classes that are present in the considered dataset. However, the ground-truth map representing that prior knowledge usually does not really describe all the land-cover typologies in the image, and the generation of a complete training set often represents a time-consuming, difficult and expensive task. This problem affects the performances of supervised classifiers, which erroneously assign each sample drawn from an unknown class to one of the known classes. In the present paper, a classification strategy is described that allows the identification of samples drawn from unknown classes through the application of a suitable Bayesian decision rule. The proposed approach is based on support vector machines (SVMs) for the estimation of probability density functions and on a recursive procedure to generate prior probability estimates for known and unknown classes. In the experiments, both a synthetic dataset and two real datasets were used.

This paper reports the outcomes of the 2014 Data Fusion Contest organized by the Image Analysis and Data Fusion Technical Committee (IADF TC) of the IEEE Geoscience and Remote Sensing Society (IEEE GRSS). As for previous years, the IADF TC organized a data fusion contest aiming at fostering new ideas and solutions for multisource remote sensing studies. In the 2014 edition, participants considered multiresolution and multisensor fusion between optical data acquired at 20-cm resolution and long-wave (thermal) infrared hyperspectral data at 1-m resolution. The Contest was proposed as a double-track competition: one aiming at accurate landcover classification and the other seeking innovation in the fusion of thermal hyperspectral and color data. In this paper, the results obtained by the winners of both tracks are presented and discussed.

Markov models represent a wide and general family of stochastic models for the temporal and spatial dependence properties associated to 1-D and multidimensional random sequences or random fields. Their applications range over a wide variety of subareas of the information and communication technology (ICT) field, including networking, automation, speech processing, genomic-sequence analysis, or image processing. Focusing on the applicative problem of land-cover mapping from very-high-resolution (VHR) remote sensing images, which is a relevant problem in many applications of environmental monitoring and natural resource exploitation, Markov models convey a great potential, thanks to their capability to effectively describe and incorporate the spatial information associated with image data into an image-classification process. In this framework, the main ideas and previous work about Markov modeling for VHR image classification will be recalled in this paper and processing results obtained through recent methods proposed by the authors will be discussed.