In hyperspectral unmixing, the prevalent model used is the linear mixing model, and a large variety of techniques based on this model has been proposed to obtain endmembers and their abundances in hyperspectral imagery. However, it has been known for some time that nonlinear spectral mixing effects can be a crucial component in many real-world scenarios, such as planetary remote sensing, intimate mineral mixtures, vegetation canopies, or urban scenes. While several nonlinear mixing models have been proposed decades ago, only recently there has been a proliferation of nonlinear unmixing models and techniques in the signal processing literature. This paper aims to give an historical overview of the majority of nonlinear mixing models and nonlinear unmixing methods, and to explain some of the more popular techniques in detail. The main models and techniques treated are bilinear models, models for intimate mineral mixtures, radiosity-based approaches, ray tracing, neural networks, kernel methods, support vector machine techniques, manifold learning methods, piece-wise linear techniques, and detection methods for nonlinearity. Furthermore, we provide an overview of several recent developments in the nonlinear unmixing literature that do not belong into any of these categories.

In hyperspectral unmixing, bilinear and linear-quadratic models have become popular recently, and also the polynomial postnonlinear model shows promising results. These models do not consider endmember interactions involving more than two endmembers, although such interactions might compose a nontrivial part of the observed spectrum in scenarios involving bright materials and complex geometrical structures, such as vegetation and intimate mixtures. In this paper, we present an extension of these models to include an infinite number of interactions. Several technical problems, such as divergence of the resulting series, can be avoided by introducing an optical interaction probability, which becomes the only free parameter of the model in addition to the abundances. We present an unmixing strategy based on this multilinear mixing (MLM) model; present comparisons with the bilinear models and the Hapke model for intimate mixing; and show that, in several scenarios, the MLM model obtains superior results.

We present a new algorithm for linear spectral mixture analysis, which is capable of supervised unmixing of hyperspectral data while respecting the constraints on the abundance coefficients. This simplex-projection unmixing algorithm is based upon the equivalence of the fully constrained least squares problem and the problem of projecting a point onto a simplex. We introduce several geometrical properties of high-dimensional simplices and combine them to yield a recursive algorithm for solving the simplex-projection problem. A concrete implementation of the algorithm for large data sets is provided, and the algorithm is benchmarked against well-known fully constrained least squares unmixing (FCLSU) techniques, on both artificial data sets and real hyperspectral data collected over the Cuprite mining region. Unlike previous algorithms for FCLSU, the presented algorithm possesses no optimization steps and is completely analytical, severely reducing the required processing power.

Spectral mixtures observed in hyperspectral imagery often display nonlinear mixing effects. Since most traditional unmixing techniques are based upon the linear mixing model, they perform poorly in finding the correct endmembers and their abundances in the case of nonlinear spectral mixing. In this paper, we present an unmixing algorithm that is capable of extracting endmembers and determining their abundances in hyperspectral imagery under nonlinear mixing assumptions. The algorithm is based upon simplex volume maximization, and uses shortest-path distances in a nearest-neighbor graph in spectral space, hereby respecting the nontrivial geometry of the data manifold in the case of nonlinearly mixed pixels. We demonstrate the algorithm on an artificial data set, the AVIRIS Cuprite data set, and a hyperspectral image of a heathland area in Belgium.

Unlike multispectral (MSI) and panchromatic (PAN) images, generally the spatial resolution of hyperspectral images (HSI) is limited, due to sensor limitations. In many applications, HSI with a high spectral as well as spatial resolution are required. In this paper, a new method for spatial resolution enhancement of a HSI using spectral unmixing and sparse coding (SUSC) is introduced. The proposed method fuses high spectral resolution features from the HSI with high spatial resolution features from an MSI of the same scene. Endmembers are extracted from the HSI by spectral unmixing, and the exact location of the endmembers is obtained from the MSI. This fusion process by using spectral unmixing is formulated as an ill-posed inverse problem which requires a regularization term in order to convert it into a well-posed inverse problem. As a regularizer, we employ sparse coding (SC), for which a dictionary is constructed using high spatial resolution MSI or PAN images from unrelated scenes. The proposed algorithm is applied to real Hyperion and ROSIS datasets. Compared with other state-of-the-art algorithms based on pansharpening, spectral unmixing, and SC methods, the proposed method is shown to significantly increase the spatial resolution while perserving the spectral content of the HSI.

We present a new model for nonlinear spectral mixing observed in hyperspectral imagery and demonstrate how this model can be used for unmixing and obtaining abundance maps. The model is based on the idea that a single pixel can contain several spatially segregated areas containing different mineral mixtures and fuses Hapke's radiative transfer model for intimate mineral mixtures with the traditional linear mixing model. The resulting model allows great flexibility for generating spectra, provides abundance coefficients in terms of total relative ground cover for each endmember, and can be reduced to several other nonlinear mixing models by an appropriate choice of the parameters. Experiments on laboratory mineral mixtures and real hyperspectral imagery show reduced reconstruction errors and more accurate abundance coefficients compared with the linear mixing model or the recently introduced multimixture pixel model. Moreover, the reconstruction error improvement can be used as a per-pixel measure of the size of the intimate mixing component.