Single-sensor color cameras, which classically use a color filter array to sample RGB channels, have recently been extended to the multispectral domain. To sample more than three wavelength bands, such systems use a multispectral filter array that provides a raw image in which a single channel value is available at each pixel. A demosaicing procedure is then needed to estimate a fully defined multispectral image. In this paper, we review multispectral demosaicing methods and propose a new one based on the pseudo-panchromatic image (PPI). Pixel values in the PPI are computed as the average spectral values. Experimental results show that our method provides estimated images of better quality than classical ones.

Snapshot polarization imaging has gained interest in the last few decades. Recent research and technology achievements defined the polarization Filter Array (PFA). It is dedicated to division-of-focal plane polarimeters, which permits to analyze the direction of light electric field oscillation. Its filters form a mosaicked pattern, in which each pixel only senses a fraction of the total polarization states, so the other missing polarization states have to be interpolated. As for Color or Spectral Filter Arrays (CFA or SFA), several dedicated demosaicking methods exist in the PFA literature. Such methods are mainly based on spatial correlation disregarding inter-channel correlation. We show that polarization channels are strongly correlated in images. We therefore propose to extend some demosaicking methods from CFA/SFA to PFA, and compare them with those that are PFA-oriented. Objective and subjective analysis show that the pseudo panchromatic image difference method provides the best results and can be used as benchmark for PFA demosaicking.

Single-sensor color cameras, which classically use a color filter array (CFA) to sample RGB channels, have recently been extended to the multispectral domain. To sample more than three wavelength bands, such systems use a multispectral filter array (MSFA) that provides a raw image in which a single channel level is available at each pixel. A demosaicing procedure is then needed to estimate a multispectral image with full spectral resolution. In this paper, we propose a new demosaicing method that takes spectral and spatial correlations into account by estimating the level for each channel. Experimental results show that it provides estimated images of better quality than classical methods.

We present a dataset of close range hyperspectral images of materials that span the visible and near infrared spectrums: HyTexiLa (Hyperspectral Texture images acquired in Laboratory). The data is intended to provide high spectral and spatial resolution reflectance images of 112 materials to study spatial and spectral textures. In this paper we discuss the calibration of the data and the method for addressing the distortions during image acquisition. We provide a spectral analysis based on non-negative matrix factorization to quantify the spectral complexity of the samples and extend local binary pattern operators to the hyperspectral texture analysis. The results demonstrate that although the spectral complexity of each of the textures is generally low, increasing the number of bands permits better texture classification, with the opponent band local binary pattern feature giving the best performance.

To discriminate gray-level texture images, spatial texture descriptors can be extracted using the local binary pattern (LBP) operator. This operator has been extended to color images at the expense of increased memory and computation requirements. Some authors propose to compute texture descriptors directly from raw images provided through a Bayer color filter array, which both avoids the demosaicking step and reduces the descriptor size. Recently, multispectral snapshot cameras have emerged to sample more than three wavelength bands using a multispectral filter array. Such cameras provide a raw image in which a single spectral channel value is available at each pixel. In this paper we design a local binary pattern operator that jointly extracts the spatial and spectral texture information directly from a raw image. Extensive experiments on a large dataset show that the proposed descriptor has both reduced computation cost and high discriminative power with regard to classical LBP descriptors applied to demosaicked images.

Single-sensor multispectral cameras, that sample spectral channels using a multispectral filter array, have recently emerged. They provide a raw image in which each channel is spectrally sampled pixel-wise according to the filter array pattern. A demosaicing procedure is then needed to estimate a multispectral image with full spectral resolution. The usefulness of intensity-based demosaicing has been shown in a previous work. In this paper, we both propose an intensity-based adaptation of the Binary Tree-based Edge-Sensing method for raw images with no dominant spectral band, and a new iterative method that uses the central wavelength distance between spectral bands.