With the development of multi-spectral imaging techniques, many new multi-spectral imaging devices have been developed in recent years. Red-green-blue and near-infrared (RGBN) cameras are widely used because they capture visible light and near-infrared light simultaneously, but they inevitably introduce color desaturation. Because there is clear multicollinearity among the RGBN channels, the ordinary least squares regression (OLSR) color correction method performs poorly. To solve color bias and multicollinearity, an RGBN camera color correction pipeline is proposed. A large number of nonlinear regression color correction methods that consist of combinations of four regression methods and nine nonlinear transforms are evaluated in this study. The results show that the proposed OLSR-based compound transform color correction method and partial least-squares regression (PLSR) based Gaussian-core transform color correction method yield better color correction results and are more robust. These approaches reduce the multicollinearity of the RGBN camera channels and will be a valuable reference in the development of RGBN imaging applications.
RGBN cameras that can capture visible light and near-infrared (NIR) light simultaneously produce better color image quality in low-light-level conditions. However, these RGBN cameras introduce additional color bias caused by the mixing of visible information and NIR information. The color correction matrix model widely used in current commercial color digital cameras cannot handle the complicated mapping function between biased color and ground truth color. Convolutional neural networks (CNNs) are good at fitting such complicated relationships, but they require a large quantity of training image pairs of different scenes. In order to achieve satisfactory training results, large amounts of data must be captured manually, even when data augmentation techniques are applied, requiring significant time and effort. Hence, a data generation method for training pairs that are consistent with target RGBN camera parameters, based on an open access RGB-NIR dataset, is proposed. The proposed method is verified by training an RGBN camera color restoration CNN model with generated data. The results show that the CNN model trained with the generated data can achieve satisfactory RGBN color restoration performance with different RGBN sensors.