In order to overcome the insufficiency of single remote sensing data in change detection, synthetic aperture radar (SAR) and optical image data can be used together for supplementation. However, conventional image fusion methods fail to address the differences in imaging mechanisms and cannot overcome some practical limitations such as usage in change detection or temporal requirement of the optical image. This study proposes a new method to fuse SAR and optical images, which is expected to be visually helpful and minimize the differences between two imaging mechanisms. The algorithm performs the fusion by establishing relationships between SAR and multispectral (MS) images by using a random forest (RF) regression, which creates a fused SAR image containing the surface roughness characteristics of the SAR image and the spectral characteristics of the MS image. The fused SAR image is evaluated by comparing it to those obtained using conventional image fusion methods and the proposed method shows that the spectral qualities and spatial qualities are improved significantly. Furthermore, for verification, other ensemble approaches such as stochastic gradient boosting regression and adaptive boosting regression are compared and overall it is confirmed that the performance of RF regression is superior. Then, change detection between the fused SAR and MS images is performed and compared with the results of change detection between MS images and between SAR images and the result using fused SAR images is similar to the result with MS images and is improved when compared to the result between SAR images. Lastly, the proposed method is confirmed to be applicable to change detection.

Efforts have been made to detect both naturally occurring and anthropogenic changes to the Earth’s surface by using satellite remote sensing imagery. There is a need to maintain the homogeneity of radiometric and phenological conditions to ensure accuracy in change detection, but images to assess long-term changes in time-series data that satisfy such conditions are difficult to obtain. For this reason, image normalization is essential. In particular, the normalizing compositive conditions require nonlinear modeling, and random forest (RF) techniques can be utilized for this normalization. This study employed Landsat-5 Thematic Mapper satellite images with temporal, radiometric and phenological differences, and obtained Radiometric Control Set Samples by selecting no-change pixels between the subject image and reference image using scattergrams. In the obtained no-change regions, RF regression was modeled, and normalized images were obtained. Next, normalization performance was evaluated by comparing the results against the following conventional linear regression methods: mean-standard deviation regression, simple regression, and no-change regression. The normalization performance of RF regression was much higher. In addition, for an additional usefulness evaluation in normalization, the normalization performance was compared with other nonlinear ensemble regressions, i.e. Adaptive Boosting regression and Stochastic Gradient Boosting regression, which confirmed that the normalization performance of RF regression was significantly higher. In other words, it was found to be highly useful for normalization when compared to other nonlinear ensemble regressions. Finally, as a result of performing change detection, normalized subject images generated by RF regression showed the highest accuracy, which indicated that the proposed method (where the image was normalized using RF regression) may be useful in change detection between multi-temporal image datasets.

This study proposes a light convolutional neural network (LCNN) well-fitted for medium-resolution (30-m) land-cover classification. The LCNN attains high accuracy without overfitting, even with a small number of training samples, and has lower computational costs due to its much lighter design compared to typical convolutional neural networks for high-resolution or hyperspectral image classification tasks. The performance of the LCNN was compared to that of a deep convolutional neural network, support vector machine (SVM), k-nearest neighbors (KNN), and random forest (RF). SVM, KNN, and RF were tested with both patch-based and pixel-based systems. Three 30 km × 30 km test sites of the Level II National Land Cover Database were used for reference maps to embrace a wide range of land-cover types, and a single-date Landsat-8 image was used for each test site. To evaluate the performance of the LCNN according to the sample sizes, we varied the sample size to include 20, 40, 80, 160, and 320 samples per class. The proposed LCNN achieved the highest accuracy in 13 out of 15 cases (i.e., at three test sites with five different sample sizes), and the LCNN with a patch size of three produced the highest overall accuracy of 61.94% from 10 repetitions, followed by SVM (61.51%) and RF (61.15%) with a patch size of three. Also, the statistical significance of the differences between LCNN and the other classifiers was reported. Moreover, by introducing the heterogeneity value (from 0 to 8) representing the complexity of the map, we demonstrated the advantage of patch-based LCNN over pixel-based classifiers, particularly at moderately heterogeneous pixels (from 1 to 4), with respect to accuracy (LCNN is 5.5% and 6.3% more accurate for a training sample size of 20 and 320 samples per class, respectively). Finally, the computation times of the classifiers were calculated, and the LCNN was confirmed to have an advantage in large-area mapping.

Thermal data products derived from remotely sensed data play significant roles as key parameters for biophysical phenomena. However, a trade-off between spatial and spectral resolutions has existed in thermal infrared (TIR) remote sensing systems, with the end product being the limited resolution of the TIR sensor. In order to treat this problem, various disaggregation methods of TIR data, based on the indices from visible and near-infrared (VNIR), have been developed to sharpen the coarser spatial resolution of TIR data. Although these methods were reported to exhibit sufficient performance in each study, preservation of thermal variation in the original TIR data is still difficult, especially in fire areas due to the distortion of the VNIR reflectance by the impact of smoke. To solve this issue, this study proposes an efficient and improved disaggregation algorithm of TIR imagery on wildfire areas using guided shortwave infrared (SWIR) band imagery via a guided image filter (GF). Radiometric characteristics of SWIR wavelengths could preserve spatially high frequency temperature components in flaming combustion, and the GF preserved thermal variation of the original TIR data in the disaggregated result. The proposed algorithm was evaluated using Landsat-8 operational land imager (OLI) and thermal infrared sensor (TIRS) images on wildfire areas, and compared with other algorithms based on a vegetation index (VI) originating from VNIR. In quantitative analysis, the proposed disaggregation method yielded the best values of root mean square error (RMSE), mean absolute error (MAE), correlation coefficient (CC), erreur relative globale adimensionelle de synthèse (ERGAS), and universal image quality index (UIQI). Furthermore, unlike in other methods, the disaggregated temperature map in the proposed method reflected the thermal variation of wildfire in visual analysis. The experimental results showed that the proposed algorithm was successfully applied to the TIR data, especially to wildfire areas in terms of quantitative and visual assessments.

Image colorization assigns colors to a grayscale image, which is an important yet difficult image-processing task encountered in various applications. In particular, grayscale aerial image colorization is a poorly posed problem that is affected by the sun elevation angle, seasons, sensor parameters, etc. Furthermore, since different colors may have the same intensity, it is difficult to solve this problem using traditional methods. This study proposes a novel method for the colorization of grayscale aerial images using random forest (RF) regression. The algorithm uses one grayscale image for input and one-color image for reference, both of which have similar seasonal features at the same location. The reference color image is then converted from the Red-Green-Blue (RGB) color space to the CIE L*a*b (Lab) color space in which the luminance is used to extract training pixels; this is done by performing change detection with the input grayscale image, and color information is used to establish color relationships. The proposed method directly establishes color relationships between features of the input grayscale image and color information of the reference color image based on the corresponding training pixels. The experimental results show that the proposed method outperforms several state-of-the-art algorithms in terms of both visual inspection and quantitative evaluation.

Image fusion is a technical method to integrate the spatial details of the high-resolution panchromatic (HRP) image and the spectral information of low-resolution multispectral (LRM) images to produce high-resolution multispectral images. The most important point in image fusion is enhancing the spatial details of the HRP image and simultaneously maintaining the spectral information of the LRM images. This implies that the physical characteristics of a satellite sensor should be considered in the fusion process. Also, to fuse massive satellite images, the fusion method should have low computation costs. In this paper, we propose a fast and efficient satellite image fusion method. The proposed method uses the spectral response functions of a satellite sensor; thus, it rationally reflects the physical characteristics of the satellite sensor to the fused image. As a result, the proposed method provides high-quality fused images in terms of spectral and spatial evaluations. The experimental results of IKONOS images indicate that the proposed method outperforms the intensity-hue-saturation and wavelet-based methods.