Cloud detection and cloud properties have substantial applications in weather forecast, signal attenuation analysis, and other cloud-related fields. Cloud image segmentation is the fundamental and important step in deriving cloud cover. However, traditional segmentation methods rely on low-level visual features of clouds and often fail to achieve satisfactory performance. Deep convolutional neural networks (CNNs) can extract high-level feature information of objects and have achieved remarkable success in many image segmentation fields. On this basis, a novel deep CNN model named SegCloud is proposed and applied for accurate cloud segmentation based on ground-based observation. Architecturally, SegCloud possesses a symmetric encoder–decoder structure. The encoder network combines low-level cloud features to form high-level, low-resolution cloud feature maps, whereas the decoder network restores the obtained high-level cloud feature maps to the same resolution of input images. The Softmax classifier finally achieves pixel-wise classification and outputs segmentation results. SegCloud has powerful cloud discrimination capability and can automatically segment whole-sky images obtained by a ground-based all-sky-view camera. The performance of SegCloud is validated by extensive experiments, which show that SegCloud is effective and accurate for ground-based cloud segmentation and achieves better results than traditional methods do. The accuracy and practicability of SegCloud are further proven by applying it to cloud cover estimation.

This study develops a novel automatic all-sky imaging system, namely, an all-sky camera (ASC) system, for cloud cover assessment. The proposed system does not require conventional solar occulting devices and can capture complete hemispheric sky images. Cloud detection is performed innovatively using a convolutional neural network model (i.e., the optimized U-Net model). Experiments demonstrate that the optimized U-Net model can effectively detect clouds from sky images. In terms of cloud cover, the estimation results of the ASC system exhibit a high correlation with those obtained via manual observation, thereby indicating the applicability of the ASC system in ground-based cloud observation and analysis.

The formation and evolution of clouds are associated with their thermodynamical and microphysical progress. Previous studies have been conducted to collect images using ground-based cloud observation equipment to provide important cloud characteristics information. However, most of this equipment cannot perform continuous observations during the day and night, and their field of view (FOV) is also limited. To address these issues, this work proposes a day and night clouds detection approach integrated into a self-made thermal-infrared (TIR) all-sky-view camera. The TIR camera consists of a high-resolution thermal microbolometer array and a fish-eye lens with a FOV larger than 160°. In addition, a detection scheme was designed to directly subtract the contamination of the atmospheric TIR emission from the entire infrared image of such a large FOV, which was used for cloud recognition. The performance of this scheme was validated by comparing the cloud fractions retrieved from the infrared channel with those from the visible channel and manual observation. The results indicated that the current instrument could obtain accurate cloud fraction from the observed infrared image, and the TIR all-sky-view camera developed in this work exhibits good feasibility for long-term and continuous cloud observation.

The atmospheric temperature profile is an important parameter to describe the state of the atmosphere, and it is crucial to climate change research, weather forecasting, and atmospheric parameter retrieval. A machine learning algorithm that incorporates historical observations and ground-based measurements was developed in this study to retrieve the atmospheric temperature profile. Specifically, the deep learning network considered historical observations for the same period and temporally correlated temperature profiles. It combined multi-layer perceptron (MLP) and the convolutional neural network (CNN). MLP derived the features from the ground factors, and CNN captured the essential features associated with the temperature profiles at the current time from latent historical data. Then, the features of the two parts were concatenated to obtain the final network. The construction and parameters of the model were optimized to determine the best model configuration and retrieval performance. The results of the model were evaluated against those of other methods on the same dataset. The model showed a good retrieval precision, which was equivalent to a small retrieval bias, root-mean-square error, and mean absolute error at all altitudes. The analysis of the application of this model to the retrieval of atmospheric temperature profiles indicates that the method is feasible.

Visible and infrared binocular all-sky-view cameras can provide continuous and complementary ground-based cloud observations. Accurate angular calibration for every pixel is an essential premise to further cloud analysis and georeferencing. However, most current calibration methods mainly rely on calibration plates, which still remains difficult for simultaneously calibrating visible and infrared binocular cameras, especially with different imaging resolutions. Thus, in this study, we present a simple and convenient angular calibration method for wide field-of-view visible and infrared binocular cameras. Without any extra instruments, the proposed method only utilizes the relation between the angular information of direct sun lights and the projected sun pixel coordinates to compute the geometric imaging parameters of the two cameras. According to the obtained parameters, the pixel-view-angle for the visible and infrared all-sky images is efficiently computed via back projection. Meanwhile, the projected pixel coordinates for the incident lights at any angle can also be computed via reprojection. Experimental results show the effectiveness and accuracy of the proposed angular calibration through the error estimation of reprojection and back projection. As a novel application, we successfully achieve visible and infrared binocular image registration at the pixel level after finishing angular calibration, which not only verifies the accuracy of calibration results, but also contributes to further cloud parameter analysis under these two different imaging features. The registration results, to our knowledge, also provide a reference for the current blank in visible and infrared binocular cloud image registration.