Retrieving thunderstorm activity through specific thermodynamic and kinematic parameters is paramount for predicting deep convective weather and investigating long‐term climatology of storm. However, the reliability of the relationship between parameters and convective events is restricted by the modelling methods and sampling of thunderstorm activity. There is no objective definition of a thunderstorm, so the clustering method is applied to the cloud‐to‐ground (CG) lightning stroke data in Central China to identify lightning clusters. These clusters are then gridded and associated with environmental variables derived from ERA5 reanalysis. Finally, machine learning (ML) technologies are applied to model the occurrence of thunderstorms. In addition, ERA5 is also evaluated. The parameters related to moisture and lapse rate calculated by ERA5 are close to sounding measurements, such as Td850, PW, LR700_400 and KI, whose correlation coefficients exceed 0.90. ERA5 has a good estimation of some parameters that are susceptible to the influence of the boundary layer. Compared with the lightning strike‐based scheme, our scheme obtains the best performance index values. An agreement between observations and predictions based on lightning clusters is also evident from the diurnal cycle of thunderstorm probabilities. Although thunderstorm activity on complex terrain is underestimated, the created ML model can explain 61.4% of the variance in the observed frequency. The results of the significance test reveal that there are statistically significant differences between the soundings corresponding to some isolated CG strikes and the thunderstorm class, but the distribution is the same as that of the non‐thunderstorm class. Solar radiation, topographic features and lake distribution play a major role in promoting the occurrence and development of thunderstorms.
Geospatial three-dimensional (3D) raster data have been widely used for simple representations and analysis, such as geological models, spatio-temporal satellite data, hyperspectral images, and climate data. With the increasing requirements of resolution and accuracy, the amount of geospatial 3D raster data has grown exponentially. In recent years, the processing of large raster data using Hadoop has gained popularity. However, data uploaded to Hadoop are randomly distributed onto datanodes without consideration of the spatial characteristics. As a result, the direct processing of geospatial 3D raster data produces a massive network data exchange among the datanodes and degrades the performance of the cluster. To address this problem, we propose an efficient group-based replica placement policy for large-scale geospatial 3D raster data, aiming to optimize the locations of the replicas in the cluster to reduce the network overhead. An overlapped group scheme was designed for three replicas of each file. The data in each group were placed in the same datanode, and different colocation patterns for three replicas were implemented to further reduce the communication between groups. The experimental results show that our approach significantly reduces the network overhead during data acquisition for 3D raster data in the Hadoop cluster, and maintains the Hadoop replica placement requirements.
1 September 2021 in Journal of Physics: Conference Series