The atmospheric boundary layer (ABL) defines the volume of air adjacent to the Earth's surface for the dilution of heat, moisture, and trace substances. Quantitative knowledge on the temporal and spatial variations in the heights of the ABL and its sub-layers is still scarce, despite their importance for a series of applications (including, for example, air quality, numerical weather prediction, greenhouse gas assessment, and renewable energy production). Thanks to recent advances in ground-based remote-sensing measurement technology and algorithm development, continuous profiling of the entire ABL vertical extent at high temporal and vertical resolution is increasingly possible. Dense measurement networks of autonomous ground-based remote-sensing instruments, such as microwave radiometers, radar wind profilers, Doppler wind lidars or automatic lidars and ceilometers are hence emerging across Europe and other parts of the world. This review summarises the capabilities and limitations of various instrument types for ABL monitoring and provides an overview on the vast number of retrieval methods developed for the detection of ABL sub-layer heights from different atmospheric quantities (temperature, humidity, wind, turbulence, aerosol). It is outlined how the diurnal evolution of the ABL can be monitored effectively with a combination of methods, pointing out where instrumental or methodological synergy are considered particularly promising. The review highlights the fact that harmonised data acquisition across carefully designed sensor networks as well as tailored data processing are key to obtaining high-quality products that are again essential to capture the spatial and temporal complexity of the lowest part of the atmosphere in which we live and breathe.

We present a method using Doppler lidar data for identifying the main sources of turbulent mixing within the atmospheric boundary layer. The method identifies the presence of turbulence and then assigns a turbulent source by combining several lidar quantities: attenuated backscatter coefficient, vertical velocity skewness, dissipation rate of turbulent kinetic energy, and vector wind shear. Both buoyancy‐driven and shear‐driven situations are identified, and the method operates in both clear‐sky and cloud‐topped conditions, with some reservations in precipitation. To capture the full seasonal cycle, the classification method was applied to more than 1 year of data from two sites, Hyytiälä, Finland, and Jülich, Germany. Analysis showed seasonal variation in the diurnal cycle at both sites; a clear diurnal cycle was observed in spring, summer, and autumn seasons, but due to their respective latitudes, a weaker cycle in winter at Jülich, and almost non‐existent at Hyytiälä. Additionally, there are significant contributions from sources other than convective mixing, with cloud‐driven mixing being observed even within the first 500 m above ground. Also evident is the considerable amount of nocturnal mixing within the lowest 500 m at both sites, especially during the winter. The presence of a low‐level jet was often detected when sources of nocturnal mixing were diagnosed as wind shear. The classification scheme and the climatology extracted from the classification provide insight into the processes responsible for mixing within the atmospheric boundary layer, how variable in space and time these can be, and how they vary with location.

Ceilometer lidars are used for cloud base height detection, to probe aerosol layers in the atmosphere (e.g. detection of elevated layers of Saharan dust or volcanic ash), and to examine boundary layer dynamics. Sensor optics and acquisition algorithms can strongly influence the observed attenuated backscatter profiles; therefore, physical interpretation of the profiles requires careful application of corrections. This study addresses the widely deployed Vaisala CL31 ceilometer. Attenuated backscatter profiles are studied to evaluate the impact of both the hardware generation and firmware version. In response to this work and discussion within the CL31/TOPROF user community (TOPROF, European COST Action aiming to harmonise ground-based remote sensing networks across Europe), Vaisala released new firmware (versions 1.72 and 2.03) for the CL31 sensors. These firmware versions are tested against previous versions, showing that several artificial features introduced by the data processing have been removed. Hence, it is recommended to use this recent firmware for analysing attenuated backscatter profiles. To allow for consistent processing of historic data, correction procedures have been developed that account for artefacts detected in data collected with older firmware. Furthermore, a procedure is proposed to determine and account for the instrument-related background signal from electronic and optical components. This is necessary for using attenuated backscatter observations from any CL31 ceilometer. Recommendations are made for the processing of attenuated backscatter observed with Vaisala CL31 sensors, including the estimation of noise which is not provided in the standard CL31 output. After taking these aspects into account, attenuated backscatter profiles from Vaisala CL31 ceilometers are considered capable of providing valuable information for a range of applications including atmospheric boundary layer studies, detection of elevated aerosol layers, and model verification.

The French–German Arctic research base AWIPEV (the Alfred Wegener Institute Helmholtz Centre for Polar and Marine Research – AWI – and the French Polar Institute Paul Emile Victor – PEV) at Ny-Ålesund, Svalbard, is a unique station for monitoring cloud-related processes in the Arctic. For the first time, data from a set of ground-based instruments at the AWIPEV observatory are analyzed to characterize the vertical structure of clouds. For this study, a 14-month dataset from Cloudnet combining observations from a ceilometer, a 94 GHz cloud radar, and a microwave radiometer is used. A total cloud occurrence of ∼81 %, with 44.8 % multilayer and 36 % single-layer clouds, was found. Among single-layer clouds the occurrence of liquid, ice, and mixed-phase clouds was 6.4 %, 9 %, and 20.6 %, respectively. It was found that more than 90 % of single-layer liquid and mixed-phase clouds have liquid water path (LWP) values lower than 100 and 200 g m⁻², respectively. Mean values of ice water path (IWP) for ice and mixed-phase clouds were found to be 273 and 164 g m⁻², respectively. The different types of single-layer clouds are also related to in-cloud temperature and the relative humidity under which they occur. Statistics based on observations are compared to ICOsahedral Non-hydrostatic (ICON) model output. Distinct differences in liquid-phase occurrence in observations and the model at different environmental temperatures lead to higher occurrence of pure ice clouds. A lower occurrence of mixed-phase clouds in the model at temperatures between −20 and −5 ^∘C becomes evident. The analyzed dataset is useful for satellite validation and model evaluation.

The Finnish Meteorological Institute, in collaboration with the University of Helsinki, has established a new ground-based remote-sensing network in Finland. The network consists of five topographically, ecologically and climatically different sites distributed from southern to northern Finland. The main goal of the network is to monitor air pollution and boundary layer properties in near real time, with a Doppler lidar and ceilometer at each site. In addition to these operational tasks, two sites are members of the Aerosols, Clouds and Trace gases Research InfraStructure Network (ACTRIS); a Ka band cloud radar at Sodankylä will provide cloud retrievals within CloudNet, and a multi-wavelength Raman lidar, PollyXT (POrtabLe Lidar sYstem eXTended), in Kuopio provides optical and microphysical aerosol properties through EARLINET (the European Aerosol Research Lidar Network). Three C-band weather radars are located in the Helsinki metropolitan area and are deployed for operational and research applications. We performed two inter-comparison campaigns to investigate the Doppler lidar performance, compare the backscatter signal and wind profiles, and to optimize the lidar sensitivity through adjusting the telescope focus length and data-integration time to ensure sufficient signal-to-noise ratio (SNR) in low-aerosol-content environments. In terms of statistical characterization, the wind-profile comparison showed good agreement between different lidars. Initially, there was a discrepancy in the SNR and attenuated backscatter coefficient profiles which arose from an incorrectly reported telescope focus setting from one instrument, together with the need to calibrate. After diagnosing the true telescope focus length, calculating a new attenuated backscatter coefficient profile with the new telescope function and taking into account calibration, the resulting attenuated backscatter profiles all showed good agreement with each other. It was thought that harsh Finnish winters could pose problems, but, due to the built-in heating systems, low ambient temperatures had no, or only a minor, impact on the lidar operation – including scanning-head motion. However, accumulation of snow and ice on the lens has been observed, which can lead to the formation of a water/ice layer thus attenuating the signal inconsistently. Thus, care must be taken to ensure continuous snow removal.

Commercially available Doppler lidars have now been proven to be efficient tools for studying winds and turbulence in the planetary boundary layer. However, in many cases low signal-to-noise ratio is still a limiting factor for utilising measurements by these devices. Here, we present a novel post-processing algorithm for Halo Stream Line Doppler lidars, which enables an improvement in sensitivity of a factor of 5 or more. This algorithm is based on improving the accuracy of the instrumental noise floor and it enables longer integration times or averaging of high temporal resolution data to be used to obtain signals down to −32 dB. While this algorithm does not affect the measured radial velocity, it improves the accuracy of radial velocity uncertainty estimates and consequently the accuracy of retrieved turbulent properties. Field measurements using three different Halo Doppler lidars deployed in Finland, Greece and South Africa demonstrate how the new post-processing algorithm increases data availability for turbulent retrievals in the planetary boundary layer, improves detection of high-altitude cirrus clouds and enables the observation of elevated aerosol layers.