31 October 2022 in ESS Open Archive
\justifying The atmospheric radiative transfer calculations are among the most time-consuming components of the numerical weather prediction (NWP) models. Deep learning (DL) models have recently been increasingly applied to accelerate radiative transfer modeling. Besides, a physical relationship exists between the output variables, including fluxes and heating rate profiles. Integration of such physical laws in DL models is crucial for the consistency and credibility of the DL-based parameterizations. Therefore, we propose a physics-incorporated framework for the radiative transfer DL model, in which the physical relationship between fluxes and heating rates is encoded as a layer of the network so that the energy conservation can be satisfied. It is also found that the prediction accuracy was improved with the physic-incorporated layer. In addition, we trained and compared various types of deep learning model architectures, including fully connected (FC) neural networks (NNs), convolutional-based NNs (CNNs), bidirectional recurrent-based NNs (RNNs), transformer-based NNs, and neural operator networks, respectively. The offline evaluation demonstrates that bidirectional RNNs, transformer-based NNs, and neural operator networks significantly outperform the FC NNs and CNNs due to their capability of global perception. A global perspective of an entire atmospheric column is essential and suitable for radiative transfer modeling as the changes in atmospheric components of one layer/level have both local and global impacts on radiation along the entire vertical column. Furthermore, the bidirectional RNNs achieve the best performance as they can extract information from both upward and downward directions, similar to the radiative transfer processes in the atmosphere.
18 August 2022 in ESS Open Archive
The calculations of atmospheric radiative transfer are among the most time-consuming components of the numerical weather prediction (NWP) models. Therefore, using deep learning to achieve fast radiative transfer has become a popular research direction. We propose a physics-incorporated framework for the radiative transfer model training, in which the thermal relationship between fluxes and heating rates is encoded as a layer of the network so that the energy conservation can be satisfied. Based on this framework, we compared various types of neural networks and found that the model structures with global receptive fields are more suitable for the radiative transfer problem, among which the Bi-LSTM model has the best performance.
1 August 2022 in ESS Open Archive
We attempt, for the first time, to estimate the surface carbon flux by the method of automatic differentiation. The atmospheric transport model is developed using a deep learning framework and is validated against standard approaches. Depends on the built-in automatic differentiation feature of the deep learning framework, the system derivatives/gradients are readily available without any extra effort. We then formulate the surface carbon flux estimation as an inverse problem using the variational approach, driven by back-propagated objective gradients. The feasibility of the automatic differentiation method is demonstrated in identical-twin observing system simulation experiments (OSSEs). The proposed framework shows favorable accuracy and great efficiency in both fully and partially observable scenarios. The present study establishes a link between machine learning frameworks and general data assimilation or inverse modeling problems, and the promising results encourage more investigations in incorporating machine learning techniques in inverse carbon modeling.