Recent years have witnessed a growth in mathematics for deep learning—which seeks a deeper understanding of the concepts of deep learning with mathematics and explores how to make it more robust—and deep learning for mathematics, where deep learning algorithms are used to solve problems in mathematics. The latter has popularised the field of scientific machine learning where deep learning is applied to problems in scientific computing. Specifically, more and more neural network (NN) architectures have been developed to solve specific classes of partial differential equations (PDEs). Such methods exploit properties that are inherent to PDEs and thus solve the PDEs better than standard feed-forward NNs, recurrent NNs, or convolutional neural networks. This has had a great impact in the area of mathematical modelling where parametric PDEs are widely used to model most natural and physical processes arising in science and engineering. In this work, we review such methods as well as their extensions for parametric studies and for solving the related inverse problems. We also show their relevance in various industrial applications.
Electrical impedance tomography (EIT) is a powerful imaging technique with diverse applications, e. g., medical diagnosis, industrial monitoring, and environmental studies. The EIT inverse problem is about inferring the internal conductivity distribution of an object from measurements taken on its boundary. It is severely ill-posed, necessitating advanced computational methods for accurate image reconstructions. Recent years have witnessed significant progress, driven by innovations in analytic-based approaches and deep learning. This review comprehensively explores techniques for solving the EIT inverse problem, focusing on the interplay between contemporary deep learning-based strategies and classical analytic-based methods. Four state of the art deep learning algorithms are rigorously examined, including the deep D-bar method, deep direct sampling method, fully connected U-net, and convolutional neural networks, harnessing the representational capabilities of deep neural networks to reconstruct intricate conductivity distributions. In parallel, two analytic-based methods, i. e., sparsity regularization and the D-bar method, rooted in mathematical formulations and regularization techniques, are dissected for their strengths and limitations. These methodologies are evaluated through an extensive array of numerical experiments, encompassing diverse scenarios that reflect real-world complexities. A suite of performance metrics is employed to assess the efficacy of these methods. These metrics collectively provide a nuanced understanding of the methods’ ability to capture essential features and delineate complex conductivity patterns. One novel feature of the study is the incorporation of variable conductivity scenarios, introducing a level of heterogeneity that mimics textured inclusions. This departure from uniform conductivity assumptions mimics realistic scenarios, where tissues or materials exhibit spatially varying electrical properties. Exploring how each method responds to such variable conductivity scenarios opens avenues for understanding their robustness and adaptability.
Maintaining a balance between electricity generation and consumption is vital for ensuring grid stability and preventing disruptions. Spatial load forecasting (SLF) predicts geographical electricity demand, thereby aiding in power system planning. However, conventional methods like multiple linear regression and autoregressive integrated moving average struggle to capture the complex spatiotemporal patterns in historical data. Advanced methods like spatiotemporal graph transformers, graph convolutional networks, and improved scale-limited dynamic time warping better capture these dependencies, thereby enhancing prediction accuracy. Despite the advancements, challenges persist, particularly in developing economies with limited reliable data. This paper presents a novel SLF approach that divides the grid into predefined clusters based on regional characteristics and economic activity. For each cluster, a customized long short-term memory (LSTM) model captures unique spatiotemporal dependencies for more accurate predictions. The proposed method was tested across five load clusters using real-world data from Cameroon’s National Electricity Transmission Company and Energy Utilities. The results, compared against a linear regression model, demonstrated the superior performance of the LSTM approach across metrics like the mean absolute percentage error, root-mean-square error, mean absolute error, and R2 score. This approach highlights the potential for enhanced, localized load forecasting in regions with data constraints.
16 August 2024 in GEM - International Journal on Geomathematics
Classical physical modeling with associated numerical simulation (model-based), and prognostic methods based on the analysis of large amounts of data (data-driven) are the two most common methods used for the mapping of complex physical processes. In recent years, the efficient combination of these approaches has become increasingly important. Continuum mechanics in the core consists of conservation equations that-in addition to the always-necessary specification of the process conditions-can be supplemented by phenomenological material models. The latter are an idealized image of the specific material behavior that can be determined experimentally, empirically, and based on a wealth of expert knowledge. The more complex the material, the more difficult the calibration is. This situation forms the starting point for this work’s hybrid data-driven and model-based approach for mapping a complex physical process in continuum mechanics. Specifically, we use data generated from a classical physical model by the MESHFREE software (MESHFREE Team in Fraunhofer ITWM & SCAI: MESHFREE. https://www.meshfree.eu, 2023) to train a Principal Component Analysis-based neural network (PCA-NN) for the task of parameter identification of the material model parameters. The obtained results highlight the potential of deep-learning-based hybrid models for determining parameters, which are the key to characterizing materials occurring naturally such as sand, soil, mud, or snow. The motivation for our research is the simulation of the interaction of vehicles with sand. However, the applicability of the presented methodology is not limited to this industrial use case. In geosciences, when predicting the runout zones of landslides or avalanches and evaluating corresponding protective measures, the parameterization of the respective material model is essential.
A reliable power supply has long been identified as an important economic growth parameter. Electricity load forecasts predict the future behavior of the electricity load. Carrying out a forecast is important for real-time dispatching of power, grid maintenance scheduling, grid expansion planning, and generation planning depending on the forecasting horizon. Most of the methods used in long-term load forecasting are regressions and are limited to predicting peak loads of a yearly or monthly resolution with low accuracy. In this paper, we propose a method based on long short-term memory-recurrent neural networks (LSTM-RNN) cells with relations between identified influential econometric load-driving parameters which includes: the Gross Domestic Product (GDP), Population (H), and past Electric Load Data. To the best of our knowledge, the use of the GDP and H as two additional independent variables in load forecast modelling using machine learning techniques is a novelty in Cameroon. A comparison was performed between a linear regression (LR)-based long-term load forecast model (a model currently used by the Transmission System Operator of Cameroon) and LSTM-RNNs model constructed. The results generated were evaluated using a Mean Absolute Percentage Error (MAPE) within the same period of evaluation, and the overall value of the MAPE obtained for LSTM-RNNs model was 5.4962 whereas that for the LR model was 7.5422. Based on these results, the LSTM-RNN model is considered highly accurate and competent. The model was used to generate a forecast for the period of 2022–2026 with an hourly resolution. A MAPE of 5.4962 was obtained with a computational time of approximately ten minutes, making the model vital for offline use by utilities due to its capacity to quantitatively and accurately predict long-term load with an hourly resolution.