Simultaneous state and parameter estimation is essential for control system design and dynamic modeling of physical systems. This capability provides critical real-time insight into system behavior, supports the discovery of underlying mechanisms, and facilitates adaptive control strategies. Surveyed in this review paper are two classes of state and parameter estimation methods: Kalman Filters and Luenberger Observers. The Kalman Filter framework, including its major variants such as the Extended Kalman Filter (EKF), Unscented Kalman Filter (UKF), Cubature Kalman Filter (CKF), and Ensemble Kalman Filter (EnKF), has been widely applied for joint and dual estimation in linear and nonlinear systems under uncertainty. In parallel, Luenberger observers, typically used in deterministic settings, offer alternative approaches through high-gain, sliding mode, and adaptive observer structures. This review focuses on the theoretical foundations, algorithmic developments, and application domains of these methods and provides a comparative analysis of their advantages, limitations, and practical relevance across diverse engineering scenarios.
13 May 2024 in The International Journal of Advanced Manufacturing Technology
Large language models have demonstrated impressive capabilities across various domains. However, their general-purpose nature often limits their effectiveness in specialized fields such as energy, where deep technical expertise and precise domain knowledge are essential. In this paper, we introduce EnergyGPT, a domain-specialized language model tailored for the energy sector, developed by fine-tuning the LLaMA 3.1-8B model on a high-quality, curated corpus of energy-related texts. We consider two adaptation strategies: a full-parameter Supervised Fine-Tuning variant and a parameter-efficient LoRA-based variant that updates only a small fraction of the model parameters. We present a complete development pipeline, including data collection and curation, model fine-tuning, benchmark design, LLM-judge choice and calibration, evaluation, and deployment. Through this work, we demonstrate that our training strategy enables improvements in domain relevance and performance without the need for large-scale infrastructure. By evaluating the performance of both EnergyGPT variants using domain-specific question-answering benchmarks, our results show that the adapted models consistently outperform the base model in most energy-related language understanding and generation tasks, with the LoRA variant achieving competitive gains at significantly reduced training cost.
23 May 2024 in The International Journal of Advanced Manufacturing Technology