15 April 2024 in IEEE Access
In this paper, we propose methods for the diagnosis of down conductor cables installed inside blades for the reliable operation of wind turbines. Utilizing the two synchronized drones equipped with X-ray devices to take X-ray images inside the blades, we propose deep learning methods for diagnosis based on X-ray images. The first method is the unsupervised deblurring method for blurry X-ray images that are generated by the drones. The key idea of the proposed method is to apply an image sharpening process to the latent space of the trained model using only blurry X-ray images. Through experiments using the X-ray images of blades, we show that the proposed method makes the outline of the down conductor cable clearer. As the second method, we propose an object detection-based method to provide fast and accurate object detection as the diagnosis. Given an X-ray image, we also propose a method to determine drone flight direction to enable drones to follow the down conductor cable. Through experiments, we show that our method has good performance in object detection (i.e., mAP of 98.21%) and classification (i.e., AUC of 0.9), and drone flight direction determination (i.e., AUC of 0.99).
24 October 2025 in IEEE Transactions on Instrumentation and Measurement
Accurate prediction of Remaining Useful Life (RUL) is critical for effective prognostics and health management (PHM) in industrial systems. However, existing data-driven methods often require large amounts of high-quality data and lack interpretability, limiting their applicability in real-world scenarios. In practice, widely used synthetic benchmark datasets such as CMAPSS and N-CMAPSS are themselves noisy due to sensor drift and mode switching, and limited in the number of available run-to-failure trajectories. In this study, we propose ST-KDFormer (Spatio-Temporal Koopman Dual-branch Transformer), a novel architecture that integrates Koopman operator theory with deep learning to address these challenges. ST-KDFormer employs separate Koopman Autoencoders (KAEs) to learn linearized latent representations of temporal and spatial system dynamics. These embeddings are jointly processed through a dual-branch Transformer encoder to capture contextual dependencies within and across temporal windows and sensor dimensions. To enable efficient end-to-end training, we introduce a unified loss function with adaptive weighting to balance embedding and RUL prediction objectives. We evaluate our approach on the CMAPSS and N-CMAPSS benchmark datasets through extensive experiments, including ablation studies and comparisons with state-of-the-art methods. The results demonstrate that ST-KDFormer achieves superior performance in terms of prediction accuracy and robustness across varying operational conditions, validating its effectiveness for practical RUL estimation tasks.
25 February 2020 in IET Renewable Power Generation
In this study, the authors are interested in estimating how much a PV system underperforms than expected by exploiting forecast uncertainty. For this, they first study a forecast accuracy‐related forecast uncertainty metric using the ensemble method based on the dropout technique, which is widely used in deep learning forecasting models. Given the forecast accuracy‐related uncertainty metric, the rationale of the authors' approach is that forecast accuracy is likely to decrease compared to the normal case of similar uncertainty metric values if any performance degradation happens. It is because similar uncertainty metric values are likely to show similar forecast accuracy. Therefore, they generate a standard table by simulating possible performance degradation cases and conduct the performance degradation diagnosis by looking up the standard table based on the uncertainty metric. From the experiments, in the case of persistent degradation, they show that their approach estimates the performance degradation with the estimation error of around 1% while an uncertainty‐unaware approach shows the estimation error of up to 5%. In the case of temporal degradation, their approach shows the estimation error of around 3%, while the uncertainty‐unaware approach does not show meaningful result.
16 April 2026 in IEEE Access
Maintenance and operation of critical energy infrastructure require extreme precision and strict adherence to safety protocols to prevent catastrophic failures. While recent advancements in general-purpose Vision-Language-Action (VLA) foundation models have shown promise in robotics, their inherent stochasticity and lack of procedural precision often result in unacceptable safety risks in high-stakes industrial environments. To address these limitations, this paper proposes a novel Hierarchical Multi-Robot Orchestration Framework designed for the coordinated control of heterogeneous robots in energy facility maintenance. The proposed framework decouples high-level cognitive reasoning from low-level execution by utilizing a local Large Language Model (LLM) as a strategic orchestrator. Grounded in a Structured Environmental Representation (M), the LLM employs Chain-of-Thought (CoT) reasoning to decompose complex maintenance missions into verifiable sub-tasks, effectively bridging the gap between linguistic intent and physical constraints. These tasks are then dispatched to specialized execution modules: a manipulation unit utilizing Action Chunking with Transformers (ACT) adapted for high-precision industrial tasks, an autonomous navigation unit for Simultaneous Localization and Mapping (SLAM)-based pathfinding, and a vision-guided logistics unit for retrieval. Experimental evaluations in a simulated power plant environment validate the efficacy of the framework. A comparative ablation study demonstrates that utilizing structured environmental grounding significantly enhances the reasoning reliability of large-scale models compared to unstructured text baselines. Specifically, the GPT-OSS (20B) model achieved a peak planning success rate of 91.7%, with a notable proficiency in handling long-horizon Strategic commands (73.3%), validating that structural clarity is essential for complex causal inference. Furthermore, the integrated execution layer demonstrated exceptional reliability, achieving a 90% success rate specifically in distribution panel maintenance tasks, confirming that the hierarchical decoupling of probabilistic reasoning and deterministic execution provides a reliable solution for autonomous maintenance.