In this paper, we propose a deep reinforcement learning (DRL) based predictive control scheme for reducing the energy consumption and energy cost of pumping systems in wastewater treatment plants (WWTP), in which the pumps are operated in a binary mode, using on/off signals. As global energy consumption increases, the efficient operation of energy-intensive facilities has also become important. A WWTP in Busan, Republic of Korea is used as the target of this study. This WWTP is a large energy-consuming facility, and the pumping station accounts for a significant portion of the energy consumption of the WWTP. The framework of the proposed scheme consists of a deep neural network (DNN) model for forecasting wastewater inflow and a DRL agent for controlling the on/off signals of the pumping system, where proximal policy optimization (PPO) and deep Q-neural network (DQN) are employed as the DRL agents. To implement smart control with DRL, a reward function is designed to consider the energy consumption amount and electricity price information. In particular, new features and penalty factors for pump switching, which are essential for preventing pump wear, are also considered. The performance of our designed DRL agents is compared with those of WWTP experts and conventional approaches such as scheduling method and model predictive control (MPC), in which integer linear programming (ILP) optimization is employed. Results show that the designed agents outperform the other approaches in terms of compliance with operating rules and reducing energy costs.
Generally, photovoltaic (PV) fault detection approaches can be divided into two groups: end-to-end and threshold methods. The end-to-end method typically uses a deep neural network (DNN) to learn fault patterns from labeled datasets, which directly detect whether faults occur or not. The threshold method first estimates power generation and uses thresholds to detect atypical deviations of measured values from estimated ones. The former method heavily relies on fault-labeled data and, therefore, requires the collection of abnormal event records, which is usually difficult, due to the sparseness of these events. The latter method typically uses statistical approaches, such as 3-sigma, to find thresholds, and it can be practically utilized without fault labels. However, setting a threshold with a proper confidence interval is still challenging, as PV power generation is sensitive to variations in environmental conditions, such as irradiance, ambient temperature, wind speed and humidity. In this paper, we propose a novel deep reinforcement learning (DRL)-based label-free fault detection scheme in which thresholds are dynamically assigned with suitable confidence intervals under varying environmental conditions. Various weather properties were used as input features (i.e., states) to a DRL agent, and proper thresholds were estimated in real time from the actions of the DRL agent. To this end, a reward function was designed for learning proper thresholds without fault labels under different weather conditions. To evaluate the performance of the proposed scheme, the PV dataset of the National Institute of Standards and Technology (NIST) was used, as it includes paired records of local weather and PV generations. The DRL-based scheme was compared with static and conventional dynamic threshold methods, based on statistical approaches. The results revealed that the proposed scheme outperformed the existing methods, providing a 5.67% higher -score in the NIST dataset.
A physical unclonable function (PUF) is broadly investigated as a secret key generator for internet-of-things (IoT) devices because of its uniqueness and randomness. Security vulnerability may occur in conventional PUF-based schemes if an attacker eavesdrops on the challenge and response pair (CRP) associated with PUF. To mitigate the impact of such key compromise, this study proposes a novel dynamic PUF key generation scheme, where the sensing data-based dynamic features are integrated to a static PUF-based key. The compressive autoencoders (AEs) typically employed for compressing the time-series data can be customized to extract data-based features. The dynamic features are quantized to generate the data-based key, and then combined with the PUF-based key for the dynamic key generation. An attacker finds it difficult to extract the PUF-based key from the synthesized ones; hence, CRPs cannot be estimated, even if the attacker can obtain the dynamic key through eavesdropping. The event signal decomposition algorithm, which disjoins the dominant event signal in the dataset, is proposed to enhance the data-based key diversity. For numerical evaluation, the static random access memory-PUF and the public energy dataset are used for the dynamic key generation. Numerical results show that the AE model can generate a data-based key that prohibits key leakage to the attacker while improving the reconstruction performance. The dynamic key is evaluated for diverse attack models (e.g., replay and modeling attacks), and the attacker cannot estimate the CRP tables.
3 December 2025 in IEEE Internet of Things Journal
In this article, we propose a novel lossless data compression framework, called Stochastic Pattern Discrete Flow (SPDFlow), designed for lightweight IoT applications. SPDFlow integrates normalizing flow models with range Asymmetric Numeral Systems (rANS) to efficiently compress high-frequency and stochastic time-series smart metering data. Building on advances in invertible flow-based distribution mapping, we design an online compression scheme optimized for electricity usage profiles sampled from tens of milliseconds to several seconds. The proposed linear and lightweight architecture enables real-time deployment on resource-constrained edge devices while maintaining robust modeling capability under unpredictable, event-driven peaks. A customized discretization strategy allows efficient encoding of wide-ranging measurement values. Comprehensive theoretical analysis and experiments across diverse datasets verify SPDFlow’s superior compression performance compared with both traditional and recent learning-based methods, achieving up to 31% data volume reduction under short update intervals. Furthermore, real-world deployment on Raspberry Pi devices confirms its practical feasibility. To the best of our knowledge, this is the first work to explore lossless compression of time-series load profiles using normalizing flows.
26 March 2026 in International Journal of Electrical Power & Energy Systems