In microgrids, energy management systems (EMS) have been considered essential systems to optimize energy scheduling, control and operation for reliable power systems. Conventional EMS researches have been predominantly performed by employing demand-side management and demand response (DR). Nonetheless, multi-action control in EMS is confronted with operational challenges in terms of the profitability and stability. In this paper, energy information systems (EIS), energy storage systems (ESS), energy trading risk management systems (ETRMS), and automatic DR (ADR) are integrated to efficiently manage the profitability and stability of the whole EMS by optimal energy scheduling. The proposed microgrid EMS architecture is optimized by using proximal policy optimization (PPO) algorithm, which has been known to have good performance in terms of learning stability and complexity. A novel performance metric, represented as a burden of load and generation (BoLG), is proposed to evaluate the energy management performance. The BoLG is incorporated into the reward settings for optimizing the management of multi-action controls such as load shifting, energy charging-discharging, and transactions. From the simulation results, it is confirmed that the proposed architecture can improve energy management performance with the proper trade-off between stability and profitability, compared to dynamic programming (DP)-based and double deep Q-network (DDQN)-based operation.

Energy management systems (EMSs) are regarded as essential components within smart grids. In pursuit of efficiency, reliability, stability, and sustainability, an integrated EMS empowered by machine learning (ML) has been addressed as a promising solution. A comprehensive review of current literature and trends has been conducted with a focus on key areas, such as distributed energy resources, energy management information systems, energy storage systems, energy trading risk management systems, demand-side management systems, grid automation, and self-healing systems. The application of ML in EMS is discussed, highlighting enhancements in data analytics, improvements in system stability, facilitation of efficient energy distribution and optimization of energy flow. Moreover, architectural frameworks, operational constraints, and challenging issues in ML-based EMS are explored by focusing on its effectiveness, efficiency, and suitability. This paper is intended to provide valuable insights into the future of EMS.

In this letter, to improve data rate over wireless communication channels, we propose a deep Q network (DQN)-based adaptive modulation scheme by using Markov decision process (MDP) model. The proposed algorithm makes the reinforcement learning agent to select rate region boundaries as the states, which divide signal-to-noise ratio (SNR) range into rate regions. The simulation results show that spectral efficiency can be improved on the average by 0.5395 bps/Hz in wide SNR range.

The transition to smart grids has served to transform traditional power systems into data-driven power systems. The purpose of this transition is to enable effective energy management and system reliability through an analysis that is centered on energy information. However, energy theft caused by vulnerabilities in the data collected from smart meters is emerging as a primary threat to the stability and profitability of power systems. Therefore, various methodologies have been proposed for energy theft detection (ETD), but many of them are challenging to use effectively due to the limitations of energy theft datasets. This paper provides a comprehensive review of ETD methods, highlighting the limitations of current datasets and technical approaches to improve training datasets and the ETD in smart grids. Furthermore, future research directions and open issues from the perspective of generative AI-based ETD are discussed, and the potential of generative AI in addressing dataset limitations and enhancing ETD robustness is emphasized.

In this paper, a deep learning-based successive interference cancellation (SIC) scheme for use in nonorthogonal multiple access (NOMA) communication systems is investigated. NOMA has become a notable technique in the field of mobile wireless communication because of its capacity to overcome orthogonality, unlike a conventional orthogonal frequency division multiple access (OFDMA) communication system. In NOMA communication systems, SIC is one of the decoding schemes applied at receivers for downlink NOMA transmissions. In this paper, a convolutional neural network (CNN)-based SIC scheme is proposed to improve performance of the single base station and multiuser NOMA scheme. In contrast to existing SIC schemes, the proposed CNN-based SIC scheme can effectively mitigate losses resulting from imperfections of the SIC. The simulation results indicate that the CNN-based SIC method can successfully relieve conventional SIC impairments and achieve good detection performance. Consequently, a CNN-based SIC scheme can be considered as a potential technique for use in NOMA detection schemes.

One of the problems of the electricity grid system is electricity loss due to energy theft, which is known as non-technical loss (NTL). The sustainability and stability of the grid system are threatened by the unexpected electricity losses. Energy theft detection based on data analysis is one of the solutions to alleviate the drawbacks of NTL. The main problem of data-based NTL detection is that collected electricity usage dataset is imbalanced. In this paper, we approach the NTL detection problem using deep reinforcement learning (DRL) to solve the data imbalanced problem of NTL. The advantage of the proposed method is that the classification method is adopted to use the partial input features without pre-processing method for input feature selection. Moreover, extra pre-processing steps to balance the dataset are unnecessary to detect NTL compared to the conventional NTL detection algorithms. From the simulation results, the proposed method provides better performances compared to the conventional algorithms under various simulation environments.