14 December 2022 in Engineering Applications of Artificial Intelligence
27 December 2025 in International Journal of Pioneering Technology and Engineering
For industrial enterprises, effective energy trading in intraday markets is vital for cost reduction but challenging due to market volatility and the complexity of decision-making. This study proposes a novel integrated energy trading framework utilizing Deep Reinforcement Learning (DRL) to automate and optimize trading strategies in the Intraday Market (IDM). Unlike conventional rule-based or purely simulation-driven RL models, the proposed framework employs a state-augmented Markov Decision Process (MDP) formulation that integrates exogenous System Marginal Price (SMP) interval forecasts directly into the agent’s observation space. Specifically, a Deep Q-Network (DQN) architecture augmented with Prioritized Experience Replay (PER) is developed to handle the high volatility and continuous state space of energy markets, overcoming the limitations of traditional tabular Q-learning. To enhance the agent's decision-making capabilities, a hybrid forecasting mechanism employing LightGBM and CatBoost algorithms is integrated to predict SMP. The proposed system was validated using real-world data from Energy Exchange Istanbul (EXIST). The results demonstrate that the DRL-based agent achieved approximately $1 savings per MWh and reduced monthly operational labor costs by over $6,000 compared to rule-based strategies, achieving a ~158% performance improvement over discrete-state Q-table baselines and proving its efficacy in minimizing energy costs and managing imbalances.
24 December 2024 in International Journal of Pioneering Technology and Engineering
There is a trend towards increasing the use of renewable energy resources worldwide. In addition to countries' efforts to increase this with the help of laws, the industry is also trying to expand the use of RE since the vast majority of the emissions are produced by the industry. Although Türkiye has rich renewable energy resources, these resources cannot yet be used effectively. Renewable energy certificate is one of the latest methods to reduce greenhouse gas emissions with the help of market mechanisms. Although renewable energy certificate is a very incipient concept for Türkiye, it has a significant potential to encourage and promote the usage and investments of renewable energy. In this study, current trends, and future expectations regarding renewable energy certificate in Türkiye have been compiled in line with the opinions of renewable energy certification experts from sector. It is thought that such analysis will be a guide for the sector and lawmakers on this subject. It is expected that the increase in academic discussions on market-based carbon emission reduction approaches will both contribute to the awareness of industry and the success of policies of national certification institutions. In this way, the payments made by industrialists in Türkiye to certification institutions abroad can be prevented from increasing at a level that would affect the current account deficit in the long term.