The rapid growth of renewable energy and increasing electricity demand pose challenges to the reliability and flexibility of traditional distribution networks. To address these issues, the construction of AC/DC hybrid distribution networks (AC/DC-HDNs) based on existing AC grids has become a promising solution. However, planning the expansion of such networks faces challenges like complex device and line topologies, dynamic fluctuations in distributed generation (DG) and load, and high power electronics costs. This paper proposes a time- and space-integrated expansion planning method for AC/DC-HDNs. The approach builds a distribution grid model based on graph theory, integrating the spatial layouts of AC distribution lines, DGs, main grids, and loads, while capturing dynamic load and renewable energy generation characteristics through time-series analysis. A modified graph attention network (MGAT)-based deep reinforcement learning (DRL) algorithm is used for optimization, balancing economic and reliability objectives. The simulation results show that the modified algorithm outperforms traditional algorithm in terms of both training efficiency and stability, with a faster convergence and lower fluctuation in cumulative rewards. Additionally, the proposed algorithm consistently achieves higher cumulative rewards, demonstrating its effectiveness in optimizing the expansion planning of AC/DC-HDNs.
Due to the radial network structures, small cross-sectional lines, and light loads characteristic of existing AC distribution networks in mountainous areas, the development of active distribution networks (ADNs) in these regions has revealed significant issues with integrating distributed generation (DGs) and consuming renewable energy. Focusing on this issue, this paper proposes a wide-range thyristor-controlled series compensation (TCSC)-based ADN and presents a deep reinforcement learning (DRL)-based optimal operation strategy. This strategy takes into account the complementarity of hydropower, photovoltaic (PV) systems, and energy storage systems (ESSs) to enhance the capacity for consuming renewable energy. In the proposed ADN, a wide-range TCSC connects the sub-networks where PV and hydropower systems are located, with ESSs configured for each renewable energy generation. The designed wide-range TCSC allows for power reversal and improves power delivery efficiency, providing conditions for the optimization operation. The optimal operation issue is formulated as a Markov decision process (MDP) with continuous action space and solved using the twin delayed deep deterministic policy gradient (TD3) algorithm. The optimal objective is to maximize the consumption of renewable energy sources (RESs) and minimize line losses by coordinating the charging/discharging of ESSs with the operation mode of the TCSC. The simulation results demonstrate the effectiveness of the proposed method.