Linfang Yan

Linfang Yan

Auto-generated profile, based on publicly available information

Linfang Yan

State Grid (Suzhou) City and Energy Research Institute, Suzhou, Jiangsu 215163, China

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 July 2021 in IEEE Transactions on Smart Grid
Verified
Journal Article
Closed access
LYLinfang Yan
Linfang Yan
XCXia Chen
Xia Chen
JZJianyu Zhou
Jianyu Zhou
YCYin Chen
Yin Chen
JWJinyu Wen
Jinyu Wen
This paper aims to crack the individual EV charging scheduling problem considering the dynamic user behaviors and the electricity price. The uncertainty of the EV charging demand is described by several factors, including the driver’s experience, the charging preference and the charging locations for realistic scenarios. An aggregate anxiety concept is introduced to characterize both the driver’s anxiety on the EV’s range and uncertain events. A mathematical model is also provided to describe the anxiety quantitatively. The problem is formulated as a Markov Decision Process (MDP) with an unknown state transition function. The objective is to find the optimal sequential charging decisions that can balance the charging cost and driver’s anxiety. A model-free deep reinforcement learning (DRL) based approach is developed to learn the optimal charging control strategy by interacting with the dynamic environment. The continuous soft actor-critic (SAC) framework is applied to design the learning method, which contains a supervised learning (SL) stage and a reinforcement learning (RL) stage. Finally, simulation studies verify the effectiveness of the proposed approach under dynamic user behaviors at different charging locations.

18 February 2022 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
LYLinfang Yan
Linfang Yan
XCXia Chen
Xia Chen
YCYin Chen
Yin Chen
JWJinyu Wen
Jinyu Wen
The growth of electric vehicles (EVs) significantly increases the residential electricity demand and potentially leads to the overload of the transformer in the distribution grid. Aiming to coordinate the charging control of EVs, this article formulates the EVs charging problem as a Markov game with an unknown transition function and proposes a cooperative charging control strategy based on the multiagent deep reinforcement learning. The uncertainties from the dynamic electricity price, non-EV residential load consumption and drivers’ individual behaviors are considered to construct the dynamic charging environment. Each agent contains a collective-policy model and an independent learner. The collective-policy model is introduced to model other agent's behaviors by approximating their power consumption. The independent learner is used to learn the optimal charging strategy by interacting with the environment. The soft-actor-critic framework is adopted to train the independent learner, enabling the proposed method to address the continuous state and action. Agents are trained with only the local observation and approximation, indicating that the proposed approach is fully decentralized and scalable to the problem with multiple agents. Finally, several numerical studies constructed based on the real-world data demonstrate the effectiveness and scalability of the proposed approach.

8 June 2022 in IEEE Transactions on Smart Grid
Verified
Journal Article
Closed access
LYLinfang Yan
Linfang Yan
XCXia Chen
Xia Chen
YCYin Chen
Yin Chen
JWJinyu Wen
Jinyu Wen
The uncertainties from the distributed energy resources (DERs) and the prosumer’s heterogeneous characteristics bring great challenges to the operation of the community energy market. In this paper, the real-time energy sharing and management in the community market are decomposed into two-layered sub-problems: the household appliance scheduling problem and the internal energy trading pricing problem. A hierarchical deep reinforcement learning (HDRL) based scheme is proposed for the community energy trading with multiple households, containing a two-stage learning process. In the inner stage, a multi-agent deep reinforcement learning (MADRL) based approach is developed to learn the real-time appliances scheduling policy based on the local observations and given internal electricity price in a decentralized way. In the outer stage, a deep reinforcement learning (DRL) based pricing approach is proposed to determine the real-time internal electricity prices based on the participants’ historical net power and external energy supplier’s electricity prices. The scheduling policy and households’ state are not required in the pricing process. Finally, the simulations with real-world datasets demonstrate that the internal energy trading can significantly reduce the prosumers’ daily cost and the control performance of the proposed scheme is superior to the existing studies.

11 November 2022 in IEEE Transactions on Power Systems
Verified
Journal Article
Closed access
QYQiufan Yang
Qiufan Yang
LYLinfang Yan
Linfang Yan
XCXia Chen
Xia Chen
YCYin Chen
Yin Chen
JWJinyu Wen
Jinyu Wen
The virtual synchronous generator (VSG) control method for energy storage is a promising way to improve the frequency stability of the power system with large-scale renewable energy. However, due to the mismatch parameters, power oscillations may occur when multiple VSGs are connected in parallel to the grid. In this paper, the relationship between oscillation and the inertia-droop parameters distribution of multiple paralleled VSGs is derived by the simplified frequency response model. Furthermore, to coordinate the inertia-droop parameters of paralleled VSGs for oscillation damping, this paper formulates the parameter tuning problem as a Markov game with an unknown transition function and proposes a distributed dynamic inertia-droop control strategy based on multi-agent deep reinforcement learning (MADRL). Based on the local and adjacent VSG information, each agent learns the optimal inertia-droop control parameters independently by interacting with the environment. The soft-actor-critic (SAC) framework is introduced to train each agent. The well-trained agent can modify the parameters of VSG dynamically to suppress the power oscillation under different operating conditions. Finally, several time-domain results demonstrate the effectiveness and robustness of the proposed approach.

10 November 2022 in IEEE Access
Verified
Journal Article
Open access
DLDan Liu
Dan Liu
KJKezheng Jiang
Kezheng Jiang
LYLinfang Yan
Linfang Yan
XJXiaotong Ji
Xiaotong Ji
KCKan Cao
Kan Cao
PXPing Xiong
Ping Xiong
Uncertainties of intermittent renewables and complexities of load demands bring challenges to the optimal operation of the microgrid. This paper proposes a fully distributed method based on consensus algorithm for solving the economic dispatch problem (EDP) of DC microgrid. The proposed distributed method is performed using multiagent system. It only needs information from neighboring agents and does not need a central controller. A two-level control structure is adopted to realize the economic dispatch and voltage regulation simultaneously. The upper level obtains the optimal power reference of dispatchable agents and maintains the power balance of the system. The lower level performs an improved droop control to track the power reference and regulate the average bus voltage for the microgrid. The proposed method’s properties and convergence are analyzed using eigenvalue perturbation theory to obtain a faster convergence speed. By designing the adjacency matrix appropriately, the proposed method can ensure the system stable when the communication topology changes. Finally, several simulations are designed to verify the effectiveness of this novel control method.

13 December 2023 in IEEE Transactions on Consumer Electronics
Verified
Journal Article
Closed access
JHJingyi He
Jingyi He
JWJiabao Wen
Jiabao Wen
LYLinfang Yan
Linfang Yan
MXMeng Xi
Meng Xi
Shuai XiaoShuai Xiao
Shuai Xiao
Jiachen YangJiachen Yang
Jiachen Yang
In recent years, with the expanding scope of the Intelligent Cyber-Physical Transportation Systems (ICTS), Autonomous Underwater Vehicle (AUV) has also become a hot product in this field that consumers are paying attention to. Consumer-level AUVs have a broad consumer market for underwater detection and search and rescue due to their small size, autonomy, flexibility, and long endurance. The formation of multiple AUVs can complete more diverse and complex tasks. However, consumers can only communicate with AUVs when they float to the surface, which poses a tough challenge to AUV’s formation control. This paper proposes an AUV On-board Control Scheme (AUV-OCS) based on multi-agent reinforcement learning and cloud computing technology to serve consumer-level AUVs, in which the local perception information preprocessed by each AUV is uploaded to the cloud center for data fusion in real-time and a centralized value function is designed to optimize the global decision. The experimental results show that the proposed AUV-OCS can effectively control the AUV cluster to complete underwater task in a predetermined formation for consumers with an average task success rate of 97.4%, and has a certain collision avoidance ability.