Zhiqiang Wan

Zhiqiang Wan

Auto-generated profile, based on publicly available information

Zhiqiang Wan

Department of Electrical, Computer and Biomedical Engineering, University of Rhode Island, Kingston, RI 02881 USA

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 November 2018 in IEEE Transactions on Smart Grid
Verified
Journal Article
Open access
ZWZhiqiang Wan
Zhiqiang Wan
HLHepeng Li
Hepeng Li
HHHaibo He
Haibo He
DPDanil Prokhorov
Danil Prokhorov
Driven by the recent advances in electric vehicle (EV) technologies, EVs become important for smart grid economy. When EVs participate in demand response program which has real-time pricing signals, the charging cost can be greatly reduced by taking full advantage of these pricing signals. However, it is challenging to determine an optimal charging strategy due to the existence of randomness in traffic conditions, user’s commuting behavior, and pricing process of the utility. Conventional model-based approaches require a model of forecast on the uncertainty and optimization for the scheduling process. In this paper, we formulate this scheduling problem as a Markov Decision Process (MDP) with unknown transition probability. A model-free approach based on deep reinforcement learning is proposed to determine the optimal strategy for this problem. The proposed approach can adaptively learn the transition probability and does not require any system model information. The architecture of the proposed approach contains two networks: a representation network to extract discriminative features from the electricity prices and a Q network to approximate the optimal action-value function. Numerous experimental results demonstrate the effectiveness of the proposed approach.

22 November 2019 in IEEE Transactions on Smart Grid
Verified
Journal Article
Closed access
HLHepeng Li
Hepeng Li
ZWZhiqiang Wan
Zhiqiang Wan
HHHaibo He
Haibo He
Electric vehicles (EVs) have been popularly adopted and deployed over the past few years because they are environment-friendly. When integrated into smart grids, EVs can operate as flexible loads or energy storage devices to participate in demand response (DR). By taking advantage of time-varying electricity prices in DR, the charging cost can be reduced by optimizing the charging/discharging schedules. However, since there exists randomness in the arrival and departure time of an EV and the electricity price, it is difficult to determine the optimal charging/discharging schedules to guarantee that the EV is fully charged upon departure. To address this issue, we formulate the EV charging/discharging scheduling problem as a constrained Markov Decision Process (CMDP). The aim is to find a constrained charging/discharging scheduling strategy to minimize the charging cost as well as guarantee the EV can be fully charged. To solve the CMDP, a model-free approach based on safe deep reinforcement learning (SDRL) is proposed. The proposed approach does not require any domain knowledge about the randomness. It directly learns to generate the constrained optimal charging/discharging schedules with a deep neural network (DNN). Unlike existing reinforcement learning (RL) or deep RL (DRL) paradigms, the proposed approach does not need to manually design a penalty term or tune a penalty coefficient. Numerical experiments with real-world electricity prices demonstrate the effectiveness of the proposed approach.

3 March 2020 in IEEE Transactions on Smart Grid
Verified
Journal Article
Closed access
HLHepeng Li
Hepeng Li
ZWZhiqiang Wan
Zhiqiang Wan
HHHaibo He
Haibo He
This paper presents a real-time demand response (DR) strategy for optimal scheduling of home appliances. The uncertainty of the resident's behavior, real-time electricity price, and outdoor temperature is considered. An efficient DR scheduling algorithm based on deep reinforcement learning (DRL) is proposed. Unlike traditional model-based approaches, the proposed approach is model-free and does not need to know the distribution of the uncertainty. Besides, unlike conventional RL-based methods, the proposed approach can handle both discrete and continuous actions to jointly optimize the schedules of different types of appliances. In the proposed approach, an approximate optimal policy based on neural network is designed to learn the optimal DR scheduling strategy. The neural network based policy can directly learn from high-dimensional sensory data of the appliance states, real-time electricity price, and outdoor temperature. A policy search algorithm based upon trust region policy optimization (TRPO) is used to train the neural network. The effectiveness of our proposed approach is validated by simulation studies where the real-world electricity price and outdoor temperature are used.

27 November 2019 in IEEE Transactions on Smart Grid
Verified
Journal Article
Closed access
FWFanrong Wei
Fanrong Wei
ZWZhiqiang Wan
Zhiqiang Wan
HHHaibo He
Haibo He
The integration of cyber-physical system increases the vulnerabilities of critical power infrastructures. Once the malicious attackers take the substation control authorities, they can trip all the transmission lines to block the power transfer. As a consequence, asynchrony will emerge between the separated regions which had been interconnected by these transmission lines. In order to recover from the attack, a straightforward way is to reclose these transmission lines once we detect the attack. However, this may cause severe impacts on the power system, such as current inrush and power swing. Therefore, it is critical to properly choose the reclosing time to mitigate these impacts. In this paper, we propose a recovery strategy to reclose the tripped transmission lines at the optimal reclosing time. In particular, a deep reinforcement learning (RL) framework is adopted to endow the strategy with the adaptability of uncertain cyber-attack scenarios and the ability of real-time decision-making. In this framework, an environment is established to simulate the power system dynamics during the attack-recovery process and generate the training data. With these data, the deep RL based strategy can be trained to determine the optimal reclosing time. Numerical results show that the proposed strategy can minimize the cyber-attack impacts under different scenarios.

20 May 2021 in IEEE Transactions on Knowledge and Data Engineering
Verified
Journal Article
Closed access
LLLusi Li
Lusi Li
ZWZhiqiang Wan
Zhiqiang Wan
HHHaibo He
Haibo He
Incomplete multi-view clustering (IMC) aims to integrate the complementary information from incomplete views to improve clustering performance. Most existing IMC methods try to fill the incomplete views or directly learn a common representation based on matrix factorization or subspace learning. The former may introduce useless even noisy information especially for data with a large missing ratio. The latter relies on the initialization and ignores the geometric structure of data. To address these issues, we propose a novel Joint Partition and Graph (JPG) learning method for IMC. Specifically, JPG jointly constructs local incomplete graph matrices, generates incomplete base partition matrices, stretches them to produce a unified partition matrix, and employs it to learn a consensus graph matrix. By this means, we transform incomplete multi-view data into a unified partition space and obtain the consensus graph in a mutual reinforcement manner. Moreover, a partition fusion strategy can allocate a large weight to the stretched base partition that is close to the unified matrix. The objective function is optimized in an alternating optimization fashion. Experimental results on several benchmark datasets demonstrate the effectiveness and superiority of JPG than the state-of-the-art baselines

15 May 2020 in IEEE Transactions on Industrial Informatics
Verified
Journal Article
Closed access
ZWZhenhua Wang
Zhenhua Wang
HHHaibo He
Haibo He
ZWZhiqiang Wan
Zhiqiang Wan
YSYan Lindsay Sun
Yan Lindsay Sun
In this paper, we investigate the coordinated topology attacks in smart grid which combine the physical topology attack and the cyber topology attack. The goal of coordinated topology attacks is to overload a critical line (different from the physical tripped line and the fake outage line) by misleading the control center into making improper dispatch. In order to determine the attack strategy, we propose a deep reinforcement learning based method to identify the physical tripped line and the fake outage line. Besides, in order to block the outage signal of the tripped line and create the fake outage signal with limited attack resources, we propose a deep reinforcement learning based approach to determine the minimal measurements to be compromised. The effectiveness of the proposed method is tested on the IEEE 30-bus and 118-bus systems.