Yue Tan

Yue Tan

Auto-generated profile, based on publicly available information

Yue Tan

Intelligent Computing and Communication (IC) Lab, Key Laboratory of Universal Wireless Communications, Ministry of Education, Beijing University of Posts and Telecommunications (BUPT), Beijing 100876, China

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 April 2020 in IEEE Communications Surveys & Tutorials
Verified
Journal Article
Closed access
LLLei Lei
Lei Lei
YTYue Tan
Yue Tan
KZKan Zheng
Kan Zheng
SLShiwen Liu
Shiwen Liu
KZKuan Zhang
Kuan Zhang
XSXuemin Shen
Xuemin Shen
The Internet of Things (IoT) extends the Internet connectivity into billions of IoT devices around the world, where the IoT devices collect and share information to reflect status of the physical world. The Autonomous Control System (ACS), on the other hand, performs control functions on the physical systems without external intervention over an extended period of time. The integration of IoT and ACS results in a new concept -autonomous IoT (AIoT). The sensors collect information on the system status, based on which the intelligent agents in the IoT devices as well as the Edge/Fog/Cloud servers make control decisions for the actuators to react. In order to achieve autonomy, a promising method is for the intelligent agents to leverage the techniques in the field of artificial intelligence, especially reinforcement learning (RL) and deep reinforcement learning (DRL) for decision making. In this paper, we first provide a tutorial of DRL, and then propose a general model for the applications of RL/DRL in AIoT. Next, a comprehensive survey of the state-of-art research on DRL for AIoT is presented, where the existing works are classified and summarized under the umbrella of the proposed general DRL model. Finally, the challenges and open issues for future research are identified.

26 November 2020
Verified
Book Chapter
Closed access
PDF file
GLGuodong Long
Guodong Long
YTYue Tan
Yue Tan
JJJing Jiang
Jing Jiang
CZChengqi Zhang
Chengqi Zhang

2 December 2020 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
LLLei Lei
Lei Lei
YTYue Tan
Yue Tan
GDGlenn Dahlenburg
Glenn Dahlenburg
Wei XiangWei Xiang
Wei Xiang
KZKan Zheng
Kan Zheng
Microgrids (MGs) are small, local power grids that can operate independently from the larger utility grid. Combined with the Internet of Things (IoT), a smart MG can leverage the sensory data and machine learning techniques for intelligent energy management. This paper focuses on deep reinforcement learning (DRL)-based energy dispatch for IoT-driven smart isolated MGs with diesel generators (DGs), photovoltaic (PV) panels, and a battery. A finite-horizon Partial Observable Markov Decision Process (POMDP) model is formulated and solved by learning from historical data to capture the uncertainty in future electricity consumption and renewable power generation. In order to deal with the instability problem of DRL algorithms and unique characteristics of finite-horizon models, two novel DRL algorithms, namely, finite-horizon deep deterministic policy gradient (FH-DDPG) and finite-horizon recurrent deterministic policy gradient (FH-RDPG), are proposed to derive energy dispatch policies with and without fully observable state information. A case study using real isolated MG data is performed, where the performance of the proposed algorithms are compared with the other baseline DRL and non-DRL algorithms. Moreover, the impact of uncertainties on MG performance is decoupled into two levels and evaluated respectively.

20 April 2016
Verified
Book Chapter
Closed access
PDF file
XWXu Wang
Xu Wang
WLWei Liu
Wei Liu
YZYujia Zhang
Yujia Zhang
YTYue Tan
Yue Tan
FLFeijing Liu
Feijing Liu