Ximing Wang

Mr. Ximing Wang


Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 November 2019 in IEEE Access
Verified
Journal Article
Open access
SLSongyi Liu
Songyi Liu
YXYifan Xu
Yifan Xu
XCXueqiang Chen
Xueqiang Chen
XWXiming Wang
Ximing Wang
MWMeng Wang
Meng Wang
YXYuhua Xu
Yuhua Xu
This paper investigates the problem of anti-jamming communication in dynamic and intelligent jamming environment. A sequential deep reinforcement learning algorithm (SDRLA) without prior information is proposed, and raw spectrum information is used as the input of SDRLA. The proposed SDRLA algorithm mainly contains two parts: Firstly, deep learning and sliding window principle are introduced to identify jamming patterns; Secondly, reinforcement learning is carried out to make on-line channel selection based on recognized jamming patterns. In addition, channel switching cost is introduced for the purpose of formulating the trade-off relationship between throughput and overhead. Taking advantage of both deep learning and reinforcement learning, this method can realize rapid and effective anti-jamming channel selection with no need for modeling the jammer's characteristics. Simulation results show the convergence and effectiveness of the proposed SDRLA algorithm. Compared with single-mode reinforcement learning, our approach can reach better convergence performance and higher utility.

1 June 2020 in IEEE Wireless Communications Letters
Verified
Journal Article
Closed access
YLYangyang Li
Yangyang Li
YXYuhua Xu
Yuhua Xu
YXYitao Xu
Yitao Xu
XLXin Liu
Xin Liu
XWXiming Wang
Ximing Wang
AAAlagan Anpalagan
Alagan Anpalagan
In this letter, the frequency selection problem in jamming environment with large number of optional frequencies is investigated. With numerous optional actions in the wider frequency band scenario, most of existing anti-jamming methods will become ineffective, since the convergence time and computational complexity will grow exponentially with the number of actions. To cope with the above challenge, a novel hierarchical deep reinforcement learning algorithm which does not need to know the jamming patterns and channel model is proposed. The proposed algorithm divides the frequency selection problem in the broadband into two steps via two subnetworks: Firstly, the frequency band is selected by the band selection network, and then the specific frequency is selected in this frequency band by the frequency selection network. Simulation results show that the proposed algorithm avoids multiple different jammings effectively and achieves satisfactory throughput with less calculation.

20 August 2020 in IEEE Transactions on Vehicular Technology
Verified
Journal Article
Closed access
YXYifan Xu
Yifan Xu
YXYuhua Xu
Yuhua Xu
XDXu Dong
Xu Dong
GRGuochun Ren
Guochun Ren
JCJin Chen
Jin Chen
LRLang Ruan
Lang Ruan
This paper mainly investigates the multi-user anti-jamming spectrum access problem. Using the idea of "converting harm into benefit", the malicious jamming signals projected by the enemy are utilized by the users as the coordination signals to guide spectrum coordination. An "internal coordination-external confrontation" multi-user anti-jamming access game model is constructed, and the existence of Nash equilibrium (NE) as well as correlated equilibrium (CE) is demonstrated. A coordination-learning based anti-jamming spectrum access algorithm (CLASA) is designed to achieve the CE of the game. Simulation results show the convergence and effectiveness of the proposed CLASA algorithm, and indicate that our approach can help users confront the malicious jammer and coordinate internal spectrum access simultaneously without information exchange. Last but not least, the fairness of the proposed approach under different jamming attack patterns is analyzed, which illustrates that this approach provides fair anti-jamming spectrum access opportunities under complicated jamming pattern.

18 May 2021 in IEEE Wireless Communications Letters
Verified
Journal Article
Closed access
HHHao Han
Hao Han
XWXiming Wang
Ximing Wang
FGFanglin Gu
Fanglin Gu
WLWen Li
Wen Li
YCYuan Cai
Yuan Cai
YXYuhua Xu
Yuhua Xu
This letter studies the problem of anti-jamming spectrum access in dynamic and unknown environments with incomplete spectrum sensing information. Most existing studies were based on the assumption that users have perfect spectrum information, thus they worked poorly with incomplete sensing information. To overcome the shortcoming, we present a robust intelligent anti-jamming spectrum access scheme which includes spectrum sensing, completion, learning and access. To complete the missing spectrum data, we design a generative adversarial network (GAN) based spectrum completion network. Based on deep reinforcement learning (DRL), a channel selection network is introduced to choose effective anti-jamming channel access policy. Simulation results show that the proposed approach is able to avoid complex jamming attacks effectively and outperforms conventional DRL-based approach with incomplete spectrum information.

1 October 2018
Verified
Conference Paper
Closed access
LKLijun Kong
Lijun Kong
YXYuhua Xu
Yuhua Xu
YZYuli Zhang
Yuli Zhang
XPXufang Pei
Xufang Pei
MKMingxing Ke
Mingxing Ke
ZFZhibin Feng
Zhibin Feng
In this article, we study the problem of anti-jamming through channel selection in fading environment. Different from the most existing works which ignored the fading characteristic of the channels, we use a Markov channel model to capture the influence of variable channel transmission rate in fading environment. Then, we model the anti-jamming channel selection problem as a Markov decision process. On this basis, an online reinforcement learning algorithm (Q-learning) is proposed to select the optimal channel intelligently. Simulation results show that the proposed algorithm outperforms the sensing algorithm. The reason is that it can learn both the pattern of jamming signal and the condition of channel, so as to select the channel with better condition for data transmission. Based on the proposed algorithm, we develop a real-life dynamic spectrum anti-jamming testbed based on the USRP platform in the indoor environment to demonstrate the effectiveness of the algorithm.

12 May 2020 in IEEE Access
Verified
Journal Article
Open access
XWXiming Wang
Ximing Wang
YXYuhua Xu
Yuhua Xu
CCChaohui Chen
Chaohui Chen
XYXiaoqin Yang
Xiaoqin Yang
JCJiaxin Chen
Jiaxin Chen
RCRunfeng Chen
Runfeng Chen
The unmanned swarm system (USS) has been seen as a promising technology, and will play an extremely important role in both the military and civilian fields such as military strikes, disaster relief and transportation business. As the “nerve center” of USS, the unmanned swarm communication system (USCS) provides the necessary information transmission medium so as to ensure the system stability and mission implementation. However, challenges caused by multiple tasks, distributed collaboration, high dynamics, ultra-dense and jamming threat make it hard for USCS to manage limited spectrum resources. To tackle with such problems, the machine learning (ML) empowered intelligent spectrum management technique is introduced in this paper. First, based on the challenges of the spectrum resource management in USCS, the requirement of spectrum sharing is analyzed from the perspective of spectrum collaboration and spectrum confrontation. We found that suitable multi-agent collaborative decision making is promising to realize effective spectrum sharing in both two perspectives. Therefore, a multi-agent learning framework is proposed which contains mobile-computing-assisted and distributed structures. Based on the framework, we provide case studies. Finally, future research directions are discussed.