12 March 2018 in IEEE Communications Letters
This letter investigates the problem of anti-jamming communications in dynamic and intelligent jamming environment through machine learning. Different from existing studies which need to know (estimate) the jamming patterns and parameters, we use the temporal and spectral information, i.e., the spectrum waterfall, directly. Firstly, to cope with the challenge of infinite state of spectrum waterfall, a recursive convolutional neural network is designed. Then, an anti-jamming deep reinforcement learning algorithm is proposed to obtain the optimal antijamming strategies. Finally, simulation results validate the the proposed approach. The proposed algorithm does not need to model the jamming patterns, and naturally has the ability to explore the unknown environment, which implies that it can be widely used for combating dynamic and intelligent jamming.
28 September 2020 in IEEE Transactions on Wireless Communications
Coalition structure is an efficient networking architecture for task implementation in unmanned aerial vehicle (UAV) networks. However, both the formation of coalition and the spectrum resource for intra-coalition communication affect the reconnaissance performance. In this paper, we investigate a cooperative reconnaissance and spectrum access (CRSA) scheme for task-driven heterogeneous coalition-based UAV networks by jointly optimizing task layer and resource layer. Specifically, coalition formation game (CFG) is formulated to jointly optimize task selection and bandwidth allocation. In addition to the traditional Pareto order and selfish order, coalition expected altruistic order maximizing coalitions' utility is proposed. The CFG under the proposed order is proved to be an exact potential game (EPG). Then the existence of stable coalition partition is guaranteed with the help of Nash equilibrium (NE). We propose a joint bandwidth allocation and coalition formation (JBACF) algorithm to achieve stable coalition partition wherein an efficient gradient projection (GP) based method is applied to solve bandwidth allocation. The effectiveness of the proposed scheme and algorithms are demonstrated through in-depth numerical simulations. The results show that our proposed CRSA scheme is superior to non-joint optimization scheme. Also, the proposed order is superior to traditional Pareto order and selfish order.
18 September 2019 in IEEE Transactions on Vehicular Technology
In this paper, we study the distributed relay assignment problem in multi-channel multi-radio unmanned aerial vehicle (UAV) communication networks. Multi-UAVs are driven by the overall task and fly in certain formation, where drones with different tasks have various transmission requirements. Source UAVs equipped with multi-radio can select more than one relay radios to achieve high data rate, and each relay radio can be shared by multiple source UAVs. We construct distributed game models to promote the global transmission performance by self-organizing coordination among UAVs. Specifically, the channel competition relationship between relay UAVs is modeled as a congestion game model, while the task-driven relay selection among UAVs is modeled as a many-to-many matching market without substitutability. With the proposed game models, the optimizing of local optimized process will lead to the improvement of global transmission results. After that, we design algorithms for the stable and changeable topology structures, respectively. Based on the given formation shape of UAVs, a learning matching algorithm is proposed to reach the optimum result with a large probability. A fast potential matching algorithm is propose to deal with the topological change of UAV networks. We prove that two proposed algorithms can both achieve the stable matching results. Simulation results show that the proposed relay assignment approaches yield good performances in terms of the global transmission satisfaction and fairness. Particularly, the result of the learning algorithm is close to the global optimum and the fast potential matching approach is robust to the perturbation of UAV networks.
17 April 2018 in IEEE Access
This paper focuses on the anti-jamming transmission problem in unmanned aerial vehicle (UAV) communication networks. Considering the incomplete information constraint and the co-channel mutual interference, a Bayesian Stackelberg game is proposed to formulate the competitive relations between UAVs (users) and the jammer. Specifically, the jammer acts as the leader, whereas users act as followers of the proposed game. Based on their utility functions, the jammer and users select their optimal power control strategies respectively. In addition, the observation error is also investigated in this paper. Due to the incomplete information constraint and the existence of co-channel mutual interference, it is challenging to obtain Stackelberg equilibrium (SE) of the proposed game. Thus, a sub-gradient based Bayesian Stackelberg iterative algorithm is proposed to obtain SE. Finally, simulations are conducted to demonstrate the performance of the proposed algorithm, and the impact of incomplete information and observation error on users' utilities are also presented.
28 February 2019 in IEEE Transactions on Vehicular Technology
24 December 2018 in IEEE Transactions on Vehicular Technology
In this paper, we investigate the anti-jamming channel selection problem for interference mitigation (IM)-based dense wireless networks in dynamic environment, in which the active user set is variable due to their specific traffic demands. We jointly consider the mutual interference among users and external jamming in IM-based dense wireless networks, and propose a generalized maximum protocol interference and jamming (GMPIJ) model to accurately capture the mutual interference and external jamming. Then, the anti-jamming channel selection problem is formulated as an anti-jamming dynamic game, and subsequently it is proved to be an exact potential game, which has at least one pure strategy Nash equilibrium (NE). Based on the stochastic learning theory, a distributed anti-jamming channel selection algorithm (DACSA) is proposed to find the NE solution. Moreover, the simulation results are presented to demonstrate the effectiveness of the proposed DACSA algorithm.