6 September 2018 in China Communications
The high-frequency(HF) communication is one of essential communication methods for military and emergency application. However, the selection of communication frequency channel is always a difficult problem as the crowded spectrum, the time-varying channels, and the malicious intelligent jamming. The existing frequency hopping, automatic link establishment and some new anti-jamming technologies can not completely solve the above problems. In this article, we adopt deep reinforcement learning to solve this intractable challenge. First, the combination of the spectrum state and the channel gain state is defined as the complex environmental state, and the Markov characteristic of defined state is analyzed and proved. Then, considering that the spectrum state and channel gain state are heterogeneous information, a new deep Q network (DQN) framework is designed, which contains multiple sub-networks to process different kinds of information. Finally, aiming to improve the learning speed and efficiency, the optimization targets of corresponding sub-networks are reasonably designed, and a heterogeneous information fusion deep reinforcement learning (HIF-DRL) algorithm is designed for the specific frequency selection. Simulation results show that the proposed algorithm performs well in channel prediction, jamming avoidance and frequency channel selection.
24 October 2017 in IEEE Access
In this paper, we consider the secure communications in a cognitive untrusted relay network, where the secondary source intends to communicate with a secondary destination through an untrusted relay in the presence of the direct source-destination link. Specifically, we first examine the connection outage probability (COP) and secrecy outage probability (SOP) to investigate the reliability and security performance in two cases, where the secondary destination exploits the maximum ratio combining (MRC) scheme or the selection combining (SC) scheme. To characterize the tradeoff between reliability and security, we then investigate the effective secrecy throughput (EST) performance by including the COP and SOP in a unified manner. In order to gain additional insights from the performance evaluation, we also provide the asymptotic expressions for the COP, SOP, and EST in high signal-to-noise ratio region. It is demonstrated that the interference temperature constraint incurred from the primary network enables a tradeoff between reliability and security of the secondary network. Moreover, the resulting analysis shows that using the untrusted relay to forward the transmitted message is unnecessary when the secondary destination employs the SC scheme and the untrusted relay operates in half-duplex mode.
2 July 2019 in IEEE Access
This paper investigates the problem of multi-user multichannel access in distributed high-frequency (HF) diversity communication networks using a game-theoretic learning algorithm which is based on correlation equilibrium (CE). We formulate the channel access problem in the HF networks as a non-cooperative game. In the access game, each user equipment (UE) optimizes its access strategy without the information about other UEs, which makes the channel access problem challenging. It is proved that there is at least one CE point that makes all UEs' access strategy efficient and fair. We propose a distributed learning algorithm based on CE to achieve multi-user access with low cost and fairly in the distributed HF networks. We use coordination signals to help each UE learn the access strategy by themselves. When each UE receives and recognizes the right coordination signals, UEs will learn to transmit data on right channels without further collisions after the learning phase. The simulation results show that the proposed learning algorithm can not only completely avoid interference and get optimal throughput but also guarantee fairness among all UEs.
1 January 2026 in IEEE Internet of Things Journal