Integrating cognitive radio into Internet of Things (IoT) is conducive to reducing spectrum scarcity for large-scale IoT deployment, where a core technology is the design of spectrum access algorithms for effective assignment of spectrum holes. However, due to the partially observable channels and increased number of users in the cognitive radio Internet of Things (CRIoT) network, the secondary users have difficulty avoiding interferences and accessing the spectrum quickly. This study presents a distributed dynamic spectrum access (DSA) algorithm that employs a priority experience replay deep echo state Q-network (PER-DESQN) for CRIoT networks with multiple users and channels. To accelerate the Q-network convergence, we use an echo state network based on the underlying temporal correlation to estimate Q-values. Then, to resolve the Q-value overestimation and improve prediction accuracy, the estimated Q-value and decision action process are trained using a double deep Q-network (DDQN). Moreover, a priority experience replay mechanism that uses the Sum-Tree combined with importance sampling weights is proposed to optimize the DDQN to address the instability of the Q-value resulting from random sampling. As the simulation results demonstrate, the proposed algorithm can make fast and accurate DSA decisions and boost the network channel capacity significantly.

Obtaining accurate angle parameters using direction-of-arrival (DOA) estimation algorithms is crucial for acquiring channel state information (CSI) in massive multiple-input multiple-output (MIMO) systems. However, the performance of the existing algorithms deteriorates severely due to mutual coupling between antenna elements in practical engineering. Therefore, for solving the array mutual coupling, the array output signal vector is modeled by mutual coupling coefficients and the DOA estimation problem is transformed into block sparse signal reconstruction and parameter optimization in this paper. Then, a novel sparse Bayesian learning (SBL)-based algorithm is proposed, in which the expectation-maximum (EM) algorithm is used to estimate the unknown parameters iteratively, and the convergence speed of the algorithm is enhanced by utilizing the approximate approximation. Moreover, considering the off-grid error caused by discretization processes, the grid refinement is carried out using the polynomial roots to realize the dynamic update of the grid points, so as to improve the DOA estimation accuracy. Simulation results show that compared with the existing algorithms, the proposed algorithm is more robust to mutual coupling and off-grid error and can obtain better estimation performance.