Adaptive traffic signal control (ATSC) based on deep reinforcement learning (DRL) has shown promising prospects to reduce traffic congestion. Most existing methods keeping traffic signal phases fixed adopt two agent actions to match a four-phase suffering unstable performance and undesirable operation in a four-phase signalized intersection. In this paper, a Double Deep Q-Network (DDQN) with a dual-agent algorithm is proposed to obtain a stable traffic signal control policy. Specifically, two agents are denoted by two different states and shift the control of green lights to make the phase sequence fixed and control process stable. State representations and reward functions are presented by improving the observability and reducing the leaning difficulty of two agents. To enhance the feasibility and reliability of two agents in the traffic control of the four-phase signalized intersection, a network structure incorporating DDQN is proposed to map states to rewards. Experiments under Simulation of Urban Mobility (SUMO) are carried out, and results show that the proposed traffic signal control algorithm is effective in improving traffic capacity.
In this paper, we investigate the mobile edge computing framework with unmanned aerial vehicle (UAV) and reconfigurable intelligent surface (RIS) collaboration, in which a dedicated non-orthogonal multiple access (NOMA) based protocol is introduced for task offloading. In the model, the UAV acts as a relay node and computation server to support multiple ground users for offloading computation tasks to remote access point with the assistance of the RIS. To explore the impact of the joint UAV and RIS design with NOMA on computation performance, the sum computation bits maximization problem is formulated by optimizing computation and offloading bits, RIS phase shift design, UAV trajectory and bandwidth allocation. In order to obtain the solution, the original problem is decomposed into three more tractable subproblems, which can be solved by applying semidefinite relaxation method and successive convex approximation technique. Finally, the numerical solution demonstrates that our proposed algorithm achieves improvements on computation capacity compared with the benchmark and outperforms considerably the scheme without collaboration of the UAV and RIS.
17 March 2020 in IEEE Transactions on Communications
The paper considers the problem of beamforming design for a multi-cell network of downlink users, who either harvest energy or decode information or do both by receiving signals from the multi-antenna base station (BS) within a time slot and over the same frequency band. Our previous contributions have showed that the time-fraction based energy and information transmission, under which first the energy is transferred within the initial fraction of time and then the information is transferred within the remaining fraction, is the most efficient design alternative both in terms of its practical implementation and network performance. However, at the time of writing, both energy and information beamforming has only been implemented for proper Gaussian signaling (PGS), which has limited the network’s throughput. Although the network throughput could be improved in some specific scenarios by using non-orthogonal multi-access (NOMA), this may compromise the user secrecy. In order to circumvent the above implementations, we conceive improper Gaussian signaling (IGS) for information beamforming, which enables the network to substantially improve its throughput in any scenario without jeopardizing the user secrecy despite its low-complexity signal processing at the user end. A simpler subclass of IGS is also considered, which also outperforms NOMA PGS and works under any arbitrary scenario.
11 May 2020 in EURASIP Journal on Wireless Communications and Networking
In vehicular communications using IEEE 802.11p, estimating channel frequency response (CFR) is a remarkably challenging task. The challenge for channel estimation (CE) lies in tracking variations of CFR due to the extremely fast time-varying characteristic of channel and low density pilot. To tackle such problem, inspired by image super-resolution (ISR) techniques, a deep learning-based temporal spectral channel network (TS-ChannelNet) is proposed. Following the process of ISR, an average decision-directed estimation with time truncation (ADD-TT) is first presented to extend pilot values into tentative CFR, thus tracking coarsely variations. Then, to make tentative CFR values accurate, a super resolution convolutional long short-term memory (SR-ConvLSTM) is utilized to track channel extreme variations by extracting sufficiently temporal spectral correlation of data symbols. Three representative vehicular environments are investigated to demonstrate the performance of our proposed TS-ChannelNet in terms of normalized mean square error (NMSE) and bit error rate (BER). The proposed method has an evident performance gain over existing methods, reaching about 84.5% improvements at some high signal-noise-ratio (SNR) regions.
25 June 2018 in IEEE Transactions on Signal Processing
This paper considers two possible approaches, which enable multiple pairs of users to exchange information via multiple multiantenna relays within one time-slot to save communication bandwidth in low-latency communications. The first approach is to deploy full-duplexes for both users and relays to make their simultaneous signal transmission and reception possible. In the second approach, the users use a fraction of a time slot to send their information to the relays and the relays use the remaining complementary fraction of the time slot to send the beamformed signals to the users. The inherent loop self-interference in the duplexes and inter-full-duplexing-user interference in the first approach are absent in the second approach. Under both these approaches, the joint design of the users’ power allocation and relays’ beamformers to either optimize the users’ exchange of information or maximize the energy-efficiency subject to user quality-of-service (QoS) constraints in terms of minimal rate thresholds leads to complex nonconvex optimization problems. Path-following algorithms are developed for their computational solutions. Numerical examples show the advantages of the second approach over the first approach.
15 May 2018 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Spherical arrays have been widely used in direction-of-arrival (DOA) estimation in recent years, and the high-resolution estimation of signal parameter via rotational invariance technique (ESPRIT) was developed in the spherical harmonics domain. However, the spherical harmonics ESPRIT (SHESPRIT) cannot estimate the DOA when the elevation approaches 90°. To solve this problem, we present a two-step SHESPRIT (TS-SHESPRIT) based on two new recurrence relations of complex spherical harmonics. Furthermore, we develop a real-valued two-step SHESPRIT (RTS-SHESPRIT) that exploits a unitary matrix to obtain a real-valued relation between the signal subspace and the steering matrix to further reduce the computational complexity. However, the number of sources that are estimated by RTS-SHESPRIT is limited. Therefore, we propose the semi-RTS-SHESPRIT method, which reduces the computational complexity associated with eigenvalue decomposition (EVD) and avoids the limitations of RTS-SHESPRIT. Relative to SHESPRIT and TS-SHESPRIT, RTS-SHESPRIT and semi-RTS-SHESPRIT reduce the computational burden by 75% during EVD. Furthermore, we derive the mean square errors (MSEs) of the above algorithms and significantly simplify the MSE expressions. Different expressions for the MSEs are due to different recurrence relations used by different SHESPRIT-type algorithms. All proposed two-step SHESPRIT-type algorithms have higher accuracy than traditional SHESPRIT. The simulation results demonstrate the satisfactory performance of our methods.