Various autonomous or assisted driving strategies have been facilitated through the accurate and reliable perception of the environment around a vehicle. Among the commonly used sensors, radar has usually been considered as a robust and cost-effective solution even in adverse driving scenarios, e.g., weak/strong lighting or bad weather. Instead of considering fusing the unreliable information from all available sensors, perception from pure radar data becomes a valuable alternative that is worth exploring. In this paper, we propose a deep radar object detection network, named RODNet, which is cross-supervised by a camera-radar fused algorithm without laborious annotation efforts, to effectively detect objects from the radio frequency (RF) images in real-time. First, the raw signals captured by millimeter-wave radars are transformed to RF images in range-azimuth coordinates. Second, our proposed RODNet takes a snippet of RF images as the input to predict the likelihood of objects in the radar field of view (FoV). Two customized modules are also added to handle multi-chirp information and object relative motion. The proposed RODNet is cross-supervised by a novel 3D localization of detected objects using a camera-radar fusion (CRF) strategy in the training stage. Due to no existing public dataset available for our task, we create a new dataset, named CRUW, 11The dataset and code are available at https://www.cruwdataset.org/. which contains synchronized RGB and RF image sequences in various driving scenarios. With intensive experiments, our proposed cross-supervised RODNet achieves 86% average precision and 88% average recall of object detection performance, which shows the robustness in various driving conditions.
3 June 2019 in IEEE Transactions on Communications
Virtual reality (VR) over wireless is emerging as an important use case of 5G networks. Fully-immersive VR experience requires the wireless delivery of huge data at ultra-low latency, thus leading to ultra-high transmission rate requirement for wireless communications. This challenge can be largely addressed by the recent network architecture known as mobile edge computing (MEC) network, which enables caching and computing capabilities at the edge of wireless networks. This paper presents a novel MEC-based mobile VR delivery framework that is able to cache parts of the field of views (FOVs) in advance and compute certain post-processing procedures on demand at the mobile VR device. To minimize the average required transmission rate, we formulate the joint caching and computing optimization problem to determine which FOVs to cache, whether to cache them in 2D or 3D as well as which FOVs to compute at the mobile device under cache size, average power consumption as well as latency constraints. When FOVs are homogeneous, we obtain a closed-form expression for the optimal joint policy which reveals interesting communications-caching-computing tradeoffs. When FOVs are heterogeneous, we obtain a local optima of the problem by transforming it into a linearly constrained indefinite quadratic problem and then applying concave convex procedure. Numerical results demonstrate the proposed mobile VR delivery framework can significantly reduce communication bandwidth while meeting low latency requirement.
Millimeter-wave (mmW) radars are being increasingly integrated into commercial vehicles to support new advanced driver-assistance systems (ADAS) by enabling robust and high-performance object detection, localization, as well as recognition - a key component of new environmental perception. In this paper, we propose a novel radar multiple perspectives convolutional neural network (RAMP-CNN) that extracts location and class of objects based on further processing of the range-velocity-angle (RVA) heatmap sequences. To bypass the complexity of 4D convolutional neural networks (NN), we propose to combine several lower-dimension NN models within our RAMP-CNN model that nonetheless approaches the performance upper-bound with lower complexity. The extensive experiments show that the proposed RAMP-CNN model achieves better average recall (AR) and average precision (AP) than prior works in all testing scenarios (see Table.III). Besides, the RAMP-CNN model is validated to work robustly under the nighttime, which enables low-cost radars as a potential substitute for pure optical sensing under severe conditions.
1 June 2020 in IEEE Transactions on Wireless Communications
The decentralized coded caching scheme of Maddah- Ali and Niesen for the shared link network achieves an orderoptimal memory-load tradeoff when the file size goes to infinity. It is then successively shown by Shanmugam et al. that, in the practical operating regime where the file size is finite, such scheme yields a much less attractive coded caching gain. In this paper, we focus on designing decentralized coded caching schemes that can achieve low worst-case loads of the shared link when the file size is finite, and maintain order-optimal memoryload tradeoffs when the file size grows to infinity. First, we propose a decentralized coded caching design framework for designing decentralized coded caching schemes that can achieve significantly lower worst-case loads than Maddah-Ali–Niesen’s decentralized coded caching scheme in the finite file size regime, while maintaining order-optimal memory-load tradeoffs when the file size grows to infinity. Then, within the proposed framework, we propose a decentralized coded caching scheme, which is simple and tractable, and can achieve a low worst-case load in both the finite and infinite file size regimes. We analyze the worst-case load of the proposed scheme and show that it outperforms Maddah- Ali–Niesen’s and Shanmugam et al.’s decentralized schemes in the finite file size regime, when the number of users is not too small. We also analyze the asymptotic worst-case load of the proposed scheme when the file size goes to infinity and show that the proposed scheme achieves an order-optimal memoryload tradeoff. Finally, we analytically characterize the behavior of the worst-case coded caching gain of the proposed scheme as a function of the required file size, when the file size is large.
28 April 2022 in IEEE Journal of Selected Topics in Signal Processing
Detecting harmful carried objects plays a key role in intelligent surveillance systems and has widespread applications, for example, in airport security. In this paper, we focus on the relatively unexplored area of using low-cost 77 GHz mmWave radar for the carried objects detection problem. The proposed system is capable of real-time detecting three classes of objects - laptop, phone, and knife - under open carry and concealed cases where objects are hidden with clothes or bags. This capability is achieved by the initial signal processing for localization and generating range-azimuth-elevation image cubes, followed by a deep learning-based prediction network and a multi-shot post-processing module for detecting objects. Extensive experiments for validating the system performance on detecting open carry and concealed objects have been presented with a self-built radar-camera testbed and collected dataset. Additionally, the influence of different input formats, factors, and parameters on system performance is analyzed, providing an intuitive understanding of the system. This system would be the very first baseline for other future works aiming to detect carried objects using 77 GHz radar.