1 February 2022 in Digital Communications and Networks
25 April 2022 in IEEE Transactions on Vehicular Technology
For vehicle-to-network communications, handover (HO) management enables vehicles to maintain the connection with the network while transiting through coverage areas of different base stations (BSs). However, the high mobility of vehicles means shorter connection periods with each BS that leads to frequent HOs, hence raises the necessity for optimal HO decision making for high quality infotainment services. Machine learning is capable of capturing underlying pattern via data driven methods to find optimal solutions to complex problems, and much learning-based HO optimization research has been conducted focusing on specific network setups. However, attention still needs to be paid to the actual deployment aspect and standardized datasets or simulation environments for evaluation. This paper proposes a deep reinforcement learning-based HO algorithm using the input parameters that are configurable in the existing measurement report of cellular networks. The performance of the proposed algorithm is evaluated using the well-known network simulator ns-3 with its official LTE module. A realistic network setup in the city center of Glasgow (U.K.) is configured with vehicle trajectories generated by the routes mobility model using Google Maps Directions API. Evaluation results reveal that the proposed algorithm significantly outperforms the A3 RSRP baseline with an average of 25.72% packet loss reduction per HO, suggesting significant improvement in quality of service of phone call and video streaming, etc. The proposed algorithm also has a small implementation cost compared to some state-of-the-art and should be deployed by a software update to a local BS controller.
21 August 2025 in IEEE Internet of Things Journal
The integration of multimodal sensing and communication systems advances the integrated sensing and communication (ISAC) concept by combining camera, LiDAR, radar, and radio-frequency (RF) data. This approach provides a promising avenue to enhance wireless link reliability and spectral efficiency while reducing end-to-end latency in 6G vehicle-to-everything (V2X) networks. Surveys on sensing and communication integration primarily concentrate on RF technologies. While initial studies have explored the combination of various sensing methods, there is a paucity of comprehensive reviews regarding how such data is utilized to enhance V2X communication performance. Therefore, this review comprehensively analyzes recent research on multimodal sensing-assisted vehicular networks to enhance communication performance, centered around channel prediction, beam management, mobility management, and multitask solutions. Since data-centric techniques are the main approach in this field, relevant datasets and simulators supporting data-driven designs are also thoroughly examined. Finally, by critically analyzing current research, the survey highlights unresolved issues and future trends in research cornerstones, method implementation, and system design. It also addresses key deployment challenges—spectrum availability, roadside hardware costs, and privacy-aware learning—thereby charting the course for developing real-world intelligent V2X networks.
26 February 2024 in APL Machine Learning
Beamforming, an integral component of modern mobile networks, enables spatial selectivity and improves network quality. However, many beamforming techniques are iterative, introducing unwanted latency to the system. In recent times, there has been a growing interest in leveraging mobile users’ location information to expedite beamforming processes. This paper explores the concept of contextual beamforming, discussing its advantages, disadvantages, and implications. Notably, we demonstrate an impressive 53% improvement in the signal-to-interference-plus-noise ratio by implementing the adaptive beamforming maximum ratio transmission (MRT) algorithm compared to scenarios without beamforming. It further elucidates how MRT contributes to contextual beamforming. The importance of localization in implementing contextual beamforming is also examined. Additionally, the paper delves into the use of artificial intelligence (AI) schemes, including machine learning and deep learning, in implementing contextual beamforming techniques that leverage user location information. Based on the comprehensive review, the results suggest that the combination of MRT and zero-forcing techniques, alongside deep neural networks employing Bayesian optimization, represents the most promising approach for contextual beamforming. Furthermore, the study discusses the future potential of programmable switches, such as Tofino—an innovative switch developed by Barefoot Networks (now a part of Intel)—in enabling location-aware beamforming. This paper highlights the significance of contextual beamforming for improving wireless telecommunications performance. By capitalizing on location information and employing advanced AI techniques, the field can overcome challenges and unlock new possibilities for delivering reliable and efficient mobile networks.
14 December 2022 in Scientific Reports
The development of ultra-dense heterogeneous networks (HetNets) will cause a significant rise in energy consumption with large-scale base station (BS) deployments, requiring cellular networks to be more energy efficient to reduce operational expense and promote sustainability. Cell switching is an effective method to achieve the energy efficiency goals, but traditional heuristic cell switching algorithms are computationally demanding with limited generalization abilities for ultra-dense HetNet applications, motivating the usage of machine learning techniques for adaptive cell switching. Graph neural networks (GNNs) are powerful deep learning models with strong generalization abilities but receive little attention for cell switching. This paper proposes a GNN-based cell switching solution (GBCSS) that has a smaller computational complexity than existing heuristic algorithms. The presented performance evaluation uses the Milan telecommunication dataset based on real-world call detail records, comparing GBCSS with a traditional exhaustive search (ES) algorithm, a state-of-the-art learning-based algorithm, and the baseline without cell switching. Results indicate that GBCSS achieves a 10.41% energy efficiency gain when compared with the baseline and achieves 75.76% of the optimal performance obtained with ES algorithm. The results also demonstrate GBCSS’ significant scalability and generalization abilities to differing load conditions and the number of BSs, suggesting this approach is well-suited to ultra-dense HetNet deployment.
22 July 2024 in IEEE Transactions on Vehicular Technology
The rapid growth of vehicle-to-network (V2N) communication demands efficient handover decision-making strategies to ensure seamless connectivity and maximum throughput. However, the dynamic nature of V2N scenarios poses challenges for traditional handover algorithms. To address this, we propose a deep reinforcement learning (DRL)-based approach for optimizing handover decisions in dynamic V2N communication. We leverages the advantages of transfer learning and meta-learning to generalize across time-evolving source and target tasks. In this paper, we derive generalization bounds for our DRLbased approach, specifically focusing on optimizing the handover process in V2N communication. The derived bounds provide theoretical guarantees on the expected generalization error of the learned handover time function for the target task. To implement our framework, we propose a meta-learning framework, Adaptto-evolve (A2E), based on the double deep Q-networks (DDQN) with Thompson sampling approach. The A2E framework enables quick adaptation to new tasks by minimizing the error upper bounds with divergence measures. Through transfer learning, the meta-learner dynamically evolves its handover decision-making strategy to maximize average throughput while reducing the number of handovers. We use Thompson sampling with the DDQN to balance exploration and exploitation. The DDQN with The Thompson sampling approach, ensuring efficient and effective learning, forms the foundation for optimizing the metatraining process, resulting in improvement in cumulated packet lossby48.02%in highway settings and 46.32%in rural settings