Radio access network (RAN) technologies continue to evolve, with Open RAN gaining the most recent momentum. In the O-RAN specifications, the RAN intelligent controllers (RICs) are software-defined orchestration and automation functions for the intelligent management of RAN. This article introduces principles for machine learning (ML), in particular, reinforcement learning (RL) applications in the O-RAN stack. Furthermore, we review the state-of-the-art research in wireless networks and cast it onto the RAN framework and the hierarchy of the O-RAN architecture. We provide a taxonomy for the challenges faced by ML/RL models throughout the development life-cycle: from the system specification to production deployment (data acquisition, model design, testing and management, etc.). To address the challenges, we integrate a set of existing MLOps principles with unique characteristics when RL agents are considered. This paper discusses a systematic model development, testing and validation life-cycle, termed: RLOps. We discuss fundamental parts of RLOps, which include: model specification, development, production environment serving, operations monitoring and safety/security. Based on these principles, we propose the best practices for RLOps to achieve an automated and reproducible model development process. At last, a holistic data analytics platform rooted in the O-RAN deployment is designed and implemented, aiming to embrace and fulfil the aforementioned principles and best practices of RLOps.
30 January 2023 in IEEE Transactions on Microwave Theory and Techniques
Microwave passive component design is of particular interest to radio frequency (RF) scholars and engineers. Although a plethora of studies have been carried out over multiple decades, designing high-frequency structures that offer high performance still heavily relies on heuristic methods and even rules of thumb. Thus, the process is often inefficient, and outcomes are not guaranteed. This article proposes a novel cascaded convolutional neural network (CNN) model to speed up the design process of planar microwave passive components. Given target behavior specifications, our proposed neural network model can quickly and accurately suggest proper component structures for single or multiple frequency bands. The feasibility and reliability of our model are validated here by both electromagnetic (EM) simulation and a fully instrumented implementation. The experimental results demonstrate that the proposed model can design planar passive components, including two-port matching networks and three-port power dividers. Moreover, our model provides passive component topologies that are fundamentally different from canonical number-limited templates and, therefore, yields novel architectures for passive microwave components. It also facilitates rapid passive components design flow for targeted electrical behavior within a limited board area. The proposed cascaded CNN model and the associated methodologies in this article are generic and, thus, can be easily extended to the design of any symmetrical planar microwave passive components.
This paper studies a WiFi indoor localisation technique based on using a deep learning model and its transfer strategies. We take CSI packets collected via the WiFi standard channel sounding as the training dataset and verify the CNN model on the subsets collected in three experimental environments. We achieve a localisation accuracy of 46.55 cm in an ideal (6.5m × 2.5m) office with no obstacles, 58.30 cm in an office with obstacles, and 102.8 cm in a sports hall (40 × 35m). Then, we evaluate the transfer ability of the proposed model to different environments. The experimental results show that, for a trained localisation model, feature extraction layers can be directly transferred to other models and only the fully connected layers need to be retrained to achieve the same baseline accuracy with non-transferred base models. This can save 60% of the training parameters and reduce the training time by more than half. Finally, an ablation study of the training dataset shows that, in both office and sport hall scenarios, after reusing the feature extraction layers of the base model, only 55% of the training data is required to obtain the models’ accuracy similar to the base models.
26 October 2022 in IEEE Microwave and Wireless Technology Letters
Microwave structure behavior prediction is an important research topic in radio frequency (RF) design. In recent years, deep-learning-based techniques have been widely implemented to study microwaves, and they are envisaged to revolutionize this arduous and time-consuming work. However, empirical data collection and neural network training are two significant challenges of applying deep learning techniques to practical RF modeling and design problems. To this end, this letter investigates a transfer-learning-based approach to improve the accuracy and efficiency of predicting microwave structure behaviors. Through experimental comparisons, we validate that the proposed approach can reduce the amount of data required for training while shortening the neural network training time for the behavior prediction of microwave structures.
This study presents an empirical investigation into the energy consumption of discriminative and generative AI models within real-world MLOps pipelines. For discriminative models, we examine various architectures and hyperparameters during training and inference and identify energy-efficient practices. For generative AI, large language models (LLMs) are assessed, with a focus primarily on energy consumption across different model sizes and varying service requests. Our study employs software-based power measurements, ensuring ease of replication across diverse configurations, models, and datasets. We analyse multiple models and hardware setups to uncover correlations among various metrics, identifying key contributors to energy consumption. The results indicate that, for discriminative models, optimising architectures, hyperparameters, and hardware can significantly reduce energy consumption without sacrificing performance. For LLMs, energy efficiency depends on balancing model size, reasoning complexity, and request-handling capacity, as larger models do not necessarily consume more energy when utilisation remains low. This analysis provides practical guidelines for designing green and sustainable ML operations, emphasising energy consumption and carbon-footprint reductions while maintaining performance. This paper can serve as a benchmark for accurately estimating total energy use across different types of AI models.