Non-orthogonal multiple access (NOMA) technology allows multiple users to use the same time-frequency resource to send signals, which can improve spectral efficiency and throughput. We study the problems of user grouping and power allocation in the downlink of a multi-carrier NOMA system. The sum rate is the optimization goal. A step-by-step optimization is adopted. Users are grouped first and then power is allocated. For user grouping, the user grouping method based on the maximum channel gain difference is improved to prevent users with similar channel gains from being grouped together. For power allocation, the deep learning power allocation algorithm is used among subcarriers. Then, the closed-form expressions of power allocation between multiplexed users are derived according to the minimum transmission rate constraint. The simulation results show that compared with the fractional transmit power allocation method and fixed power allocation method, the deep learning power allocation method improves the system sum rate by about 2.2% and 19%, respectively. The power allocation methods we propose improve the system sum rate by about 10% compared to the fractional transmit power allocation method used among subcarriers and between multiplexed users.

Traffic sign detection plays an integral role in intelligent driving systems. It was found that in real driving scenarios, traffic signs were easily obscured by haze leading to traffic sign detection inaccuracy in assisted driving systems. Therefore, we designed a traffic sign detection model for hazy weather that can effectively help drivers to recognize road signs and reduce the incidence of traffic accidents. A high-precision traffic sign detection network has been designed to address the problem of decreased model recognition performance caused by external factors such as small size of traffic signs and haze obstruction in real-world scenarios. First, the default YOLOv8 was found to have low model detection accuracy in hazy weather occlusion conditions through experimental studies. Therefore, a deeper lightweight and efficient multi-branch CSP (Cross Stage Partial) module was introduced. Second, a dual path feature fusion network was designed to address the problem of insufficient feature fusion due to the small size of traffic signs. Finally, in order to be able to better simulate the real haze weather scene, we added fog to the raw data to enrich the data samples. This was verified through experiments on a public Chinese traffic sign detection dataset after fogging treatment, compared to the default YOLOv8 model. The improved DPF-YOLOv8 algorithm achieved 2.1% and 2.2% improvement in mAP@0.5 and mAP@0.5:0.95 performance metrics to 65.0% and 47.4%, respectively.

Aiming at the energy storage scheduling problem of microgrid system with wind power generation, this paper proposes an energy management strategy of microgrid based on deep reinforcement learning. In order to analyze the influence of different scenario combination models on the microgrid energy storage dispatching strategy, taking the residential user microgrid system as an example, a microgrid dispatching problem environment model was constructed. In the case of changes in multiple factors such as power generation and load, the coordinated control of compound energy is a complex optimization decision-making problem. Different schemes may affect the stability of the system’s power supply, utilization efficiency and economic benefits. To this end, this article uses three deep reinforcement learning algorithms and compares them with experiments. The results show that there are obvious differences in the ability of deep reinforcement learning algorithms to converge to the optimal strategy, but it also proves the feasibility and effectiveness of deep reinforcement learning in the coordinated control of composite energy storage problems, which has strong academic significance and engineering value, and can be used to deal with similar problems.

Surrounded by the Shandong Peninsula, the Bohai Sea and Yellow Sea possess vast marine energy resources. An analysis of actual meteorological data from these regions indicates significant seasonality and intra-day uncertainty in wind and photovoltaic power generation. The challenge of scheduling to leverage the complementary characteristics of various renewable energy sources for maintaining grid stability is substantial. In response, we have integrated wave energy with offshore photovoltaic and wind power generation and propose a day-ahead and intra-day multi-time-scale rolling optimization scheduling strategy for the complementary dispatch of these three energy sources. Using real meteorological data from this maritime area, we employed a CNN-LSTM neural network to predict the power generation and load demand of the area on both day-ahead 24 h and intra-day 1 h time scales, with the DDPG algorithm applied for refined electricity management through rolling optimization scheduling of the forecast data. Simulation results demonstrate that the proposed strategy effectively meets load demands through complementary scheduling of wave power, wind power, and photovoltaic power generation based on the climatic characteristics of the Bohai and Yellow Sea regions, reducing the negative impacts of the seasonality and intra-day uncertainty of these three energy sources on the grid. Additionally, compared to the day-ahead scheduling strategy alone, the day-ahead and intra-day rolling optimization scheduling strategy achieved a reduction in system costs by 16.1% and 22% for a typical winter day and a typical summer day, respectively.

Mobile Edge Computing (MEC) technology and Simultaneous Wireless Information and Power Transfer (SWIPT) technology are important ones to improve the computing rate and the sustainability of devices in the Internet of things (IoT). However, the system models of most relevant papers only considered multi-terminal, excluding multi-server. Therefore, this paper aims at the scenario of IoT with multi-terminal, multi-server and multi-relay, in which can optimize the computing rate and computing cost by using deep reinforcement learning (DRL) algorithm. Firstly, the formulas of computing rate and computing cost in proposed scenario are derived. Secondly, by introducing the modified Actor-Critic (AC) algorithm and convex optimization algorithm, we get the offloading scheme and time allocation that maximize the computing rate. Finally, the selection scheme of minimizing the computing cost is obtained by AC algorithm. The simulation results verify the theoretical analysis. The algorithm proposed in this paper not only achieves a near-optimal computing rate and computing cost while significantly reducing the program execution delay, but also makes full use of the energy collected by the SWIPT technology to improve energy utilization.