Yaozong Pan

Dr. Yaozong Pan

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 September 2019 in IEEE Access
Verified
Journal Article
Open access
YPYaozong Pan
Yaozong Pan
HJHaiyang Jiang
Haiyang Jiang
HYHaitao Yang
Haitao Yang
JZJian Zhang
Jian Zhang
Deep reinforcement learning (RL) holds considerable promise to help address a variety of multi-agent problems in a dynamic and complex environment. In multi-agent scenarios, most tasks require multiple agents to cooperate and the number of agents has a negative impact on the training efficiency of reinforcement learning. To this end, we propose a novel method, which uses the framework of centralized training and distributed execution and uses parameter sharing among homogeneous agents to replace partial calculation of network parameters in policy evolution. The parameter asynchronous sharing mechanism and the soft sharing mechanism are used to balance the exploratory of agents and the consistency of homogenous agents’ policy. We experimentally validated our approach in different types of multi-agent scenarios. The empirical results show that our method can significantly promote training efficiency in collaborative tasks, competitive tasks, and mixed tasks without affecting the performance.

5 June 2019 in Symmetry
Verified
Journal Article
Open access
PDF file
HJHaiyang Jiang
Haiyang Jiang
YPYaozong Pan
Yaozong Pan
JZJian Zhang
Jian Zhang
HYhaitao yang
haitao yang
In this paper, our goal is to improve the recognition accuracy of battlefield target aggregation behavior while maintaining the low computational cost of spatio-temporal depth neural networks. To this end, we propose a novel 3D-CNN (3D Convolutional Neural Networks) model, which extends the idea of multi-scale feature fusion to the spatio-temporal domain, and enhances the feature extraction ability of the network by combining feature maps of different convolutional layers. In order to reduce the computational complexity of the network, we further improved the multi-fiber network, and finally established an architecture—3D convolution Two-Stream model based on multi-scale feature fusion. Extensive experimental results on the simulation data show that our network significantly boosts the efficiency of existing convolutional neural networks in the aggregation behavior recognition, achieving the most advanced performance on the dataset constructed in this paper.

13 September 2024 in Electronics
Verified
Journal Article
Open access
PDF file
ZZZhiyong Zhao
Zhiyong Zhao
ZMZhongyang Mao
Zhongyang Mao
ZZZhilin Zhang
Zhilin Zhang
YPYaozong Pan
Yaozong Pan
JXJianwu Xu
Jianwu Xu
The existing collaborative channel perception suffers from unreasonable data fusion weight allocation, which mismatches the channel perception capability of the node devices. This often leads to significant deviations between the channel perception results and the actual channel state. To solve this issue, this paper integrates the data fusion algorithm from evidence fusion theory with data link channel state perception. It applies the data fusion advantages of evidence fusion theory to evaluate the traffic pulse statistical capability of network node devices. Specifically, the typical characteristic parameters describing the channel perception capability of node devices are regarded as evidence parameter sets under the recognition framework. By calculating the credibility and falsity of the characteristic parameters, the differences and conflicts between nodes are measured to achieve a comprehensive evaluation of the traffic pulse statistical capabilities of node devices. Based on this evaluation, the geometric mean method is adopted to calculate channel state perception weights for each node within a single-hop range, and a weight allocation strategy is formulated to improve the accuracy of channel state perception.

18 December 2019 in IEEE Access
Verified
Journal Article
Open access
CYChunhui Yuan
Chunhui Yuan
HYHaitao Yang
Haitao Yang
YPYaozong Pan
Yaozong Pan
Interconnection between multiple data link systems is an urgent problem for wireless control systems. Its difficulty lies in the fact that data link messages are multi-source heterogeneous, By analyzing its sub-domain characteristics, we constructs the data message domain ontology and establishes a data link message ontology model based on Bayesian network(DLMOBN). It includes the study of nodes, directed edges and node similarity probability distribution and so on, convert multi-source heterogeneous messages into mathematical models. We propose a data link message ontology mapping algorithm, the OWL syntax is used to formally describe the acquired domain ontology, extract useful information such as concepts, attributes, and instances, and then store the information in a preset data structure, k-means algorithm is used to cluster them to form “cluster”, which is used as a classification index to classify the similarity pair as a node in the Bayesian network, and pass the concept of the lower layer between nodes to the prior concept of the upper layer. The semantic distance, the attribute, the feature and other factors of the similar pair are used to calculate the semantic similarity. Finally, the final semantic similarity value is obtained by weighting. It is verified by experiments that the method improves the recall rate and precision, reduces the time complexity.

17 September 2024 in Electronics
Verified
Journal Article
Open access
PDF file
ZMZhongyang Mao
Zhongyang Mao
ZZZhilin Zhang
Zhilin Zhang
FLFaping Lu
Faping Lu
YPYaozong Pan
Yaozong Pan
TZTianqi Zhang
Tianqi Zhang
YYYang You
Yang You
As humans continue to exploit the ocean, the number of UAV nodes at sea and the demand for their services are increasing. Given the dynamic nature of marine environments, traditional resource allocation methods lead to inefficient service transmission and ping-pong effects. This study enhances the alignment between network resources and node services by introducing an attention mechanism and double deep Q-learning (DDQN) algorithm that optimizes the service-access strategy, curbs action outputs, and improves service-node compatibility, thereby constituting a novel method for UAV network resource allocation in marine environments. A selective suppression module minimizes the variability in action outputs, effectively mitigating the ping-pong effect, and an attention-aware module is designed to strengthen node-service compatibility, thereby significantly enhancing service transmission efficiency. Simulation results indicate that the proposed method boosts the number of completed services compared with the DDQN, soft actor–critic (SAC), and deep deterministic policy gradient (DDPG) algorithms and increases the total value of completed services.

24 April 2019 in Symmetry
Verified
Journal Article
Open access
PDF file
YPYaozong Pan
Yaozong Pan
JZJian Zhang
Jian Zhang
CYChunhui Yuan
Chunhui Yuan
HYhaitao yang
haitao yang
Using expert samples to improve the performance of reinforcement learning (RL) algorithms has become one of the focuses of research nowadays. However, in different application scenarios, it is hard to guarantee both the quantity and quality of expert samples, which prohibits the practical application and performance of such algorithms. In this paper, a novel RL decision optimization method is proposed. The proposed method is capable of reducing the dependence on expert samples via incorporating the decision-making evaluation mechanism. By introducing supervised learning (SL), our method optimizes the decision making of the RL algorithm by using demonstrations or expert samples. Experiments are conducted in Pendulum and Puckworld scenarios to test the proposed method, and we use representative algorithms such as deep Q-network (DQN) and Double DQN (DDQN) as benchmarks. The results demonstrate that the method adopted in this paper can effectively improve the decision-making performance of agents even when the expert samples are not available.