JUN CAO

Mr. JUN CAO


Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 March 2025 in Algorithms
Verified
Journal Article
Open access
PDF file
Xia HuaXia Hua
Xia Hua
TZTt Zhang
Tt Zhang
JCJUN CAO
JUN CAO
Dynamic path planning enables vehicles to autonomously navigate in unknown or continuously changing environments, thereby reducing reliance on fixed maps. Deep reinforcement learning (DRL), with its superior performance in handling high-dimensional state spaces and complex dynamic environments, has been widely applied to dynamic path planning. Traditional DRL methods are prone to capturing unnecessary noise information and irrelevant features during the training process, leading to instability and decreased adaptability of models in complex dynamic environments. To address this challenge, we propose a dynamic path-planning method based on our Causal State-Masking Twin-delayed Deep Deterministic Policy Gradient (CSM-TD3) algorithm. CSM-TD3 integrates a causal inference mechanism by introducing dynamic state masks and intervention mechanisms, allowing the policy network to focus on genuine causal features for decision optimization and thereby enhancing the convergence speed and generalization capabilities of the agent. Furthermore, causal state-masking DRL allows the system to learn the optimal mask configurations through backpropagation, enabling the model to adaptively adjust the causal features of interest. Extensive experimental results demonstrate that this method significantly enhances the convergence of the TD3 algorithm and effectively improves its performance in dynamic path planning.

11 March 2025 in Mathematics
Verified
Journal Article
Open access
PDF file
JLJiansha Lu
Jiansha Lu
佳张佳蕊 张
佳蕊 张
JCJUN CAO
JUN CAO
XXXuesong Xu
Xuesong Xu
Yiping ShaoYiping Shao
Yiping Shao
ZCZhenbo Cheng
Zhenbo Cheng
In order to address the impact of equipment fault diagnosis and repair delays on production schedule execution in the dynamic scheduling of flexible job shops, this paper proposes a multi-resource, multi-objective dynamic scheduling optimization model, which aims to minimize delay time and completion time. It integrates the scheduling of the workpieces, machines, and maintenance personnel to improve the response efficiency of emergency equipment maintenance. To this end, a self-learning Ant Colony Algorithm based on deep reinforcement learning (ACODDQN) is designed in this paper. The algorithm searches the solution space by using the ACO, prioritizes the solutions by combining the non-dominated sorting strategies, and achieves the adaptive optimization of scheduling decisions by utilizing the organic integration of the pheromone update mechanism and the DDQN framework. Further, the generated solutions are locally adjusted via the feasible solution optimization strategy to ensure that the solutions satisfy all the constraints and ultimately generate a Pareto optimal solution set with high quality. Simulation results based on standard examples and real cases show that the ACODDQN algorithm exhibits significant optimization effects in several tests, which verifies its superiority and practical application potential in dynamic scheduling problems.

1 January 2023 in International Journal of Frontiers in Engineering Technology
Verified
Journal Article
Open access
PDF file
JCJUN CAO
JUN CAO
The combination of industrial information technology, automation technology and design and manufacturing technology can not only give full play to the advantages of existing technology, but also optimize the process technology and practical operation skills of injection molding machines, ensure the accuracy and simplicity of precision processing processes, and improve the quality and efficiency of products. On the other hand, it can also effectively guide the urgently needed intelligent manufacturing talents in China, promote the career transformation of universities, ensure the full use of talents, and promote the technological development of high-tech industries. In this paper, the author makes a detailed analysis and research on the application of intelligent digitization in the production and assembly of injection molding machines, hoping to provide conditions for the current production and assembly of injection molding machines.