12 November 2021 in IEEE Transactions on Artificial Intelligence
Sequential decision-making (SDM) is a common type of decision-making problem with sequential and multistage characteristics. Among them, the learning and updating of policy are the main challenges in solving SDM problems. Unlike previous machine autonomy driven by artificial intelligence alone, we improve the control performance of SDM tasks by combining human intelligence and machine intelligence. Specifically, this article presents a paradigm of a human–machine traded control systems based on reinforcement learning methods to optimize the solution process of sequential decision problems. By designing the idea of autonomous boundary and credibility assessment, we enable humans and machines at the decision-making level of the systems to collaborate more effectively. And the arbitration in the human–machine traded control systems introduces the Bayesian neural network and the dropout mechanism to consider the uncertainty and security constraints. Finally, experiments involving machine traded control, human traded control were implemented. The preliminary experimental results of this article show that our traded control method improves decision-making performance and verifies the effectiveness for SDM problems.
1 January 2025 in IET Control Theory & Applications
Considering the importance of solder paste printing in the production process of surface mounted technology (SMT), as well as the decisive impact of key process parameters on the solder paste printing effect. Traditional methods, whether manual or machine tuning, suffer from significant production capacity losses due to long downtime, and machines cannot adaptively adjust parameters based on human expert knowledge, thereby affecting the qualification rate of solder paste printing and the efficiency of SMT production lines. This paper proposes a human–machine integration optimization method for key printing process parameters. By establishing a printing quality prediction model and a key process parameter strategy model, a closed‐loop control system has been formed to achieve machine autonomous parameter tuning with expert knowledge. And this paper has completed the establishment of the strategy model based on deep reinforcement learning methods, enabling the SMT production line to predict and adjust key process parameters in real time based on SPI data. In addition, the optimization method described in this paper retains the final decision‐making authority of human operators to ensure emergency correction of prediction bias and decision failure history in the system. The final experimental results of this paper indicate that the proposed optimization method performs well in terms of qualification rate, correction effect, SPI data prediction, etc. These demonstrate the effectiveness and value of the proposed human‐on‐the‐loop optimization method in SMT production lines.
1 January 2026 in Engineering Research Express
In clinical EEG-based diagnosis, the acquisition of sufficient and well-labeled data is often hindered by high data collection costs, limited accessibility to subjects, and the inherent difficulty of expert labeling. These constraints result in insufficient data availability, significantly limiting the performance and reliability of traditional machine learning models. To address this challenge, we propose a hybrid human–machine diagnostic framework that integrates deep convolutional generative adversarial networks (DCGANs) and convolutional neural networks (CNNs) for depression detection under incomplete data conditions. The DCGAN module synthesizes realistic EEG samples to augment scarce datasets, while CNNs are employed for feature extraction and classification. A confidence-aware fusion strategy dynamically integrates expert assessments with model predictions, effectively improving diagnostic accuracy in scenarios with limited labeled data. Experimental results on real EEG datasets demonstrate that the proposed approach achieves superior performance, offering a practical solution for intelligent diagnosis in resource-constrained settings.
13 February 2026 in Advanced Engineering Informatics
23 April 2026 in SSRN Electronic Journal
To address the inefficient search caused by high-dimensional action spaces in distribution network fault restoration and the safety limitations of purely data-driven decisions in previously unseen scenarios, this paper proposes a knowledge-enhanced reinforcement learning framework, termed DQN-KG-BNN-IQR-Review. More specifically, a knowledge graph(KG) is first used to retrieve high-quality historical cases and provide heuristic action recommendations, thereby narrowing the search space during early training and alleviating inefficient exploration. On this basis, a Bayesian neural network(BNN) is introduced to quantify the epistemic uncertainty of the DQN in real time. By combining these uncertainty estimates with a sliding-window interquartile range(IQR), a dynamic safety boundary is constructed to govern the transition between autonomous model decisions and expert takeover, which improves decision robustness in cognitively unfamiliar states. In addition, a retrospective expert review mechanism is designed to replay successful expert trajectories after failed episodes. By correcting trajectory deviations and steering parameter updates toward more informative directions, this mechanism further enhances generalization. Experimental results show that the proposed framework not only accelerates training convergence, but also achieves an effective balance between restoration efficiency and operational safety in self-healing decision making through the coordinated interaction of its constituent modules.