Qianqian Zhang

Dr. Qianqian Zhang

Auto-generated profile, based on publicly available information

Dr. Qianqian Zhang


Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 November 2021 in IEEE Transactions on Artificial Intelligence
Verified
Journal Article
Closed access
QZQianqian Zhang
Qianqian Zhang
YKYu Kang
Yu Kang
YZYunbo Zhao
Yunbo Zhao
PLPengfei Li
Pengfei Li
SYShiyi You
Shiyi You
Sequential decision-making (SDM) is a common type of decision-making problem with sequential and multistage characteristics. Among them, the learning and updating of policy are the main challenges in solving SDM problems. Unlike previous machine autonomy driven by artificial intelligence alone, we improve the control performance of SDM tasks by combining human intelligence and machine intelligence. Specifically, this article presents a paradigm of a human–machine traded control systems based on reinforcement learning methods to optimize the solution process of sequential decision problems. By designing the idea of autonomous boundary and credibility assessment, we enable humans and machines at the decision-making level of the systems to collaborate more effectively. And the arbitration in the human–machine traded control systems introduces the Bayesian neural network and the dropout mechanism to consider the uncertainty and security constraints. Finally, experiments involving machine traded control, human traded control were implemented. The preliminary experimental results of this article show that our traded control method improves decision-making performance and verifies the effectiveness for SDM problems.

1 January 2025 in IET Control Theory & Applications
Verified
Journal Article
Open access
QZQianqian Zhang
Qianqian Zhang
PLPengfei Li
Pengfei Li
YZYun‐Bo Zhao
Yun‐Bo Zhao
YKYu Kang
Yu Kang
Considering the importance of solder paste printing in the production process of surface mounted technology (SMT), as well as the decisive impact of key process parameters on the solder paste printing effect. Traditional methods, whether manual or machine tuning, suffer from significant production capacity losses due to long downtime, and machines cannot adaptively adjust parameters based on human expert knowledge, thereby affecting the qualification rate of solder paste printing and the efficiency of SMT production lines. This paper proposes a human–machine integration optimization method for key printing process parameters. By establishing a printing quality prediction model and a key process parameter strategy model, a closed‐loop control system has been formed to achieve machine autonomous parameter tuning with expert knowledge. And this paper has completed the establishment of the strategy model based on deep reinforcement learning methods, enabling the SMT production line to predict and adjust key process parameters in real time based on SPI data. In addition, the optimization method described in this paper retains the final decision‐making authority of human operators to ensure emergency correction of prediction bias and decision failure history in the system. The final experimental results of this paper indicate that the proposed optimization method performs well in terms of qualification rate, correction effect, SPI data prediction, etc. These demonstrate the effectiveness and value of the proposed human‐on‐the‐loop optimization method in SMT production lines.

1 January 2026 in Engineering Research Express
Verified
Journal Article
Closed access
NCNa Cheng
Na Cheng
YLYongheng Li
Yongheng Li
QZQianqian Zhang
Qianqian Zhang
YZYunbo Zhao
Yunbo Zhao
YKYu Kang
Yu Kang
ZWZihui Wu
Zihui Wu
In clinical EEG-based diagnosis, the acquisition of sufficient and well-labeled data is often hindered by high data collection costs, limited accessibility to subjects, and the inherent difficulty of expert labeling. These constraints result in insufficient data availability, significantly limiting the performance and reliability of traditional machine learning models. To address this challenge, we propose a hybrid human–machine diagnostic framework that integrates deep convolutional generative adversarial networks (DCGANs) and convolutional neural networks (CNNs) for depression detection under incomplete data conditions. The DCGAN module synthesizes realistic EEG samples to augment scarce datasets, while CNNs are employed for feature extraction and classification. A confidence-aware fusion strategy dynamically integrates expert assessments with model predictions, effectively improving diagnostic accuracy in scenarios with limited labeled data. Experimental results on real EEG datasets demonstrate that the proposed approach achieves superior performance, offering a practical solution for intelligent diagnosis in resource-constrained settings.

13 February 2026 in Advanced Engineering Informatics
Verified
Journal Article
Closed access
YLYongheng Li
Yongheng Li
QZQianqian Zhang
Qianqian Zhang
YKYu Kang
Yu Kang
YZYunbo Zhao
Yunbo Zhao

30 July 2026 in Machines
Verified
Journal Article
Open access
PDF file
Zhenhuan DingZhenhuan Ding
Zhenhuan Ding
JLJin Lv
Jin Lv
ZDZhenhuan Ding
Zhenhuan Ding
KLKai Lv
Kai Lv
XMXun Mao
Xun Mao
QZQianqian Zhang
Qianqian Zhang
As the operation modes and maintenance management requirements of power grids become increasingly complex, the optimization of monthly outage maintenance schedules faces challenges such as difficulty in multi-department coordination, high reliance on manual experience, and insufficient adaptability to dynamic demands. To address these issues, this paper proposes a collaborative optimization method for monthly outage schedules of power grids based on a large language model and reinforcement learning. The method uses the large language model to parse natural language requirements raised in balance meetings, converting requirements such as fixed maintenance dates, duration adjustments, and forbidden maintenance periods into structured constraint parameters. Subsequently, the small reinforcement learning model based on Dueling Deep Q-Network (Dueling DQN) re-optimizes the outage schedule according to the updated environment parameters, achieving a collaborative solution from meeting requirement parsing to schedule generation. Case study results on the IEEE 39-bus system show that the proposed method can integrate the dynamic requirements arising from multiple rounds of balance meetings and perform adaptive optimization of the outage schedule under different constraint conditions. Experimental results on the IEEE 39-bus system demonstrate that the proposed framework effectively optimizes monthly outage schedules. Compared with the initial schedule, the proposed method reduces monthly voltage violations by 31 times and decreases active power loss by 35.88 MWh.

23 April 2026 in SSRN Electronic Journal
Verified
Preprint
Open access
MLMengjie Li
Mengjie Li
QZQianqian Zhang
Qianqian Zhang
ZDZhenhuan Ding
Zhenhuan Ding
PLPengfei Li
Pengfei Li
YZYunbo Zhao
Yunbo Zhao
YKYu Kang
Yu Kang
To address the inefficient search caused by high-dimensional action spaces in distribution network fault restoration and the safety limitations of purely data-driven decisions in previously unseen scenarios, this paper proposes a knowledge-enhanced reinforcement learning framework, termed DQN-KG-BNN-IQR-Review. More specifically, a knowledge graph(KG) is first used to retrieve high-quality historical cases and provide heuristic action recommendations, thereby narrowing the search space during early training and alleviating inefficient exploration. On this basis, a Bayesian neural network(BNN) is introduced to quantify the epistemic uncertainty of the DQN in real time. By combining these uncertainty estimates with a sliding-window interquartile range(IQR), a dynamic safety boundary is constructed to govern the transition between autonomous model decisions and expert takeover, which improves decision robustness in cognitively unfamiliar states. In addition, a retrospective expert review mechanism is designed to replay successful expert trajectories after failed episodes. By correcting trajectory deviations and steering parameter updates toward more informative directions, this mechanism further enhances generalization. Experimental results show that the proposed framework not only accelerates training convergence, but also achieves an effective balance between restoration efficiency and operational safety in self-healing decision making through the coordinated interaction of its constituent modules.