In this article, an active disturbance rejection controller (ADRC) based on deep reinforcement learning (DRL) algorithm is proposed to be used in the flux weakening control (FWC) system of motors for more electric aircraft. Artificial intelligence algorithm is introduced into ADRC motor control system for the first time, and DRL is designed as the automatic tuning for the parameters optimization of ADRC. The interface module scheme is proposed to realize the conversion between the relevant quantities of the control system and the DRL Agent according to the characteristics of ADRC. The parameters are optimized in the form of parameter modification, and a new DRL-ADRC control framework is proposed which can avoid being trapped into local optimum. The ADRC model designed for the speed loop of FWC system are first introduced. An interface module is subsequently built to enable DRL to interact with the FWC system automatically. DRL agent is trained to optimize the internal parameters of ADRC, which have the characteristics of large quantities, weak sensitivity and strong coupling. Deep deterministic policy gradient is used as the strategy of DRL, which can quickly determine the descent gradient and converge the multiobjective optimization problem. Simulation and comparison with classical heuristic algorithms and disturbance rejection methods are carried out to show the superiority of DRL. The feasibility and effectiveness of the proposed control method are verified by experiments on an aerospace motor for MEA.
6 December 2022 in IEEE Transactions on Industrial Electronics
In this article, a multiscenario parameter optimization method for an active disturbance rejection controller (ADRC) of a permanent magnet synchronous motor (PMSM) based on deep reinforcement learning (DRL) is proposed as MSPO-DRL. The parameter setting of the nonlinear ADRC has always been one of the difficulties affecting the optimal performance of ADRC, and there will be different optimal parameters under different control requirements. In this article, an artificial intelligence algorithm is introduced into the parameter optimization process of ADRC, and the DRL parameter optimization model that can automatically optimize and adjust the ADRC parameters in different application scenarios is constructed so that the ADRC can achieve the best control effect conveniently and the limitation of current methods has been solved. ADRC is applied to the speed loop of flux weakening control of PMSM for more electric aircraft, and the mathematical model of ADRC in this environment is built above all. The Markov decision process is integrated into ADRC. The interface module and reward function between ADRC and MSPO-DRL are designed. The concept of the ADRC control scenario is defined and integrated into the concept of the Markov decision process to improve the generalization of DRL. Then, the MSPO-DRL model is established, and the deep deterministic gradient strategy is used as the gradient descent strategy to converge the parameters optimization. After the model learning is completed, different environmental conditions are randomly selected for simulation and experiments to verify the optimization effect and generalization performance of the algorithm. Optimizations that are carried out by the heuristic algorithms are used for comparisons, and the superiority and feasibility of the proposed algorithm are verified.
15 November 2021 in IEEE Transactions on Power Electronics
In this article, an improved hybrid particle swarm optimization (IHPSO) algorithm is proposed to solve the optimization problem of controller parameters in the design of a permanent magnet synchronous motor (PMSM) servo system. The proposed algorithm presents the directional mutation operation to the particles, which fixes the position of some particular particles so as to enhance the searching ability to some remote regions. In order to cooperate with directional mutation operation, the updating formula of particles velocity is ulteriorly improved. Then, the proposed IHPSO algorithm is adopted to optimize parameters of the designed controller. A simulation and an experimental platform of the PMSM servo system are designed using a biological intelligence controller based on hormone regulation for the speed control and feedforward compensation for the position controller, where IHPSO is applied to the parameter optimization for speed and position controllers, which validate the effectiveness of the IHPSO algorithm and the designed control system.
25 May 2023 in IEEE Transactions on Power Electronics
This article proposes an improved model-free active disturbance rejection deadbeat predictive current control(ADRDPCC) method for permanent magnet synchronous motor (PMSM) used in more electric aircraft (MEA) based on the data driven method, which is used to solve the parameter mismatch problem of deadbeat predictive current control (DPCC) and improve the performance of PMSM control system. DPCC model applied to the current loop of the MEA motor is established as the main control strategy of the system. The principle of active disturbance rejection control is combined with DPCC, and the ADRDPCC structure is formed to optimize the control strategy. A specific extended state observer (ESO) of ADRDPCC is designed to track the internal disturbance caused by parameter mismatch and the external disturbance in real time. DPCC is used as the control law of the ADRDPCC structure to predict the current and output the reference voltage based on the observation of ESO. A deep reinforcement learning model based on ADRDPCC is designed and trained based on the data-driven method. The trained model can compensate and optimize ADRDPCC based on the disturbance observed by ESO and the observed control state of PMSM. The simulated and experimental results show the superiority of the proposed method.
10 January 2023 in IEEE Transactions on Energy Conversion
In this article, a novel active disturbance rejection control (ADRC) based on deep reinforcement learning (DRL) is proposed to improve the performance of permanent magnet synchronous motor (PMSM) for more electric aircraft (MEA). MEA motors have the requirements of safety and stability so that a new ADRC method is put forward based on the limitation of nonlinear error attenuation function of traditional ADRC. The flux weakening control model of PMSM is firstly established. Then the ADRC model is built and applied to the speed loop of the control system. In order to reduce the number of control parameters and the jitter of the control law, deep neural network is employed to replace the traditional control law. Markov decision process is integrated into the novel ADRC to establish DRL model. A method based on twin delayed deep deterministic (TD3) policy gradient algorithm is proposed to train the neural network and optimize the DRL model. Model predictive control and traditional ADRC are used as comparison algorithms. Simulation and experiments show the effectiveness and superiority of the proposed method.
17 August 2023 in IEEE Transactions on Power Electronics
The article proposes an enhanced deadbeat predictive current control for the permanent-magnet synchronous motor using an iterative sliding mode observer to improve the current control accuracy. The inevitable deadtime and distortion of flux linkage will lead to large periodic current ripples related to the speed, which may degrade the performance of the motor control. To overcome these problems and improve the robustness of the controller, the iterative learning control (ILC) and sliding mode observer are combined, and feedforward to the deadbeat controller for prediction accuracy improvement. Moreover, in order to satisfy the requirements of the variable speed operation of the motor, the ILC is enhanced to achieve spatial learning ability. Experimental results are finally implemented on STM32-based platform to validate the effectiveness of the proposed method for current ripples suppression and adaptability to variable speed.