Metaheuristic algorithms are constructed to solve optimization problems, but they cannot solve all the problems with best solutions. This work proposes a novel self-adaptive metaheuristic optimization algorithm, named Optimal Stochastic Process Optimizer (OSPO), which can solve different kinds of optimization problems with promising performance. Specifically, OSPO regards the procedure of optimization as a realization of stochastic process, and with the help of Subjective Probability Distribution Function (SPDF) and Receding Sampling Strategy proposed in this paper, OSPO can control the exploration-exploitation property online by the adaptive modification of the parameters in SPDF. This adaptive exploration-exploitation property of OSPO contributes to dealing with different kinds of problems; thus, it makes OSPO have the potential to solve at least a vast majority of optimization problems. The proposed algorithm is first benchmarked on uni-modal, multi-modal and composite test functions both in low and high dimensions. The results are verified by comparative studies with seven well-performed metaheuristic algorithms. Then, 21 real-world optimization problems are used to further investigate the effectiveness of OSPO. The winners of CEC2020 Competition on Real-World Single Objective Constrained Optimization, SASS algorithm, sCMAgES algorithm, EnMODE algorithm and COLSHADE algorithm are used as four comparative algorithms in real-world optimization problems. The analysis of simulations demonstrates that OSPO is able to provide very competitive performance compared to the comparative meta-heuristics both in benchmark functions and in real-world optimization problems; thus, the potential of OSPO to solve at least a vast majority of optimization problems is verified. A corresponding MATLAB APP demo is available on https://github.com/JiahongXu123/OSPO-algorithm.git.
Path-tracking control algorithms in agriculture typically focus on how to improve the trajectory-tracking performance of autonomous agricultural machinery, and the agricultural productivity is optimized in a two-layer way. The upper operational layer optimizes an optimal tracking trajectory with the best agricultural productivity, and the lower control layer—such as Nonlinear Model Predictive Control (NMPC)—receives this optimized tracking trajectory first, and then steers the vehicle to track this trajectory with high accuracy. However, this two-layer structure cannot improve the agricultural productivity at the control layer online, which makes the agricultural operation sub-optimal. In this paper, we focus on agricultural machinery operational efficiency, to represent agricultural productivity; in order to realize optimizing control to further improve agricultural machinery operational efficiency, a new path-tracking control algorithm, named Efficiency-oriented Model Predictive Control (EfiMPC), is proposed. EfiMPC is intrinsically a nested structure, which can consider the global performance of the whole system defined in the operational layer—like the agricultural machinery operational efficiency considered in this paper—in the control layer online; thus, the agricultural machinery operational efficiency can be improved during the farming operation. An unreachable tracking point, denoted as the pseudo-point, has been proposed, to indicate the agricultural machinery operational efficiency objective in a receding horizon fashion; EfiMPC can utilize this pseudo-point to realize the optimizing control online. A simulation case study was used to test the superiority of the proposed EfiMPC algorithm, and the results show that, compared with the traditional NMPC algorithm, the agricultural machinery operational efficiency realized by EfiMPC was improved by 8.56%; thus, the effectiveness of the EfiMPC has been demonstrated.
Optimal operation and control, which can result in the global optimal operation performance of industrial processes, has been a hot topic in recent control strategy designs. However, existing control strategies, such as real-time optimization (RTO), dynamic real-time optimization (DRTO), and economic model predictive control (EMPC), have their own limitations, and they can only generate sub-optimal operation performance. In order to further improve online global operation performance, a new kind of control strategy named efficiency-oriented model predictive control (EfiMPC) is proposed in this paper. The aim of the EfiMPC is discussed first, and then, the ideal EfiMPC strategy with a nested structure is proposed, where the inner layer is the offline construction of an efficiency-oriented terminal region, and the outer layer is the direct optimization of the transient operation performance. This efficiency-oriented terminal region can guarantee a dynamic operation performance in the closed-loop perspective, and a better global operation performance can thus be obtained. A practical EfiMPC strategy, which replaces the offline construction of the efficiency-oriented terminal region with the online optimization of the average dynamic operation performance in the inner layer, is also proposed, and the recursive feasibility as well as the closed-loop stability of practical EfiMPC are discussed. Finally, a CSTR application was used to test the superiority of the proposed EfiMPC strategy, and the simulation results show that EfiMPC can obtain the best global operation performance compared with the other three control strategies; thus, the effectiveness of EfiMPC is demonstrated.
Existing control strategies, such as Real-time Optimization (RTO), Dynamic Real-time Optimization (DRTO), and Economic Model Predictive Control (EMPC) cannot enable optimal operation and control behavior in an optimal fashion. This work proposes a novel control strategy, named the efficiency-oriented model predictive control (MPC), which can fully realize the potential of the optimization margin to improve the global process performance of the whole system. The ideas of optimization margin and optimization efficiency are first proposed to measure the superiority of the control strategy. Our new efficiency-oriented MPC innovatively uses a nested optimization structure to optimize the optimization margin directly online. To realize the computation, a Periodic Approximation technique is proposed, and an Efficiency-Oriented MPC Type I is constructed based on the Periodic Approximation. In order to alleviate the strict constraint of Efficiency-Oriented MPC Type I, the zone-control-based optimization concept is used to construct an Efficiency-Oriented MPC Type II. These two well-designed efficiency-oriented controllers were compared with other control strategies over a Continuous Stirred Tank Reactor (CSTR) application. The simulation results show that the proposed control strategy can generate superior closed-loop process performance, for example, and the Efficiency-Oriented MPC Type I can obtain 7.11% higher profits than those of other control strategies; the effectiveness of the efficiency-oriented MPC was, thereby, demonstrated.
Purpose: The purpose of this research on the control of three-axis aero-dynamic pendulum with disturbance is to facilitate the applications of equipment with similar pendulum structure in intelligent manufacturing and robot. Design/methodology/approach: The controller proposed in this paper is mainly implemented in the following ways. First, the kinematic model of the three-axis aero-dynamic pendulum is derived in state space form to construct the predictive model. Then, according to the predictive model and objective function, the control problem can be expressed a quadratic programming (QP) problem. The optimal solution of the QP problem at each sampling time is the value of control variable. Findings: The trajectory tracking and point stability tests performed on the 3D space with different disturbances are validated and the results show the effectiveness of the proposed control strategy. Originality/value: This paper proposes a nonlinear unstable three-axis aero-dynamic pendulum with less power devices. Meanwhile, the trajectory tracking and point stability problem of the pendulum system is investigated with the model predictive control strategy.
In reinforcement learning (RL), reward function design is critical to the learning efficiency and final performance of agents. However, in complex tasks such as humanoid motion tracking, traditional static weighted reward functions struggle to adapt to shifting learning priorities across training stages, and designing a suitable shaping reward is problematic. To address these challenges, this paper proposes a two-layered reward reinforcement learning framework. The framework decomposes the reward into two layers: an upper-level goal reward that measures task completion, and a lower-level optimizing reward that includes auxiliary objectives such as stability, energy consumption, and motion smoothness. The key innovation lies in the online optimization of the lower-level reward weights via an online meta-heuristic optimization algorithm. This online adaptivity enables goal-conditioned reward shaping, allowing the reward structure to evolve autonomously without requiring expert demonstrations, thereby improving learning robustness and interpretability. The framework is tested on a gymnastic motion tracking problem for the Unitree G1 humanoid robot in the Isaac Gym simulation environment. The experimental results show that, compared to a static reward baseline, the proposed framework achieves 7.58% and 10.30% improvements in upper-body and lower-body link tracking accuracy, respectively. The resulting motions also exhibit better synchronization and reduced latency. The simulation results demonstrate the effectiveness of the framework in promoting efficient exploration, accelerating convergence, and enhancing motion imitation quality.