In this paper, two novel algorithms to find the Nash equilibrium solution of the non‐zero‐sum games for continuous‐time input‐affine nonlinear systems are presented. Based on integral reinforcement learning method, the integral‐exploration‐coupled Hamilton‐Jacobi (HJ) equations are derived, which does not contain any information of the system dynamics. Then, based on neural networks approximation, two different adaptive tuning law of weights are given to estimate the approximate solution of the coupled HJ equations. Both two algorithms can estimate the value function and the policy without knowing or identifying the system dynamics. The closed‐loop system stability and the convergence of weights are guaranteed based on Lyapunov analysis. Finally, the simulation results of a two‐player non‐zero‐sum game demonstrate the effectiveness of our algorithms.
The nonlinear characteristics in the bicycle robot dynamic system make the bicycle robot control much more difficult. Aiming at this problem, the cascade sliding-mode control method was applied to the bicycle robot nonlinear system. A kind of bicycle robot nonlinear dynamic model presented based on Lagrange method was analyzed and the cascade sliding-mode controller of multi-sliding surface was designed with the method of variable structure control theory. This method divided system states into two sub-systems. Firstly, two state variables of subsystem are chosen to construct the first-layer sliding surface, on the basis of the first-layer sliding function, the first layer sliding surface and one of the residual state variables are used to construct the second-layer sliding surface, at last, all of the system states are included in final sliding surface. The ultimate control is obtained by using Lyapunov stability theorem. since each sub-sliding surface contains the equivalent components of sliding surface, which makes the system states move along the each sub-sliding surface. The cascade sliding-mode controller has the bicycle robot controlled effectively, which has been verified in the simulation experiment.
Tilt angle measurement in dynamic systems is problematic because the rotation of the measured platform is coupled with translation. Therefore, when some sensors are applied in dynamic systems, their output signals are often submerged in the noise signals generated by translation. To enhance the ability of tilt sensors to resist translational noise, a dynamic tilt sensor is proposed based on the principle of variable reluctance from the perspective of sensor structure. The eccentric structure of the sensor constructed with a shell, liquid, and internal damping plate was designed according to the principles of mechanics. The characteristic of translational acceleration restraint determined by the sensor structure was established theoretically. In addition, the magnetic circuit of the sensor was analyzed to illustrate the sensor’s working principles. A Clapp oscillator circuit was designed to convert mechanical motion into a measureable electrical signal. A method to determine the sensor’s direction of rotation is proposed. A waveform conversion circuit was designed to convert the sine wave output of the Clapp oscillator to a square wave, and a square-wave frequency measurement circuit was designed based on the C8051 micro-control unit. A translation–rotation experimental hardware platform was constructed. The data acquisition program was designed on a PC platform, and the translation–rotation experiments were conducted with an MTi attitude measurement unit as a reference. The validity of the tilt angle measurements and the effect of the translational acceleration restraint of the sensor were verified by the experimental data. The theoretical results obtained were consistent with the experimental data, verifying the validity of the theoretical analysis and experimental devices employed. A measurement range of −180 to 180° was achieved.
The main distribution frame (MDF) is an important component between the user and the operator that supplies a telecommunication service and is the only layer in the seven-layer communication architecture that is not fully automated. In this paper, a cross-connect method for simulating the rapier picking of a rapier loom (shuttleless loom) is proposed to imitate the shedding and the picking action to achieve quick switching. Using the designed “shedding device” and “picking device”, a model prototype of the automatic optical distribution frame (AODF) was constructed and tested for verification.