In this article, a novel hybrid reinforcement $Q$ -learning control method is proposed to solve the adaptive fuzzy $H_{\infty }$ control problem of discrete-time nonlinear Markov jump systems based on the Takagi–Sugeno fuzzy model. First, the core problem of adaptive fuzzy $H_{\infty }$ control is converted to solving fuzzy game coupled algebraic Riccati equation, which can hardly be solved by mathematical methods directly. To solve this problem, an offline parallel hybrid learning algorithm is first designed, where system dynamics should be known as a prior. Furthermore, an online parallel $Q$ -learning hybrid learning algorithm is developed. The main characteristics of the proposed online hybrid learning algorithms are threefold: 1) system dynamics are avoided during the learning process; 2) compared with the policy iteration method, the restriction of the initial stable control policy is removed; and 3) compared with the value iteration method, a faster convergence rate can be obtained. Finally, we provide a tunnel diode circuit system model to validate the effectiveness of the present learning algorithm.

In the literature, the effects of switching with average dwell time (ADT), Markovian switching, and intermittent coupling on stability and synchronization of dynamic systems have been extensively investigated. However, all of them are considered separately because it seems that the three kinds of switching are different from each other. This article proposes a new concept to unify these switchings and considers global exponential synchronization almost surely (GES a.s.) in an array of neural networks (NNs) with mixed delays (including time-varying delay and unbounded distributed delay), switching topology, and stochastic perturbations. A general switching mechanism with transition probability (TP) and mode-dependent ADT (MDADT) (i.e., TP-based MDADT switching in this article) is introduced. By designing a multiple Lyapunov-Krasovskii functional and developing a set of new analytical techniques, sufficient conditions are obtained to ensure that the coupled NNs with the general switching topology achieve GES a.s., even in the case that there are both synchronizing and nonsynchronizing modes. Our results have removed the restrictive condition that the increment coefficients of the multiple Lyapunov-Krasovskii functional at switching instants are larger than one. As applications, the coupled NNs with Markovian switching topology and intermittent coupling are employed. Numerical examples are provided to demonstrate the effectiveness and the merits of the theoretical analysis.

This article considers global exponential synchronization almost surely (GES a.s.) for a class of switched discrete-time neural networks (DTNNs). The considered system switches from one mode to another according to transition probability (TP) and evolves with mode-dependent average dwell time (MDADT), i.e., TP-based MDADT switching, which is more practical than classical average dwell time (ADT) switching. The logarithmic quantization technique is utilized to design mode-dependent quantized output controllers (QOCs). Noticing that external perturbations are unavoidable, actuator fault (AF) is also considered. New Lyapunov-Krasovskii functionals and analytical techniques are developed to obtain sufficient conditions to guarantee the GES a.s. It is discovered that the TP matrix plays an important role in achieving the GES a.s., the upper bound of the dwell time (DT) of unsynchronized subsystems can be very large, and the lower bound of the DT of synchronized subsystems can be very small. An algorithm is given to design the control gains, and an optimal algorithm is provided for reducing conservatism of the given results. Numerical examples demonstrate the effectiveness and the merits of the theoretical analysis.

This paper proposes a quaternion-valued one-layer recurrent neural network approach to resolve constrained convex function optimization problems with quaternion variables. Leveraging the novel generalized Hamilton-real (GHR) calculus, the quaternion gradient-based optimization techniques are proposed to derive the optimization algorithms in the quaternion field directly rather than the methods of decomposing the optimization problems into the complex domain or the real domain. Via chain rules and Lyapunov theorem, the rigorous analysis shows that the deliberately designed quaternion-valued one-layer recurrent neural network stabilizes the system dynamics while the states reach the feasible region in finite time and converges to the optimal solution of the considered constrained convex optimization problems finally. Numerical simulations verify the theoretical results.

In this article, a periodic self-triggered impulsive (PSTI) control scheme is proposed to achieve synchronization of neural networks (NNs). Two kinds of impulsive gains with constant and random values are considered, and the corresponding synchronization criteria are obtained based on tools from impulsive control, event-driven control theory, and stability analysis. The designed triggering protocol is simpler, easier to implement, and more flexible compared with some previously reported algorithms as the protocol combines the advantages of the periodic sampling and event-driven control. In addition, the chaotic synchronization of NNs via the presented PSTI sampling is further applied to encrypt images. Several examples are also utilized to illustrate the validity of the presented synchronization algorithm of NNs based on PSTI control and its potential applications in image processing.

This article addresses the investigation of sliding-mode control (SMC) for slow-sampling singularly perturbed systems (SPSs) with Markov jump parameters. As a new attempt, the SMC strategy is considered in the study of discrete-time Markov jump SPSs. Subsequently, in order to design a sliding-mode controller to ensure the stability of the proposed system, a novel integral sliding surface is constructed, and an SMC law is synthesized to ensure the reachability of the sliding surface. Through the utilization of Lyapunov stability and SMC theory, sufficient conditions are derived to ensure the state trajectories of the system are driven to a predefined sliding surface and the closed-loop sliding mode dynamics are stochastically stable. Finally, the applicability of the proposed SMC strategy is verified by a numerical example and a practical electric circuit model.