The trust region method is an effective method for solving unconstrained optimization problems. Incorrectly updating the rules of the trust region radius will increase the number of iterations and affect the calculation efficiency. In order to obtain an effective radius for the trust region, an adaptive radius updating criterion is proposed based on the gradient of the current iteration point and the eigenvalue of the Hessian matrix which avoids calculating the inverse of the Hessian matrix during radius updating. This approach reduces the computation time and enhances the algorithm’s performance. On this basis, we apply adaptive radius and non-monotonic techniques to the trust region algorithm and propose an improved non-monotonic adaptive trust region algorithm. Under proper assumptions, the convergence of the algorithm is analyzed. Numerical experiments confirm that the suggested algorithm is effective.
This paper addresses the stability of stochastic delayed recurrent neural networks (SDRNNs), identifying challenges in existing scalar methods, which suffer from strong assumptions and limited applicability. Three key innovations are introduced: (1) weakening noise perturbation conditions by extending diagonal matrix assumptions to non-negative definite matrices; (2) establishing criteria for both mean-square exponential stability and almost sure exponential stability in the absence of input; (3) directly handling complex structures like time-varying delays through matrix analysis. Compared with prior studies, this approach yields broader stability conclusions under weaker conditions, with numerical simulations validating the theoretical effectiveness.