Donald Coolidge Wunsch

Prof. Donald Coolidge Wunsch

orcid

Research Focus & Metrics

Academic Career Length

25Years (2002-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 October 2022 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
Yongliang YangYongliang Yang
Yongliang Yang
YPYongping Pan
Yongping Pan
CXCheng-Zhong Xu
Cheng-Zhong Xu
DWDonald Coolidge Wunsch
Donald Coolidge Wunsch
This article presents a novel efficient experience-replay-based adaptive dynamic programming (ADP) for the optimal control problem of a class of nonlinear dynamical systems within the Hamiltonian-driven framework. The quasi-Hamiltonian is presented for the policy evaluation problem with an admissible policy. With the quasi-Hamiltonian, a novel composite critic learning mechanism is developed to combine the instantaneous data with the historical data. In addition, the pseudo-Hamiltonian is defined to deal with the performance optimization problem. Based on the pseudo-Hamiltonian, the conventional Hamilton–Jacobi–Bellman (HJB) equation can be represented in a filtered form, which can be implemented online. Theoretical analysis is investigated in terms of the convergence of the adaptive critic design and the stability of the closed-loop systems, where parameter convergence can be achieved under a weakened excitation condition. Simulation studies are investigated to verify the efficacy of the presented design scheme.

14 April 2021 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
Weinan GaoWeinan Gao
Weinan Gao
MMMohammed Mynuddin
Mohammed Mynuddin
DWDonald Coolidge Wunsch
Donald Coolidge Wunsch
ZJZhong-Ping Jiang
Zhong-Ping Jiang
In this article, a data-driven distributed control method is proposed to solve the cooperative optimal output regulation problem of leader–follower multiagent systems. Different from traditional studies on cooperative output regulation, a distributed adaptive internal model is originally developed, which includes a distributed internal model and a distributed observer to estimate the leader’s dynamics. Without relying on the dynamics of multiagent systems, we have proposed two reinforcement learning algorithms, policy iteration and value iteration, to learn the optimal controller through online input and state data, and estimated values of the leader’s state. By combining these methods, we have established a basis for connecting data-distributed control methods with adaptive dynamic programming approaches in general since these are the theoretical foundation from which they are built.

16 September 2021 in Biomarker Research
Verified
Journal Article
Open access
PDF file
Daniel B HierDaniel B Hier
Daniel B Hier
TOTayo Obafemi-ajayi
Tayo Obafemi-ajayi
MTMatthew S. Thimgan
Matthew S. Thimgan
GOGayla R. Olbricht
Gayla R. Olbricht
SASima Azizi
Sima Azizi
DWDonald Coolidge Wunsch
Donald Coolidge Wunsch
Background: The use of blood biomarkers after mild traumatic brain injury (mTBI) has been widely studied. We have identified eight unresolved issues related to the use of five commonly investigated blood biomarkers: neurofilament light chain, ubiquitin carboxy-terminal hydrolase-L1, tau, S100B, and glial acidic fibrillary protein. We conducted a focused literature review of unresolved issues in three areas: mode of entry into and exit from the blood, kinetics of blood biomarkers in the blood, and predictive capacity of the blood biomarkers after mTBI. Findings: Although a disruption of the blood brain barrier has been demonstrated in mild and severe traumatic brain injury, biomarkers can enter the blood through pathways that do not require a breach in this barrier. A definitive accounting for the pathways that biomarkers follow from the brain to the blood after mTBI has not been performed. Although preliminary investigations of blood biomarkers kinetics after TBI are available, our current knowledge is incomplete and definitive studies are needed. Optimal sampling times for biomarkers after mTBI have not been established. Kinetic models of blood biomarkers can be informative, but more precise estimates of kinetic parameters are needed. Confounding factors for blood biomarker levels have been identified, but corrections for these factors are not routinely made. Little evidence has emerged to date to suggest that blood biomarker levels correlate with clinical measures of mTBI severity. The significance of elevated biomarker levels thirty or more days following mTBI is uncertain. Blood biomarkers have shown a modest but not definitive ability to distinguish concussed from non-concussed subjects, to detect sub-concussive hits to the head, and to predict recovery from mTBI. Blood biomarkers have performed best at distinguishing CT scan positive from CT scan negative subjects after mTBI.

22 February 2019 in IEEE Transactions on Cybernetics
Verified
Journal Article
Closed access
Shuhui LiShuhui Li
Shuhui Li
HWHoyun Won
Hoyun Won
XFXingang Fu
Xingang Fu
MFMichael Fairbank
Michael Fairbank
DWDonald Coolidge Wunsch
Donald Coolidge Wunsch
Eduardo AlonsoEduardo Alonso
Eduardo Alonso
This paper focuses on current control in a permanent-magnet synchronous motor (PMSM). This paper has two main objectives: the first objective is to develop a neural-network (NN) vector controller to overcome the decoupling inaccuracy problem associated with the conventional proportional-integral-based vector-control methods. The NN is developed using the full dynamic equation of a PMSM, and trained to implement optimal control based on approximate dynamic programming. The second objective is to evaluate the robust and adaptive performance of the NN controller against that of the conventional standard vector controller under motor parameter variation and dynamic control conditions by: 1) simulating the behavior of a PMSM typically used in realistic electric vehicle applications and 2) building an experimental system for hardware validation as well as combined hardware and simulation evaluation. The results demonstrate that the NN controller outperforms conventional vector controllers in both simulation and hardware implementation.

31 January 2018 in IEEE Transactions on Control Systems Technology
Verified
Journal Article
Closed access
Yongliang YangYongliang Yang
Yongliang Yang
HMHamidreza Modares
Hamidreza Modares
DWDonald Coolidge Wunsch
Donald Coolidge Wunsch
YYYixin Yin
Yixin Yin
This brief presents a partially model-free solution to the distributed containment control of multiagent systems using off-policy reinforcement learning (RL). The followers are assumed to be heterogeneous with different dynamics, and the leaders are assumed to be active in the sense that their control inputs can be nonzero. Optimality is explicitly imposed in solving the containment problem to not only drive the agents' states into a convex hull of the leaders' states but also minimize their transient responses. Inhomogeneous algebraic Riccati equations (AREs) are derived to solve the optimal containment control with active leaders. The resulting control protocol for each agent depends on its own state and an estimation of an interior point inside the convex hull spanned by the leaders. This estimation is provided by designing a distributed observer for a trajectory inside the convex hull of active leaders. Only the knowledge of the leaders' dynamics is required by the observer. An off-policy RL algorithm is developed to solve the inhomogeneous AREs online in real time without requiring any knowledge of the followers' dynamics. Finally, a simulation example is presented to show the effectiveness of the presented algorithm.

10 February 2020 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
Yongliang YangYongliang Yang
Yongliang Yang
KVKyriakos G. Vamvoudakis
Kyriakos G. Vamvoudakis
HMHamidreza Modares
Hamidreza Modares
YYYixin Yin
Yixin Yin
DWDonald Coolidge Wunsch
Donald Coolidge Wunsch
In this article, we present an intermittent framework for safe reinforcement learning (RL) algorithms. First, we develop a barrier function-based system transformation to impose state constraints while converting the original problem to an unconstrained optimization problem. Second, based on optimal derived policies, two types of intermittent feedback RL algorithms are presented, namely, a static and a dynamic one. We finally leverage an actor/critic structure to solve the problem online while guaranteeing optimality, stability, and safety. Simulation results show the efficacy of the proposed approach.