Bo Pang

Bo Pang

Auto-generated profile, based on publicly available information

Bo Pang

Control and Networks Lab, Department of Electrical and Computer Engineering, Tandon School of Engineering, New York University, Brooklyn, NY, USA

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 June 2021 in IEEE Transactions on Automatic Control
Verified
Journal Article
Closed access
BPBo Pang
Bo Pang
TBTao Bian
Tao Bian
ZJZhong-Ping Jiang
Zhong-Ping Jiang
This article studies the robustness of policy iteration in the context of continuous-time infinite-horizon linear quadratic regulator (LQR) problem. It is shown that Kleinman's policy iteration algorithm is small-disturbance input-to-state stable, a property that is stronger than Sontag's local input-to-state stability but weaker than global input-to-state stability. More precisely, whenever the error in each iteration is bounded and small, the solutions of the policy iteration algorithm are also bounded and enter a small neighborhood of the optimal solution of the LQR problem. Based on this result, an off-policy data-driven policy iteration algorithm for the LQR problem is shown to be robust when the system dynamics are subject to small additive unknown bounded disturbances. The theoretical results are validated by a numerical example.

1 August 2020 in Automatica
Verified
Journal Article
Closed access
BPBo Pang
Bo Pang
ZJZhong-Ping Jiang
Zhong-Ping Jiang
IMIven Mareels
Iven Mareels

1 September 2018 in Engineering Applications of Artificial Intelligence
Verified
Journal Article
Closed access
YCYin Cheng
Yin Cheng
YHYuexin Huang
Yuexin Huang
BPBo Pang
Bo Pang
WZWeidong Zhang
Weidong Zhang

3 May 2022 in IEEE Transactions on Automatic Control
Verified
Journal Article
Closed access
BPBo Pang
Bo Pang
ZJZhong-Ping Jiang
Zhong-Ping Jiang
This article studies the adaptive optimal stationary control of continuous-time linear stochastic systems with both additive and multiplicative noises, using reinforcement learning techniques. Based on policy iteration, a novel off-policy reinforcement learning algorithm, named optimistic least-squares-based policy iteration, is proposed, which is able to find iteratively near-optimal policies of the adaptive optimal stationary control problem directly from input/state data without explicitly identifying any system matrices, starting from an initial admissible control policy. The solutions given by the proposed optimistic least-squares-based policy iteration are proved to converge to a small neighborhood of the optimal solution with probability one, under mild conditions. The application of the proposed algorithm to a triple inverted pendulum example validates its feasibility and effectiveness.

16 April 2020 in IEEE Transactions on Automatic Control
Verified
Journal Article
Closed access
BPBo Pang
Bo Pang
ZJZhong-Ping Jiang
Zhong-Ping Jiang
This article studies the infinite-horizon adaptive optimal control of continuous-time linear periodic (CTLP) systems. A novel value iteration (VI) based off-policy adaptive dynamic programming (ADP) algorithm is proposed for a general class of CTLP systems, so that approximate optimal solutions can be obtained directly from the collected data, without the exact knowledge of system dynamics. Under mild conditions, the proofs on uniform convergence of the proposed algorithm to the optimal solutions are given for both the model-based and model-free cases. The VI-based ADP algorithm is able to find suboptimal controllers without assuming the knowledge of an initial stabilizing controller. Application to the optimal control of a triple inverted pendulum subjected to a periodically varying load demonstrates the feasibility and effectiveness of the proposed method.

8 May 2023 in IEEE Transactions on Automatic Control
Verified
Journal Article
Closed access
LCLeilei Cui
Leilei Cui
BPBo Pang
Bo Pang
ZJZhong-Ping Jiang
Zhong-Ping Jiang
This paper studies the adaptive optimal control problem for a class of linear time-delay systems described by delay differential equations (DDEs). A crucial strategy is to take advantage of recent developments in reinforcement learning (RL) and adaptive dynamic programming (ADP) and develop novel methods to learn adaptive optimal controllers from finite samples of input and state data. In this paper, the data-driven policy iteration (PI) is proposed to solve the infinite-dimensional algebraic Riccati equation (ARE) iteratively in the absence of exact model knowledge. Interestingly, the proposed recursive PI algorithm is new in the present context of continuous-time time-delay systems, even when the model knowledge is assumed known. The efficacy of the proposed learning-based control methods is validated by means of practical applications arising from metal cutting and autonomous driving.