Calvin Tsay

Calvin Tsay

Auto-generated profile, based on publicly available information

Calvin Tsay

Imperial College London

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 July 2020 in Journal of Process Control
Verified
Journal Article
Closed access
ACAdrian Caspari
Adrian Caspari
CTCalvin Tsay
Calvin Tsay
AMAdel Mhamdi
Adel Mhamdi
MBMichael Baldea
Michael Baldea
AMAlexander Mitsos
Alexander Mitsos

20 February 2025 in Industrial & Engineering Chemistry Research
Verified
Journal Article
Open access
MBMaximilian Bloor
Maximilian Bloor
AAAkhil Ahmed
Akhil Ahmed
NKNiki Kotecha
Niki Kotecha
MMMehmet Mercangöz
Mehmet Mercangöz
CTCalvin Tsay
Calvin Tsay
EREhecatl Antonio del Río-Chanona
Ehecatl Antonio del Río-Chanona
This work proposes a control-informed reinforcement learning (CIRL) framework that integrates proportional-integral-derivative (PID) control components into the architecture of deep reinforcement learning (RL) policies, incorporating prior knowledge from control theory into the learning process. CIRL improves performance and robustness by combining the best of both worlds: the disturbance-rejection and set point-tracking capabilities of PID control and the nonlinear modeling capacity of deep RL. Simulation studies conducted on a continuously stirred tank reactor system demonstrate the improved performance of CIRL compared to both conventional model-free deep RL and static PID controllers. CIRL exhibits better set point-tracking ability, particularly when generalizing to trajectories containing set points outside the training distribution, suggesting enhanced generalization capabilities. Furthermore, the embedded prior control knowledge within the CIRL policy improves its robustness to unobserved system disturbances. The CIRL framework combines the strengths of classical control and reinforcement learning to develop sample-efficient and robust deep reinforcement learning algorithms with potential applications in complex industrial systems.

22 February 2023 in Computers & Chemical Engineering
Verified
Journal Article
Open access
JFJose Pablo Folch
Jose Pablo Folch
RLRobert M. Lee
Robert M. Lee
BSBehrang Shafei
Behrang Shafei
DWDavid Walz
David Walz
CTCalvin Tsay
Calvin Tsay
RMRuth Misener
Ruth Misener

22 November 2024 in Current Opinion in Green and Sustainable Chemistry
Verified
Journal Article
Open access
JPJoel A. Paulson
Joel A. Paulson
CTCalvin Tsay
Calvin Tsay

1 January 2022 in Applied Energy
Verified
Journal Article
Closed access
ATAlexander Thebelt
Alexander Thebelt
CTCalvin Tsay
Calvin Tsay
RLRobert M. Lee
Robert M. Lee
NSNathan Sudermann-Merx
Nathan Sudermann-Merx
DWDavid Walz
David Walz
RMRuth Misener
Ruth Misener

22 March 2024 in Computers & Chemical Engineering
Verified
Journal Article
Open access
TMTom McDonald
Tom McDonald
CTCalvin Tsay
Calvin Tsay
ASArtur M. Schweidtmann
Artur M. Schweidtmann
NYNeil Yorke-Smith
Neil Yorke-Smith