Thiagarajan Ramachandran

Thiagarajan Ramachandran

Auto-generated profile, based on publicly available information

Thiagarajan Ramachandran

Pacific Northwest National Laboratory (PNNL), Richland, USA

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 November 2020
Verified
Conference Paper
Open access
ABArnab Bhattacharya
Arnab Bhattacharya
TRThiagarajan Ramachandran
Thiagarajan Ramachandran
SBSandeep Banik
Sandeep Banik
CDChase P. Dowling
Chase P. Dowling
SBShaunak D. Bopardikar
Shaunak D. Bopardikar
Adversary emulation is an offensive exercise that provides a comprehensive assessment of a system’s resilience against cyber attacks. However, adversary emulation is typically a manual process, making it costly and hard to deploy in cyber-physical systems (CPS) with complex dynamics, vulnerabilities, and operational uncertainties. In this paper, we develop an automated, domain-aware approach to adversary emulation for CPS. We formulate a Markov Decision Process (MDP) model to determine an optimal attack sequence over a hybrid attack graph with cyber (discrete) and physical (continuous) components and related physical dynamics. We apply model-based and model-free reinforcement learning (RL) methods to solve the discrete-continuous MDP in a tractable fashion. As a baseline, we also develop a greedy attack algorithm and compare it with the RL procedures. We summarize our findings through a numerical study on sensor deception attacks in buildings to compare the performance and solution quality of the proposed algorithms.

13 July 2023 in ACM Transactions on Cyber-Physical Systems
Verified
Journal Article
Open access
SBSandeep Banik
Sandeep Banik
TRThiagarajan Ramachandran
Thiagarajan Ramachandran
ABArnab Bhattacharya
Arnab Bhattacharya
SBShaunak D. Bopardikar
Shaunak D. Bopardikar
Security of cyber-physical systems (CPS) continues to pose new challenges due to the tight integration and operational complexity of the cyber and physical components. To address these challenges, this article presents a domain-aware, optimization-based approach to determine an effective defense strategy for CPS in an automated fashion—by emulating a strategic adversary in the loop that exploits system vulnerabilities, interconnection of the CPS, and the dynamics of the physical components. Our approach builds on an adversarial decision-making model based on a Markov Decision Process (MDP) that determines the optimal cyber (discrete) and physical (continuous) attack actions over a CPS attack graph. The defense planning problem is modeled as a non-zero-sum game between the adversary and defender. We use a model-free reinforcement learning method to solve the adversary’s problem as a function of the defense strategy. We then employ Bayesian optimization (BO) to find an approximate best-response for the defender to harden the network against the resulting adversary policy. This process is iterated multiple times to improve the strategy for both players. We demonstrate the effectiveness of our approach on a ransomware-inspired graph with a smart building system as the physical process. Numerical studies show that our method converges to a Nash equilibrium for various defender-specific costs of network hardening.

15 November 2025
Verified
Conference Paper
Open access
RMRounak Meyur
Rounak Meyur
SDSam Donald
Sam Donald
TMTonya Martin
Tonya Martin
TRThiagarajan Ramachandran
Thiagarajan Ramachandran
SPSumit Purohit
Sumit Purohit