Soumyendu Sarkar

Mr. Soumyendu Sarkar


Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
Soumyendu SarkarSoumyendu Sarkar
Soumyendu Sarkar
Avisek NaugAvisek Naug
Avisek Naug
RLRicardo Luna
Ricardo Luna
AGAntonio Guillen
Antonio Guillen
VGVineet Gundecha
Vineet Gundecha
ABAshwin Ramesh Babu
Ashwin Ramesh Babu
As machine learning workloads are significantly increasing energy consumption, sustainable data centers with low carbon emissions are becoming a top priority for governments and corporations worldwide. This requires a paradigm shift in optimizing power consumption in cooling and IT loads, shifting flexible loads based on the availability of renewable energy in the power grid, and leveraging battery storage from the uninterrupted power supply in data centers, using collaborative agents. The complex association between these optimization strategies and their dependencies on variable external factors like weather and the power grid carbon intensity makes this a hard problem. Currently, a real-time controller to optimize all these goals simultaneously in a dynamic real-world setting is lacking. We propose a Data Center Carbon Footprint Reduction (DC-CFR) multi-agent Reinforcement Learning (MARL) framework that optimizes data centers for the multiple objectives of carbon footprint reduction, energy consumption, and energy cost. The results show that the DC-CFR MARL agents effectively resolved the complex interdependencies in optimizing cooling, load shifting, and energy storage in real-time for various locations under real-world dynamic weather and grid carbon intensity conditions. DC-CFR significantly outperformed the industry-standard ASHRAE controller with a considerable reduction in carbon emissions (14.5%), energy usage (14.4%), and energy cost (13.7%) when evaluated over one year across multiple geographical regions.

1 August 2023
Verified
Conference Paper
Open access
PDF file
Soumyendu SarkarSoumyendu Sarkar
Soumyendu Sarkar
VGVineet Gundecha
Vineet Gundecha
SGSahand Ghorbanpour
Sahand Ghorbanpour
ASAlexander Shmakov
Alexander Shmakov
ABAshwin Ramesh Babu
Ashwin Ramesh Babu
MCMathieu Cocho
Mathieu Cocho
Electronic proceedings of IJCAI 2023

24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
Soumyendu SarkarSoumyendu Sarkar
Soumyendu Sarkar
Avisek NaugAvisek Naug
Avisek Naug
AGAntonio Guillen
Antonio Guillen
RLRicardo Luna
Ricardo Luna
VGVineet Gundecha
Vineet Gundecha
SMSajad Mousavi
Sajad Mousavi
The rapid growth of machine learning (ML) has led to an increased demand for computational power, resulting in larger data centers (DCs) and higher energy consumption. To address this issue and reduce carbon emissions, intelligent design and control of DC components such as IT servers, cabinets, HVAC cooling, flexible load shifting, and battery energy storage are essential. However, the complexity of designing and controlling them in tandem presents a significant challenge. While some individual components like CFD-based design and Reinforcement Learning (RL) based HVAC control have been researched, there's a gap in the holistic design and optimization covering all elements simultaneously. To tackle this, we've developed DCRL-Green, a multi-agent RL environment that empowers the ML community to design data centers and research, develop, and refine RL controllers for carbon footprint reduction in DCs. It is a flexible, modular, scalable, and configurable platform that can handle large High Performance Computing (HPC) clusters. Furthermore, in its default setup, DCRL-Green provides a benchmark for evaluating single as well as multi-agent RL algorithms. It easily allows users to subclass the default implementations and design their own control approaches, encouraging community development for sustainable data centers. Open Source Link: https://github.com/HewlettPackard/dc-rl

11 April 2025 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
Soumyendu SarkarSoumyendu Sarkar
Soumyendu Sarkar
ABAshwin Ramesh Babu
Ashwin Ramesh Babu
SMSajad Mousavi
Sajad Mousavi
VGVineet Gundecha
Vineet Gundecha
SGSahand Ghorbanpour
Sahand Ghorbanpour
DRDesik Rengarajan
Desik Rengarajan
We present a Reinforcement Learning Platform for Adversarial Black-box untargeted and targeted attacks, RLAB, that allows users to select from various distortion filters to create adversarial examples. The platform uses a Reinforcement Learning agent to add minimum distortion to input images while still causing misclassification by the target model. The agent uses a novel dual-action method to explore the input image at each step to identify sensitive regions for adding distortions while removing noises that have less impact on the target model. This dual action leads to faster and more efficient convergence of the attack. The platform can also be used to measure the robustness of image classification models against specific distortion types. Also, retraining the model with adversarial samples significantly improved robustness when evaluated on benchmark datasets. The proposed platform outperforms state-of-the-art methods in terms of the average number of queries required to cause misclassification. This advances trustworthiness with a positive social impact.

11 April 2025 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
Soumyendu SarkarSoumyendu Sarkar
Soumyendu Sarkar
Avisek NaugAvisek Naug
Avisek Naug
AGAntonio Guillen
Antonio Guillen
VGVineet Gundecha
Vineet Gundecha
RGRicardo Luna Gutiérrez
Ricardo Luna Gutiérrez
CBCullen Bash
Cullen Bash
Reducing the environmental impact of cloud computing requires efficient workload distribution across geographically dispersed Data Center Clusters (DCCs) and simultaneously optimizing liquid and air (HVAC) cooling with time shift of workloads within individual data centers (DC). This paper introduces Green-DCC, which proposes a Reinforcement Learning (RL) based hierarchical controller to optimize both workload and liquid cooling dynamically in a DCC. By incorporating factors like weather, carbon intensity, and resource availability, Green-DCC addresses realistic constraints and interdependencies. We demonstrate how the system optimizes multiple data centers synchronously, enabling the scope of digital twins, and compare the performance of various RL approaches based on carbon emissions and sustainability metrics while also offering a framework and benchmark simulation for broader ML research in sustainability.

24 March 2024 in Proceedings of the AAAI Conference on Artificial Intelligence
Verified
Journal Article
Open access
PDF file
Soumyendu SarkarSoumyendu Sarkar
Soumyendu Sarkar
ABAshwin Ramesh Babu
Ashwin Ramesh Babu
SMSajad Mousavi
Sajad Mousavi
VGVineet Gundecha
Vineet Gundecha
Avisek NaugAvisek Naug
Avisek Naug
SGSahand Ghorbanpour
Sahand Ghorbanpour
We present a generic Reinforcement Learning (RL) framework optimized for crafting adversarial attacks on different model types spanning from ECG signal analysis (1D), image classification (2D), and video classification (3D). The framework focuses on identifying sensitive regions and inducing misclassifications with minimal distortions and various distortion types. The novel RL method outperforms state-of-the-art methods for all three applications, proving its efficiency. Our RL approach produces superior localization masks, enhancing interpretability for image classification and ECG analysis models. For applications such as ECG analysis, our platform highlights critical ECG segments for clinicians while ensuring resilience against prevalent distortions. This comprehensive tool aims to bolster both resilience with adversarial training and transparency across varied applications and data types.