Vijay Gadepally

Vijay Gadepally

Auto-generated profile, based on publicly available information

Vijay Gadepally

SuperComputing Center, MIT Lincoln Laboratory, USA

Research Focus & Metrics

Academic Career Length

15Years (2012-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 October 2023
Verified
Conference Paper
Open access
DZDan Zhao
Dan Zhao
SSSiddharth Samsi
Siddharth Samsi
JMJoseph McDonald
Joseph McDonald
BLBaolin Li
Baolin Li
DBDavid Bestor
David Bestor
VGVijay Gadepally
Vijay Gadepally
As research and deployment of AI grows, the computational burden to support and sustain its progress inevitably does too. To train or fine-tune state-of-the-art models in NLP, computer vision, etc., some form of AI hardware acceleration is virtually a requirement. Recent large language models require considerable resources to train and deploy, resulting in significant energy usage, potential carbon emissions, and massive demand for GPUs and other hardware accelerators. However, this surge carries large implications for energy sustainability at the HPC/datacenter level. In this paper, we study the effects of power-capping GPUs at a research supercomputing center on GPU temperature and power draw; we show significant decreases in both temperature and power draw, reducing power consumption and potentially improving hardware life-span, with minimal impact on job performance. To our knowledge, our work is the first to conduct and make available a detailed analysis of the effects of GPU power-capping at the supercomputing scale. We hope our work will inspire HPCs/datacenters to further explore, evaluate, and communicate the impact of power-capping AI hardware accelerators for more sustainable AI.

1 December 2012 in The Journal of Computational Science Education
Verified
Journal Article
Open access
VGVijay Gadepally
Vijay Gadepally
AKAshok Krishnamurthy
Ashok Krishnamurthy
UOUmit Ozguner
Umit Ozguner

17 July 2024
Verified
Conference Paper
Open access
CBChansup Byun
Chansup Byun
JMJulia Mullen
Julia Mullen
ARAlbert Iwersen Reuther
Albert Iwersen Reuther
WAWilliam Arcand
William Arcand
WBWilliam Bergeron
William Bergeron
LMLauren Milechin
Lauren Milechin
One of the more complex tasks for researchers using HPC systems is performance monitoring and tuning of their applications. Developing a practice of continuous performance improvement, both for speed-up and efficient use of resources is essential to the long term success of both the HPC practitioner and the research project. Profiling tools provide a nice view of the performance of an application but often have a steep learning curve and rarely provide an easy to interpret view of resource utilization. Lower level tools such as top and htop provide a view of resource utilization for those familiar and comfortable with Linux but a barrier for newer HPC practitioners. To expand the existing profiling and job monitoring options, the MIT Lincoln Laboratory Supercomputing Center created LLoad, a tool that captures a snapshot of the resources being used by a job on a per user basis. LLload is a tool built from standard HPC tools that provides an easy way for a researcher to track resource usage of active jobs. We explain how the tool was designed and implemented and provide insight into how it is used to aid new researchers in developing their performance monitoring skills as well as guide researchers in their resource requests.

6 October 2022 in arXiv
Verified
Preprint
Open access
PDF file
BLBaolin Li
Baolin Li
TPTirthak Patel
Tirthak Patel
SSSiddarth Samsi
Siddarth Samsi
VGVijay Gadepally
Vijay Gadepally
DTDevesh Tiwari
Devesh Tiwari
GPU technology has been improving at an expedited pace in terms of size and performance, empowering HPC and AI/ML researchers to advance the scientific discovery process. However, this also leads to inefficient resource usage, as most GPU workloads, including complicated AI/ML models, are not able to utilize the GPU resources to their fullest extent -- encouraging support for GPU multi-tenancy. We propose MISO, a technique to exploit the Multi-Instance GPU (MIG) capability on the latest NVIDIA datacenter GPUs (e.g., A100, H100) to dynamically partition GPU resources among co-located jobs. MISO's key insight is to use the lightweight, more flexible Multi-Process Service (MPS) capability to predict the best MIG partition allocation for different jobs, without incurring the overhead of implementing them during exploration. Due to its ability to utilize GPU resources more efficiently, MISO achieves 49% and 16% lower average job completion time than the unpartitioned and optimal static GPU partition schemes, respectively.