David Irwin

David Irwin

Auto-generated profile, based on publicly available information

David Irwin

University of Massachusetts Amherst, Amherst, USA

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 December 2023 in Proceedings of the ACM on Measurement and Analysis of Computing Systems
Verified
Journal Article
Open access
WHWalid A. Hanafy
Walid A. Hanafy
QLQianlin Liang
Qianlin Liang
NBNoman Bashir
Noman Bashir
DIDavid Irwin
David Irwin
PSPrashant Shenoy
Prashant Shenoy
Cloud platforms are increasing their emphasis on sustainability and reducing their operational carbon footprint. A common approach for reducing carbon emissions is to exploit the temporal flexibility inherent to many cloud workloads by executing them in periods with the greenest energy and suspending them at other times. Since such suspend-resume approaches can incur long delays in job completion times, we present a new approach that exploits the elasticity of batch workloads in the cloud to optimize their carbon emissions. Our approach is based on the notion of "carbon scaling," similar to cloud autoscaling, where a job dynamically varies its server allocation based on fluctuations in the carbon cost of the grid's energy. We develop a greedy algorithm for minimizing a job's carbon emissions via carbon scaling that is based on the well-known problem of marginal resource allocation. We implement a CarbonScaler prototype in Kubernetes using its autoscaling capabilities and an analytic tool to guide the carbon-efficient deployment of batch applications in the cloud. We then evaluate CarbonScaler using real-world machine learning training and MPI jobs on a commercial cloud platform and show that it can yield i) 51% carbon savings over carbon-agnostic execution; ii) 37% over a state-of-the-art suspend-resume policy; and iii) 8 over the best static scaling policy.

22 April 2024
Verified
Conference Paper
Open access
TSThanathorn Sukprasert
Thanathorn Sukprasert
ASAbel Souza
Abel Souza
NBNoman Bashir
Noman Bashir
DIDavid Irwin
David Irwin
PSPrashant Shenoy
Prashant Shenoy

28 October 2023
Verified
Conference Paper
Open access
ASAbel Souza
Abel Souza
SJShruti Jasoria
Shruti Jasoria
BCBasundhara Chakrabarty
Basundhara Chakrabarty
ABAlexander Bridgwater
Alexander Bridgwater
ALAxel Lundberg
Axel Lundberg
PSPrashant Shenoy
Prashant Shenoy
There has been a significant societal push towards sustainable practices, including in computing. Modern interactive workloads such as geo-distributed web-services exhibit various spatiotemporal and performance flexibility, enabling the possibility to adapt the location, time, and intensity of processing to align with the availability of renewable and low-carbon energy. An example is a web application hosted across multiple cloud regions, each with varying carbon intensity based on their local electricity mix. Distributed load-balancing enables the exploitation of low-carbon energy through load migration across regions, reducing web applications carbon footprint. In this paper, we present CASPER, a carbon-aware scheduling and provisioning system that primarily minimizes the carbon footprint of distributed web services while also respecting their Service Level Objectives (SLO). We formulate CASPER as an multi-objective optimization problem that considers both the variable carbon intensity and latency constraints of the network. Our evaluation reveals the significant potential of CASPER in achieving substantial reductions in carbon emissions. Compared to baseline methods, CASPER demonstrates improvements of up to 70% with no latency performance degradation.

27 April 2024
Verified
Conference Paper
Open access
WHWalid A. Hanafy
Walid A. Hanafy
QLQianlin Liang
Qianlin Liang
NBNoman Bashir
Noman Bashir
ASAbel Souza
Abel Souza
DIDavid Irwin
David Irwin
PSPrashant Shenoy
Prashant Shenoy
The continued exponential growth of cloud datacenter capacity has increased awareness of the carbon emissions when executing large compute-intensive workloads. To reduce carbon emissions, cloud users often temporally shift their batch workloads to periods with low carbon intensity. While such time shifting can increase job completion times due to their delayed execution, the cost savings from cloud purchase options, such as reserved instances, also decrease when users operate in a carbon-aware manner. This happens because carbon-aware adjustments change the demand pattern by periodically leaving resources idle, which creates a trade-off between carbon emissions and cost. In this paper, we present GAIA, a carbon-aware scheduler that enables users to address the three-way trade-off between carbon, performance, and cost in cloud-based batch schedulers. Our results quantify the carbon-performance-cost trade-off in cloud platforms and show that compared to existing carbon-aware scheduling policies, our proposed policies can double the amount of carbon savings per percentage increase in cost, while decreasing the performance overhead by 26%.

9 July 2023
Verified
Conference Paper
Open access
WHWalid A. Hanafy
Walid A. Hanafy
RBRoozbeh Bostandoost
Roozbeh Bostandoost
NBNoman Bashir
Noman Bashir
DIDavid Irwin
David Irwin
MHMohammad Hajiesmaili
Mohammad Hajiesmaili
PSPrashant Shenoy
Prashant Shenoy

20 November 2024
Verified
Conference Paper
Open access
JMJorge Murillo
Jorge Murillo
WHWalid A. Hanafy
Walid A. Hanafy
DIDavid Irwin
David Irwin
RSRamesh Sitaraman
Ramesh Sitaraman
PSPrashant Shenoy
Prashant Shenoy
Content Delivery Networks (CDNs) are Internet-scale systems that deliver streaming and web content to users from many geographically distributed edge data centers. Since large CDNs can comprise hundreds of thousands of servers deployed in thousands of global data centers, they can consume a large amount of energy for their operations and thus are responsible for large amounts of Green House Gas (GHG) emissions. As these networks scale to cope with increased demand for bandwidth-intensive content, their emissions are expected to rise further, making sustainable design and operation an important goal for the future. Since different geographic regions vary in the carbon intensity and cost of their electricity supply, in this paper, we consider spatial shifting as a key technique to jointly optimize the carbon emissions and energy costs of a CDN. We present two forms of shifting: spatial load shifting, which operates within the time scale of minutes, and VM capacity shifting, which operates at a coarse time scale of days or weeks. The proposed techniques jointly reduce carbon and electricity costs while considering the performance impact of increased request latency from such optimizations. Using real-world traces from a large CDN and carbon intensity and energy prices data from electric grids in different regions, we show that increasing the latency by 60ms can reduce carbon emissions by up to 35.5%, 78.6%, and 61.7% across the US, Europe, and worldwide, respectively. In addition, we show that capacity shifting can increase carbon savings by up to 61.2%. Finally, we analyze the benefits of spatial shifting and show that it increases carbon savings from added solar energy by 68% and 130% in the US and Europe, respectively.