Stas Bekman

Stas Bekman

Auto-generated profile, based on publicly available information

Stas Bekman

Contextual AI, USA

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 August 2024
Verified
Conference Paper
Open access
QAQuentin Anthony
Quentin Anthony
JHJacob Hatef
Jacob Hatef
DNDeepak Narayanan
Deepak Narayanan
SBStella Biderman
Stella Biderman
SBStas Bekman
Stas Bekman
DPDhabaleswar Panda
Dhabaleswar Panda
While GPUs are responsible for training the vast majority of state-of-the-art deep learning models, the implications of their architecture are often overlooked when designing new deep learning (DL) models. As a consequence, modifying a DL model to be more amenable to the target hardware can significantly improve the runtime performance of DL training and inference. In this paper, we provide a set of guidelines for users to maximize the runtime performance of their transformer models. These guidelines have been created by carefully considering the impact of various model hyperparameters controlling model shape on the efficiency of the underlying computation kernels executed on the GPU. We find the throughput of models with “efficient” model shapes is up to 39% higher while preserving accuracy compared to models with a similar number of parameters but with unoptimized shapes.