Shang Yang

Shang Yang

Auto-generated profile, based on publicly available information

Shang Yang

MIT, Cambridge, MA, USA

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 October 2023
Verified
Conference Paper
Open access
HTHaotian Tang
Haotian Tang
SYShang Yang
Shang Yang
ZLZhijian Liu
Zhijian Liu
KHKe Hong
Ke Hong
ZYZhongming Yu
Zhongming Yu
SHSong Han
Song Han
Sparse convolution plays a pivotal role in emerging workloads, including point cloud processing in AR/VR, autonomous driving, and graph understanding in recommendation systems. Since the computation pattern is sparse and irregular, specialized high-performance kernels are required. Existing GPU libraries offer two dataflow types for sparse convolution. The gather-GEMM-scatter dataflow is easy to implement but not optimal in performance, while the dataflows with overlapped computation and memory access (e.g. implicit GEMM) are highly performant but have very high engineering costs. In this paper, we introduce TorchSparse++, a new GPU library that achieves the best of both worlds. We create a highly efficient Sparse Kernel Generator that generates performant sparse convolution kernels at less than one-tenth of the engineering cost of the current state-of-the-art system. On top of this, we design the Sparse Autotuner, which extends the design space of existing sparse convolution libraries and searches for the best dataflow configurations for training and inference workloads. Consequently, TorchSparse++ achieves 2.9 × , 3.3 × , 2.2 × and 1.7 × measured end-to-end speedup on an NVIDIA A100 GPU over state-of-the-art MinkowskiEngine, SpConv 1.2, TorchSparse and SpConv v2 in inference; and is 1.2-1.3 × faster than SpConv v2 in mixed precision training across seven representative autonomous driving benchmarks. It also seamlessly supports graph convolutions, achieving 2.6-7.6 × faster inference speed compared with state-of-the-art graph deep learning libraries. Our code is publicly released at https://github.com/mit-han-lab/torchsparse.

22 March 2026
Verified
Conference Paper
Open access
QHQinghao Hu
Qinghao Hu
SYShang Yang
Shang Yang
JGJunxian Guo
Junxian Guo
XYXiaozhe Yao
Xiaozhe Yao
YLYujun Lin
Yujun Lin
SHSong Han
Song Han

9 September 2021
Verified
Book Chapter
Closed access
PDF file
QHQiangqiang He
Qiangqiang He
YQYu Qiao
Yu Qiao
SYShang Yang
Shang Yang
CWChongjun Wang
Chongjun Wang