Gang Huang

Gang Huang

Auto-generated profile, based on publicly available information

Gang Huang

Peking University, Beijing, China

Research Focus & Metrics

Academic Career Length

28Years (1999-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 December 2020 in IEEE Transactions on Mobile Computing
Verified
Journal Article
Closed access
CXChenren Xu
Chenren Xu
SJShuang Jiang
Shuang Jiang
GLGuojie Luo
Guojie Luo
GSGuangyu Sun
Guangyu Sun
ANAn Ning
An Ning
XLXuanzhe Liu
Xuanzhe Liu
Edge Computing has emerged as a new computing paradigm dedicated for mobile performance enhancement and energy efficiency purposes. Specifically, it benefits today’s interactive applications on power-constrained devices by offloading compute-intensive tasks to the edge nodes in close proximity. Meanwhile, FPGA is well known for its excellence in accelerating (domain-specific) compute-intensive tasks such as deep learning algorithms in a high performance and energy-efficient manner due to its hardware-customizable nature. In this paper, we make the first attempt to leverage and combine the advantages of these two, and proposed a new network-assisted computing model, namely FPGA-based edge computing. As a case study, we choose three computer vision (CV)-based mobile interactive applications, and implement their back-end computation engines on FPGA. By deploying such application-customized accelerator modules for computation offloading at the network edge, we experimentally demonstrate that this approach can effectively reduce response time for the applications and energy consumption for the entire system in comparison with traditional CPU-based edge/cloud offloading approach.

8 May 2012 in Computer
Verified
Journal Article
Closed access
HMHong Mei
Hong Mei
GHGang Huang
Gang Huang
TXTao Xie
Tao Xie
To meet the needs of computing in the Internet environment, the Internetware software paradigm provides a set of technologies that support the development of applications with characteristics that are autonomous, cooperative, situational, evolvable, emergent, and trustworthy.

30 March 2025
Verified
Conference Paper
Open access
DXDaliang Xu
Daliang Xu
HZHao Zhang
Hao Zhang
LYLiming Yang
Liming Yang
RLRuiqi Liu
Ruiqi Liu
GHGang Huang
Gang Huang
XLXuanzhe Liu
Xuanzhe Liu
On-device inference for Large Language Models (LLMs), driven by increasing privacy concerns and advancements of mobile-sized models, has gained significant interest. However, even mobile-sized LLMs (e.g., Gemma-2B) encounter unacceptably high inference latency, often bottlenecked by the prefill stage in tasks like screen UI understanding. We present llm.npu, the first LLM inference system utilizing on-device Neural Processing Unit (NPU) offloading to reduce prefill latency. llm.npu enhances NPU offloading efficiency by re-constructing the prompt and model in three levels: (1) At prompt level, it divides variable-length prompts into multiple fixed-sized chunks while maintaining data dependencies; (2) At tensor level, it identifies and extracts significant outliers to run on the CPU/GPU in parallel with minimal overhead; (3) At block level, it schedules Transformer blocks in an out-of-order manner to the CPU/GPU and NPU based on their hardware affinity and sensitivity to accuracy. Compared to competitive baselines, llm.npu achieves 22.4x faster prefill speed and 30.7x energy savings on average, and up to 32.8x speedup in an end-to-end real-world application. For the first time, llm.npu achieves more than 1,000 tokens/sec prefilling for a billion-sized model.

7 July 2016 in IEEE Transactions on Services Computing
Verified
Journal Article
Closed access
GHGang Huang
Gang Huang
XLXuanzhe Liu
Xuanzhe Liu
YMYun Ma
Yun Ma
XLXuan Lu
Xuan Lu
YZYing Zhang
Ying Zhang
YXYingfei Xiong
Yingfei Xiong
Mobile Web applications (a.k.a., Web apps) stand for an important trend for next-generation Internet-based software. Currently popular mobile Web apps need to be adapted to various and ever-changing contexts and personalized user requirements. Based on our over-decade research experiences and practice on the Internetware paradigm, this position article describes an Internetware-oriented approach to designing, developing, and deploying situational mobile Web apps, by synthesizing the resources and services of mobile and cloud. Guided by a novel Service-Model-View-Controller (SMVC) software model, a mobile Web app is organized into a well-defined structure that facilitates adaptation including online/offline data access, computation offloading, user interface optimization, hybrid composition, etc. We provide efficient runtime support spanning mobile and cloud to make mobile Web apps more flexibly adaptive. The proof-of-concept evaluation demonstrates that our approach can benefit end-users with optimized user experience of mobile Web apps.

13 October 2022 in IEEE Transactions on Mobile Computing
Verified
Journal Article
Closed access
CYChengxu Yang
Chengxu Yang
MXMengwei Xu
Mengwei Xu
QWQipeng Wang
Qipeng Wang
ZCZhenpeng Chen
Zhenpeng Chen
KHKang Huang
Kang Huang
XLXuanzhe Liu
Xuanzhe Liu
Federated learning (FL) becomes a promising machine learning paradigm. The impact of heterogeneous hardware specifications and dynamic states on the FL process has not yet been studied systematically. This paper presents the first large-scale study of this impact based on real-world data collected from 136k smartphones. We conducted extensive experiments on our proposed heterogeneity-aware FL platform namely FLASH , to systematically explore the performance of state-of-the-art FL algorithms and key FL configurations in heterogeneity-aware and -unaware settings, finding the following. (1) Heterogeneity causes accuracy to drop by up to 9.2% and convergence time to increase by 2.32×. (2) Heterogeneity negatively impacts popular aggregation algorithms, e.g., the accuracy variance reduction brought by q-FedAvg drops by 17.5%. (3) Heterogeneity does not worsen the accuracy loss caused by gradient-compression algorithms significantly, but it compromises the convergence time by up to 2.5×. (4) Heterogeneity hinders client-selection algorithms from selecting wanted clients, thus reducing effectiveness. e.g., the accuracy increase brought by the state-of-the-art client-selection algorithm drops by 73.9%. (5) Heterogeneity causes the optimal FL hyper-parameters to drift significantly. More specifically, the heterogeneity-unaware setting favors looser deadline and higher reporting fraction to achieve better training performance. (6) Heterogeneity results in non-trivial failed clients (more than 10%) and leads to participation bias (the top 30% of clients contribute 86% of computations). Our FLASH platform and data have been publicly open sourced.

29 January 2024 in IEEE Transactions on Services Computing
Verified
Journal Article
Closed access
QLQing Li
Qing Li
SWShangguang Wang
Shangguang Wang
XMXiao Ma
Xiao Ma
AZAo Zhou
Ao Zhou
YWYue Wang
Yue Wang
XLXuanzhe Liu
Xuanzhe Liu
Satellite edge computing can incur dramatically increased energy demand onboard, which is met by satellite batteries during eclipses. Excessive energy usage during regular operations accelerates battery wear. Therefore, it is important and timely to optimize the energy consumption onboard to extend satellite batteries life. This paper investigates battery-aware energy optimization for satellite edge computing under energy harvesting dynamics and wireless environment uncertainty. Inspired by the periodical energy harvesting and satellite-ground connection, we develop a pattern-aware online energy scheduling algorithm within an online convex optimization framework. This learning algorithm achieves theoretical guarantees of no regret and gradually zeroing constraint violations. We further exploit inter-satellites collaboration to extend the average battery life in a whole constellation where satellites have different battery capacity degradation. Trace-driven simulations show that our algorithm can significantly extend the battery life by 1.32× and effectively adapt to the energy harvesting dynamics and wireless environment uncertainty.