Jiayi Huang

Jiayi Huang

Auto-generated profile, based on publicly available information

Jiayi Huang

The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 March 2025 in IEEE Transactions on Knowledge and Data Engineering
Verified
Journal Article
Closed access
WCWeilin Cai
Weilin Cai
JJJuyong Jiang
Juyong Jiang
FWFan Wang
Fan Wang
JTJing Tang
Jing Tang
SKSunghun Kim
Sunghun Kim
JHJiayi Huang
Jiayi Huang
Large language models (LLMs) have garnered unprecedented advancements across diverse fields, ranging from natural language processing to computer vision and beyond. The prowess of LLMs is underpinned by their substantial model size, extensive and diverse datasets, and the vast computational power harnessed during training, all of which contribute to the emergent abilities of LLMs (e.g., in-context learning) that are not present in small models. Within this context, the mixture of experts (MoE) has emerged as an effective method for substantially scaling up model capacity with minimal computation overhead, gaining significant attention from academia and industry. Despite its growing prevalence, there lacks a systematic and comprehensive review of the literature on MoE. This survey seeks to bridge that gap, serving as an essential resource for researchers delving into the intricacies of MoE. We first briefly introduce the structure of the MoE layer, followed by proposing a new taxonomy of MoE. Next, we overview the core designs for various MoE models including both algorithmic and systemic aspects, alongside collections of available open-source implementations, hyperparameter configurations and empirical evaluations. Furthermore, we delineate the multifaceted applications of MoE in practice, and outline some potential directions for future research. To facilitate ongoing updates and the sharing of cutting-edge advances in MoE research, we have established a resource repository at https://github.com/withinmiaov/A-Survey-on-Mixture-of-Experts-in-LLMs.

12 October 2020 in IEEE Transactions on Computers
Verified
Journal Article
Closed access
PMPritam Majumder
Pritam Majumder
SKSungkeun Kim
Sungkeun Kim
JHJiayi Huang
Jiayi Huang
KYKi Hwan Yum
Ki Hwan Yum
EKEun Jung Kim
Eun Jung Kim
Ever increasing performance demand and shrinking in the transistor size together result in complex and dense packing in large chips. That motivates designers to opt for many small specialized hardware modules in a chip to extract maximum performance benefits with relatively lower complexity and cost. These altogether opens up new directions for heterogeneous modular System-on-Chip(SoC) research, where a large system is built by assembling small independently designed chiplets(small chips). We focus on the communication aspect of such SoCs, especially newly observed deadlock among chiplets. Even though deadlock is a classic problem in networks and many solutions are available, the modular SoC design demands customized solutions that preservesthe design flexibility for chiplet designers. We propose Remote Control(RC), a simple routing oblivious deadlock avoidance scheme based on selective injection-control mechanism. Along with guarantee on deadlock freedom, RC aims to provide a methodology to make each independently designed chiplet seamlessly integrate in any modular SoCs. We achieve up to 56.34% throughput and15.49% zero load latency improvements on synthetic traffic and up to 20% on real workloads taken from vast range of benchmark suites, over the state-of-the-art turn restriction based technique applied in modular SoC domain.

22 October 2020 in IEEE Transactions on Computers
Verified
Journal Article
Closed access
JHJiayi Huang
Jiayi Huang
SBShilpa Bhosekar
Shilpa Bhosekar
RBRahul Boyapati
Rahul Boyapati
NWNingyuan Wang
Ningyuan Wang
BHByul Hur
Byul Hur
EKEun Jung Kim
Eun Jung Kim
Scalable Networks-on-Chip (NoCs) have become the standard interconnection mechanisms in large-scale multicore architectures. These NoCs consume a large fraction of the on-chip power budget, where the static portion is becoming dominant as technology scales down to sub-10nm node. Therefore, it is essential to reduce static power so as to achieve energy-efficient computing. Power-Gating, as an effective static power saving technique, can be used to power off inactive routers for static power saving. However, packet deliveries in irregular power-gated network suffer from detour or waiting time overhead to either route around or wake up power-gated routers. In this paper, we propose Fly-Over (FLOV), a voting approach for dynamic router power-gating in a light-weight and distributed manner, which includes FLOV router microarchitecture, adaptive power-gating policy, and low-latency dynamic routing algorithms. We evaluate F LOV using synthetic workloads as well as real workloads from PARSEC 2.1 benchmark suite. Our full system evaluations show that F LOV reduces the power consumption of NoC by 31% and 20%, respectively, on average across several benchmarks, compared to the Baseline and state-of-the-art while maintaining the similar performance.


17 July 2024 in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Verified
Journal Article
Closed access
RMRuiyang Ma
Ruiyang Ma
JHJiayi Huang
Jiayi Huang
SZShijian Zhang
Shijian Zhang
YXYuan Xie
Yuan Xie
GLGuojie Luo
Guojie Luo
Network on chip (NoC) has surfaced as a crucial interconnection strategy in modern digital systems, thereby demanding meticulous verification. Due to its multiple nodes and high concurrency, verifying an NoC is labor-intensive, making it complex to generate a multitude of test cases. Recently, hardware fuzzing has been identified as a promising automated approach for hardware verification. However, when we tried to apply these fuzzing techniques to our internally developed NoC design, we discovered that they were incompatible with the specificities of NoC. Additionally, they are also incompatible with the standard IC verification workflow and universal verification methodology (UVM) environment. In this work, we aim to automate our verification process of NoC with fuzzing. We propose a fuzzing strategy specifically tailored for industrial NoC UVM verification. We employ fuzzing in NoC verification at multiple levels, including router verification, network verification, and stress testing. As a case study we apply our approach to an open-source NoC component in OpenPiton. Remarkably, our fuzzing methods automatically achieved complete code and functional coverage in the router and mesh network. We also effectively detect injected starvation bugs with fuzzing. The evaluation results clearly demonstrate the practicability of our fuzzing approach to considerably reduce the manpower required for test case generation compared with traditional NoC verification.

28 October 2023
Verified
Conference Paper
Open access
CBChen Bai
Chen Bai
JHJiayi Huang
Jiayi Huang
XWXuechao Wei
Xuechao Wei
YMYuzhe Ma
Yuzhe Ma
SLSicheng Li
Sicheng Li
YXYuan Xie
Yuan Xie
Design space exploration (DSE) for microarchitecture parameters is an essential stage in microprocessor design to explore the trade-offs among performance, power, and area (PPA). Prior work either employs excessive expert efforts to guide microarchitecture parameter tuning or demands high computing resources to prepare datasets and train black-box prediction models for DSE. In this work, we aim to circumvent the domain knowledge requirements through automated bottleneck analysis and propose ArchExplorer, which reveals microarchitecture bottlenecks to guide DSE with much fewer simulations. ArchExplorer consists of a new graph formulation of microexecution, an optimal critical path construction algorithm, and hardware resource reassignment strategies. Specifically, the critical path is constructed from the microexecution to uncover the performance-critical microarchitecture bottlenecks, which facilitates ArchExplorer to reclaim the hardware budgets of performance-insensitive structures that consume unnecessary power and area. These budgets are then reassigned to the microarchitecture bottlenecks for performance boost while maintaining the power and area constraints under the total budget envelope. Experiments show that ArchExplorer can find better PPA Pareto-optimal designs, achieving an average of higher Pareto hypervolume using at most fewer simulations compared to the state-of-the-art approaches.