Haojian Huang

Haojian Huang

Auto-generated profile, based on publicly available information

Haojian Huang

The University of Hong Kong, Hong Kong, China

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 April 2024 in Knowledge-Based Systems
Verified
Journal Article
Open access
ZLZhe Liu
Zhe Liu
HHHaojian Huang
Haojian Huang
SLSukumar Letchmunan
Sukumar Letchmunan
MDMuhammet Deveci
Muhammet Deveci

28 October 2024
Verified
Conference Paper
Open access
HCHaodong Chen
Haodong Chen
HHHaojian Huang
Haojian Huang
JDJunhao Dong
Junhao Dong
MZMingzhe Zheng
Mingzhe Zheng
DSDian Shao
Dian Shao
Dynamic Facial Expression Recognition (DFER) is crucial for understanding human behavior. However, current methods exhibit limited performance mainly due to the insufficient utilization of facial dynamics, and the ambiguity of expression semantics, etc. To this end, we propose a novel framework, named Multi-modal Fine-grained CLIP for DFER with AdaptERs (FineCLIPER), incorporating the following novel designs: 1) To better distinguish between similar facial expressions, we extend the class labels to textual descriptions from both positive and negative aspects, and obtain supervision by calculating the cross-modal similarity based on the CLIP model; 2) Our FineCLIPER adopts a hierarchical manner to effectively mine useful cues from DFE videos. Specifically, besides directly embedding video frames as input (low semantic level), we propose to extract the face segmentation masks and landmarks based on each frame (middle semantic level) and utilize the Multi-modal Large Language Model (MLLM) to further generate detailed descriptions of facial changes across frames with designed prompts (high semantic level). Additionally, we also adopt Parameter-Efficient Fine-Tuning (PEFT) to enable efficient adaptation of large pre-trained models (i.e., CLIP) for this task. Our FineCLIPER achieves SOTA performance on the DFEW, FERV39k, and MAFW datasets in both supervised and zero-shot settings with few tunable parameters. Project page: https://haroldchen19.github.io/FineCLIPER-Page/

28 October 2024
Verified
Conference Paper
Open access
HHHaojian Huang
Haojian Huang
XQXiaozhennn Qiao
Xiaozhennn Qiao
ZCZhuo Chen
Zhuo Chen
HCHaodong Chen
Haodong Chen
BLBingyu Li
Bingyu Li
XLXuelong Li
Xuelong Li
Zero-shot learning (ZSL) enables the recognition of novel classes by leveraging semantic knowledge transfer from known to unknown categories. This knowledge, typically encapsulated in attribute descriptions, aids in identifying class-specific visual features, thus facilitating visual-semantic alignment and improving ZSL performance. However, real-world challenges such as distribution imbalances and attribute co-occurrence among instances often hinder the discernment of local variances in images, a problem exacerbated by the scarcity of fine-grained, region-specific attribute annotations. Moreover, the variability in visual presentation within categories can also skew attribute-category associations. In response, we propose a bidirectional cross-modal ZSL approach CREST. It begins by extracting representations for attribute and visual localization and employs Evidential Deep Learning (EDL) to measure underlying epistemic uncertainty, thereby enhancing the model's resilience against hard negatives. CREST incorporates dual learning pathways, focusing on both visual-category and attribute-category alignments, to ensure robust correlation between latent and observable spaces. Moreover, we introduce an uncertainty-informed cross-modal fusion technique to refine visual-attribute inference. Extensive experiments demonstrate our model's effectiveness and unique explainability across multiple datasets. Our code and data are available at: https://github.com/JethroJames/CREST

27 October 2025
Verified
Conference Paper
Open access
QLQiang Li
Qiang Li
QYQingsen Yan
Qingsen Yan
HHHaojian Huang
Haojian Huang
PWPeng Wu
Peng Wu
HZHaokui Zhang
Haokui Zhang
YZYanning Zhang
Yanning Zhang


13 June 2025 in Fuzzy Sets and Systems
Verified
Journal Article
Closed access
HQHaoye Qiu
Haoye Qiu
ZLZhe Liu
Zhe Liu
HHHaojian Huang
Haojian Huang
SLSukumar Letchmunan
Sukumar Letchmunan
MDMuhammet Deveci
Muhammet Deveci
Tapan SenapatiTapan Senapati
Tapan Senapati