Hao Huang

Hao Huang

Auto-generated profile, based on publicly available information

Hao Huang

New York University Abu Dhabi

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 April 2024 in Journal of Imaging
Verified
Journal Article
Open access
PDF file
YHYu Hao
Yu Hao
FYFan Yang
Fan Yang
HHHao Huang
Hao Huang
SYShuaihang Yuan
Shuaihang Yuan
SRSundeep Rangan
Sundeep Rangan
Yi FangYi Fang
Yi Fang
People with blindness and low vision (pBLV) encounter substantial challenges when it comes to comprehensive scene recognition and precise object identification in unfamiliar environments. Additionally, due to the vision loss, pBLV have difficulty in accessing and identifying potential tripping hazards independently. Previous assistive technologies for the visually impaired often struggle in real-world scenarios due to the need for constant training and lack of robustness, which limits their effectiveness, especially in dynamic and unfamiliar environments, where accurate and efficient perception is crucial. Therefore, we frame our research question in this paper as: How can we assist pBLV in recognizing scenes, identifying objects, and detecting potential tripping hazards in unfamiliar environments, where existing assistive technologies often falter due to their lack of robustness? We hypothesize that by leveraging large pretrained foundation models and prompt engineering, we can create a system that effectively addresses the challenges faced by pBLV in unfamiliar environments. Motivated by the prevalence of large pretrained foundation models, particularly in assistive robotics applications, due to their accurate perception and robust contextual understanding in real-world scenarios induced by extensive pretraining, we present a pioneering approach that leverages foundation models to enhance visual perception for pBLV, offering detailed and comprehensive descriptions of the surrounding environment and providing warnings about potential risks. Specifically, our method begins by leveraging a large-image tagging model (i.e., Recognize Anything Model (RAM)) to identify all common objects present in the captured images. The recognition results and user query are then integrated into a prompt, tailored specifically for pBLV, using prompt engineering. By combining the prompt and input image, a vision-language foundation model (i.e., InstructBLIP) generates detailed and comprehensive descriptions of the environment and identifies potential risks in the environment by analyzing environmental objects and scenic landmarks, relevant to the prompt. We evaluate our approach through experiments conducted on both indoor and outdoor datasets. Our results demonstrate that our method can recognize objects accurately and provide insightful descriptions and analysis of the environment for pBLV.

31 October 2024
Verified
Book Chapter
Closed access
PDF file
YTYu Tian
Yu Tian
CWCongcong Wen
Congcong Wen
MSMIN SHI
MIN SHI
MAMuhammad Muneeb Afzal
Muhammad Muneeb Afzal
HHHao Huang
Hao Huang
MWMengyu Wang
Mengyu Wang

3 December 2024
Verified
Book Chapter
Closed access
PDF file
CWCongcong Wen
Congcong Wen
YHYisiyuan Huang
Yisiyuan Huang
HHHao Huang
Hao Huang
YHYanjia Huang
Yanjia Huang
SYShuaihang Yuan
Shuaihang Yuan
Yi FangYi Fang
Yi Fang

16 October 2025 in IEEE Transactions on Medical Imaging
Verified
Journal Article
Closed access
MLMinghan Li
Minghan Li
CWCongcong Wen
Congcong Wen
YTYu Tian
Yu Tian
MSMIN SHI
MIN SHI
YLYan Luo
Yan Luo
MWMengyu Wang
Mengyu Wang
Fairness remains a critical concern in healthcare, where unequal access to services and treatment outcomes can adversely affect patient health. While Federated Learning (FL) presents a collaborative and privacy-preserving approach to model training, ensuring fairness is challenging due to heterogeneous data across institutions, and current research primarily addresses non-medical applications. To fill this gap, we establish the first experimental benchmark for fairness in medical FL, evaluating six representative FL methods across diverse demographic attributes and imaging modalities. We introduce FairFedMed, the first medical FL dataset specifically designed to study group fairness (i.e., consistent performance across demographic groups). It comprises two parts: FairFedMed-Oph, featuring 2D fundus and 3D OCT ophthalmology samples with six demographic attributes; and FairFedMed-Chest, which simulates real cross-institutional FL using subsets of CheXpert and MIMIC-CXR. Together, they support both simulated and real-world FL across diverse medical modalities and demographic groups. Existing FL models often underperform on medical images and overlook fairness across demographic groups. To address this, we propose FairLoRA, a fairness-aware FL framework based on SVD-based low-rank approximation. It customizes singular value matrices per demographic group while sharing singular vectors, ensuring both fairness and efficiency. Experimental results on the FairFedMed dataset demonstrate that FairLoRA not only achieves state-of-the-art performance in medical image classification but also significantly improves fairness across diverse populations. Our code and dataset can be accessible via GitHub link: https://github.com/Harvard-AI-and-Robotics-Lab/FairFedMed.


4 March 2023
Verified
Book Chapter
Closed access
PDF file
SYShuaihang Yuan
Shuaihang Yuan
XLXiang Li
Xiang Li
HHHao Huang
Hao Huang
YFYi Fang
Yi Fang