Siyang Jiang

Siyang Jiang

Auto-generated profile, based on publicly available information

Siyang Jiang

The Chinese University of Hong Kong, Hong Kong, Hong Kong

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 November 2024 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Verified
Journal Article
Open access
BYBufang Yang
Bufang Yang
SJSiyang Jiang
Siyang Jiang
LXLilin Xu
Lilin Xu
KLKaiwei Liu
Kaiwei Liu
HLHai Li
Hai Li
ZYZhenyu Yan
Zhenyu Yan
Large language models (LLMs) have the potential to transform digital healthcare, as evidenced by recent advances in LLM-based virtual doctors. However, current approaches rely on patient's subjective descriptions of symptoms, causing increased misdiagnosis. Recognizing the value of daily data from smart devices, we introduce a novel LLM-based multi-turn consultation virtual doctor system, DrHouse, which incorporates three significant contributions: 1) It utilizes sensor data from smart devices in the diagnosis process, enhancing accuracy and reliability. 2) DrHouse leverages continuously updating medical knowledge bases to ensure its model remains at diagnostic standard's forefront. 3) DrHouse introduces a novel diagnostic algorithm that concurrently evaluates potential diseases and their likelihood, facilitating more nuanced and informed medical assessments. Through multi-turn interactions, DrHouse determines the next steps, such as accessing daily data from smart devices or requesting in-lab tests, and progressively refines its diagnoses. Evaluations on three public datasets and our self-collected datasets show that DrHouse can achieve up to an 31.5% increase in diagnosis accuracy over the state-of-the-art baselines. The results of a 32-participant user study show that 75% medical experts and 91.7% test subjects are willing to use DrHouse.

27 August 2025
Verified
Conference Paper
Open access
MYMu Yuan
Mu Yuan
LZLan Zhang
Lan Zhang
LZLiekang Zeng
Liekang Zeng
SJSiyang Jiang
Siyang Jiang
BYBufang Yang
Bufang Yang
GXGuoliang Xing
Guoliang Xing

20 June 2026
Verified
Conference Paper
Open access
SJSiyang Jiang
Siyang Jiang
MYMu Yuan
Mu Yuan
XJXiang Ji
Xiang Ji
BYBufang Yang
Bufang Yang
ZLZeyu Liu
Zeyu Liu
GXGuoliang Xing
Guoliang Xing
Multimodal human action recognition (HAR) utilizes complementary data for activity classification. Built on traditional HAR tasks, recent advances in Large Language Models (LLMs) enable detailed descriptions and causal reasoning of human actions, advancing new tasks of human action understanding (HAU) and human action reasoning (HARn). However, most LLMs, especially multimodal Large Vision-Language Models (LVLMs), struggle with modalities other than RGB images, like depth, IMU, ormmWave, due to a lack of large-scale datasets in these task domains. Existing HAR datasets provide only coarse-grained annotations, in-sufficient for depicting the detailed action dynamics required in HAU and HARn tasks. Simply combining annotations and generating captions with LLMs often lacks necessary logical and spatiotemporal consistency. In this paper, we introduce CUHK-X, a large-scale multi-modal dataset and benchmarks for HAR, HAU, and HARn. It includes 64,267 samples of 40 actions performed by 30 participants across two indoor environments, covering diverse daily scenarios. To address the challenge of spatiotemporal inconsistencies in captions, we propose a prompt-based scene creation method that leverages LLMs to generate logically connected activity sequences. CUHK-X also includes three benchmarks with six tasks to evaluate state-of-the-art models. Experimental results show average accuracies of 76.52% for HAR, 40.76% for HAU, and 70.25% for HARn. This large-scale multimodal dataset aims to empower the research community to apply, develop, and adapt data-intensive learning techniques for a wide range of human activity-related tasks.

3 November 2025
Verified
Conference Paper
Open access
YHYuting He
Yuting He
XWXinyan Wang
Xinyan Wang
MYMu Yuan
Mu Yuan
BYBufang Yang
Bufang Yang
SJSiyang Jiang
Siyang Jiang
HCHongkai Chen
Hongkai Chen


26 October 2026
Verified
Conference Paper
Open access
WLWenrui Lu
Wenrui Lu
MYMu Yuan
Mu Yuan
BYBufang Yang
Bufang Yang
SJSiyang Jiang
Siyang Jiang
Wei GaoWei Gao
Wei Gao
GXGuoliang Xing
Guoliang Xing