Siying Wu

Siying Wu

Auto-generated profile, based on publicly available information

Siying Wu

Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, AnHui, HeFei, China

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 January 2024 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
SWSiying Wu
Siying Wu
Xueyang FuXueyang Fu
Xueyang Fu
FWFeng Wu
Feng Wu
ZZZheng-Jun Zha
Zheng-Jun Zha
Vision-and-Language Navigation (VLN) requires that an agent can comprehensively understand the given instructions and the immediate visual information obtained from the environment, so as to make correct actions to achieve the navigation goal. Therefore, semantic alignment across modalities is crucial for the agent understanding its own state during the navigation process. However, the potential of semantic alignment has not been systematically explored in current studies, which limits the further improvement of navigation performance. To address this issue, we propose a new Latent Semantic Alignment Learning method to develop the semantically aligned relationships contained in the environment. Specifically, we introduce three novel pre-training tasks: Trajectory-conditioned Masked Fragment Modeling, Action Prediction of Masked Observation, and Hierarchical Triple Contrastive Learning. The first two tasks are used to reason about cross-modal dependencies, while the third one is able to learn semantically consistent representations across modalities. In this way, the Latent Semantic Alignment Learning method establishes a consistent perception of the environment and makes the agent's actions easier to explain. Experiments on common benchmarks verify the effectiveness of our proposed methods. For example, we improve the Success Rate by 1.6% on the R2R validation unseen set and 4.3% on the R4R validation unseen set over the baseline model.

27 October 2025 in Expert Systems with Applications
Verified
Journal Article
Closed access
LGLubin Gan
Lubin Gan
JZJing Zhang
Jing Zhang
LQLinhao Qu
Linhao Qu
YWYijun Wang
Yijun Wang
SWSiying Wu
Siying Wu
XSXiaoyan Sun
Xiaoyan Sun

27 October 2025
Verified
Conference Paper
Open access
YWYijun Wang
Yijun Wang
SWSiying Wu
Siying Wu
LGLubin Gan
Lubin Gan
ZZZheyu Zhang
Zheyu Zhang
JZJing Zhang
Jing Zhang
XSXiaoyan Sun
Xiaoyan Sun