Siyuan Wang

Siyuan Wang

Auto-generated profile, based on publicly available information

Siyuan Wang

Fudan University

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 April 2022 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
SWSiyuan Wang
Siyuan Wang
ZLZhongkun Liu
Zhongkun Liu
WZWanjun Zhong
Wanjun Zhong
MZMing Zhou
Ming Zhou
ZWZhongyu Wei
Zhongyu Wei
NDNan Duan
Nan Duan
Complex reasoning aims to draw a correct inference based on complex rules. As a hallmark of human intelligence, it involves a degree of explicit reading comprehension, interpretation of logical knowledge and complex rule application. In this paper, we take a step forward in complex reasoning by systematically studying the three challenging and domain-general tasks of the Law School Admission Test (LSAT), including analytical reasoning, logical reasoning and reading comprehension. We propose a hybrid reasoning system to integrate these three tasks and achieve impressive overall performance on the LSAT tests. The experimental results demonstrate that our system endows itself a certain complex reasoning ability, especially the fundamental reading comprehension and challenging logical reasoning capacities. Further analysis also shows the effectiveness of combining the pre-trained models with the task-specific reasoning module, and integrating symbolic knowledge into discrete interpretable reasoning steps in complex reasoning. We further shed a light on the potential future directions, like unsupervised symbolic knowledge extraction, model interpretability, few-shot learning and comprehensive benchmark for complex reasoning.

1 January 2024
Verified
Conference Paper
Open access
PDF file
SWSiyuan Wang
Siyuan Wang
ZWZhongyu Wei
Zhongyu Wei
YCYejin Choi
Yejin Choi
XRXiang Ren
Xiang Ren
Siyuan Wang, Zhongyu Wei, Yejin Choi, Xiang Ren. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024.

19 October 2023 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
SWSiyuan Wang
Siyuan Wang
ZWZhongyu Wei
Zhongyu Wei
JXJiarong Xu
Jiarong Xu
TLTaishan Li
Taishan Li
ZFZhihao Fan
Zhihao Fan
Recent pre-trained language models (PLMs) equipped with foundation reasoning skills have shown remarkable performance on downstream complex tasks. However, the significant structure reasoning skill has been rarely studied, which involves modeling implicit structure information within the text and performing explicit logical reasoning over them to deduce the conclusion. This paper proposes a unified learning framework that combines explicit structure reasoning and language pre-training to endow PLMs with the structure reasoning skill. It first identifies several elementary structures within contexts to construct structured queries and performs step-by-step reasoning along the queries to identify the answer entity. The fusion of textual semantics and structure reasoning is achieved by using contextual representations learned by PLMs to initialize the representation space of structures, and performing stepwise reasoning on this semantic representation space. Experimental results on four datasets demonstrate that the proposed model achieves significant improvements in complex reasoning tasks involving diverse structures, and shows transferability to downstream tasks with limited training data and effectiveness for complex reasoning of KGs modality.

13 December 2024
Verified
Book Chapter
Closed access
PDF file
SYShengbin Yue
Shengbin Yue
SLShujun Liu
Shujun Liu
YZYuxuan Zhou
Yuxuan Zhou
CSChenchen Shen
Chenchen Shen
SWSiyuan Wang
Siyuan Wang
ZWZhongyu Wei
Zhongyu Wei

28 February 2023 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
ZSZekai Shao
Zekai Shao
SSShuran Sun
Shuran Sun
YZYuheng Zhao
Yuheng Zhao
SWSiyuan Wang
Siyuan Wang
ZWZhongyu Wei
Zhongyu Wei
SCSiming Chen
Siming Chen
Open-domain question answering (OpenQA) is an essential but challenging task in natural language processing that aims to answer questions in natural language formats on the basis of large-scale unstructured passages. Recent research has taken the performance of benchmark datasets to new heights, especially when these datasets are combined with techniques for machine reading comprehension based on Transformer models. However, as identified through our ongoing collaboration with domain experts and our review of literature, three key challenges limit their further improvement: (i) complex data with multiple long texts, (ii) complex model architecture with multiple modules, and (iii) semantically complex decision process. In this paper, we present VEQA, a visual analytics system that helps experts understand the decision reasons of OpenQA and provides insights into model improvement. The system summarizes the data flow within and between modules in the OpenQA model as the decision process takes place at the summary, instance and candidate levels. Specifically, it guides users through a summary visualization of dataset and module response to explore individual instances with a ranking visualization that incorporates context. Furthermore, VEQA supports fine-grained exploration of the decision flow within a single module through a comparative tree visualization. We demonstrate the effectiveness of VEQA in promoting interpretability and providing insights into model enhancement through a case study and expert evaluation.

18 February 2024 in arXiv
Verified
Preprint
Open access
PDF file
SWSiyuan Wang
Siyuan Wang
ZLZhuohan Long
Zhuohan Long
ZFZhihao Fan
Zhihao Fan
ZWZhongyu Wei
Zhongyu Wei
XHXuanjing Huang
Xuanjing Huang
This paper presents a benchmark self-evolving framework to dynamically evaluate rapidly advancing Large Language Models (LLMs), aiming for a more accurate assessment of their capabilities and limitations. We utilize a multi-agent system to manipulate the context or question of original instances, reframing new evolving instances with high confidence that dynamically extend existing benchmarks. Towards a more scalable, robust and fine-grained evaluation, we implement six reframing operations to construct evolving instances testing LLMs against diverse queries, data noise and probing their problem-solving sub-abilities. With this framework, we extend benchmark datasets of four tasks. Experimental results show a general performance decline in most LLMs against their original results. This decline under our scalable and robust evaluations, alongside our fine-grained evaluation, more accurately reflect models' capabilities. Besides, our framework widens performance discrepancies both between different models and within the same model across various tasks, facilitating more informed model selection for specific tasks (Code and data are available at https://github.com/NanshineLoong/Self-Evolving-Benchmark).