Xinyi Zhou

Xinyi Zhou

Auto-generated profile, based on publicly available information

Xinyi Zhou

University of Washington Seattle Washington USA

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 December 2024 in arXiv
Verified
Preprint
Open access
PDF file
BJBohan Jiang
Bohan Jiang
DLDawei Li
Dawei Li
ZTZhen Tan
Zhen Tan
XZXinyi Zhou
Xinyi Zhou
ARAshwin Rao
Ashwin Rao
HLHuan Liu
Huan Liu
Measuring the relative impact of CTs is important for prioritizing responses and allocating resources effectively, especially during crises. However, assessing the actual impact of CTs on the public poses unique challenges. It requires not only the collection of CT-specific knowledge but also diverse information from social, psychological, and cultural dimensions. Recent advancements in large language models (LLMs) suggest their potential utility in this context, not only due to their extensive knowledge from large training corpora but also because they can be harnessed for complex reasoning. In this work, we develop datasets of popular CTs with human-annotated impacts. Borrowing insights from human impact assessment processes, we then design tailored strategies to leverage LLMs for performing human-like CT impact assessments. Through rigorous experiments, we textit{discover that an impact assessment mode using multi-step reasoning to analyze more CT-related evidence critically produces accurate results; and most LLMs demonstrate strong bias, such as assigning higher impacts to CTs presented earlier in the prompt, while generating less accurate impact assessments for emotionally charged and verbose CTs.