Ai-Jou Chou

Ai-Jou Chou

Auto-generated profile, based on publicly available information

Ai-Jou Chou

Wikimedia Foundation, Berlin, Germany

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
30 April 2023
Verified
Conference Paper
Open access
ABAitolkyn Baigutanova
Aitolkyn Baigutanova
JMJaehyeon Myung
Jaehyeon Myung
DSDiego Sáez-Trumper
Diego Sáez-Trumper
ACAi-Jou Chou
Ai-Jou Chou
MRMiriam Redi
Miriam Redi
MCMeeyoung Cha
Meeyoung Cha
Wikipedia plays a crucial role in the integrity of the Web. This work analyzes the reliability of this global encyclopedia through the lens of its references. We operationalize the notion of reference quality by defining reference need (RN), i.e., the percentage of sentences missing a citation, and reference risk (RR), i.e., the proportion of non-authoritative references. We release Citation Detective, a tool for automatically calculating the RN score, and discover that the RN score has dropped by 20 percent point in the last decade, with more than half of verifiable statements now accompanying references. The RR score has remained below 1% over the years as a result of the efforts of the community to eliminate unreliable references. We propose pairing novice and experienced editors on the same Wikipedia article as a strategy to enhance reference quality. Our quasi-experiment indicates that such a co-editing experience can result in a lasting advantage in identifying unreliable sources in future edits. As Wikipedia is frequently used as the ground truth for numerous Web applications, our findings and suggestions on its reliability can have a far-reaching impact. We discuss the possibility of other Web services adopting Wiki-style user collaboration to eliminate unreliable content.

4 August 2023
Verified
Conference Paper
Open access
MTMykola Trokhymovych
Mykola Trokhymovych
MAMuniza Aslam
Muniza Aslam
ACAi-Jou Chou
Ai-Jou Chou
RBRicardo Baeza-Yates
Ricardo Baeza-Yates
DSDiego Sáez-Trumper
Diego Sáez-Trumper

12 April 2026
Verified
Conference Paper
Open access
ABAitolkyn Baigutanova
Aitolkyn Baigutanova
FNFrancisco Navas
Francisco Navas
PAPablo Aragón
Pablo Aragón
MTMykola Trokhymovych
Mykola Trokhymovych
MAMuniza Aslam
Muniza Aslam
DSDiego Sáez-Trumper
Diego Sáez-Trumper
Wikipedia is a critical source of information for millions of users across the Web. It serves as a key resource for large language models, search engines, question-answering systems, and other Web-based applications. In Wikipedia, content needs to be verifiable, meaning that readers can check that claims are backed by references to reliable sources. This depends on manual verification by editors, an effective but labor-intensive process, especially given the high volume of daily edits. To address this challenge, we introduce a multilingual machine learning system to assist editors in identifying claims requiring citations. Our approach is tested in 10 language editions of Wikipedia, outperforming existing benchmarks for reference need assessment. We not only consider machine learning evaluation metrics but also system requirements, allowing us to explore the trade-offs between model accuracy and computational efficiency under real-world infrastructure constraints. We deploy our system in production and release data and code to support further research.