Multilingual Reference Need Assessment System for Wikipedia

Abstract

Wikipedia is a critical source of information for millions of users across the Web. It serves as a key resource for large language models, search engines, question-answering systems, and other Web-based applications. In Wikipedia, content needs to be verifiable, meaning that readers can check that claims are backed by references to reliable sources. This depends on manual verification by editors, an effective but labor-intensive process, especially given the high volume of daily edits. To address this challenge, we introduce a multilingual machine learning system to assist editors in identifying claims requiring citations. Our approach is tested in 10 language editions of Wikipedia, outperforming existing benchmarks for reference need assessment. We not only consider machine learning evaluation metrics but also system requirements, allowing us to explore the trade-offs between model accuracy and computational efficiency under real-world infrastructure constraints. We deploy our system in production and release data and code to support further research.

Citation

@inproceedings{10.1145/3774904.3792803,
  author = {Baigutanova, Aitolkyn and Navas, Francisco and Aragón, Pablo and Trokhymovych, Mykola and Aslam, Muniza and Chou, Ai-Jou and Redi, Miriam and Sáez Trumper, Diego},
  title = {Multilingual Reference Need Assessment System for Wikipedia},
  year = {2026},
  isbn = {9798400723070},
  publisher = {Association for Computing Machinery},
  address = {New York, NY, USA},
  url = {https://doi.org/10.1145/3774904.3792803},
  doi = {10.1145/3774904.3792803},
  booktitle = {Proceedings of the ACM Web Conference 2026},
  pages = {8191--8199},
  numpages = {9},
  location = {United Arab Emirates},
  series = {WWW '26},
}

Other publications

• Adversarial Creation and Detection of AI-Generated Social Bot Content (CIKM’26)
• An End-to-End Ukrainian RAG for Local Deployment. Optimized Hybrid Search and Lightweight Generation (UNLP’26)
• Graph-Linguistic Fusion: Using Language Models for Wikidata Vandalism Detection (ACL’25)
• Hidden Persuasion: Detecting Manipulative Narratives on Social Media During the 2022 Russian Invasion of Ukraine (UNLP’25)
• Characterizing Knowledge Manipulation in a Russian Wikipedia Fork (ICWSM’25)
• An Open Multilingual System for Scoring Readability of Wikipedia (ACL’24)
• Wikidata Vandalism Detection with Graph-Linguistic Fusion (2024)
• Fair Multilingual Vandalism Detection System for Wikipedia (KDD’23)
• GeoDD: End-to-End Spatial Data De-duplication System (2023)
• WikiFactFind: Semi-automated fact-checking based on Wikipedia (2022)
• WikiCheck: An End-to-End Open Source Automatic Fact-Checking API Based on Wikipedia (CIKM’21)

← All publications