# Multilingual Reference Need Assessment System for Wikipedia

- **Authors:** Aitolkyn Baigutanova, Francisco Navas, Pablo Aragón, Mykola Trokhymovych, Muniza Aslam, Ai-Jou Chou, Miriam Redi, Diego Sáez Trumper
- **Venue:** Proceedings of the ACM Web Conference 2026 (WWW’26), 2026
- **Publisher:** Association for Computing Machinery
- **DOI:** https://doi.org/10.1145/3774904.3792803
- **Keywords:** reference need, citation needed, verifiability, Wikipedia, multilingual NLP, language models, content moderation
- **Page:** https://www.trokhymovych.com/publications/multilingual-reference-need-assessment-system-for-wikipedia-2026/

## Abstract

Wikipedia is a critical source of information for millions of users across the Web. It serves as a key resource for large language models, search engines, question-answering systems, and other Web-based applications. In Wikipedia, content needs to be verifiable, meaning that readers can check that claims are backed by references to reliable sources. This depends on manual verification by editors, an effective but labor-intensive process, especially given the high volume of daily edits. To address this challenge, we introduce a multilingual machine learning system to assist editors in identifying claims requiring citations. Our approach is tested in 10 language editions of Wikipedia, outperforming existing benchmarks for reference need assessment. We not only consider machine learning evaluation metrics but also system requirements, allowing us to explore the trade-offs between model accuracy and computational efficiency under real-world infrastructure constraints. We deploy our system in production and release data and code to support further research.

## Links

- arXiv: https://arxiv.org/abs/2603.17146
- HTML: https://doi.org/10.1145/3774904.3792803
- Data: https://analytics.wikimedia.org/published/datasets/one-off/reference-need/
- PDF: https://arxiv.org/pdf/2603.17146
- Blog: https://meta.wikimedia.org/wiki/Machine_learning_models/Production/Multilingual_reference_need
- Code: https://gitlab.wikimedia.org/repos/research/reference-quality
- Website: https://wikitech.wikimedia.org/w/index.php?api=lift-wing%2Fv1&title=Special%3ARestSandbox#/:~:text=a%20Wikipedia%20revision-,POST,Predict%20missing%20references%20in%20a%20Wikipedia%20revision,-POST

## Citation

```bibtex
@inproceedings{10.1145/3774904.3792803,
  author = {Baigutanova, Aitolkyn and Navas, Francisco and Aragón, Pablo and Trokhymovych, Mykola and Aslam, Muniza and Chou, Ai-Jou and Redi, Miriam and Sáez Trumper, Diego},
  title = {Multilingual Reference Need Assessment System for Wikipedia},
  year = {2026},
  isbn = {9798400723070},
  publisher = {Association for Computing Machinery},
  address = {New York, NY, USA},
  url = {https://doi.org/10.1145/3774904.3792803},
  doi = {10.1145/3774904.3792803},
  booktitle = {Proceedings of the ACM Web Conference 2026},
  pages = {8191--8199},
  numpages = {9},
  location = {United Arab Emirates},
  series = {WWW '26},
}
```