GeoDD: End-to-End Spatial Data De-duplication System

Abstract

People generate vast amounts of data that can be used for analytics, data-driven decision-making, and forecasting. However, to extract value from data, we need to apply specific methods of cleaning and prepossessing it. In this paper, we observe the problem of geospatial data de-duplication, propose and implement end-to-end solutions for social-media-based data de-duplication. We apply advanced geospatial, natural language processing, and classical machine learning methods for our solution. Our tool shows high competitiveness in observed competition and can process a vast amount of data with limited computational resources.

Citation

@inproceedings{10.1007/978-3-031-21438-7_60,
  author = {Trokhymovych, Mykola and Kosovan, Oleksandr},
  editor = {Silhavy, Radek and Silhavy, Petr and Prokopova, Zdenka},
  title = {GeoDD: End-to-End Spatial Data De-duplication System},
  booktitle = {Data Science and Algorithms in Systems},
  year = {2023},
  publisher = {Springer International Publishing},
  address = {Cham},
  pages = {717--727},
  isbn = {978-3-031-21438-7},
  url = {https://link.springer.com/chapter/10.1007/978-3-031-21438-7_60},
  doi = {10.1007/978-3-031-21438-7_60},
}

Other publications

• Adversarial Creation and Detection of AI-Generated Social Bot Content (CIKM’26)
• Multilingual Reference Need Assessment System for Wikipedia (WWW’26)
• An End-to-End Ukrainian RAG for Local Deployment. Optimized Hybrid Search and Lightweight Generation (UNLP’26)
• Graph-Linguistic Fusion: Using Language Models for Wikidata Vandalism Detection (ACL’25)
• Hidden Persuasion: Detecting Manipulative Narratives on Social Media During the 2022 Russian Invasion of Ukraine (UNLP’25)
• Characterizing Knowledge Manipulation in a Russian Wikipedia Fork (ICWSM’25)
• An Open Multilingual System for Scoring Readability of Wikipedia (ACL’24)
• Wikidata Vandalism Detection with Graph-Linguistic Fusion (2024)
• Fair Multilingual Vandalism Detection System for Wikipedia (KDD’23)
• WikiFactFind: Semi-automated fact-checking based on Wikipedia (2022)
• WikiCheck: An End-to-End Open Source Automatic Fact-Checking API Based on Wikipedia (CIKM’21)

← All publications