# GeoDD: End-to-End Spatial Data De-duplication System

- **Authors:** Mykola Trokhymovych, Oleksandr Kosovan
- **Venue:** Data Science and Algorithms in Systems, 2023
- **Publisher:** Springer International Publishing
- **DOI:** https://doi.org/10.1007/978-3-031-21438-7_60
- **Keywords:** data deduplication, geospatial data, entity resolution, NLP, machine learning, social media data
- **Page:** https://www.trokhymovych.com/publications/geodd-end-to-end-spatial-data-de-duplication-system-2023/

## Abstract

People generate vast amounts of data that can be used for analytics, data-driven decision-making, and forecasting. However, to extract value from data, we need to apply specific methods of cleaning and prepossessing it. In this paper, we observe the problem of geospatial data de-duplication, propose and implement end-to-end solutions for social-media-based data de-duplication. We apply advanced geospatial, natural language processing, and classical machine learning methods for our solution. Our tool shows high competitiveness in observed competition and can process a vast amount of data with limited computational resources.

## Links

- HTML: https://link.springer.com/chapter/10.1007/978-3-031-21438-7_60
- PDF: https://oleksandrkosovan.github.io/pdf/GeoDD.pdf
- Code: https://github.com/trokhymovych/forsquare-competition
- Slides: https://www.trokhymovych.com/assets/pdf/papers_slides/GeoDD_%20End-to-end%20spatial%20data%20de-duplication%20system.pdf

## Citation

```bibtex
@inproceedings{10.1007/978-3-031-21438-7_60,
  author = {Trokhymovych, Mykola and Kosovan, Oleksandr},
  editor = {Silhavy, Radek and Silhavy, Petr and Prokopova, Zdenka},
  title = {GeoDD: End-to-End Spatial Data De-duplication System},
  booktitle = {Data Science and Algorithms in Systems},
  year = {2023},
  publisher = {Springer International Publishing},
  address = {Cham},
  pages = {717--727},
  isbn = {978-3-031-21438-7},
  url = {https://link.springer.com/chapter/10.1007/978-3-031-21438-7_60},
  doi = {10.1007/978-3-031-21438-7_60},
}
```