Using HyperLogLog to Prevent Data Retention in Social Media Streaming Data Analytics

Publikation: Beitrag in FachzeitschriftForschungsartikelBeigetragenBegutachtung

Abstract

Social media data are widely used to gain insights about social incidents, whether on a local or global scale. Within the process of analyzing and evaluating the data, it is common practice to download and store it locally. Considerations about privacy protection of social media users are often neglected thereby. However, protecting privacy when dealing with personal data is demanded by laws and ethics. In this paper, we introduce a method to store social media data using the cardinality estimator HyperLogLog. Based on an exemplary disaster management scenario, we show that social media data can be analyzed by counting occurrences of posts, without becoming in possession of the actual raw data. For social media data analyses like these, that are based on counting occurrences, cardinality estimation suffices the task. Thus, the risk of abuse, loss, or public exposure of the data can be mitigated and privacy of social media users can be preserved. The ability to do unions and intersections on multiple datasets further encourages the use of this technology. We provide a proof-of-concept implementation for our introduced method, using data provided by the Twitter API.

Details

OriginalspracheEnglisch
Aufsatznummer60
Seitenumfang13
FachzeitschriftISPRS International Journal of Geo-Information
Jahrgang12(2023)
Ausgabenummer2
PublikationsstatusVeröffentlicht - 9 Feb. 2023
Peer-Review-StatusJa

Externe IDs

ORCID /0000-0003-2949-4887/work/170583043

Schlagworte

Schlagwörter

  • cardinality estimation, data retention, disaster management, geocode systems, hyperloglog algorithm, privacy protection, privacy-aware data storage, social media, Twitter

Bibliotheksschlagworte