Analyzing and explaining privacy risks on time series data: ongoing work and challenges

Tristan Allard, Hira Asghar, Gildas Avoine, Christophe Bobineau, Pierre Cauchois, Elisa Fromont, Anna Monreale, Francesca Naretto, Roberto Pellungrini, Francesca Pratesi, Marie-Christine Rousset, Antonin VoyezSIGKDD Explor 2024 · DOI

Introduction

As urban environments transition into "Smart Cities," the proliferation of IoT devices—such as smart meters and mobility trackers—generates a continuous stream of high-resolution temporal data. While this data is invaluable for urban planning and resource management, it presents significant privacy challenges. This paper, a collaborative effort from the European TAILOR project, investigates systematic methods for quantifying and explaining privacy risks in time series data, moving beyond manual audits toward automated, interpretable frameworks.

Automated Risk Assessment Frameworks

The researchers propose a multi-faceted approach to assessing privacy risks, focusing on three primary attack vectors:

  1. Re-identification (PRUDENCE & EXPERT): The PRUDENCE framework utilizes a "Unicity" metric to simulate attacks, identifying the specific combinations of time points that uniquely distinguish a user. Complementing this, the EXPERT framework treats risk assessment as a machine learning task. It employs a Bidirectional Long Short-Term Memory (Bi-LSTM) network to predict high-risk time series and uses SHAP (SHapley Additive exPlanations) to provide interpretability, pinpointing the exact time slots that contribute most to an individual's vulnerability.
  2. Membership Inference Attacks (MIA): This method evaluates whether an individual's data was included in a published aggregate. By using the efficient Minirocket classifier, the authors test if an attacker can detect a target's unique signature within a crowd.
  3. Data Reconstruction via Formal Verification: This data-independent approach analyzes the structure of SPARQL queries. By comparing utility queries (used for publishing) against potential privacy queries (used by attackers), the system uses graph patterns and constraint solvers to mathematically prove if sensitive information can be reconstructed from aggregates.

Dataset and Experimental Setup

The primary benchmark for this study is the Irish Social Science Data Archive (ISSDA) dataset, which contains half-hourly electrical consumption data from over 6,000 Irish households. After cleaning, the researchers utilized 4,622 full series, enriched with demographic and appliance ownership metadata represented as an RDF knowledge graph.

Visualization of individual household consumption (TS 1, 2, 3) versus the group average.

Key Insights: The Vulnerability of Aggregated Data

A critical finding of this research is the "Three-Point Rule." In the ISSDA dataset, knowing a single consumption value at a specific time identifies approximately 15% of users. However, knowing just three consecutive values allows for the unique identification of over 98% of households. This highlights that even minimal background knowledge can lead to total de-anonymization.

Furthermore, the study demonstrates that common protection methods like aggregation are not panaceas. While publishing daily sums is inherently safer than publishing day/night sums, the risk of re-identification spikes dramatically as soon as an attacker gains even minor temporal context.

Re-identification risk distributions across different temporal aggregation strategies: (a) daily, (b) day/night, and (c) consecutive slots.

Explainability and Mitigation

The authors introduce the "oddness score," a metric measuring how much an individual's consumption pattern deviates from the population mean. Their results show that "weirder" data—outliers in consumption—are significantly more susceptible to Membership Inference Attacks. By using SHAP, the EXPERT framework can pinpoint specific events, such as power surges or holiday periods, that make a user's data identifiable. This explainability is vital for data publishers, allowing them to understand not just that data is risky, but why it is risky.

Conclusion and Future Directions

While the proposed methods show promise, several challenges remain. Scalability is a primary concern, as methods must eventually handle data from tens of millions of devices. Additionally, the "evolution" of privacy risks over time (data drift) and the increased complexity of multivariate data (e.g., combining electricity, water, and mobility data) present ongoing hurdles. Future work will focus on modeling more abstract attackers and developing robust defenses against the "curse of dimensionality" in multi-source temporal data.

Summary updated

BibTeX
@article{allard2024analyzing,
  author = {Tristan Allard and Hira Asghar and Gildas Avoine and Christophe Bobineau and Pierre Cauchois and Elisa Fromont and Anna Monreale and Francesca Naretto and Roberto Pellungrini and Francesca Pratesi and Marie-Christine Rousset and Antonin Voyez},
  title = {{Analyzing and explaining privacy risks on time series data: ongoing work and challenges}},
  journal = {SIGKDD Explor.},
  year = {2024},
  doi = {10.1145/3682112.3682118},
}
Figure