Identifying Predictions That Influence the Future: Detecting Performative Concept Drift in Data Streams

Brandon Gower-Winter, Georg Krempl, Sergey Dragomiretskiy, Tineke Jelsma, Arno SiebesAAAI 2025 · DOI

Abstract

Traditional machine learning models are often treated as passive observers, assuming that the data they predict is independent of the predictions themselves. However, in many real-world applications—such as financial markets, recommendation engines, and fraud detection—the model's output actively shapes the future data distribution, a phenomenon known as performative drift. This paper introduces CheckerBoard Performative Drift Detection (CB-PDD), a novel intervention-based algorithm designed to distinguish between natural "intrinsic" drift and "performative" drift caused by the model's own feedback loops.

The Challenge of Performative Drift

In standard stream learning, "Concept Drift" is typically attributed to external changes in the environment, such as shifting consumer habits. Performative prediction complicates this by creating feedback loops:

  • Self-fulfilling loops: A prediction causes the predicted event to occur (e.g., a trading bot's buy signal driving up a stock price).
  • Self-defeating loops: A prediction causes the environment to react against it (e.g., scammers changing tactics to evade a newly deployed fraud detector).

Existing drift detectors like ADWIN or DDM can identify that a change has occurred but are blind to the source. Failing to distinguish performative drift from intrinsic drift can lead to retraining models on "tainted" data, potentially amplifying biases or causing system instability.

Methodology: The CB-PDD Algorithm

The authors propose CheckerBoard Performative Drift Detection (CB-PDD), which moves beyond passive observation to active intervention. The algorithm operates in three primary stages:

1. Checkerboard Intervention

Instead of a standard predictive model, CB-PDD partitions the feature space into a "checkerboard" grid. It assigns arbitrary labels to these regions and periodically flips them after a defined "trial length" ($\tau$). This creates a controlled environment to observe how the data stream responds to specific, randomized predictions.

The checkerboard intervention strategy partitions the feature space and flips labels over time to test for environmental response.

2. Density Tracking and Statistical Testing

The algorithm monitors the density of incoming data points within these regions. If the drift is performative, the distribution will shift in response to the arbitrary labels. CB-PDD uses a Mann-Whitney U test to compare density changes in regions where predictions matched the target versus those where they did not. A statistically significant difference indicates that the environment is reacting to the model's outputs, flagging the drift as performative.

Experimental Evaluation

To evaluate CB-PDD, the authors developed a novel synthetic data generator based on Random Radial Basis Functions (RandomRBF), allowing for tunable performative drift strength ($\sigma$). They also utilized semi-synthetic versions of real-world datasets, including Water Potability, Loan Status, and Credit Card data.

Key Results

Experimental results demonstrate that CB-PDD is highly effective at identifying performative drift even when traditional detectors fail.

  • Sensitivity to Drift Strength: As shown in the performance analysis, the detection rate reaches near-perfection as the performative drift strength ($\sigma$) increases.
  • Parameter Sensitivity: The "trial length" ($\tau$) is a critical factor; longer trials allow feedback loops more time to manifest, leading to higher detection rates at lower drift strengths.
Detection rate of CB-PDD across varying drift strengths (σ) and trial lengths (τ), showing high efficacy as drift becomes more pronounced.
  • Robustness: The algorithm maintained low false-positive rates (0%–20%) in environments containing only intrinsic drift, successfully filtering out natural changes that were not correlated with the checkerboard interventions.

Discussion and Limitations

While CB-PDD provides a powerful tool for identifying performative loops, it introduces a "cost of detection." To function, the algorithm must deliberately misclassify some data points to probe the system's response. In sensitive domains like medical diagnostics, such interventions may be unethical or prohibitively expensive.

Additionally, the algorithm's performance is tied to data density. In the Credit Card dataset, the extreme rarity of the "fraud" class (0.172%) made it difficult for the statistical tests to reach significance. Future research will explore "dynamic mixing" strategies to balance the need for accurate real-time predictions with the necessity of intervention-based drift detection.

Summary updated

BibTeX
@inproceedings{gowerwinter2025identifying,
  author = {Brandon Gower-Winter and Georg Krempl and Sergey Dragomiretskiy and Tineke Jelsma and Arno Siebes},
  title = {{Identifying Predictions That Influence the Future: Detecting Performative Concept Drift in Data Streams}},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year = {2025},
  doi = {10.1609/aaai.v39i11.33276},
}
Figure