A Synthetic Benchmark for Target-Centric Causal Discovery in Industrial Processes

Angelo ZilettiarXiv 2026 · arXiv

TL;DR

Researchers have developed a new synthetic benchmark specifically for target-centric causal discovery in industrial batch processes. Unlike previous benchmarks that evaluate entire causal graphs, this tool allows engineers to test how well algorithms can identify the specific "levers" (direct causes) that drive a target variable like product quality, even in the presence of complex industrial phenomena like control loops and sensor drift.

What Problem Does This Paper Address?

In manufacturing, "root-cause analysis" is the holy grail. If a batch of chemicals comes out off-specification, an engineer needs to know which specific process variable—temperature, pressure, or raw material purity—directly caused the failure.

Current causal discovery benchmarks fall short for industrial applications for two reasons:

  1. Whole-Graph Bias: Most benchmarks evaluate how well an algorithm reconstructs an entire causal network. In a factory with hundreds of sensors, we usually only care about the causes of one specific target.
  2. Fixed Difficulty: Real-world industrial data is messy, but existing datasets often have "baked-in" difficulties. You can't easily test how an algorithm handles just sensor noise versus just a feedback control loop.

This paper introduces a generator that builds causal models "around the target," allowing researchers to turn specific "difficulty knobs" one at a time to see exactly where different algorithms break.

Methods

The authors propose a two-level Structural Causal Model (SCM) inspired by batch production:

  • Batch-level: Models variables that change once per batch (e.g., the specific lot of raw material used).
  • Time-step level: Models the minute-by-minute sensor trajectories within a batch.

The generator is modular, featuring components that mimic real-world plant behavior (see Table 1 below). These include control loops (where a controller hides the variation of a cause), delayed effects, and downstream measurements (which are effects of the target, not causes).

Table 1: Core components of the generator.

The key innovation is the use of variance-based "shares." By adjusting these parameters, the user can precisely control the signal strength of a cause, the amount of confounding (shared latent causes), or the tightness of a feedback controller.

Datasets

The authors released a benchmark consisting of:

  • 119 configurations of the generator.
  • 1,190 unique "plants" (10 per configuration).
  • Validation against public datasets: They compared their synthetic data's difficulty to standard industrial datasets like Tennessee Eastman and IndPenSim, showing that their "combined difficulty" settings accurately reflect the challenges of real-world industrial data.

Key Insights and Ideas

  • The "Look-alike" Challenge: In industrial settings, many variables are correlated with the target but aren't direct causes. They might be "siblings" (sharing a hidden cause) or "ancestors" (acting through another variable). The benchmark explicitly labels these roles, allowing for a detailed error analysis of why a method failed.
  • Control Loops are Causal "Cloaking Devices": One of the most striking findings is how feedback controllers hide causal relationships. Because a controller moves an actuator to keep a variable steady, the data may show zero correlation between a cause and the target, even though the causal link is physically present.
  • Target-Centricity Simplifies Evaluation: By focusing on the target, the authors can use metrics like "lift" (how much better a method is than random guessing) and "first pick" accuracy, which are more intuitive for engineers than global graph metrics like Structural Hamming Distance.

Key Results

The authors evaluated eight methods, ranging from simple lagged correlation to advanced causal estimators like PCMCI+, DoubleML, and SpaceTime.

  • Reference Performance: In "easy" settings, most methods performed well. However, simple association measures (Correlation, Granger) tended to select far too many candidates, leading to low precision.
  • Combined Difficulties: When multiple challenges (noise, confounding, joint effects) were combined, performance plummeted. Correlation and VARLiNGAM often mistakenly identified descendants (effects of the target) as causes.
  • Top Performers: Methods that adjust for other candidates—specifically PCMCI+, DoubleML, and SpaceTime—maintained the highest "lift," often returning short, high-precision lists of 1–3 candidates.
Figure 2: Comparison of eight methods on reference vs. combined difficulty settings. Note how performance degrades as "green" (correct causes) is replaced by other colors (errors).

Limitations and Future Work

  • Structural vs. Physical: The generator models the causal structure of a plant, not its underlying physics (e.g., it doesn't solve Navier-Stokes or chemical kinetic equations).
  • Noise Assumptions: The current model assumes Gaussian exogenous noise, which may not capture the "spiky" or non-linear noise found in some industrial environments.
  • Future Directions: The authors suggest this generator could be used to create massive amounts of synthetic training data for Foundation Models in causal inference, potentially allowing for "pre-trained" root-cause analysis tools.

Summary updated

Abstract

Causal discovery promises to find which recorded variables drive a process target such as product quality, yield or energy use. Process data with known causes are rare, and in existing benchmarks the difficulty of identifying the causes of a target is either fixed by the recorded data or set for the whole graph. We present a synthetic benchmark for target-centric causal discovery in industrial processes. Its generator is a two-level structural causal model inspired by batch production, assembled from components that each model one phenomenon of process data, such as a control loop or a delayed effect. The graph is built around the target: without sensor error, every non-cause can be distinguished from the direct causes by conditioning on them or by time order. Each component is set independently, so the difficulty can be varied one condition at a time. We evaluate eight methods, from association measures to effect estimation, with an error analysis by the role of the selected candidate; all degrade as the difficulties combine, each in a way consistent with its assumptions.
BibTeX
@misc{ziletti2026synthetic,
  author = {Angelo Ziletti},
  title = {{A Synthetic Benchmark for Target-Centric Causal Discovery in Industrial Processes}},
  year = {2026},
  eprint = {2611.17556},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.17556},
}
Figure