In the world of retail, a forecast is more than just a number; it’s a roadmap for ordering stock. When a merchant plans a promotion, they aren't just asking "how much will I sell?" but "how much extra will this promotion add?" This "extra" is known as lift.
In his paper, "Auditing World-Model Explanations in Retail Forecasting," Karthik Iyer reveals a dangerous gap in how we trust these models. He demonstrates that a model’s explanation can be perfectly "faithful" (it accurately describes what the model is doing) while being fundamentally "incorrect" (it gets the real-world cause-and-effect wrong). For a retailer, this distinction is the difference between a profitable promotion and a warehouse full of unsold goods.
TL;DR
Standard "sanity checks" for AI explanations often only prove that an explanation matches the model's internal logic, not that it reflects reality. This paper introduces an auditing framework for retail forecasting that reveals how models can pass these checks while overstating promotional lift by up to 40%, potentially leading to massive overstocking costs.
What Problem Does This Paper Address?
Retailers use "plan-lift" explanations to decompose a forecast into a baseline (what would sell anyway) and lift (the boost from price cuts, displays, or ads). Merchants use these lift estimates to decide how much inventory to buy.
The challenge is that forecasting models are often "black boxes." To trust them, researchers use "faithfulness" checks to ensure the explanation isn't just making things up. However, Iyer argues that faithfulness is not enough. If a model learns a biased relationship—for example, if it thinks a promotion caused a sales spike that was actually just a seasonal trend—it will provide a "faithful" but "incorrect" explanation. The paper seeks to bridge this gap by auditing explanations against known truths and real-world causal benchmarks.
Methods
The author proposes a suite of eight checks (C1 to C8) to audit any model that provides plan-lift explanations. These checks are categorized into four buckets:
- Against the model itself: Does the explanation hold up by construction and remain stable?
- Against common sense: Does a deeper price cut ever (incorrectly) lead to a lower forecast?
- Against what sold: Does the predicted lift correlate with actual sales?
- Against another model and a cause: Does the model agree with established benchmarks (like LightGBM) or measured causal effects?
The paper evaluates two types of models: a World Model (a neural network that "rolls" through a plan) and LightGBM (a standard gradient-boosted tree model).
Crucially, the author uses a "known-answer" study. By generating synthetic store data where the exact effect of every price cut and promotion is programmed in, the author can definitively measure when a model's explanation is lying.
Datasets
The study utilizes several prominent retail datasets:
- M5 (Walmart): Daily sales of ~3,000 items.
- Dominick’s Finer Foods: A classic 1990s dataset from a Chicago grocery chain, used here to estimate real-world price response.
- Breakfast at the Frat & Corporación Favorita: Public datasets used to test the models across different retail contexts.
- Synthetic "Known-Answer" Data: A custom-generated dataset where the "ground truth" causal effects are known.
Key Insights and Ideas
- Faithfulness $\neq$ Correctness: This is the "aha moment." A model can pass every internal sanity check (C1-C3) and still be dangerously wrong about the world. Iyer calls these "faithful failures."
- The "Merchant Habit" Bias: If merchants historically run promotions during weeks they already expect high demand, models will incorrectly attribute that high demand to the promotion itself. In the synthetic study, this caused models to overstate lift by ~1.4x.
- The Regular Price Trap: Models often learn from temporary "price cuts" (which have high impact) and incorrectly assume that a permanent "regular price" change will have the same massive effect. In reality, regular price changes move far fewer units.
- Accuracy is No Shield: Surprisingly, the paper found that a model's forecasting accuracy (how close it gets to the final number) is not related to how many explanation checks it passes. You can have a very accurate forecast built on a completely wrong causal explanation.
Key Results
The results from the "known-answer" study (summarized in Figure 3) show that even "correct" models can be misled by the data they are fed.
- Lift Overstatement: When plans followed demand (the "high-demand weeks" scenario), the World Model stated 1.33 to 1.40 times the true lift. LightGBM was similarly off (1.26x).
- Price Response Error: The World Model’s stated response to a lasting regular-price change was 4.7 to 6.5 times the true effect.
- Common Sense Failures: On the real-world Dominick’s data, a deeper price cut actually lowered the forecast in 29% to 83% of cases—a clear logic error that standard accuracy metrics would never catch.
- The Cost of Error: Ordering stock based on these overstated lifts would result in an inventory error of 0.44 to 0.48 of the true lift.
Limitations and Future Work
The author acknowledges several hurdles:
- Observational Noise: The real-world benchmark (C7) relies on "zone price deviations" in old data, which is a noisy proxy for a true randomized experiment.
- Simplicity of Synthetic Data: The generated world doesn't account for "cannibalization" (e.g., buying more Coke because it's on sale, so you buy less Pepsi).
- Need for Experiments: The paper concludes that for a retailer to truly trust these lifts, they should run their own controlled experiments (A/B tests) to create a "ground truth" benchmark for their specific stores.
In short: Don't just ask if your model is accurate; ask if its explanation of why it's accurate matches the real world.
Summary updated