Inference on the Optimal Assortment in the Multinomial Logit Model

Shuting Shen, Xi Chen, Ethan X. Fang, Junwei LuarXiv 2023 · DOI · arXiv

TL;DR

This paper introduces a novel framework for performing hypothesis tests on the optimal assortment of products offered to customers, moving beyond just estimating the assortment itself. They develop a statistically rigorous method to answer practical business questions like "should we include product X?" or "is product category Y sufficiently represented?" under the widely used Multinomial Logit (MNL) choice model.

What Problem Does This Paper Address?

In retail and e-commerce, deciding which products to offer (assortment optimization) is crucial for maximizing revenue. While significant progress has been made in algorithms to find the optimal assortment, there's a critical gap in quantifying the uncertainty around these decisions. Decision-makers often don't need the exact optimal set, but rather need to test specific hypotheses about it. For example, a retailer might want to know with statistical confidence if a particular product should be part of the optimal offering, or if a certain proportion of the assortment should be dedicated to a specific category. Existing methods primarily focus on estimation, leaving a void in robust hypothesis testing for these practical business questions under realistic choice models like the MNL.

Methods

The authors propose a novel inferential framework that tackles this uncertainty quantification problem. Their approach involves:

  • Estimating Latent Preference Scores: They first estimate the unobserved customer preference scores using penalized maximum likelihood estimation from observed choice data.
  • Debiasing the Estimator: A Newton-based debiasing step is applied to correct for potential biases introduced by the regularization.
  • Sign Change Point Detection: The core idea is to reframe testing properties of the optimal assortment into a problem of detecting the "sign change point" of marginal revenue gaps. This is a key theoretical insight that simplifies the complex combinatorial problem.
  • Gaussian Multiplier Bootstrap: To handle the statistical uncertainty and construct confidence intervals for the optimal assortment's characteristics (specifically, its size, K*), they employ a Gaussian multiplier bootstrap. This technique is used to approximate the distribution of a maximal statistic, allowing for hypothesis testing.
  • Hypothesis Testing Framework: They establish a general framework for testing hypotheses of the form $S^* \in S_o$ (where $S^*$ is the optimal assortment and $S_o$ is a set of assortments satisfying certain properties), which is then translated into testing properties of $K^*$.

Datasets

Not discussed in the paper. The experiments are conducted on simulated data.

Key Insights and Ideas

  • Reframing the Problem: The most significant insight is reformulating assortment optimization inference into a sign change point detection problem. This allows for a more tractable statistical analysis.
  • Bridging Estimation and Inference: The paper effectively bridges the gap between estimating model parameters (preference scores) and performing inferential tasks (hypothesis testing) on a derived quantity (optimal assortment).
  • Practical Relevance: The framework directly addresses practical business questions that go beyond simple estimation, providing decision-makers with statistically grounded answers.
  • Generalizability: The proposed framework is designed to be general, applicable to testing various properties of the optimal assortment under the MNL model.

Key Results

  • Theoretical Guarantees: The paper provides theoretical guarantees for the validity of the proposed inferential procedure, showing asymptotic normality of key estimators and valid coverage probabilities for confidence intervals under mild conditions.
  • Empirical Validation: Numerical experiments on simulated data demonstrate that the proposed method achieves empirical coverage probabilities close to the nominal level and shows good performance in Type I error control and power for hypothesis testing examples. Specifically, Figure 2 shows that the empirical coverage probability of the confidence interval for $K^*$ converges to the nominal level of 0.95 as the sample size $L$ increases. Figures 3 and 4 illustrate that the Type I error converges to the nominal 0.05 level, and the power increases to 1 as $L$ grows.

Limitations and Future Work

  • MNL Model Assumption: The current framework is developed under the Multinomial Logit (MNL) choice model. The authors acknowledge that real-world choice behaviors can be more complex.
  • Computational Efficiency: While the method is theoretically sound, they suggest seeking more computationally efficient and scalable methods for constructing confidence intervals.
  • Generalizing to Other Models: Future work includes extending the results to other choice models, such as the capacitated MNL model or mixture of MNL models (MMNL).

Summary updated

Abstract

Assortment optimization has received active explorations in the past few decades due to its practical importance. Despite the extensive literature dealing with optimization algorithms and latent score estimation, uncertainty quantification for the optimal assortment still needs to be explored and is of great practical significance. Instead of estimating and recovering the complete optimal offer set, decision-makers may only be interested in testing whether a given property holds true for the optimal assortment, such as whether they should include several products of interest in the optimal set, or how many categories of products the optimal set should include. This paper proposes a novel inferential framework for testing such properties. We consider the widely adopted multinomial logit (MNL) model, where we assume that each customer will purchase an item within the offered products with a probability proportional to the underlying preference score associated with the product. We reduce inferring a general optimal assortment property to quantifying the uncertainty associated with the sign change point detection of the marginal revenue gaps. We show the asymptotic normality of the marginal revenue gap estimator, and construct a maximum statistic via the gap estimators to detect the sign change point. By approximating the distribution of the maximum statistic with multiplier bootstrap techniques, we propose a valid testing procedure. We also conduct numerical experiments to assess the performance of our method.
BibTeX
@misc{shen2023inference,
  author = {Shuting Shen and Xi Chen and Ethan X. Fang and Junwei Lu},
  title = {{Inference on the Optimal Assortment in the Multinomial Logit Model}},
  year = {2023},
  eprint = {2301.12254},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2301.12254},
}

Loading related content...

Figure