Minimax Variance Minimization for Optimal Experimental Design

This direction is split into other directions: G-optimal design. Its last version stays readable and citable here.

Version 1 of 185 papers94 conceptsfrozen 2026-10-04

In many scientific and engineering domains, data collection is expensive. Whether you are conducting biological trials, stress-testing a 3D-printed bridge, or evaluating Large Language Models (LLMs), you cannot test every possibility. The challenge is to select a small subset of experiments that provides the most information about the entire system.

A recurring solution across recent research is the application of Optimal Experimental Design, specifically focusing on minimax variance minimization. Instead of sampling randomly, these methods strategically allocate resources to minimize the worst-case uncertainty across a model's entire domain.

The Geometry of Information

To understand why this works, consider a linear model where we try to estimate a reward or outcome based on a set of features. In a linear bandit setting, as explored by Marta Soare, Alessandro Lazaric, and Remi Munos in Best-Arm Identification in Linear Bandits, the uncertainty of our estimates isn't uniform. It depends on the "geometry" of the points we choose to sample.

If we only sample points that are highly correlated, we leave massive "blind spots" in other directions of the feature space. G-optimal design solves this by selecting a distribution of samples that minimizes the maximum variance of the predictions across all possible actions. By "covering" the space efficiently, we ensure that no matter which action turns out to be the best, we have enough information to identify it.

The Minimax Perspective: Playing Against Nature

The "minimax" framing treats experimental design as a game against an adversary. You choose a sampling strategy, and the "adversary" (nature) chooses the parameters or outcomes that would make your estimate the least accurate. By minimizing this maximum possible error, you create a design that is robust to initial ignorance.

This is particularly vital in biological experiments. Michael I. Jordan and Patrick Flaherty demonstrated in Robust design of biological experiments that framing design as a semidefinite programming (SDP) problem with built-in uncertainty allows for experiments that succeed even when the initial biological model is slightly wrong.

Similarly, in active statistical inference, Puheng Li and Emmanuel Candes use minimax optimization to hedge between active and uniform sampling. In Robust Sampling for Active Statistical Inference, they show that this prevents the "catastrophic" failures that occur when an AI’s uncertainty estimates are overconfident.

Scaling to High Dimensions and RL

As we move from simple linear models to Reinforcement Learning (RL), the number of possible "experiments" (state-action pairs) explodes. Researchers like Tor Lattimore and Csaba Szepesvari have shown that we don't need to explore every state. In Learning with Good Feature Representations in Bandits and in RL with a Generative Model, they utilize the Kiefer-Wolfowitz theorem to identify a minimal set of "anchor" actions. These anchors act as a basis for the entire environment; once you understand the rewards at these points, you can bound the variance across the entire state space.

This principle is extended to Linear Markov Decision Processes by Jérôme Taupin and Alexandre Proutiere. Their algorithm, GSS (G-Sampling-and-Stop), uses G-optimal design to ensure that the structural parameters of the environment are learned with a sample complexity that scales only with the feature dimension, effectively bypassing the curse of dimensionality (Best Policy Identification in Linear MDPs).

Modern Applications: From Structures to LLMs

The utility of minimax variance minimization extends far beyond theoretical bandits:

Summary of Intuition

Minimax variance minimization works because it treats information as a geometric resource. By identifying the "corners" and "axes" of a problem's feature space—the points that minimize the maximum possible prediction error—researchers can build models that are not just efficient, but robust to the very uncertainties they are trying to resolve.

Papers in this version

Showing 60 of 85 papers.

History & citationVersion 1 · 2026-10-04

Split into other directions · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_minimax_variance_minimization_for_optima_7dbed5aa,
  title = {Minimax Variance Minimization for Optimal Experimental Design},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/minimax-variance-minimization-for-optimal-experimental-design/rdr_7dbed5aa178743ad8a9c134623b5211b},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_minimax_variance_minimization_for_optima_7dbed5aa_v1,
  title = {Minimax Variance Minimization for Optimal Experimental Design},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/minimax-variance-minimization-for-optimal-experimental-design/rdr_7dbed5aa178743ad8a9c134623b5211b/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}