Filtering Unreliable Samples via Predictive Entropy

69 concepts51 papers1 proposal

When deploying machine learning models to the real world, they inevitably encounter data distributions that differ from their training environments. To maintain accuracy, models must adapt on the fly using unsupervised techniques like pseudo-labeling or entropy minimization. However, this creates a dangerous feedback loop: if a model encounters an unfamiliar or noisy sample, its prediction is likely incorrect. If the model then updates its own weights based on this flawed prediction, it introduces noisy gradients, leading to catastrophic forgetting and confirmation bias.

To break this loop, researchers use predictive entropy filtering. By treating a model's output distribution as a direct gauge of its own uncertainty, systems can selectively filter out unreliable samples, ensuring that adaptation and learning are driven only by high-quality data.


The Core Intuition: Sharp vs. Flat Distributions

To understand why entropy filtering works, consider how a classification model expresses uncertainty. When given an input $x$, the model outputs a softmax probability vector over possible classes.

Confident Prediction (Low Entropy):     [0.95, 0.02, 0.01, 0.02]  --> Sharp
Uncertain Prediction (High Entropy):    [0.26, 0.24, 0.25, 0.25]  --> Flat

We can quantify the "flatness" of this distribution using Shannon entropy:

$$H(p) = -\sum_{i} p_i \log p_i$$

A sharp, confident distribution yields low entropy, while a flat, uncertain distribution yields high entropy.

In unsupervised settings—such as Test-Time Adaptation (TTA)—the model uses its own predictions as "pseudo-labels" to compute gradients and update its parameters. If the model updates its weights on a high-entropy sample, it is essentially forcing itself to become confident about a random guess. This introduces chaotic, noisy gradients into the optimization process. By setting an entropy threshold, we can implement a quality gate: only samples with an entropy below the threshold are allowed to alter the model's state.


Protecting Models During Test-Time Adaptation

The primary battleground for entropy-based filtering is Test-Time Adaptation, where a pre-trained model must adapt to a shifting test stream without access to any original training data.

Jiaxiang Wu et al. demonstrated the necessity of this gating mechanism in Efficient Test-Time Model Adaptation without Forgetting. They showed that filtering out high-entropy test samples prevents noisy gradients from corrupting model parameters during distribution shifts. Rather than optimizing over every encountered instance, updating on fewer, highly reliable samples yields significantly higher final accuracy.

This finding is echoed across various architectures and modalities:


Curation of Dynamic Memories and Buffers

Instead of directly updating model weights via backpropagation, many modern adaptation frameworks maintain an explicit cache or memory buffer of past experiences to guide future predictions. Entropy filtering serves as the gatekeeper for these memories, ensuring that the stored knowledge remains uncorrupted.

For vision-language models like CLIP, Adilbek Karmanov et al. developed a training-free approach in Efficient Test-Time Adaptation of Vision-Language Models that uses prediction entropy to self-curate a dynamic key-value cache. By storing only high-confidence samples, the local cache remains reliable under distribution shifts.

Similarly, Hongyu Sun applied this concept to 3D spatial data in Point-Cache: Test-time Dynamic and Hierarchical Cache for Robust and Generalizable Point Cloud Analysis, demonstrating that entropy filtering prevents sensor noise from corrupting the hierarchical inference cache.

Incoming Stream ──> [ Calculate Entropy ] ───> High Entropy ──> Discard / Evict
                               │
                               └───> Low Entropy ───> Store in Dynamic Cache

When operating with a fixed buffer size in continuous environments, entropy can also dictate eviction policies. As designed by Zhilin Zhu et al. in Reshaping the Online Data Buffering and Organizing Mechanism for Continual Test-Time Adaptation, when a data buffer reaches capacity, the system calculates the entropy of all buffered instances and evicts the most uncertain samples, preserving a clean, representative set for adaptation.


Filtering Augmentations and Finding the Learning Signal

Entropy filtering is equally effective when applied to multiple variations of a single sample. In test-time prompt tuning, models often generate multiple augmented views of an incoming image to find stable representations.

Zichen Liu et al. leveraged this in DART: Dual-Modal Adaptive Online Prompting and Knowledge Retention for Test-Time Adaptation, filtering out augmented views that produce high-entropy predictions. This ensures that prompt updates are driven only by clean, informative visual features, a strategy that Xin Wang et al. demonstrated in TAPT: Test-Time Adversarial Prompt Tuning for Robust Inference in Vision-Language Models can protect vision-language models against adversarial distribution shifts.

The Nuance: When High Entropy is Useful

While the dominant paradigm filters out high-entropy samples to avoid noise, a compelling counter-perspective uses entropy to find informative data. If a sample has extremely low entropy, the model already knows it perfectly, meaning it offers little new learning signal.

To balance this, researchers have explored non-linear filtering strategies:

  1. Targeted High Entropy for Robustness: In FDS: Feedback-Guided Domain Synthesis with Multi-Source Conditional Diffusion Models for Domain Generalization, Ali Bahri et al. used a classifier's uncertainty as a feedback loop to filter synthetic data. They intentionally selected images that elicited high entropy in the classifier, prioritizing hard, boundary-testing examples that force the model to learn more robust features.
  2. Dual-Entropy Thresholding: For unsupervised large language model reasoning, Qingyang Zhang et al. introduced a dual-threshold approach in Right Question is Already Half the Answer: Fully Unsupervised LLM Reasoning Incentivization. Their framework prunes prompts where the model is either completely certain (redundant data) or completely uncertain (hopelessly noisy data), isolating a "sweet spot" of moderate entropy where the most useful learning signals reside.
[ Low Entropy / Redundant ] <── Threshold 1 ──> [ Useful Learning Signal ] <── Threshold 2 ──> [ High Entropy / Noisy ]

Broad Versatility

Beyond adaptation, entropy-based filtering serves as a foundational tool across machine learning paradigms wherever unsupervised data curation is required:

By treating predictive entropy not merely as a passive diagnostic metric but as an active filtering mechanism, modern architectures can safely navigate uncurated data streams, isolating stable learning signals amid real-world noise.

Key Foundational Work

Effectiveness of Automatic Expansion of Training Data for Japanese Word Sense Disambiguation (2011) — contributed 1 concept elements to this direction.
Bayesian Assessment of Newborn Brain Maturity from Two-Channel Sleep Electroencephalograms. (2012) — contributed 1 concept elements to this direction.
History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_entropy_based_sample_filtering_067e6ae1,
  title = {entropy-based sample filtering},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/entropy-based-sample-filtering/rdr_067e6ae1ffcd47209cf31d2ca82d8eda},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_entropy_based_sample_filtering_067e6ae1_v1,
  title = {entropy-based sample filtering},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/entropy-based-sample-filtering/rdr_067e6ae1ffcd47209cf31d2ca82d8eda/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake