Refining Labels via Local Feature Space Consistency

403 concepts256 papers1 proposal

When training deep learning models under weak supervision—such as semi-supervised learning, unsupervised domain adaptation, or learning with noisy labels—we inevitably encounter the trap of confirmation bias.

If a model relies solely on its own prediction confidence (e.g., softmax outputs) to select which pseudo-labels to trust, it tends to memorize and amplify its own mistakes. As Alessandro Conti et al. observe in Cluster-level pseudo-labelling for source-free cross-domain facial expression recognition, raw model confidence is a highly unreliable indicator of accuracy when evaluating out-of-distribution or unlabeled data.

To break this feedback loop, a prominent research direction has emerged: neighborhood-based label refinement. Instead of trusting what a model predicts for an isolated sample, these techniques validate and correct labels by looking at where that sample sits within the latent feature space relative to its neighbors.


Why It Works: The Manifold Hypothesis

The core intuition behind neighborhood refinement relies on a fundamental property of deep neural networks: even when a model's final classification boundary is warped or uncalibrated due to label noise, its internal layers often still learn a coherent, cluster-structured representation space. Under the manifold hypothesis, semantically similar instances naturally cluster together in this high-dimensional embedding space.

Ioannis Patras demonstrates this phenomenon in NoiseBox: Toward More Efficient and Effective Learning With Noisy Labels, showing that a sample's topological consistency with its neighbors provides a far cleaner signal for label correctness than individual loss values or prediction scores. If an instance is labeled "cat" but its closest neighbors in the feature space are all "dog" representations, the local geometry exposes the label as an anomaly.

By shifting the validation mechanism from the model's predictions to the feature space's geometry, researchers can implement a non-parametric sanity check that filters out noise and stabilizes self-training.


Mechanisms of Neighborhood Refinement

Taxonomically, researchers operationalize this local consistency through three primary geometric mechanisms:

1. K-Nearest Neighbor (k-NN) Consensus

The most direct implementation is a local voting scheme. For any given sample, the framework identifies its $k$-nearest neighbors in the feature space and aggregates their labels.

2. Prototype and Centroid Proximity

Rather than computing individual pairwise distances for every neighbor, models can compute global or batch-level class "prototypes"—the mean feature vector for each category.

[ Class Centroid A ] <--- (Close: Validated as Class A) --- [ Unlabeled Sample ]
                                                                 |
                                                                 v (Far from Centroid B)
                                                            [ Class Centroid B ]

3. Graph Label Propagation and Bidirectional Walks

When local neighborhoods are chained together, they form a graph that allows labels to flow along high-density data manifolds.


Applications Across Weakly Supervised Regimes

This core mechanism of neighborhood validation has been successfully adapted across several distinct problem domains:

Semi-Supervised Learning with Few Labels

When labeled data is exceptionally scarce, self-training frameworks like NeST, introduced by Ran Xu et al. in Neighborhood-Regularized Self-Training for Learning with Few Labels, use neighborhood divergence metrics to prevent the model from drifting. By ensuring that pseudo-labels match the internal consistency of nearby feature clusters, the model preserves its structural boundaries even when initialized from minimal supervision.

Unsupervised Domain Adaptation (UDA)

In cross-domain tasks, the model must generalize to a target domain without target labels. Yoonhyung Kim et al. show in Semi-Supervised Domain Adaptation via Selective Pseudo Labeling and Progressive Self-Training that target features positioned near labeled source anchors act as "golden samples" that can reliably seed the adaptation process.

Furthermore, Jaehoon Choi et al. demonstrate in Pseudo-Labeling Curriculum for Unsupervised Domain Adaptation that prioritizing pseudo-labels in high-density feature regions early in training prevents the model from being poisoned by the noisy, sparse representations typically found near cross-domain decision boundaries.

History & citationVersion 1 · 2026-10-04

Current · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_neighborhood_based_label_refinement_7122bd9f,
  title = {neighborhood-based label refinement},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/neighborhood-based-label-refinement/rdr_7122bd9f67c84afab3bdce3cfeedb489},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}

This exact version (version 1, frozen text):

@misc{lacuna_neighborhood_based_label_refinement_7122bd9f_v1,
  title = {neighborhood-based label refinement},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/neighborhood-based-label-refinement/rdr_7122bd9f67c84afab3bdce3cfeedb489/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}
About

These directions overlap with this one through shared papers.

See something wrong? Report a mistake