Learning Discriminative Prototypes via Boundary Repulsion MixUp for Object Re-Identification

Athena Psalta, Vasileios Tsironis, Konstantinos KarantzalosarXiv 2026 · arXiv

TL;DR

PBR-ReID introduces a novel framework that treats the geometry between different identities as an explicit learning target. By using learnable prototypes and a "Boundary Repulsion MixUp" (BRM) strategy, it identifies visually similar identities and pushes their features away from the ambiguous decision boundaries, achieving state-of-the-art results on major person and vehicle re-identification benchmarks.

What Problem Does This Paper Address?

Object Re-Identification (ReID) is the task of matching the same individual or vehicle across different, non-overlapping camera views. The core challenge is twofold: the model must be robust to "intra-class" changes (like different lighting or angles for the same person) while maintaining a sharp "inter-class" separation between different people who look very similar (e.g., two people wearing nearly identical red jackets).

Most existing methods rely on pairwise losses (like triplet loss) that only shape these boundaries implicitly. Furthermore, standard regularization techniques like MixUp—which creates synthetic training samples by interpolating between two images—can actually be counterproductive in ReID. By placing synthetic samples right in the "confusion zone" between two similar identities, standard MixUp can blur the very boundaries that need to be the sharpest.

Methods

The authors propose PBR-ReID (Prototype-based Boundary Repulsion for ReID), which consists of three main pillars:

  1. Learnable Prototypes: Instead of just comparing images to images, every identity in the dataset is assigned a "prototype"—a learnable vector in the embedding space. These prototypes act as stable anchors for each class.
  2. Boundary Repulsion MixUp (BRM): This is the paper's "secret sauce." The system uses a similarity matrix of the prototypes to find the most "confusable" pairs of identities. For these pairs, it constructs a "boundary proxy" (an interpolated point between their prototypes) and then explicitly repels the actual image features away from this proxy. This "hardens" the decision boundary, creating a clear buffer zone where no features should reside.
  3. Two-Stage Training Protocol:
    • Warmup: The backbone (a DiNOv3 Vision Transformer) is frozen while the prototypes are trained to find their optimal positions.
  4. Joint Fine-tuning: Both the backbone and prototypes are trained together. To keep the system stable, the prototypes are updated using an Exponential Moving Average (EMA), preventing them from jumping around too much as the backbone's feature space evolves.
Figure 1. PBR-ReID Framework. Input images are passed through a DiNOv3 ViT backbone to produce normalized embeddings, jointly optimized with a learnable prototype matrix (one vector per identity) that anchors each class in the embedding space. The staged training progression (right) illustrates how embedding geometry evolves from random initialization through prototype warmup to joint fine-tuning, with features forming compact intra-class clusters separated by enforced inter-class margins. Prototypes act only during training and are discarded at inference.

Datasets

The model was evaluated on a wide array of standard benchmarks:

  • Person ReID: Market-1501, DukeMTMC-reID, MSMT17 (the most challenging), CUHK03-NP, and IUST (a culturally-aware dataset).
  • Vehicle ReID: VeRi-776 and VehicleID.

Key Insights and Ideas

  • Geometry as a Target: The most innovative leap is moving from reactive learning (adjusting to errors) to proactive geometry shaping. By using prototypes to "see" the global structure of the embedding space, the model can target specific areas of confusion before they cause retrieval errors.
  • Inverting MixUp: While MixUp is traditionally used to smooth the data manifold, BRM "inverts" this logic for discrimination. It uses the MixUp mechanism to identify the most ambiguous regions and then tells the model: "This area is forbidden."
  • Stability over Speed: The authors found that learnable prototypes are highly sensitive. Without the initial warmup phase and the EMA stabilization during joint training, the model's performance collapses.
Figure 2. Boundary Repulsion MixUp (BRM). BRM operates in four stages. First, pairwise prototype cosine similarities are computed for all identities in the batch. Second, confusable pairs (those exceeding similarity threshold τ) are identified. Third, for each confusable pair, a boundary-proxy prototype is constructed by linearly interpolating the two class prototypes with a Beta-sampled coefficient λ, which also mixes the corresponding features. Fourth, the BRM loss combines hard-target attraction terms, which pull the mixed feature toward both participating prototypes, with repulsion terms, which penalize original features lying within margin mBRM of the boundary-proxy prototype.

Key Results

PBR-ReID set new state-of-the-art (SOTA) records or achieved highly competitive results across the board:

  • MSMT17: Achieved 79.7% mAP, outperforming the previous best (HPL) by 0.7%.
  • Market-1501: Reached 94.0% mAP.
  • VehicleID: Achieved 90.2% Rank-1 accuracy on the large test split, outperforming specialized vehicle ReID models.
  • Ablation Studies: Removing the BRM component dropped performance by about 1.5-1.6% mAP, confirming that the "boundary repulsion" logic is a significant driver of the model's success.

Qualitative results show that the model is significantly better at ignoring "distractor" identities—people or cars that share the same color and type but are actually different individuals.

Limitations and Future Work

  • Supervised Nature: The current framework relies on ground-truth identity labels. The authors suggest that a promising future direction is extending this to unsupervised ReID, where prototypes would be derived from cluster pseudo-labels.
  • Computational Overhead during Training: While inference is fast (the prototypes are discarded after training), the joint optimization of thousands of prototypes adds some complexity to the training phase, though the authors note it scales linearly and remains manageable on a single GPU.

Summary updated

Abstract

Object re-identification requires embeddings that are robust to intra-class variation in viewpoint, illumination, and occlusion, yet preserve sharp separation between visually similar identities. The hardest errors arise precisely where confusable identities meet, a region that pairwise losses shape only implicitly. We present PBR-ReID, a prototype-based framework that makes this inter-class geometry an explicit learning target. Each identity is represented by a learnable prototype jointly optimized with a DiNOv3 backbone and the resulting prototype similarity matrix reveals, at every training step, which identities are most confusable. On this signal we build Boundary Repulsion MixUp (BRM), a geometry-aware regularizer that converts standard MixUp's weakness into a discriminative signal. Rather than interpolating samples across confusable identities, which blurs the boundaries that matter most, BRM constructs an explicit boundary proxy between each confusable pair and repels their features away from it, converting boundary ambiguity into a discriminative signal. We adopt a two-stage training protocol consisting of a prototype warmup phase followed by EMA-stabilized joint fine-tuning. Extensive experiments on person and vehicle ReID benchmarks demonstrate strong performance, with thorough ablations confirming each component's contribution. Code is available at https://github.com/psaltaath/pbr-reid.
BibTeX
@misc{psalta2026learning,
  author = {Athena Psalta and Vasileios Tsironis and Konstantinos Karantzalos},
  title = {{Learning Discriminative Prototypes via Boundary Repulsion MixUp for Object Re-Identification}},
  year = {2026},
  eprint = {2610.34305},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.34305},
}
Figure