Adaptive Masking Enhances Visual Grounding

Sen Jia, Lei LiSubmission to ICLR 2026 · Withdrawn

Its authors withdrew this paper, so there is no full text to read or summarize.

Abstract

Humans excel at recognizing objects under incomplete information by focusing on their most salient features. Inspired by this capability, we present **IMAGE** (**I**nterpretative **MA**sking with **G**aussian Radiation Mod**E**ling), a novel training paradigm for visual grounding that selectively obscures salient regions. By compelling models to infer objects from suboptimal cues, IMAGE mimics human adaptability in scenarios where critical features are absent. We propose a progressive training strategy that gradually increases the masking ratio, compelling the model to extract essential object attributes rather than memorizing all possible features. Experiments on standard visual grounding benchmarks demonstrate notable improvements in zero-shot and low-shot scenarios, with IMAGE seamlessly integrating into existing architectures. The method’s training-only operation ensures zero added computational cost during deployment, offering a practical pathway toward robust, data-efficient visual grounding.
BibTeX
@misc{jia2026adaptive,
  author = {Sen Jia and Lei Li},
  title = {{Adaptive Masking Enhances Visual Grounding}},
  year = {2026},
  url = {https://openreview.net/forum?id=QvyN5ctweM},
  howpublished = {OpenReview},
  note = {Submitted to ICLR 2026},
}
Figure