Empowering Test-Time Adaptation with Complementary Vision-Language Knowledge in Open-World Scenarios
Its authors withdrew this paper, so there is no full text to read or summarize.
Lists
Only you see this
Abstract
Test-time adaptation in open-world scenarios (OWTTA), which addresses both domain discrepancy and semantic variance, has gained increasing attention for enabling models to adapt dynamically during inference. Existing approaches mainly rely on discriminative models, whose over-specialized knowledge restricts their adaptability in open-world settings. In contrast, vision-language models (VLMs), trained on diverse large-scale data, provide broader and more transferable knowledge, yet their role in OWTTA remains underexplored. In this work, we propose a framework empowered by vision-language models, termed Vision-Language knowledge Boosted Open-world test-time adaptation (VLBO). Specifically, by casting OWTTA into a probabilistic perspective, we first propose agreement-boosted filtering (AF), in which the discriminative model assumes the primary role of filtering out out-of-distribution samples, while the VLM provides a reinforcing signal to refine this process based on its agreement with the discriminative model. We then introduce semantics-boosted adaptation (SA), where VLM-extracted representations serve as semantic guidance to enhance the discriminative model’s adaptation to target domains. This unified framework leverages the complementary strengths of vision-language models and discriminative counterparts, enabling robust and effective adaptation in open-world scenarios. Extensive experiments across multiple benchmarks demonstrate the consistent effectiveness of the proposed method.
BibTeX
@misc{lin2026empowering,
author = {Jia-Qi Lin and Yinghua Yao and Chang-Dong Wang and Yuangang Pan},
title = {{Empowering Test-Time Adaptation with Complementary Vision-Language Knowledge in Open-World Scenarios}},
year = {2026},
url = {https://openreview.net/forum?id=CFAYmfjd4v},
howpublished = {OpenReview},
note = {Submitted to ICLR 2026},
}Loading related content...