Ego-VPA: Egocentric Video Understanding with Parameter-Efficient Adaptation
Lists
Only you see this
Abstract
Video understanding typically requires fine-tuning the large backbone when adapting to new domains. In this paper, we leverage the egocentric video foundation models (EgoVFMs) based on video-language pre-training and propose a parameter-efficient adaptation for egocentric video tasks, namely Ego-VPA. It employs a local sparse approximation for each video frame/text feature using the basis prompts, and the selected basis prompts are used to synthesize video/text prompts. Since the basis prompts are shared across frames and modalities, it models context fusion and cross-modal transfer in an efficient fashion. Experiments show that EgoVPA excels in lightweight adaptation (with only 0.84% learnable parameters), largely improving over baselines and reaching the performance of full fine-tuning.
BibTeX
@inproceedings{wu2025ego,
author = {Tz-Ying Wu and Kyle Min and Subarna Tripathi and Nuno Vasconcelos},
title = {{Ego-VPA: Egocentric Video Understanding with Parameter-Efficient Adaptation}},
booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
year = {2025},
doi = {10.1109/wacv61041.2025.00897},
}