Toward Long Video Understanding via Fine-Detailed Video Story Generation
Lists
Only you see this
Abstract
Long video understanding has become a critical task in computer vision, driving advancements across numerous applications from surveillance to content retrieval. Existing video understanding methods suffer from two challenges when dealing with long video understanding: intricate long-context relationship modeling and interference from redundancy. To tackle these challenges, we introduce Fine-Detailed Video Story generation (FDVS), which interprets long videos into detailed textual representations. Specifically, to achieve fine-grained modeling of long-temporal content, we propose a Bottom-up Video Interpretation Mechanism that progressively interprets video content from clips to video. To avoid interference from redundant information in videos, we introduce a Semantic Redundancy Reduction mechanism that removes redundancy at both the visual and textual levels. Our method transforms long videos into hierarchical textual representations that contain multi-granularity information of the video. With these representations, FDVS is applicable to various tasks without any fine-tuning. We evaluate the proposed method across eight datasets spanning three tasks. The performance demonstrates the effectiveness and versatility of our method.
BibTeX
@article{you2025toward,
author = {Zeng You and Zhiquan Wen and Yaofo Chen and Xin Li and Runhao Zeng and Yaowei Wang and Mingkui Tan},
title = {{Toward Long Video Understanding via Fine-Detailed Video Story Generation}},
journal = {IEEE Trans. Circuits Syst. Video Technol.},
year = {2025},
url = {https://openreview.net/forum?id=jUsQ9pW6Nj},
}Loading related content...