Modeling Human Memory in Multi-Object Tracking with Transformers
Lists
Only you see this
Abstract
When tracking objects, humans rely on a memory mechanism, memorize the track of an object then look for it in the current scene. In this paper, we propose Memory-based Multi-object Tracking with Transformers (MMTT) to mimic human behavior in multi-object tracking. Unlike Re-ID-based methods, MMTT solves multi-object tracking in an explicit way, with a Track Encoder to extract track memory, a Detection Encoder to extract detection interactions, and a Memory Decoder to simulate the "look" process. The design of MMTT has the ability to model both spatial and temporal in-formation of a single track. We evaluate on commonly used MOT datasets and the experimental results demonstrate its superior effectiveness. We hope this paper can provide a novel direction for the MOT task. The code and models will be made publicly available upon acceptance.
BibTeX
@inproceedings{li2022modeling,
author = {Yizhuo Li and Cewu Lu},
title = {{Modeling Human Memory in Multi-Object Tracking with Transformers}},
booktitle = {IEEE International Conference on Acoustics, Speech and Signal Processing},
year = {2022},
url = {https://openreview.net/forum?id=H1WT3N468q},
}Loading related content...