A Deep Spatiotemporal Perspective for Understanding Crowd Behavior

Yuke LiIEEE Trans. Multimedia 2018 · OpenReview

Abstract

Understanding crowd behavior is a pivotal step toward urban scene analysis. This is considered a very challenging task and has rarely been addressed to date due to the complexity of motion dynamics co-occurring across a given scene, which involves spatial and temporal dependencies. Unlike the mainstream research, which usually treats the temporal and spatial dependencies in a crowd separately, this paper presents a deep end-to-end approach that jointly considers the spatiotemporal information, leading to a rich understanding of crowd behavior. We first extract the displacement information describing crowd motion patterns from tracklets/trajectories. This information is subsequently fed into a convolutional layer to learn the underlying motion patterns and create high-level representations. The derived representations are used as inputs to a long short-term memory-based architecture to learn the underlying spatiotemporal cues in a single operation for the entire crowd in a given scene. We evaluate our approach on a widely used, large-scale benchmark datasets for three critical applications: pedestrian path forecasting, destination estimation, and holistic crowd behavior classification. The results show a drastic improvement compared to recently trending works.
BibTeX
@article{li2018deep,
  author = {Yuke Li},
  title = {{A Deep Spatiotemporal Perspective for Understanding Crowd Behavior}},
  journal = {IEEE Trans. Multimedia},
  year = {2018},
  url = {https://openreview.net/forum?id=vlJiVX2oq7k},
}

Loading related content...

Figure