What Makes a Video a Video: Analyzing Temporal Information in Video Understanding Models and Datasets

The ability to capture temporal information has been critical to the development of video understanding models. While there have been numerous attempts at modeling motion in videos, an explicit analysis of the effect of temporal information for video understanding is still missing. In this work, we aim to bridge this gap and ask the follo...More