EgoPet: Egomotion and Interaction Data from an Animal's Perspective
arxiv(2024)
摘要
Animals perceive the world to plan their actions and interact with other
agents to accomplish complex tasks, demonstrating capabilities that are still
unmatched by AI systems. To advance our understanding and reduce the gap
between the capabilities of animals and AI systems, we introduce a dataset of
pet egomotion imagery with diverse examples of simultaneous egomotion and
multi-agent interaction. Current video datasets separately contain egomotion
and interaction examples, but rarely both at the same time. In addition, EgoPet
offers a radically distinct perspective from existing egocentric datasets of
humans or vehicles. We define two in-domain benchmark tasks that capture animal
behavior, and a third benchmark to assess the utility of EgoPet as a
pretraining resource to robotic quadruped locomotion, showing that models
trained from EgoPet outperform those trained from prior datasets.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要