GazeMotion: Gaze-guided Human Motion Forecasting
arxiv(2024)
摘要
We present GazeMotion, a novel method for human motion forecasting that
combines information on past human poses with human eye gaze. Inspired by
evidence from behavioural sciences showing that human eye and body movements
are closely coordinated, GazeMotion first predicts future eye gaze from past
gaze, then fuses predicted future gaze and past poses into a gaze-pose graph,
and finally uses a residual graph convolutional network to forecast body
motion. We extensively evaluate our method on the MoGaze, ADT, and GIMO
benchmark datasets and show that it outperforms state-of-the-art methods by up
to 7.4
proxy to gaze, our method still achieves an average improvement of 5.5
finally report an online user study showing that our method also outperforms
prior methods in terms of perceived realism. These results show the significant
information content available in eye gaze for human motion forecasting as well
as the effectiveness of our method in exploiting this information.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要