MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints
CVPR 2024(2024)
摘要
This work proposes a novel learning framework for visual hand dynamics
analysis that takes into account the physiological aspects of hand motion. The
existing models, which are simplified joint-actuated systems, often produce
unnatural motions. To address this, we integrate a musculoskeletal system with
a learnable parametric hand model, MANO, to create a new model, MS-MANO. This
model emulates the dynamics of muscles and tendons to drive the skeletal
system, imposing physiologically realistic constraints on the resulting torque
trajectories. We further propose a simulation-in-the-loop pose refinement
framework, BioPR, that refines the initial estimated pose through a multi-layer
perceptron (MLP) network. Our evaluation of the accuracy of MS-MANO and the
efficacy of the BioPR is conducted in two separate parts. The accuracy of
MS-MANO is compared with MyoSuite, while the efficacy of BioPR is benchmarked
against two large-scale public datasets and two recent state-of-the-art
methods. The results demonstrate that our approach consistently improves the
baseline methods both quantitatively and qualitatively.
更多查看译文
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要