A novel multi modal tracking method based on depth and semantic color features for human robot interaction
2015 14th IAPR International Conference on Machine Vision Applications (MVA)(2015)
摘要
In this paper we tackle the challenges of visual tracking for personal robots. We have proposed a novel track-by-detection method that combines a semantic object model with depth properties to obtain target contours. The tracking can be initialized by either 2D or 3D inputs, which are further refined using clustering based background removal to obtain an initial object model. During tracking, we propose to refine the search space by metric constancy and removal of the support plane. Further, the target appearance is modeled using a semantic human centric color descriptor, continuously updated by an online learning algorithm. The spatial compactness of the target is described using a Gaussian model with an initially determined variance. A fusion of the obtained color and depth models based on a target-background dissimilarity measure, is used to perform segmentation based tracking using graph cuts to obtain object contours. The experimental results in a household scenario show a good performance of the algorithm in challenging conditions such as scale, viewpoint change and out of plane rotations.
更多查看译文
关键词
multi modal tracking method,depth features,semantic color features,human robot interaction,visual tracking,personal robots,track-by-detection method,semantic object model,depth properties,target contours,clustering based background removal,initial object model,search space,metric constancy,support plane removal,target appearance modeling,semantic human centric color descriptor,online learning algorithm,spatial compactness,Gaussian model,target-background dissimilarity measure,segmentation based tracking,graph cuts,scale,viewpoint change,out-of-plane rotations
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络