In a series of image frames of the moving object to the template method as a model for histogram matching, due to a very large amount of template matching. It is not possible to target the whole image, but also meet the real-time search and matching .If we aim to conduct a reliable estimate, it can be completed in a relatively small region of the search template. Kalman filter is a linear sequence of the dynamic systems, the state minimum variance estimation algorithm. Through dynamic equations to describe the equation of state and observation systems, it can arbitrarily observe point as a starting point, and recursive filtering method. It is a small amount with the characteristics of real-time computation.