Dimension emotion recognition method based on multi-scale time sequence modeling

The invention discloses a dimension emotion recognition method based on multi-scale time sequence modeling. The method includes performing face detection and tracking on each frame image of a video sequence, and extracting face key points as first class face features; extracting gray values of pixels of a face region image, mouth region image and eye region image as second, third and fourth class face features; performing dimension emotion initial prediction according to the four classes of face features of the multiple frame image in a unit period t; performing time sequence and modality combination through a linear regression device according to the emotion initial prediction results of N unit periods t, and outputting an emotion prediction value of the video sequence. According to the method, time sequence modeling with different scales is performed on video sequence signals, and the precision prediction of each time sequence unit is implemented; the method is adaptive to emotion recognition of face signals of videos and has the advantages of fine real-time performance and greatly improved recognition precision.