Recognition of emotions using Kinects

Emotion recognition can improve the quality of patient care, product development and human-machine interaction.Psychological studies indicate that emotional state can be expressed in the way people walk,and the human gait can be used to reveal a person's emotional state.This paper proposes a novel method to do emotion recognition by using Microsoft Kinect to record gait patterns and train machine learning algorithms for emotion recognition. 59 subjects are recruited, and their gait patterns are recorded by two Kinect cameras.Joint selection, coordinate system transformation, sliding window gauss filtering,differential operation, and data segmentation are used for data preprocessing.We run Fourier transformation to extract features from the gait patterns and utilize Principal Component Analysis(PCA) for feature selection. By using NaiveBayes, RandomForests, LibSVM and SMO classifiers, the accuracy of recognition between natural and angry emotions can reach 80%,and the accuracy of recognition between natural and happy emotions can reach above 70%.The result indicates that Kinect can be used in the recognition of emotions with fairly well performance.