RGBD Human Action Recognition using Multi-Features Combination and K-Nearest Neighbors Classification

In this paper, we present a novel system to analyze human body motions for action recognition task from two sets of features using RGBD videos. The Bag-of-Features approach is used for recognizing human action by extracting local spatialtemporal features and shape invariant features from all video frames. These feature vectors are computed in four steps: Firstly, detecting all interest keypoints from RGB video frames using Speed-Up Robust Features and filters motion points using Motion History Image and Optical Flow, then aligned these motion points to the depth frame sequences. Secondly, using a Histogram of orientation gradient descriptor for computing the features vector around these points from both RGB and depth channels, then combined these feature values in one RGBD feature vector. Thirdly, computing Hu-Moment shape features from RGBD frames; fourthly, combining the HOG features with Hu-moments features in one feature vector for each video action. Finally, the k-means clustering and the multi-class K-Nearest Neighbor is used for the classification task. This system is invariant to scale, rotation, translation, and illumination. All tested, are utilized on a dataset that is available to the public and used often in the community. By using this new feature combination method improves performance on actions with low movement and reach recognition rates superior to other publications of the dataset.

@article{Al-Akam2017,
  title     = {RGBD Human Action Recognition using Multi-Features Combination and K-Nearest Neighbors Classification},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {8},
  number    = {10},
  year      = {2017},
  publisher = {The Science and Information Organization},
  author    = {Rawya Al-Akam and Dietrich Paulus},
  doi       = {10.14569/IJACSA.2017.081050},
  url       = {https://doi.org/10.14569/IJACSA.2017.081050}
}