Human Related-Health Actions Detection using Android Camera based on TensorFlow Object Detection API

A new method to detect human health-related actions (HHRA) from a video sequence using an Android camera. The Android platform works not only to capture video images through its camera, but also to detect emergency actions. An application for HHRA is to help monitor unattended children, individuals with special needs or the elderly. The application has been investigating based on TensorFlow Object Detection Application Program Interface (API) technique with Android studio. This paper fundamentally focuses on the comparison, in terms of improving speed and detection accuracy. In this work, two promising new approaches for HHRA detection has been proposed: SSD Mobilenet and Faster RCNN Resnet models. The proposed approaches are evaluated on the NTU RGB+D dataset, which it knows as the present greatest publicly accessible 3D action recognition dataset. The dataset has been split into training and testing dataset. The total confidence scores detection quality (total mAP) for all the actions classes are 95.8% based on the SSD-Mobilenet model and 93.8% based on Faster-R-CNN-Resnet model. The detection process is achieved using two methods to evaluate the detection performance using Android camera (Galaxy S6) and using TensorFlow Object Detection Notebook in terms of accuracy and detection speed. Experimental results have demonstrated valuable improvements in terms of detection accuracy and efficiency for human health-related actions identification. The experiments have executed on Ubuntu 16.04LTS GTX1070 @ 2.80GHZ x8 system.

@article{Al-Azzoa2018,
  title     = {Human Related-Health Actions Detection using Android Camera based on TensorFlow Object Detection API},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {9},
  number    = {10},
  year      = {2018},
  publisher = {The Science and Information Organization},
  author    = {Fadwa Al-Azzoa and Arwa Mohammed Taqia and Mariofanna Milanovab},
  doi       = {10.14569/IJACSA.2018.091002},
  url       = {https://doi.org/10.14569/IJACSA.2018.091002}
}