Eye-movement Analysis and Prediction using Deep Learning Techniques and Kalman Filter

Abstract: Eye movement analysis has gained significant atten-tion from the eye-tracking research community, particularly for real-time applications. Eye movement prediction is predominantly required for the improvement of sensor lag. The previously introduced eye-movement approaches focused on classifying eye movements into two categories: saccades and non-saccades. Al-though these approaches are practical and relatively simple, they confuse fixations and smooth pursuit by putting them up within the non-saccadic category. Moreover, Eye movement analysis has been integrated into different applications, including psychology, neuroscience, human attention analysis, industrial engineering, marketing, advertising, etc. This paper introduces a low-cost eye-movement analysis system using Convolutional Neural Network (CCN) techniques and the Kalman filter to estimate and analyze eye position. The experiment results reveal that the proposed system can accurately classify and predict eye movements and detect pupil position in frames, notwithstanding the face tracking and detection. Additionally, the obtained results revealed that the overall performance of the proposed system is more efficient and effective comparing to Recurrent Neural Network (RNN).

Sameer Rafee, Xu Yun, Zhang Jian Xin and Zaid Yemeni. “Eye-movement Analysis and Prediction using Deep Learning Techniques and Kalman Filter”. International Journal of Advanced Computer Science and Applications (IJACSA) 13.4 (2022). http://dx.doi.org/10.14569/IJACSA.2022.01304107

@article{Rafee2022,
title = {Eye-movement Analysis and Prediction using Deep Learning Techniques and Kalman Filter},
journal = {International Journal of Advanced Computer Science and Applications},
doi = {10.14569/IJACSA.2022.01304107},
url = {http://dx.doi.org/10.14569/IJACSA.2022.01304107},
year = {2022},
publisher = {The Science and Information Organization},
volume = {13},
number = {4},
author = {Sameer Rafee and Xu Yun and Zhang Jian Xin and Zaid Yemeni}
}