Eye Contact as a New Modality for Man-machine Interface

In daily life, people use many appliances, where different machines and tools should be operated with their specialized interfaces. These specialized interfaces are often not intuitive and thus require considerable time and effort to master. On the other hand, human communications are rich in modalities and mostly intuitive. One of them is eye contact. This study proposes eye contact for enriching modalities for human-machine interface. The proposed interface modality, based on a neural network for object detection, allows humans to initiate machine operations by looking at them. In this paper, the hardware framework for building this interface is elaborated and the results of usability assessment through users’ experiments are reported.

@article{Kobayashi2023,
  title     = {Eye Contact as a New Modality for Man-machine Interface},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {14},
  number    = {3},
  year      = {2023},
  publisher = {The Science and Information Organization},
  author    = {Syusuke Kobayashi and Pitoyo Hartono},
  doi       = {10.14569/IJACSA.2023.0140306},
  url       = {https://doi.org/10.14569/IJACSA.2023.0140306}
}