Eye Gaze-based Early Intent Prediction Utilizing CNN-LSTM

Fatemeh Koochaki, Laleh Najafizadeh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In assistive technologies designed for patients with extremely limited motor or communication capabilities, it is of significant importance to accurately predict the intention of the user, in a timely manner. This paper presents a new framework for the early prediction of the user's intent via their eye gaze. The seen objects in the displayed images, and the order of their selection are identified from the spatial and temporal information of the gaze. By employing a combination of convolution neuronal network (CNN) and long short term memory (LSTM), early prediction of the user's intention is enabled. The proposed framework is tested using experimental data obtained from eight subjects. Results demonstrate an average accuracy of 82.27% across all considered intended tasks for early prediction, confirming the effectiveness of the proposed method.

Original languageEnglish (US)
Title of host publication2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1310-1313
Number of pages4
ISBN (Electronic)9781538613115
DOIs
StatePublished - Jul 2019
Event41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2019 - Berlin, Germany
Duration: Jul 23 2019Jul 27 2019

Publication series

NameProceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
ISSN (Print)1557-170X

Conference

Conference41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2019
CountryGermany
CityBerlin
Period7/23/197/27/19

All Science Journal Classification (ASJC) codes

  • Signal Processing
  • Biomedical Engineering
  • Computer Vision and Pattern Recognition
  • Health Informatics

Fingerprint Dive into the research topics of 'Eye Gaze-based Early Intent Prediction Utilizing CNN-LSTM'. Together they form a unique fingerprint.

  • Cite this

    Koochaki, F., & Najafizadeh, L. (2019). Eye Gaze-based Early Intent Prediction Utilizing CNN-LSTM. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2019 (pp. 1310-1313). [8857054] (Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/EMBC.2019.8857054