Enabling Communication for Locked-in Syndrome Patients using Deep Learning and an Emoji-based Brain Computer Interface

Alexandra Comaniciu, Laleh Najafizadeh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

Locked-in syndrome describes a condition in which patients are incapable of speaking or moving, although they do retain their cognitive capabilities. In this paper, we propose a novel Brain Computer Interface design using a versatile emoji-based symbol display and a deep learning solution to enable these patients to communicate using recordings obtained through electroencephalography (EEG). EEG signals are converted into images representing their spatiotemporal characteristics. Images are then classified using a deep convolutional neural network (CNN) to recognize the intended emoji symbol. A prototype of the proposed system was tested on five healthy volunteers, showing significant improvement in the recognition rate when compared to the classic LDA classifier.

Original languageEnglish (US)
Title of host publication2018 IEEE Biomedical Circuits and Systems Conference, BioCAS 2018 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538636039
DOIs
StatePublished - Dec 20 2018
Event2018 IEEE Biomedical Circuits and Systems Conference, BioCAS 2018 - Cleveland, United States
Duration: Oct 17 2018Oct 19 2018

Publication series

Name2018 IEEE Biomedical Circuits and Systems Conference, BioCAS 2018 - Proceedings

Other

Other2018 IEEE Biomedical Circuits and Systems Conference, BioCAS 2018
Country/TerritoryUnited States
CityCleveland
Period10/17/1810/19/18

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering
  • Health Informatics
  • Instrumentation
  • Signal Processing
  • Biomedical Engineering

Keywords

  • Brain Computer Interface
  • Convolutional networks
  • Deep learning
  • EEG
  • P300

Fingerprint

Dive into the research topics of 'Enabling Communication for Locked-in Syndrome Patients using Deep Learning and an Emoji-based Brain Computer Interface'. Together they form a unique fingerprint.

Cite this