Language-Based Process Phase Detection in the Trauma Resuscitation

Yue Gu, Xinyu Li, Shuhong Chen, Hunagcan Li, Richard A. Farneth, Ivan Marsic, Randall S. Burd

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Scopus citations

Abstract

Process phase detection has been widely used in surgical process modeling (SPM) to track process progression. These studies mostly used video and embedded sensor data, but spoken language also provides rich semantic information directly related to process progression. We present a long-short term memory (LSTM) deep learning model to predict trauma resuscitation phases using verbal communication logs. We first use an LSTM to extract the sentence meaning representations, and then sequentially feed them into another LSTM to extract the mean-ing of a sentence group within a time window. This information is ultimately used for phase prediction. We used 24 manually-transcribed trauma resuscitation cases to train, and the remain-ing 6 cases to test our model. We achieved 79.12% accuracy, and showed performance advantages over existing visual-audio systems for critical phases of the process. In addition to language information, we evaluated a multimodal phase prediction structure that also uses audio input. We finally identified the challenges of substituting manual transcription with automatic speech recognition in trauma resuscitation.

Original languageEnglish (US)
Title of host publicationProceedings - 2017 IEEE International Conference on Healthcare Informatics, ICHI 2017
EditorsMollie Cummins, Julio Facelli, Gerrit Meixner, Christophe Giraud-Carrier, Hiroshi Nakajima
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages239-247
Number of pages9
ISBN (Electronic)9781509048816
DOIs
StatePublished - Sep 8 2017
Event5th IEEE International Conference on Healthcare Informatics, ICHI 2017 - Park City, United States
Duration: Aug 23 2017Aug 26 2017

Publication series

NameProceedings - 2017 IEEE International Conference on Healthcare Informatics, ICHI 2017

Other

Other5th IEEE International Conference on Healthcare Informatics, ICHI 2017
CountryUnited States
CityPark City
Period8/23/178/26/17

All Science Journal Classification (ASJC) codes

  • Health Informatics

Keywords

  • Deep learning
  • LSTM
  • Process phase detection
  • Semantic representation
  • Verbal communication logs

Fingerprint Dive into the research topics of 'Language-Based Process Phase Detection in the Trauma Resuscitation'. Together they form a unique fingerprint.

Cite this