An Indirect Eavesdropping Attack of Keystrokes on Touch Screen through Acoustic Sensing

Jiadi Yu, Li Lu, Yingying Chen, Yanmin Zhu, Linghe Kong

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

This paper demonstrates the feasibility of a side-channel attack to infer keystrokes on touch screen leveraging an off-the-shelf smartphone. Although there exist some studies on keystroke eavesdropping attacks on touch screen, they are mainly direct eavesdropping attacks, i.e., require the device of victims compromised to provide side-channel information for the adversary, which are hardly launched in practical scenarios. In this work, we show the practicability of an indirect eavesdropping attack, KeyListener, which infers keystrokes on QWERTY keyboards of touch screen leveraging audio devices on a smartphone. We investigate the attenuation of acoustic signals, and find that a user's keystroke fingers can be localized through the attenuation of acoustic signals received by the microphones in the smartphone. We then utilize the attenuation of acoustic signals to localize each keystroke, and further analyze errors induced by ambient noises. To improve the accuracy of keystroke localization, KeyListener further tracks finger movements during inputs through phase change and Doppler effect to reduce errors of acoustic signal attenuation-based keystroke localization. In addition, a binary tree-based search approach is employed to infer keystrokes in a context-aware manner. The proposed keystroke eavesdropping attack is robust to various environments without the assistance of additional infrastructures. Extensive experiments demonstrate that the accuracy of keystroke inference in top-5 candidates can approach 90 percent with a top-5 error rate of around 6 percent, which is a strong indication of the possible user privacy leakage of inputs on QWERTY keyboard.

Original languageEnglish (US)
Article number8869844
Pages (from-to)337-351
Number of pages15
JournalIEEE Transactions on Mobile Computing
Volume20
Issue number2
DOIs
StatePublished - Feb 1 2021

All Science Journal Classification (ASJC) codes

  • Software
  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Keywords

  • Keystroke inference
  • acoustic signals
  • indirect eavesdropping attack

Fingerprint

Dive into the research topics of 'An Indirect Eavesdropping Attack of Keystrokes on Touch Screen through Acoustic Sensing'. Together they form a unique fingerprint.

Cite this