Through-Wall Remote Human Voice Recognition Using Doppler Radar With Transfer Learning

Rohan Khanna, Daegun Oh, Youngwook Kim

Research output: Contribution to journalArticlepeer-review

38 Scopus citations

Abstract

We investigated the feasibility of using Doppler radar to recognize human voices by capturing the micro-Doppler signatures of vibrations from the larynx and mouth. The signatures produced through the vibrations of a human being's vocal cords generate unique micro-Doppler signatures, depending on the letters pronounced. These can then be used to classify and recognize different words and letters. In this paper, we could successfully capture echo signals using the Doppler radar when a human subject spoke seven musical notes from Do to Ti and alphabet letters from A to Z. Spectrogram analysis was conducted for classification purposes, and the deep convolutional neural networks employed could classify the 26 letters to an accuracy of 94%. To overcome the deficiency of the measured data and improve the classification accuracy, transfer learning was introduced. Using the VGG-16 model, its accuracy was improved up to 97%. Additional experiments were conducted to ascertain the radar's capability to detect the human voice through a barrier between the human and the radar. In this paper, we demonstrated the possibility of remote voice recognition using Doppler information, with or without a barrier.

Original languageEnglish
Article number8653899
Pages (from-to)4571-4576
Number of pages6
JournalIEEE Sensors Journal
Volume19
Issue number12
DOIs
StatePublished - 15 Jun 2019

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

Keywords

  • AlexNet
  • Human voice recognition
  • VGG-16
  • convolutional neural network
  • deep learning
  • micro-Doppler signatures
  • transfer learning

Fingerprint

Dive into the research topics of 'Through-Wall Remote Human Voice Recognition Using Doppler Radar With Transfer Learning'. Together they form a unique fingerprint.

Cite this