A user-friendly headset for radar-based silent speech recognition

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

Abstract

Silent speech interfaces allow speech communication to take place in the absence of the acoustic speech signal. Radar-based sensing with radio antennas on the speakers’ face can be used as a non-invasive modality to measure speech articulation in such applications. One of the major challenges with this approach is the variability between different sessions, mainly due to the repositioning of the antennas on the face of the speaker. In order to reduce the impact of this influencing factor, we developed a wearable headset that can be 3D-printed with flexible materials and weighs only about 69 g. For evaluation, a radar-based word recognition experiment was performed, where five speakers recorded a speech corpus in multiple sessions, alternatively with the headset and with double-sided tape to place the antennas on the face. By using a bidirectional long short-term memory network for classification, an average intersession word accuracy of 76.50% and 68.18% was obtained using the headset and the tape, respectively. This indicates that the antenna (re-) positioning accuracy with the headset is not worse than that with the double-sided tape while providing other benefits.

Details

Original languageEnglish
Title of host publicationProceedings Interspeech 2022
Pages4835-4839
Number of pages5
Publication statusPublished - 18 Sept 2022
Peer-reviewedYes

External IDs

Scopus 85140068764
ORCID /0000-0003-0167-8123/work/167214904

Keywords

Research priority areas of TU Dresden

Subject groups, research areas, subject areas according to Destatis

Keywords

  • silent speech interfaces, radar imaging, BiLSTM, wearable headset, speech-related biosignals