An Action-Based Concept for the Phonetic Annotation of Sign Language Gestures

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Beitragende

  • Bernd J. Kröger - (Autor:in)
  • Jim Kannampuzha - (Autor:in)
  • Dominik Bauer - (Autor:in)
  • Peter Birkholz - , Universitätsklinikum Aachen, Rheinisch-Westfälische Technische Hochschule Aachen (Autor:in)
  • Philippe Dreuw - (Autor:in)
  • Hermann Ney - (Autor:in)

Abstract

Communicative actions are specific movements or gestures which are accomplished by vocal tract articulators (lips, tongue, velum etc.) for speech, by facial articulators (eye brows, eye lids etc.) for co-verbal facial expression and by other bodily articulators (hands, arms etc.) for co-verbal gesturing. While action-based approaches already exist for spoken language processing it is the aim of this paper to adopt action theory for signed language processing (i.e. production and perception of sign language). Method: An action-based method for the phonetic annotation of sign language has been developed and a 100 sentence American Sign Language corpus has been analyzed using this method. Results: Five basic types of sign actions were identified, all indicating the importance of movement phases even if the goal of a gesture is to reach a specific target (e.g. specific hand shape, orientation, location, and/or direction). Conclusion: This study is a starting point for investigating sign language production quantitatively in terms of a unified action theory.

Details

OriginalspracheEnglisch
TitelElektronische Sprachsignalverarbeitung 2010
Redakteure/-innenHansjörg Mixdorff
Herausgeber (Verlag) Dresden : TUDpress
Seiten33-39
Seitenumfang7
ISBN (Print)978-3-941298-85-9
PublikationsstatusVeröffentlicht - 1 März 2010
Peer-Review-StatusJa
Extern publiziertJa

Publikationsreihe

ReiheStudientexte zur Sprachkommunikation
Band53
ISSN0940-6832

Externe IDs

ORCID /0000-0003-0167-8123/work/168716959

Schlagworte

Schlagwörter

  • Multimodal Communication