An Action-Based Concept for the Phonetic Annotation of Sign Language Gestures

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

  • Bernd J. Kröger - (Author)
  • Jim Kannampuzha - (Author)
  • Dominik Bauer - (Author)
  • Peter Birkholz - , University Hospital Aachen, RWTH Aachen University (Author)
  • Philippe Dreuw - (Author)
  • Hermann Ney - (Author)

Abstract

Communicative actions are specific movements or gestures which are accomplished by vocal tract articulators (lips, tongue, velum etc.) for speech, by facial articulators (eye brows, eye lids etc.) for co-verbal facial expression and by other bodily articulators (hands, arms etc.) for co-verbal gesturing. While action-based approaches already exist for spoken language processing it is the aim of this paper to adopt action theory for signed language processing (i.e. production and perception of sign language). Method: An action-based method for the phonetic annotation of sign language has been developed and a 100 sentence American Sign Language corpus has been analyzed using this method. Results: Five basic types of sign actions were identified, all indicating the importance of movement phases even if the goal of a gesture is to reach a specific target (e.g. specific hand shape, orientation, location, and/or direction). Conclusion: This study is a starting point for investigating sign language production quantitatively in terms of a unified action theory.

Details

Original languageEnglish
Title of host publicationElektronische Sprachsignalverarbeitung 2010
EditorsHansjörg Mixdorff
Publisher Dresden : TUDpress
Pages33-39
Number of pages7
ISBN (print)978-3-941298-85-9
Publication statusPublished - 1 Mar 2010
Peer-reviewedYes
Externally publishedYes

Publication series

SeriesStudientexte zur Sprachkommunikation
Volume53
ISSN0940-6832

External IDs

ORCID /0000-0003-0167-8123/work/168716959

Keywords

Keywords

  • Multimodal Communication