The role of audiovisual feedback delays and bimodal congruency for visuomotor performance in human-machine interaction
Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung
Beitragende
Abstract
Despite incredible technological progress in the last decades, latency is still an issue for today's technologies and their applications. To better understand how latency and resulting feedback delays affect the interaction between humans and cyber-physical systems (CPS), the present study examines separate and joint effects of visual and auditory feedback delays on performance and the motor control strategy in a complex visuomotor task. Thirty-six participants played the Wire Loop Game, a fine motor skill task, while going through four different delay conditions: no delay, visual only, auditory only, and audiovisual (length: 200 ms). Participants' speed and accuracy for completing the task and movement kinematic were assessed. Visual feedback delays slowed down movement execution and impaired precision compared to a condition without feedback delays. In contrast, delayed auditory feedback improved precision. Descriptively, the latter finding mainly appeared when congruent visual and auditory feedback delays were provided. We discuss the role of temporal congruency of audiovisual information as well as potential compensatory mechanisms that can inform the design of multisensory feedback in human-CPS interaction faced with latency.
Details
Originalsprache | Englisch |
---|---|
Titel | ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction |
Erscheinungsort | New York, NY, USA |
Herausgeber (Verlag) | Association for Computing Machinery |
Seiten | 555–563 |
Seitenumfang | 9 |
ISBN (elektronisch) | 979-8-4007-0055-2/23/10. |
Publikationsstatus | Veröffentlicht - 9 Okt. 2023 |
Peer-Review-Status | Ja |
Externe IDs
Scopus | 85175795359 |
---|---|
ORCID | /0000-0002-6673-9591/work/147142744 |
Schlagworte
ASJC Scopus Sachgebiete
Schlagwörter
- Delayed auditory feedback, Delayed visual feedback, Human-CPS interaction, Multisensory congruency, Visuomotor control