The role of audiovisual feedback delays and bimodal congruency for visuomotor performance in human-machine interaction
Research output: Contribution to book/conference proceedings/anthology/report › Conference contribution › Contributed › peer-review
Contributors
Abstract
Despite incredible technological progress in the last decades, latency is still an issue for today's technologies and their applications. To better understand how latency and resulting feedback delays affect the interaction between humans and cyber-physical systems (CPS), the present study examines separate and joint effects of visual and auditory feedback delays on performance and the motor control strategy in a complex visuomotor task. Thirty-six participants played the Wire Loop Game, a fine motor skill task, while going through four different delay conditions: no delay, visual only, auditory only, and audiovisual (length: 200 ms). Participants' speed and accuracy for completing the task and movement kinematic were assessed. Visual feedback delays slowed down movement execution and impaired precision compared to a condition without feedback delays. In contrast, delayed auditory feedback improved precision. Descriptively, the latter finding mainly appeared when congruent visual and auditory feedback delays were provided. We discuss the role of temporal congruency of audiovisual information as well as potential compensatory mechanisms that can inform the design of multisensory feedback in human-CPS interaction faced with latency.
Details
Original language | English |
---|---|
Title of host publication | ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction |
Place of Publication | New York, NY, USA |
Publisher | Association for Computing Machinery |
Pages | 555–563 |
Number of pages | 9 |
ISBN (electronic) | 979-8-4007-0055-2/23/10. |
Publication status | Published - 9 Oct 2023 |
Peer-reviewed | Yes |
External IDs
Scopus | 85175795359 |
---|---|
ORCID | /0000-0002-6673-9591/work/147142744 |
Keywords
ASJC Scopus subject areas
Keywords
- Delayed auditory feedback, Delayed visual feedback, Human-CPS interaction, Multisensory congruency, Visuomotor control