Anticipatory Hand Glove: Understanding Human Actions for Enhanced Interaction

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Abstract

Perceived real-time interactions between humans and a metaverse often require synchronizing actions in the virtual and real world. Latency is a main blocking factor due to processing and transmitting data over long distances because cloud data centres that deploy metaverse locate far away. We present an anticipatory computing solution to predict precisely human actions grasping objects based on hand kinesthetics leveraging smart gloves with IMU and flexion sensors. We demonstrated that the gain from the anticipation of up to several hundred milliseconds could compensate for computing and transmission latency, enabling immersive interactions over extremely long distances. Our solution is flexible and is free from locking into particular smart glove vendors, making it easy for future extensions.

Details

Original languageEnglish
Title of host publicationUbiComp/ISWC 2023 Adjunct - Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2023 ACM International Symposium on Wearable Computing
PublisherAssociation for Computing Machinery, Inc
Pages170-174
Number of pages5
ISBN (electronic)9798400702006
Publication statusPublished - 8 Oct 2023
Peer-reviewedYes

Conference

Title2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & 2023 ACM International Symposium on Wearable Computing
Abbreviated titleUbiComp / ISWC 2023
Duration8 - 12 October 2023
Website
LocationCancún Convention Center
CityCancún
CountryMexico

External IDs

ORCID /0000-0001-7008-1537/work/158767464
ORCID /0000-0001-8469-9573/work/161891160

Keywords

Keywords

  • anticipatory computing, deep learning, gesture recognition, human-machine interactions