CleAR Sight: Exploring the Potential of Interacting with Transparent Tablets in Augmented Reality

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Abstract

In this paper, we examine the potential of incorporating transparent, handheld devices into head-mounted Augmented Reality (AR). Additional mobile devices have long been successfully used in head-mounted AR, but they obscure the visual context and real world objects during interaction. Transparent tangible displays can address this problem, using either transparent OLED screens or rendering by the head-mounted display itself. However, so far, there is no systematic analysis of the use of such transparent tablets in combination with AR head-mounted displays (HMDs), with respect to their benefits and arising challenges. We address this gap by introducing a research platform based on a touch-enabled, transparent interaction panel, for which we present our custom hardware design and software stack in detail. Furthermore, we developed a series of interaction concepts for this platform and demonstrate them in the context of three use case scenarios: the exploration of 3D volumetric data, collaborative visual data analysis, and the control of smart home appliances. We validate the feasibility of our concepts with interactive prototypes that we used to elicit feedback from HCI experts. As a result, we contribute to a better understanding of how transparent tablets can be integrated into future AR environments.

Details

Original languageEnglish
Title of host publicationProceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022
EditorsHenry Duh, Ian Williams, Jens Grubert, J. Adam Jones, Jianmin Zheng
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages196-205
Number of pages10
ISBN (electronic)9781665453257
Publication statusPublished - 2022
Peer-reviewedYes

Conference

Title21st IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022
Duration17 - 21 October 2022
CitySingapore
CountrySingapore

External IDs

ORCID /0000-0002-2176-876X/work/159171486
ORCID /0000-0002-3548-723X/work/159171694
ORCID /0000-0003-1467-7031/work/159172195

Keywords

Keywords

  • Human computer interaction (HCI), Human-centered computing, Interaction design, Interaction paradigms, Mixed/augmented reality