ViewR: Architectural-Scale Multi-User Mixed Reality with Mobile Head-Mounted Displays

Research output: Contribution to journalResearch articleContributedpeer-review

Abstract

The emergence of mobile head-mounted displays with robust “inside-out” markerless tracking and video-passthrough permits the creation of novel mixed reality (MR) experiences in which architectural spaces of arbitrary size can be transformed into immersive multi-user visualisation arenas. Here we outline ViewR, an open-source framework for rapidly constructing and deploying architectural-scale multi-user MR experiences. ViewR includes tools for rapid alignment of real and virtual worlds, tracking loss detection and recovery, user trajectory visualisation and world state synchronisation between users with persistence across sessions. ViewR also provides control over the blending of the real and the virtual, specification of site-specific blending zones, and video-passthrough avatars, allowing users to see and interact with one another directly.

Using ViewR, we explore the transformation of large architectural structures into immersive arenas by creating a range of experiences in various locations, with a particular focus on architectural affordances such as mezzanines, stairs, gangways and elevators. Our tests reveal that ViewR allows for experiences that would not be possible with pure virtual reality, and indicate that, with certain strategies for recovering from tracking errors, it is possible to construct large scale multi-user MR experiences using contemporary consumer virtual reality head-mounted displays.

Details

Original languageEnglish
Pages (from-to)5609-5622
Number of pages14
JournalIEEE Transactions on Visualization and Computer Graphics
Volume30 (2024)
Issue number8
Publication statusPublished - 7 Aug 2023
Peer-reviewedYes

External IDs

Scopus 85167786007
ORCID /0000-0002-3611-8719/work/142236831
ORCID /0000-0002-8923-6284/work/142247088
ORCID /0000-0002-3671-1619/work/142248367
Mendeley df5d5d9f-98d3-3fbe-946b-b7e72b2cf64a

Keywords

Research priority areas of TU Dresden

Subject groups, research areas, subject areas according to Destatis

Keywords

  • Cameras, Co-Located Systems, Collaboration, Collaborative Systems, Head-mounted displays, Mixed / Augmented Reality, Mixed reality, Resists, Virtual Reality, Virtual reality, Visualization, Visualization Systems

Library keywords