Point Cloud Alignment through Mid-Air Gestures on a Stereoscopic Display

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung


Manual point cloud registration is often a crucial step during the mapping of 3D point clouds and usually performed on a conventional desktop setup with mouse interaction. Since 3D point clouds are inherently spatial, these 2D applications suffer from impaired depth perception and inconvenient interaction. Nonetheless, there are few efforts to improve the usability of these applications. To address this, we propose an alternative setup, consisting of a stereoscopic display and an external hand tracker, allowing for enhanced depth perception and natural interaction without the need for body-worn devices or handheld controllers. We developed interaction techniques for point cloud alignment in 3D space, including visual feedback during alignment, and implemented a proof-of-concept prototype in the context of a surgical use case. We describe the use case, design and implementation of our concepts and outline future work. Herewith we provide a user-centered alternative to desktop applications for manual point cloud registration.


TitelCHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
ErscheinungsortNew York, NY, USA
Herausgeber (Verlag)Association for Computing Machinery (ACM), New York
ISBN (elektronisch)9781450394222
ISBN (Print)9781450394215
PublikationsstatusVeröffentlicht - 19 Apr. 2023

Externe IDs

dblp conf/chi/KrugSDKD23
Scopus 85158111258
Mendeley 5c0c5d98-3402-372a-bf7a-77d5a5b02f1f
ORCID /0000-0002-2176-876X/work/151435446



  • point cloud registration, mid-air interaction, point cloud alignment, stereoscopic display, image guidance navigation systems