HoloLens augmented reality system for transperineal free-hand prostate procedures

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Ming Li - , National Institutes of Health (NIH) (Author)
  • Sherif Mehralivand - , National Cancer Institute (NCI) (Author)
  • Sheng Xu - , National Institutes of Health (NIH) (Author)
  • Nicole Varble - , National Institutes of Health (NIH), Koninklijke Philips N.V. (Author)
  • Ivane Bakhutashvili - , National Institutes of Health (NIH) (Author)
  • Sandeep Gurram - , National Cancer Institute (NCI) (Author)
  • Peter A. Pinto - , National Cancer Institute (NCI) (Author)
  • Peter L. Choyke - , National Cancer Institute (NCI) (Author)
  • Bradford J. Wood - , National Institutes of Health (NIH) (Joint last author)
  • Baris Turkbey - , National Cancer Institute (NCI) (Joint last author)

Abstract

Purpose: An augmented reality (AR) system was developed to facilitate free-hand real-time needle guidance for transperineal prostate (TP) procedures and to overcome the limitations of a traditional guidance grid. Approach: The HoloLens AR system enables the superimposition of annotated anatomy derived from preprocedural volumetric images onto a patient and addresses the most challenging part of free-hand TP procedures by providing real-time needle tip localization and needle depth visualization during insertion. The AR system accuracy, or the image overlay accuracy (n = 56), and needle targeting accuracy (n = 24) were evaluated within a 3D-printed phantom. Three operators each used a planned-path guidance method (n = 4) and free-hand guidance (n = 4) to guide needles into targets in a gel phantom. Placement error was recorded. The feasibility of the system was further evaluated by delivering soft tissue markers into tumors of an anthropomorphic pelvic phantom via the perineum. Results: The image overlay error was 1.29 ± 0.57 mm, and needle targeting error was 2.13 ± 0.52 mm. The planned-path guidance placements showed similar error compared to the free-hand guidance (4.14 ± 1.08 mm versus 4.20 ± 1.08 mm, p = 0.90). The markers were successfully implanted either into or in close proximity to the target lesion. Conclusions: The HoloLens AR system can provide accurate needle guidance for TP interventions. AR support for free-hand lesion targeting is feasible and may provide more flexibility than grid-based methods, due to the real-time 3D and immersive experience during free-hand TP procedures.

Details

Original languageEnglish
Article number025001
JournalJournal of medical imaging : JMI
Volume10
Issue number2
Publication statusPublished - 1 Mar 2023
Peer-reviewedYes
Externally publishedYes

Keywords

Keywords

  • augmented reality, HoloLens guidancemedical imaging, interventional radiology, percutaneous procedure, transperineal prostate procedure