Multi-stage mask-aware Depth Enhancement for RGB-IR-stereo Fusion on historic Timber Surfaces

Research output: Contribution to journal › Conference article › Contributed › peer-review

Contributors

  • Junquan Pan - , University of Bamberg (Author)
  • Maria Chizhova - , University of Bamberg (Author)
  • Mona Hess - , University of Bamberg (Author)
  • Thomas Luhmann - , Jade University of Applied Sciences (Author)
  • Ferdinand Maiwald - , Chair of Optical 3D-Metrology (Author)

Abstract

This paper presents a mask-aware multi-stage depth enhancement framework for digital documentation of historical timber surfaces using RGB-Stereo-IR fusion. Accurate geometric recording of aged wood features such as wooden knots remains challenging due to uneven illumination and weak texture. The proposed pipeline, which aims to stabilise depth geometry under uneven illumination and low-texture surface conditions, integrates object detection, instance segmentation and confidence-guided depth refinement across three stages: (A) TV(total variation)-regularized mask-aware refinement, (B) confidence-weighted multi-view fusion, and (C) patch-based stereo reconstruction. Experiments on historical timber beams under varying illumination demonstrate improved depth completeness and geometric consistency, achieving a residual standard deviation below 0.6 mm in bright scenes and stable reconstruction in low-light conditions. The framework offers a practical solution for depth reconstruction of cultural heritage timber, supporting more reliable feature detection and analysis.

Details

Original languageEnglish
Pages (from-to)217-226
Number of pages10
JournalISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Volume11
Issue number1-2026
Publication statusPublished - 3 Jul 2026
Peer-reviewedYes

Conference

Title25th Congress of the International Society for Photogrammetry and Remote Sensing
SubtitleFrom Imagery to Understanding
Abbreviated titleISPRS Congress Toronto 2026
Conference number25
Duration4 - 11 July 2026
Website
LocationMetro Toronto Convention Centre (MTCC)
CityToronto
CountryCanada

External IDs

ORCID /0000-0002-2456-9731/work/222762609

Keywords

Keywords

  • Damage assessment, Heritage timber, Instance segmentation, Mask-aware depth enhancement, Object detection, RGB-IR-Stereo fusion