Multi-stage mask-aware Depth Enhancement for RGB-IR-stereo Fusion on historic Timber Surfaces

Publikation: Beitrag in Fachzeitschrift › Konferenzartikel › Beigetragen › Begutachtung

Beitragende

  • Junquan Pan - , Otto-Friedrich-Universität Bamberg (Autor:in)
  • Maria Chizhova - , Otto-Friedrich-Universität Bamberg (Autor:in)
  • Mona Hess - , Otto-Friedrich-Universität Bamberg (Autor:in)
  • Thomas Luhmann - , Jade Hochschule (Autor:in)
  • Ferdinand Maiwald - , Professur für Optische 3D Messverfahren (Autor:in)

Abstract

This paper presents a mask-aware multi-stage depth enhancement framework for digital documentation of historical timber surfaces using RGB-Stereo-IR fusion. Accurate geometric recording of aged wood features such as wooden knots remains challenging due to uneven illumination and weak texture. The proposed pipeline, which aims to stabilise depth geometry under uneven illumination and low-texture surface conditions, integrates object detection, instance segmentation and confidence-guided depth refinement across three stages: (A) TV(total variation)-regularized mask-aware refinement, (B) confidence-weighted multi-view fusion, and (C) patch-based stereo reconstruction. Experiments on historical timber beams under varying illumination demonstrate improved depth completeness and geometric consistency, achieving a residual standard deviation below 0.6 mm in bright scenes and stable reconstruction in low-light conditions. The framework offers a practical solution for depth reconstruction of cultural heritage timber, supporting more reliable feature detection and analysis.

Details

OriginalspracheEnglisch
Seiten (von - bis)217-226
Seitenumfang10
FachzeitschriftISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Jahrgang11
Ausgabenummer1-2026
PublikationsstatusVeröffentlicht - 3 Juli 2026
Peer-Review-StatusJa

Konferenz

Titel25th Congress of the International Society for Photogrammetry and Remote Sensing
UntertitelFrom Imagery to Understanding
KurztitelISPRS Congress Toronto 2026
Veranstaltungsnummer25
Dauer4 - 11 Juli 2026
Webseite
OrtMetro Toronto Convention Centre (MTCC)
StadtToronto
LandKanada

Externe IDs

ORCID /0000-0002-2456-9731/work/222762609

Schlagworte

ASJC Scopus Sachgebiete

  • Instrumentierung - Damage assessment, Heritage timber, Instance segmentation, Mask-aware depth enhancement, Object detection, RGB-IR-Stereo fusion
  • Umweltwissenschaften (sonstige) - Damage assessment, Heritage timber, Instance segmentation, Mask-aware depth enhancement, Object detection, RGB-IR-Stereo fusion
  • Erdkunde und Planetologie (sonstige) - Damage assessment, Heritage timber, Instance segmentation, Mask-aware depth enhancement, Object detection, RGB-IR-Stereo fusion

Schlagwörter

  • Damage assessment, Heritage timber, Instance segmentation, Mask-aware depth enhancement, Object detection, RGB-IR-Stereo fusion