Fusion of Optical and Millimeter Wave SAR Sensing for Object Recognition in Indoor Environment

Research output: Contribution to book/conference proceedings/anthology/reportConference contributionContributedpeer-review

Contributors

  • Aman Batra - , University of Duisburg-Essen (Author)
  • Tobias Hark - , Ruhr University Bochum (Author)
  • Jonas Schorlemer - , Ruhr University Bochum (Author)
  • Nils Pohl - , Ruhr University Bochum (Author)
  • Ilona Rolfes - , Ruhr University Bochum (Author)
  • Michael Wiemeler - , University of Duisburg-Essen (Author)
  • Diana Gohringer - , Chair of Adaptive Dynamic Systems (Author)
  • Thomas Kaiser - , University of Duisburg-Essen (Author)
  • Jan Barowski - , Ruhr University Bochum (Author)

Abstract

Synthetic aperture radar (SAR) sensing at the millimeter-wave (mmWave) spectrum has emerging applications in indoor environments such as high-resolution imaging and localization, material characterization, and object recognition. Although a high-resolution environment map is obtained with SAR at the mmWave spectrum, recognition of objects based on shape is trivial, especially in the case of 2D imaging, where limited shape information is available. Therefore, this paper proposes a method for indoor object recognition in mmWave SAR sensing based on fusion with optical and mmWave SAR image fusion. The recognition includes detection, localization, and classification. Besides, extraction of geometric properties of the objects is also addressed. In this paper, firstly, a 2D multi-object indoor environment mapping is implemented at the spectrum of 68-92 GHz with a frequency modulated continuous wave (FMCW) radar. It replicates a setup of drone-based sensing with side-looking SAR. Two measurement scenarios are considered which primarily differ concerning object positions. The SAR image is reconstructed using a time-domain backprojection algorithm including a calibration procedure for generating a correct imaging plane. Finally, based on the presented method of SAR image fusion with the optical image at visible spectrum obtained using a CMOS camera, object recognition is evaluated.

Details

Original languageEnglish
Title of host publication2022 5th International Workshop on Mobile Terahertz Systems, IWMTS 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-5
ISBN (electronic)9781665482752
Publication statusPublished - 2022
Peer-reviewedYes

Workshop

TitleFifth International Workshop on Mobile Terahertz Systems 2022
Abbreviated titleIWMTS 2022
Conference number5
Duration4 - 6 July 2022
Website
CityDuisburg
CountryGermany

External IDs

ORCID /0000-0003-2571-8441/work/159607531

Keywords

Keywords

  • Indoor mapping, mmWave SAR, Object classification, Object detection, Radar imaging