A robust optical flow motion estimation and correction method for IRT imaging in brain surgery

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

Abstract

In brain surgery, respiration motion, outliers, and occlusions create artefacts in Infrared Thermography (IRT) imaging. In this paper, we propose a robust method to handle multiple motion, outliers, and occlusions in IRT images which consists of two phases: preprocessing and image motion estimation. In the preprocessing phase, the Region of Interest (RoI) segmentation is employed to extract the brain cortex only. Thereafter, the Phase Correlation method is employed to compensate for large motion followed by occlusion masking based on an approach applying Cellular Nonlinear Networks (CNN). Next, intensity adjustment is made with respect to the reference image. Then, a Gaussian filter is applied. In the following phase, the image motion is estimated by employing Combined Local-Global (CLG) optical flow method. In order to find the best regularization coefficient for the spatial coherency term and the number of iterations for recursive optical flow estimation, we generated ground truth and evaluated the accuracy of the estimated motion vectors based on Average Angular Error (AAE) and Average Magnitude Error (AME). The efficiency improvement of the proposed method was tested on 1024 IRT images based on different comparisons. Thereby, the proposed method shows promising results for motion estimation and correction application in brain surgery.

Details

Original languageEnglish
Pages (from-to)226-251
Number of pages26
JournalQuantitative infrared thermography : QIRT
Volume18
Issue number4
Publication statusPublished - 2020
Peer-reviewedYes

External IDs

ORCID /0000-0001-7436-0103/work/146643812
ORCID /0000-0002-7267-7016/work/146644695

Keywords

Keywords

  • cellular nonlinear networks, IRT imaging, motion correction, motion estimation, occlusion masking, optical flow