Coupling image restoration and segmentation: A generalized linear model/bregman perspective

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Grégory Paul - , ETH Zurich (Author)
  • Janick Cardinale - , ETH Zurich (Author)
  • Ivo F. Sbalzarini - , ETH Zurich (Author)

Abstract

We introduce a new class of data-fitting energies that couple image segmentation with image restoration. These functionals model the image intensity using the statistical framework of generalized linear models. By duality, we establish an information-theoretic interpretation using Bregman divergences. We demonstrate how this formulation couples in a principled way image restoration tasks such as denoising, deblurring (deconvolution), and inpainting with segmentation. We present an alternating minimization algorithm to solve the resulting composite photometric/geometric inverse problem. We use Fisher scoring to solve the photometric problem and to provide asymptotic uncertainty estimates. We derive the shape gradient of our data-fitting energy and investigate convex relaxation for the geometric problem. We introduce a new alternating split-Bregman strategy to solve the resulting convex problem and present experiments and comparisons on both synthetic and real-world images.

Details

Original languageEnglish
Pages (from-to)69-93
Number of pages25
JournalInternational journal of computer vision
Volume104
Issue number1
Publication statusPublished - Aug 2013
Peer-reviewedYes
Externally publishedYes

External IDs

ORCID /0000-0003-4414-4340/work/159608290

Keywords

Keywords

  • Alternating split Bregman, Convex relaxation, Generalized linear model, Restoration, Segmentation, Shape gradient