Deep learning-enhanced light-field imaging with continuous validation

Publikation: Beitrag in FachzeitschriftForschungsartikelBeigetragenBegutachtung

Beitragende

  • Nils Wagner - , European Molecular Biology Laboratory (EMBL) Heidelberg, Technische Universität München, Helmholtz Information & Data Science Academy (HIDA) (Autor:in)
  • Fynn Beuttenmueller - , European Molecular Biology Laboratory (EMBL) Heidelberg, Universität Heidelberg (Autor:in)
  • Nils Norlin - , European Molecular Biology Laboratory (EMBL) Heidelberg, Lund University (Autor:in)
  • Jakob Gierten - , Universität Heidelberg (Autor:in)
  • Juan Carlos Boffi - , European Molecular Biology Laboratory (EMBL) Heidelberg (Autor:in)
  • Joachim Wittbrodt - , Universität Heidelberg (Autor:in)
  • Martin Weigert - , École Polytechnique Fédérale de Lausanne (Autor:in)
  • Lars Hufnagel - , European Molecular Biology Laboratory (EMBL) Heidelberg (Autor:in)
  • Robert Prevedel - , European Molecular Biology Laboratory (EMBL) Heidelberg, European Molecular Biology Laboratory (EMBL) Monterotondo (Autor:in)
  • Anna Kreshuk - , European Molecular Biology Laboratory (EMBL) Heidelberg (Autor:in)

Abstract

Visualizing dynamic processes over large, three-dimensional fields of view at high speed is essential for many applications in the life sciences. Light-field microscopy (LFM) has emerged as a tool for fast volumetric image acquisition, but its effective throughput and widespread use in biology has been hampered by a computationally demanding and artifact-prone image reconstruction process. Here, we present a framework for artificial intelligence–enhanced microscopy, integrating a hybrid light-field light-sheet microscope and deep learning–based volume reconstruction. In our approach, concomitantly acquired, high-resolution two-dimensional light-sheet images continuously serve as training data and validation for the convolutional neural network reconstructing the raw LFM data during extended volumetric time-lapse imaging experiments. Our network delivers high-quality three-dimensional reconstructions at video-rate throughput, which can be further refined based on the high-resolution light-sheet images. We demonstrate the capabilities of our approach by imaging medaka heart dynamics and zebrafish neural activity with volumetric imaging rates up to 100 Hz.

Details

OriginalspracheEnglisch
Seiten (von - bis)557-563
Seitenumfang7
FachzeitschriftNature methods
Jahrgang18
Ausgabenummer5
PublikationsstatusVeröffentlicht - Mai 2021
Peer-Review-StatusJa
Extern publiziertJa

Externe IDs

PubMed 33963344
ORCID /0000-0002-7780-9057/work/205992958

Schlagworte