Learned end-to-end high-resolution lensless fiber imaging towards real-time cancer diagnosis

Research output: Contribution to journalResearch articleContributedpeer-review

Abstract

Recent advances in label-free histology promise a new era for real-time diagnosis in neurosurgery. Deep learning using autofluorescence is promising for tumor classification without histochemical staining process. The high image resolution and minimally invasive diagnostics with negligible tissue damage is of great importance. The state of the art is raster scanning endoscopes, but the distal lens optics limits the size. Lensless fiber bundle endoscopy offers both small diameters of a few 100 microns and the suitability as single-use probes, which is beneficial in sterilization. The problem is the inherent honeycomb artifacts of coherent fiber bundles (CFB). For the first time, we demonstrate an end-to-end lensless fiber imaging with exploiting the near-field. The framework includes resolution enhancement and classification networks that use single-shot CFB images to provide both high-resolution imaging and tumor diagnosis. The well-trained resolution enhancement network not only recovers high-resolution features beyond the physical limitations of CFB, but also helps improving tumor recognition rate. Especially for glioblastoma, the resolution enhancement network helps increasing the classification accuracy from 90.8 to 95.6%. The novel technique enables histological real-time imaging with lensless fiber endoscopy and is promising for a quick and minimally invasive intraoperative treatment and cancer diagnosis in neurosurgery.

Details

Original languageEnglish
Article number18846
JournalScientific reports
Volume12
Issue number1
Publication statusPublished - 7 Nov 2022
Peer-reviewedYes

External IDs

Scopus 85141378736
WOS 000879914800019
PubMed 36344626
Mendeley 8552ee78-bc0d-3183-ad82-0ba2f5fccd47

Keywords