A convolutional neural network with self-attention for fully automated metabolic tumor volume delineation of head and neck cancer in [ 18 F]FDG PET/CT

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Pavel Nikulin - , Helmholtz-Zentrum Dresden-Rossendorf (Author)
  • Sebastian Zschaeck - , Charité – Universitätsmedizin Berlin (Author)
  • Jens Maus - , Helmholtz-Zentrum Dresden-Rossendorf (Author)
  • Paulina Cegla - , Greater Poland Cancer Centre (Author)
  • Elia Lombardo - , University Hospital Münster (Author)
  • Christian Furth - , Charité – Universitätsmedizin Berlin (Author)
  • Joanna Kaźmierska - , Capital Medical University (CMU) (Author)
  • Julian M M Rogasch - , Charité – Universitätsmedizin Berlin (Author)
  • Adrien Holzgreve - , University Hospital Münster (Author)
  • Nathalie L Albert - , Hospital of the Ludwig-Maximilians-University (LMU) Munich (Author)
  • Konstantinos Ferentinos - , European University Cyprus (Author)
  • Iosif Strouthos - , European University Cyprus (Author)
  • Marina Hajiyianni - , Charité – Universitätsmedizin Berlin (Author)
  • Sebastian N Marschner - , Hospital of the Ludwig-Maximilians-University (LMU) Munich (Author)
  • Claus Belka - , Hospital of the Ludwig-Maximilians-University (LMU) Munich, German Cancer Consortium (DKTK) partner site Munich (Author)
  • Guillaume Landry - , Hospital of the Ludwig-Maximilians-University (LMU) Munich (Author)
  • Witold Cholewinski - , University of Medical Sciences Poznan (Author)
  • Jörg Kotzerke - , Department of Nuclear Medicine (Author)
  • Frank Hofheinz - , Helmholtz-Zentrum Dresden-Rossendorf (Author)
  • Jörg van den Hoff - , Department of Nuclear Medicine, Helmholtz-Zentrum Dresden-Rossendorf (Author)

Abstract

PURPOSE: PET-derived metabolic tumor volume (MTV) and total lesion glycolysis of the primary tumor are known to be prognostic of clinical outcome in head and neck cancer (HNC). Including evaluation of lymph node metastases can further increase the prognostic value of PET but accurate manual delineation and classification of all lesions is time-consuming and prone to interobserver variability. Our goal, therefore, was development and evaluation of an automated tool for MTV delineation/classification of primary tumor and lymph node metastases in PET/CT investigations of HNC patients.

METHODS: Automated lesion delineation was performed with a residual 3D U-Net convolutional neural network (CNN) incorporating a multi-head self-attention block. 698 [Formula: see text]F]FDG PET/CT scans from 3 different sites and 5 public databases were used for network training and testing. An external dataset of 181 [Formula: see text]F]FDG PET/CT scans from 2 additional sites was employed to assess the generalizability of the network. In these data, primary tumor and lymph node (LN) metastases were interactively delineated and labeled by two experienced physicians. Performance of the trained network models was assessed by 5-fold cross-validation in the main dataset and by pooling results from the 5 developed models in the external dataset. The Dice similarity coefficient (DSC) for individual delineation tasks and the primary tumor/metastasis classification accuracy were used as evaluation metrics. Additionally, a survival analysis using univariate Cox regression was performed comparing achieved group separation for manual and automated delineation, respectively.

RESULTS: In the cross-validation experiment, delineation of all malignant lesions with the trained U-Net models achieves DSC of 0.885, 0.805, and 0.870 for primary tumor, LN metastases, and the union of both, respectively. In external testing, the DSC reaches 0.850, 0.724, and 0.823 for primary tumor, LN metastases, and the union of both, respectively. The voxel classification accuracy was 98.0% and 97.9% in cross-validation and external data, respectively. Univariate Cox analysis in the cross-validation and the external testing reveals that manually and automatically derived total MTVs are both highly prognostic with respect to overall survival, yielding essentially identical hazard ratios (HR) ([Formula: see text]; [Formula: see text] vs. [Formula: see text]; [Formula: see text] in cross-validation and [Formula: see text]; [Formula: see text] vs. [Formula: see text]; [Formula: see text] in external testing).

CONCLUSION: To the best of our knowledge, this work presents the first CNN model for successful MTV delineation and lesion classification in HNC. In the vast majority of patients, the network performs satisfactory delineation and classification of primary tumor and lymph node metastases and only rarely requires more than minimal manual correction. It is thus able to massively facilitate study data evaluation in large patient groups and also does have clear potential for supervised clinical application.

Details

Original languageEnglish
Pages (from-to)2751-2766
Number of pages16
JournalEuropean journal of nuclear medicine and molecular imaging
Volume50
Issue number9
Publication statusPublished - Jul 2023
Peer-reviewedYes

External IDs

PubMedCentral PMC10317885
Scopus 85153066199
WOS 000975921500001
Mendeley 16542dac-798f-3f7a-a735-74a5f5c3fcd9

Keywords

Sustainable Development Goals

Keywords

  • Humans, Positron Emission Tomography Computed Tomography/methods, Fluorodeoxyglucose F18/metabolism, Lymphatic Metastasis/diagnostic imaging, Tumor Burden, Head and Neck Neoplasms/diagnostic imaging, Neural Networks, Computer

Library keywords