Image prediction of disease progression for osteoarthritis by style-based manifold extrapolation

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Tianyu Han - , RWTH Aachen University (Author)
  • Jakob Nikolas Kather - , Else Kröner Fresenius Center for Digital Health, RWTH Aachen University, University of Leeds, Heidelberg University  (Author)
  • Federico Pedersoli - , RWTH Aachen University (Author)
  • Markus Zimmermann - , RWTH Aachen University (Author)
  • Sebastian Keil - , Medical Faculty Carl Gustav Carus (Author)
  • Maximilian Schulze-Hagen - , RWTH Aachen University (Author)
  • Marc Terwoelbeck - , RWTH Aachen University (Author)
  • Peter Isfort - , RWTH Aachen University (Author)
  • Christoph Haarburger - , Ocumeda GmbH (Author)
  • Fabian Kiessling - , RWTH Aachen University, Fraunhofer Institute for Digital Medicine (Author)
  • Christiane Kuhl - , RWTH Aachen University (Author)
  • Volkmar Schulz - , RWTH Aachen University, Fraunhofer Institute for Digital Medicine (Author)
  • Sven Nebelung - , RWTH Aachen University (Author)
  • Daniel Truhn - , RWTH Aachen University (Author)

Abstract

Disease-modifying management aims to prevent deterioration and progression of the disease, and not just to relieve symptoms. We present a solution for the management by a methodology that allows the prediction of progression risk and morphology in individuals using a latent extrapolation approach. To this end, we combined a regularized generative adversarial network and a latent nearest neighbour algorithm for joint optimization to generate plausible images of future time points. We evaluated our method on osteoarthritis data from a multicenter longitudinal study (the Osteoarthritis Initiative). With presymptomatic baseline data, our model is generative and considerably outperforms the end-to-end learning model in discriminating the progressive cohort. Two experiments were performed with seven radiologists. When no synthetic follow-up radiographs were provided, our model performed better than all seven radiologists. In cases in which the synthetic follow-ups generated by our model were made available to the radiologist for diagnosis support, the specificity and sensitivity of all readers in discriminating progressors increased from 72.3% to 88.6% and from 42.1% to 51.6%, respectively. Our results open up a new possibility of using model-based morphology and risk prediction to make predictions about disease occurrence, as demonstrated by the example of osteoarthritis.

Details

Original languageEnglish
Pages (from-to)1029-1039
Number of pages11
JournalNature Machine Intelligence
Volume4
Issue number11
Publication statusPublished - Nov 2022
Peer-reviewedYes