Understanding the Role of Expert Intuition in Medical Image Annotation: A Cognitive Task Analysis Approach

Research output: Contribution to journalConference articleContributedpeer-review

Contributors

  • Florian Leiser - , Karlsruhe Institute of Technology (Author)
  • Manuel Schmidt-Kraepelin - , Karlsruhe Institute of Technology (Author)
  • Simon Warsinsky - , Karlsruhe Institute of Technology (Author)
  • Scott Thiebes - , Karlsruhe Institute of Technology (Author)
  • Ali Sunyaev - , Karlsruhe Institute of Technology (Author)
  • Marie Daum - , University Hospital Heidelberg (Author)
  • Martin Wagner - , University Hospital Heidelberg (Author)

Abstract

To improve contemporary machine learning (ML) models, research is increasingly looking at tapping in and incorporating the knowledge of domain experts. However, expert knowledge often relies on intuition, which is difficult to formalize for incorporation into ML models. Against this backdrop, we investigate the role of intuition in the context of expert medical image annotation. We apply a cognitive task analysis approach, where we observe and interview six expert medical image annotators to gain insights into pertinent decision cues and the role of intuition during annotation. Our results show that intuition plays an important role in various steps of the medical image annotation process, particularly in the appraisals of very easy or very difficult images, and in case purely cognitive appraisals remain inconclusive. Overall, we contribute to a better understanding of expert intuition in medical image annotation and provide possible interfaces to incorporate said intuition into ML models.

Details

Original languageEnglish
Pages (from-to)2850-2859
Number of pages10
JournalProceedings of the Annual Hawaii International Conference on System Sciences
Publication statusPublished - 2023
Peer-reviewedYes
Externally publishedYes

Conference

Title56th Hawaii International Conference on System Sciences 2023
Abbreviated titleHICSS-56
Conference number56
Duration3 - 6 January 2023
Website
Degree of recognitionInternational event
LocationHyatt Regency Maui
CityMaui
CountryUnited States of America

Keywords

ASJC Scopus subject areas

Keywords

  • cognitive task analysis, expert knowledge, intuition, machine learning, medical image annotation