Following the Machine, Doubting Yourself: Behavioral Reliance and Confidence Erosion in AI-Assisted Diagnosis

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/Gutachten › Beitrag in Konferenzband › Beigetragen › Begutachtung

Abstract

AI-based diagnostic systems promise to improve medical decision-making, yet little is known about how the quality of their recommendations shapes behavioral reliance and users' confidence in their own expertise. We report a between-subjects online experiment in which 74 medical professionals interpreted 15 X-ray images with support from a simulated AI whose accuracy was manipulated (14 vs. 8 of 15 correct recommendations). Accurate AI advice increased reliance and diagnostic performance but lowered participants' confidence in their unaided judgment, consistent with social comparison theory. When the previously reliable AI produced a false negative, two thirds of participants who had initially identified the abnormality abandoned their correct diagnosis. A PLS-SEM analysis shows that domain self-efficacy raises diagnostic confidence, which in turn reduces calibrated diagnostic performance under accurate AI. The findings establish reliance and confidence as separable outcomes that can move in opposite directions and identify a boundary condition of self-efficacy in human-AI collaboration.

Details

OriginalspracheEnglisch
TitelInternational Conference on Information Systems (ICIS) 2026
Seitenumfang17
PublikationsstatusVeröffentlicht - 1 Dez. 2026
Peer-Review-StatusJa

Konferenz

TitelInternational Conference on Information Systems 2026
UntertitelDigital Collaboration and Coexistence
KurztitelICIS 2026
Dauer13 - 16 Dezember 2026
Webseite
BekanntheitsgradInternationale Veranstaltung
OrtLisbon Congress Centre
StadtLisbon
LandPortugal