Reporting checklist for foundation and large language models in medical research (REFINE): an international consensus guideline

Publikation: Beitrag in FachzeitschriftForschungsartikelBeigetragenBegutachtung

Beitragende

  • Ismail Mese - , Üsküdar State Hospital (Autor:in)
  • Tugba Akinci D'Antonoli - , Universitäts-Kinderspital beider Basel (Autor:in)
  • Christian Bluethgen - , Stanford University (Autor:in)
  • Keno Bressem - , Klinikum Rechts der Isar (MRI TUM) (Autor:in)
  • Renato Cuocolo - , University of Salerno (Autor:in)
  • Akshay Chaudhari - , Stanford University (Autor:in)
  • Ali S Tejani - , University of California at San Francisco (Autor:in)
  • Amanda Isaac - , King's College London (KCL) (Autor:in)
  • Andrea Ponsiglione - , Università degli Studi di Napoli Federico II (Autor:in)
  • Aymen Meddeb - , Charité – Universitätsmedizin Berlin (Autor:in)
  • Bardia Khosravi - , Mayo Clinic Rochester, MN (Autor:in)
  • Bastien Le Guellec - , Centre Hospitalier Universitaire (CHU) de Lille (Autor:in)
  • Charles E Kahn - , University of Pennsylvania (Autor:in)
  • Chong Hyun Suh - , Asan Medical Center (Autor:in)
  • Daniel Pinto Dos Santos - , Universitätsmedizin Mainz (Autor:in)
  • Dow-Mu Koh - , Institute of Cancer Research (Autor:in)
  • Eleftherios Tzanis - , Universität Kreta (Autor:in)
  • Elmar Kotter - , Universitätsklinikum Freiburg (Autor:in)
  • Errol Colak - , University of Toronto (Autor:in)
  • Felipe Kitamura - , Universidade Federal de São Paulo (Autor:in)
  • Felix Busch - , Klinikum Rechts der Isar (MRI TUM) (Autor:in)
  • Felix Nensa - , Universitätsklinikum Essen (Autor:in)
  • Guang Yang - , East China Normal University, Shanghai (Autor:in)
  • Henning Müller - , The Sense Innovation & Research Center (Autor:in)
  • Jakob Nikolas Kather - , Medizinische Klinik und Poliklinik I, Else Kröner Fresenius Zentrum für Digitale Gesundheit, Nationales Zentrum für Tumorerkrankungen (NCT) Heidelberg, Leeds Teaching Hospitals NHS Trust (Autor:in)
  • Jawed Nawabi - , Charité – Universitätsmedizin Berlin (Autor:in)
  • Jens Kleesiek - , Universitätsklinikum Essen (Autor:in)
  • Jingyu Zhong - , Shanghai Jiao Tong University (Autor:in)
  • João Santinha - , Universidade de Lisboa (Autor:in)
  • Johannes Haubold - , Universitätsklinikum Essen (Autor:in)
  • José Guilherme de Almeida - , Champalimaud Foundation (Autor:in)
  • Karim Lekadir - , ICREA - Institució Catalana de Recerca i Estudis Avançats (Autor:in)
  • Kostas Marias - , Foundation for Research and Technology-Hellas (Autor:in)
  • Lara Noelle Reiner - , Charité – Universitätsmedizin Berlin (Autor:in)
  • Lena Maier-Hein - , Mohamed Bin Zayed University of Artificial Intelligence (Autor:in)
  • Linda Moy - , NYU Grossman School of Medicine (Autor:in)
  • Lisa C Adams - , Klinikum Rechts der Isar (MRI TUM) (Autor:in)
  • Luis Martí-Bonmatí - , Hospital Universitari i Politècnic La Fe (Autor:in)
  • Magdalini Paschali - , Stanford University (Autor:in)
  • Mana Moassefi - , Mayo Clinic Rochester, MN (Autor:in)
  • Matthias Dietzel - , Universitätsklinikum der Friedrich-Alexander-Universität Erlangen-Nürnberg (Autor:in)
  • Merel Huisman - , Radboud University Medical Center (Autor:in)
  • Michael Ingrisch - , Konrad Zuse School of Excellence in Reliable AI (Autor:in)
  • Michail E Klontzas - , Foundation for Research and Technology-Hellas (Autor:in)
  • Nikolaos Papanikolaou - , Royal Marsden NHS Foundation Trust (Autor:in)
  • Oliver Diaz - , Universitat de Barcelona (Autor:in)
  • Paulo Kuriki - , University of Texas Southwestern Medical Center (Autor:in)
  • Philipp Seeböck - , Medizinische Universität Wien (Autor:in)
  • Pouria Rouzrokh - , Mayo Clinic Rochester, MN (Autor:in)
  • Quirin D Strotzer - , Universitätsklinikum Regensburg (Autor:in)
  • Seong Ho Park - , Asan Medical Center (Autor:in)
  • Shahriar Faghani - , Mayo Clinic Rochester, MN (Autor:in)
  • Soroosh Tayebi Arasteh - , Stanford Medicine (Autor:in)
  • Su Hwan Kim - , Klinikum Rechts der Isar (MRI TUM) (Autor:in)
  • Vasantha Kumar Venugopal - , Rajiv Gandhi Cancer Institute and Research Centre (Autor:in)
  • Woojin Kim - , VA Palo Alto Health Care System (VAPAHCS) (Autor:in)
  • Burak Kocak - , Başakşehir Çam And Sakura Cıty Hospıtal (Autor:in)

Abstract

PURPOSE: To develop the REporting checklist for FoundatIon and large laNguagE models (REFINE), an international reporting guideline for transparent and reproducible reporting of foundation model (FM) and large language model (LLM) studies in medical research, including imaging artificial intelligence (AI) applications.

METHODS: The protocol was prespecified and publicly archived. A modified Delphi process was conducted to establish reporting standards for unimodal and multimodal FM and LLM applications involving text, imaging, and structured data. The steering committee coordinated protocol development, expert recruitment, all Delphi rounds, and the harmonization phase. Decisions were made based on predefined consensus thresholds. In Rounds 1 and 2, structured ratings and free-text feedback informed iterative revisions. In the post-Delphi harmonization phase, terminology was standardized, and detailed reporting instructions were finalized.

RESULTS: The REFINE development group comprised 57 contributors from 17 countries, and 54 panelists from 16 countries completed Rounds 1 and 2. The harmonization phase was completed by three expert panelists and the steering committee. The entire process produced a 44-item, six-section framework with standardized terminology and detailed reporting instructions, supported by an online platform for practical use (https://refinechecklist.github.io/refine/checklist.html).

CONCLUSION: The REFINE provides a comprehensive, consensus-based reporting standard for medical FM and LLM research, including imaging AI studies. The online version facilitates practical implementation.

CLINICAL SIGNIFICANCE: The REFINE enables transparent, comparable, and reproducible reporting of FM and LLM studies, supporting reliable evidence synthesis in medical and imaging-focused AI studies.

Details

OriginalspracheEnglisch
FachzeitschriftDiagnostic and interventional radiology : official journal of the Turkish Society of Radiology
PublikationsstatusElektronische Veröffentlichung vor Drucklegung - 26 Feb. 2026
Peer-Review-StatusJa

Externe IDs

ORCID /0000-0002-3730-5348/work/212492326
unpaywall 10.4274/dir.2026.263812

Schlagworte