Journal Article DKFZ-2026-02189

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
A five-phase evaluation framework for diagnostic and predictive medical artificial intelligence.

 ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;

2026
Macmillan Publishers Limited [Basingstoke]

npj digital medicine 9(1), 678 () [10.1038/s41746-026-03155-7]
 GO

Abstract: Artificial intelligence (AI) has advanced rapidly across diagnostic, prognostic, and clinical decision-support applications, yet the pathway from laboratory performance to demonstrable clinical benefit remains fragmented and inconsistently defined. Existing evaluations rely heavily on retrospective testing and algorithm-centric metrics, while current guidelines emphasize reporting standards rather than specifying validation across stages of model maturity. This study proposes a five-phase evaluation framework for medical AI, supported by a dynamic evaluation architecture reflecting the nonlinear, iterative nature of AI systems. The framework integrates technical validation, operational robustness validation, controlled interaction validation, clinical evidence validation, and real-world integration validation, while incorporating phase-gating criteria and local and systemic fall-back triggers. These mechanisms enable re-entry into earlier phases based on drift, version updates, or safety signals, and accommodate parallel activities such as implementation research informing clinical trials. By systematically mapping multicenter external validation, shadow-mode testing, human-AI comparison and cooperation studies, randomized controlled trials, real-world evaluations, and adaptive designs into a coherent lifecycle pathway, the framework addresses persistent gaps between laboratory performance and clinical benefit. It provides researchers, clinical institutions, and regulators with an operational, scalable approach aligned with evolving regulatory expectations, supporting trustworthy, ethically aligned, and lifecycle-based evidence generation for medical AI systems.

Classification:

Contributing Institute(s):
  1. Primäre Krebsprävention (C120)
Research Program(s):
  1. 313 - Krebsrisikofaktoren und Prävention (POF4-313) (POF4-313)

Appears in the scientific report 2026
Database coverage:
Medline ; DOAJ ; Article Processing Charges ; Clarivate Analytics Master Journal List ; Current Contents - Clinical Medicine ; DOAJ Seal ; Essential Science Indicators ; Fees ; IF >= 15 ; JCR ; PubMed Central ; SCOPUS ; Science Citation Index Expanded ; Web of Science Core Collection
Click to display QR Code for this record

The record appears in these collections:
Document types > Articles > Journal Article
Public records
Publications database

 Record created 2026-09-07, last modified 2026-09-08


Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)