guest ::
| Home > Publications database > Navigating prevalence shifts in image analysis algorithm deployment. |
| Home > Publications database > Navigating prevalence shifts in image analysis algorithm deployment. |
| Journal Article | DKFZ-2025-00465 |
; ; ; ; ; ; ;
2025
Elsevier Science
Amsterdam [u.a.]
This record in other databases: 
Please use a persistent id in citations: doi:10.1016/j.media.2025.103504
Abstract: Domain gaps are significant obstacles to the clinical implementation of machine learning (ML) solutions for medical image analysis. Although current research emphasizes new training methods and network architectures, the specific impact of prevalence shifts on algorithms in real-world applications is often overlooked. Differences in class frequencies between development and deployment data are crucial, particularly for the widespread adoption of artificial intelligence (AI), as disease prevalence can vary greatly across different times and locations. Our contribution is threefold. Based on a diverse set of 30 medical classification tasks (1) we demonstrate that lack of prevalence shift handling can have severe consequences on the quality of calibration, decision threshold, and performance assessment. Furthermore, (2) we show that prevalences can be accurately and reliably estimated in a data-driven manner. Finally, (3) we propose a new workflow for prevalence-aware image classification that uses estimated deployment prevalences to adjust a trained classifier to a new environment, without requiring additional annotated deployment data. Comprehensive experiments indicate that our proposed approach could contribute to generating better classifier decisions and more reliable performance estimates compared to current practice.
Keyword(s): Class imbalance ; Domain gap ; Generalization ; Medical image classification ; Prevalence shift
; Clarivate Analytics Master Journal List ; Current Contents - Engineering, Computing and Technology ; Ebsco Academic Search ; Essential Science Indicators ; IF >= 10 ; JCR ; SCOPUS ; Science Citation Index Expanded ; Web of Science Core Collection
|
The record appears in these collections: |
