Journal Article (Review Article) DKFZ-2024-00338

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Understanding metric-related pitfalls in image analysis validation.

 ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;  ;

2024
Nature Publishing Group London [u.a.]

Nature methods 21(2), 182 - 194 () [10.1038/s41592-023-02150-0]
 GO

This record in other databases:  

Please use a persistent id in citations: doi:

Abstract: Validation metrics are key for tracking scientific progress and bridging the current chasm between artificial intelligence research and its translation into practice. However, increasing evidence shows that, particularly in image analysis, metrics are often chosen inadequately. Although taking into account the individual strengths, weaknesses and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multistage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides a reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Although focused on biomedical image analysis, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. The work serves to enhance global comprehension of a key topic in image analysis validation.

Classification:

Note: #EA:E130#LA:E130#LA:E290#

Contributing Institute(s):
  1. E130 Intelligente Medizinische Systeme (E130)
  2. E230 Medizinische Bildverarbeitung (E230)
  3. C060 Biostatistik (C060)
  4. NWG Interaktives maschinelles Lernen (E290)
  5. DKTK Koordinierungsstelle Frankfurt (FM01)
Research Program(s):
  1. 315 - Bildgebung und Radioonkologie (POF4-315) (POF4-315)

Appears in the scientific report 2024
Database coverage:
Medline ; BIOSIS Previews ; Biological Abstracts ; Clarivate Analytics Master Journal List ; Current Contents - Life Sciences ; DEAL Nature ; Ebsco Academic Search ; Essential Science Indicators ; IF >= 40 ; JCR ; NationallizenzNationallizenz ; SCOPUS ; Science Citation Index Expanded ; Web of Science Core Collection
Click to display QR Code for this record

The record appears in these collections:
Document types > Articles > Journal Article
Public records
Publications database

 Record created 2024-02-14, last modified 2025-03-26


Fulltext:
Download fulltext PDF Download fulltext PDF (PDFA)
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)