000282494 001__ 282494
000282494 005__ 20240723104117.0
000282494 0247_ $$2arXiv$$aarXiv:2302.01790
000282494 0247_ $$2doi$$adoi.org/10.48550/arXiv.2302.01790
000282494 037__ $$aDKFZ-2023-01783
000282494 088__ $$2arXiv$$aarXiv:2302.01790
000282494 1001_ $$0P:(DE-He78)97e904f47dab556a77c0149cd0002591$$aReinke, Annika$$b0
000282494 245__ $$aUnderstanding metric-related pitfalls in image analysis validation
000282494 260__ $$barXiv$$c2023
000282494 3367_ $$0PUB:(DE-HGF)25$$2PUB:(DE-HGF)$$aPreprint$$bpreprint$$mpreprint$$s1721724030_17462
000282494 3367_ $$2ORCID$$aWORKING_PAPER
000282494 3367_ $$028$$2EndNote$$aElectronic Article
000282494 3367_ $$2DRIVER$$apreprint
000282494 3367_ $$2BibTeX$$aARTICLE
000282494 3367_ $$2DataCite$$aOutput Types/Working Paper
000282494 500__ $$aarXiv:2302.01790 [cs.CV]  	(or arXiv:2302.01790v2 [cs.CV] for this version)  	https://doi.org/10.48550/arXiv.2302.01790
000282494 520__ $$aValidation metrics are key for the reliable tracking of scientific progress and for bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately in relation to the underlying research problem. This could be attributed to a lack of accessibility of metric-related knowledge: While taking into account the individual strengths, weaknesses, and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multi-stage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides the first reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Focusing on biomedical image analysis but with the potential of transfer to other fields, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. To facilitate comprehension, illustrations and specific examples accompany each pitfall. As a structured body of information accessible to researchers of all levels of expertise, this work enhances global comprehension of a key topic in image analysis validation.
000282494 536__ $$0G:(DE-HGF)POF4-315$$a315 - Bildgebung und Radioonkologie (POF4-315)$$cPOF4-315$$fPOF IV$$x0
000282494 588__ $$aDataset connected to arXivarXiv
000282494 650_7 $$2Other$$aComputer Vision and Pattern Recognition (cs.CV)
000282494 650_7 $$2Other$$aFOS: Computer and information sciences
000282494 7001_ $$0P:(DE-He78)26651d9aa10255ad4f35610a56aa91e8$$aTizabi, Minu D.$$b1
000282494 7001_ $$0P:(DE-He78)6ae68adec0915a4ae2d58aff814aaceb$$aBaumgartner, Michael$$b2
000282494 7001_ $$0P:(DE-He78)c9d6245b17f0ab26eeed345cb00d3359$$aEisenmann, Matthias$$b3
000282494 7001_ $$0P:(DE-He78)98dd16a42af0888dd129e1cd2ee2766a$$aHeckmann-Nötzel, Doreen$$b4
000282494 7001_ $$0P:(DE-He78)64296d0922a2da68074f5de2ccf74487$$aKavur, A. Emre$$b5
000282494 7001_ $$0P:(DE-He78)683f71d452c83a7f5ec62969c6012466$$aRädsch, Tim$$b6
000282494 7001_ $$0P:(DE-HGF)0$$aSudre, Carole H.$$b7
000282494 7001_ $$0P:(DE-HGF)0$$aAcion, Laura$$b8
000282494 7001_ $$0P:(DE-HGF)0$$aAntonelli, Michela$$b9
000282494 7001_ $$0P:(DE-HGF)0$$aArbel, Tal$$b10
000282494 7001_ $$0P:(DE-HGF)0$$aBakas, Spyridon$$b11
000282494 7001_ $$0P:(DE-HGF)0$$aBenis, Arriel$$b12
000282494 7001_ $$0P:(DE-HGF)0$$aBlaschko, Matthew$$b13
000282494 7001_ $$0P:(DE-He78)fdeeec93551e8f3bad68db88a1130c5d$$aBüttner, Florian$$b14
000282494 7001_ $$0P:(DE-HGF)0$$aCardoso, M. Jorge$$b15
000282494 7001_ $$0P:(DE-HGF)0$$aCheplygina, Veronika$$b16
000282494 7001_ $$0P:(DE-HGF)0$$aChen, Jianxu$$b17
000282494 7001_ $$0P:(DE-He78)8da2eca0bc6341c8681c317fe2b8e27b$$aChristodoulou, Evangelia$$b18
000282494 7001_ $$0P:(DE-HGF)0$$aCimini, Beth A.$$b19
000282494 7001_ $$0P:(DE-HGF)0$$aCollins, Gary S.$$b20
000282494 7001_ $$0P:(DE-HGF)0$$aFarahani, Keyvan$$b21
000282494 7001_ $$0P:(DE-HGF)0$$aFerrer, Luciana$$b22
000282494 7001_ $$0P:(DE-HGF)0$$aGaldran, Adrian$$b23
000282494 7001_ $$0P:(DE-HGF)0$$avan Ginneken, Bram$$b24
000282494 7001_ $$0P:(DE-HGF)0$$aGlocker, Ben$$b25
000282494 7001_ $$0P:(DE-He78)77a2a5b07dcbd46277a18a32372ea154$$aGodau, Patrick$$b26
000282494 7001_ $$0P:(DE-He78)ee8356e679288a9a6176198b11ab2e2c$$aHaase, Robert$$b27
000282494 7001_ $$0P:(DE-HGF)0$$aHashimoto, Daniel A.$$b28
000282494 7001_ $$0P:(DE-HGF)0$$aHoffman, Michael M.$$b29
000282494 7001_ $$0P:(DE-HGF)0$$aHuisman, Merel$$b30
000282494 7001_ $$0P:(DE-He78)7ea9af59d03ec7deb982a0e0562358fa$$aIsensee, Fabian$$b31
000282494 7001_ $$0P:(DE-HGF)0$$aJannin, Pierre$$b32
000282494 7001_ $$0P:(DE-HGF)0$$aKahn, Charles E.$$b33
000282494 7001_ $$0P:(DE-HGF)0$$aKainmueller, Dagmar$$b34
000282494 7001_ $$0P:(DE-HGF)0$$aKainz, Bernhard$$b35
000282494 7001_ $$0P:(DE-HGF)0$$aKarargyris, Alexandros$$b36
000282494 7001_ $$0P:(DE-HGF)0$$aKarthikesalingam, Alan$$b37
000282494 7001_ $$0P:(DE-HGF)0$$aKenngott, Hannes$$b38
000282494 7001_ $$0P:(DE-He78)ec13544e7fd4c62ac008490a4547e990$$aKleesiek, Jens$$b39
000282494 7001_ $$0P:(DE-HGF)0$$aKofler, Florian$$b40
000282494 7001_ $$0P:(DE-HGF)0$$aKooi, Thijs$$b41
000282494 7001_ $$0P:(DE-He78)bb6a7a70f976eb8df1769944bf913596$$aKopp-Schneider, Annette$$b42
000282494 7001_ $$0P:(DE-HGF)0$$aKozubek, Michal$$b43
000282494 7001_ $$0P:(DE-HGF)0$$aKreshuk, Anna$$b44
000282494 7001_ $$0P:(DE-HGF)0$$aKurc, Tahsin$$b45
000282494 7001_ $$0P:(DE-HGF)0$$aLandman, Bennett A.$$b46
000282494 7001_ $$0P:(DE-HGF)0$$aLitjens, Geert$$b47
000282494 7001_ $$0P:(DE-HGF)0$$aMadani, Amin$$b48
000282494 7001_ $$0P:(DE-He78)33c74005e1ce56f7025c4f6be15321b3$$aMaier-Hein, Klaus$$b49
000282494 7001_ $$0P:(DE-HGF)0$$aMartel, Anne L.$$b50
000282494 7001_ $$0P:(DE-HGF)0$$aMattson, Peter$$b51
000282494 7001_ $$0P:(DE-HGF)0$$aMeijering, Erik$$b52
000282494 7001_ $$0P:(DE-HGF)0$$aMenze, Bjoern$$b53
000282494 7001_ $$0P:(DE-HGF)0$$aMoons, Karel G. M.$$b54
000282494 7001_ $$0P:(DE-HGF)0$$aMüller, Henning$$b55
000282494 7001_ $$0P:(DE-HGF)0$$aNichyporuk, Brennan$$b56
000282494 7001_ $$0P:(DE-HGF)0$$aNickel, Felix$$b57
000282494 7001_ $$0P:(DE-He78)ce7813ed6ec6ac6cc92e67e89a54ca10$$aPetersen, Jens$$b58
000282494 7001_ $$0P:(DE-HGF)0$$aRafelski, Susanne M.$$b59
000282494 7001_ $$0P:(DE-HGF)0$$aRajpoot, Nasir$$b60
000282494 7001_ $$0P:(DE-HGF)0$$aReyes, Mauricio$$b61
000282494 7001_ $$0P:(DE-HGF)0$$aRiegler, Michael A.$$b62
000282494 7001_ $$0P:(DE-HGF)0$$aRieke, Nicola$$b63
000282494 7001_ $$0P:(DE-He78)bf6f53ab6b4f57f00e71da7e1594b17e$$aSaez-Rodriguez, Julio$$b64
000282494 7001_ $$0P:(DE-HGF)0$$aSánchez, Clara I.$$b65
000282494 7001_ $$0P:(DE-HGF)0$$aShetty, Shravya$$b66
000282494 7001_ $$0P:(DE-HGF)0$$avan Smeden, Maarten$$b67
000282494 7001_ $$0P:(DE-HGF)0$$aSummers, Ronald M.$$b68
000282494 7001_ $$0P:(DE-HGF)0$$aTaha, Abdel A.$$b69
000282494 7001_ $$0P:(DE-HGF)0$$aTiulpin, Aleksei$$b70
000282494 7001_ $$0P:(DE-HGF)0$$aTsaftaris, Sotirios A.$$b71
000282494 7001_ $$0P:(DE-HGF)0$$aVan Calster, Ben$$b72
000282494 7001_ $$0P:(DE-HGF)0$$aVaroquaux, Gaël$$b73
000282494 7001_ $$0P:(DE-He78)1042737c83ba70ec508bdd99f0096864$$aWiesenfarth, Manuel$$b74
000282494 7001_ $$0P:(DE-HGF)0$$aYaniv, Ziv R.$$b75
000282494 7001_ $$0P:(DE-He78)04a0b5a49db132d8f00cee326cb743ca$$aJäger, Paul F.$$b76
000282494 7001_ $$0P:(DE-He78)26a1176cd8450660333a012075050072$$aMaier-Hein, Lena$$b77
000282494 773__ $$adoi.org/10.48550/arXiv.2302.01790
000282494 909CO $$ooai:inrepo02.dkfz.de:282494$$pVDB
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)97e904f47dab556a77c0149cd0002591$$aDeutsches Krebsforschungszentrum$$b0$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)26651d9aa10255ad4f35610a56aa91e8$$aDeutsches Krebsforschungszentrum$$b1$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)6ae68adec0915a4ae2d58aff814aaceb$$aDeutsches Krebsforschungszentrum$$b2$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)c9d6245b17f0ab26eeed345cb00d3359$$aDeutsches Krebsforschungszentrum$$b3$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)98dd16a42af0888dd129e1cd2ee2766a$$aDeutsches Krebsforschungszentrum$$b4$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)64296d0922a2da68074f5de2ccf74487$$aDeutsches Krebsforschungszentrum$$b5$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)683f71d452c83a7f5ec62969c6012466$$aDeutsches Krebsforschungszentrum$$b6$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)fdeeec93551e8f3bad68db88a1130c5d$$aDeutsches Krebsforschungszentrum$$b14$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)8da2eca0bc6341c8681c317fe2b8e27b$$aDeutsches Krebsforschungszentrum$$b18$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)77a2a5b07dcbd46277a18a32372ea154$$aDeutsches Krebsforschungszentrum$$b26$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)7ea9af59d03ec7deb982a0e0562358fa$$aDeutsches Krebsforschungszentrum$$b31$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)ec13544e7fd4c62ac008490a4547e990$$aDeutsches Krebsforschungszentrum$$b39$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)bb6a7a70f976eb8df1769944bf913596$$aDeutsches Krebsforschungszentrum$$b42$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)33c74005e1ce56f7025c4f6be15321b3$$aDeutsches Krebsforschungszentrum$$b49$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)bf6f53ab6b4f57f00e71da7e1594b17e$$aDeutsches Krebsforschungszentrum$$b64$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)1042737c83ba70ec508bdd99f0096864$$aDeutsches Krebsforschungszentrum$$b74$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)04a0b5a49db132d8f00cee326cb743ca$$aDeutsches Krebsforschungszentrum$$b76$$kDKFZ
000282494 9101_ $$0I:(DE-588b)2036810-0$$6P:(DE-He78)26a1176cd8450660333a012075050072$$aDeutsches Krebsforschungszentrum$$b77$$kDKFZ
000282494 9131_ $$0G:(DE-HGF)POF4-315$$1G:(DE-HGF)POF4-310$$2G:(DE-HGF)POF4-300$$3G:(DE-HGF)POF4$$4G:(DE-HGF)POF$$aDE-HGF$$bGesundheit$$lKrebsforschung$$vBildgebung und Radioonkologie$$x0
000282494 9141_ $$y2023
000282494 9201_ $$0I:(DE-He78)E130-20160331$$kE130$$lE130 Intelligente Medizinische Systeme$$x0
000282494 9201_ $$0I:(DE-He78)C060-20160331$$kC060$$lC060 Biostatistik$$x1
000282494 9201_ $$0I:(DE-He78)E230-20160331$$kE230$$lE230 Medizinische Bildverarbeitung$$x2
000282494 9201_ $$0I:(DE-He78)E290-20160331$$kE290$$lNWG Interaktives maschinelles Lernen$$x3
000282494 980__ $$apreprint
000282494 980__ $$aVDB
000282494 980__ $$aI:(DE-He78)E130-20160331
000282494 980__ $$aI:(DE-He78)C060-20160331
000282494 980__ $$aI:(DE-He78)E230-20160331
000282494 980__ $$aI:(DE-He78)E290-20160331
000282494 980__ $$aUNRESTRICTED