Preprint DKFZ-2024-02587

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
Embarrassingly Simple Scribble Supervision for 3D Medical Segmentation

 ;  ;  ;  ;  ;  ;  ;  ;  ;

2024
arXiv

arXiv () [10.48550/ARXIV.2403.12834]  GO

Please use a persistent id in citations: doi:

Abstract: Traditionally, segmentation algorithms require dense annotations for training, demanding significant annotation efforts, particularly within the 3D medical imaging field. Scribble-supervised learning emerges as a possible solution to this challenge, promising a reduction in annotation efforts when creating large-scale datasets. Recently, a plethora of methods for optimized learning from scribbles have been proposed, but have so far failed to position scribble annotation as a beneficial alternative. We relate this shortcoming to two major issues: 1) the complex nature of many methods which deeply ties them to the underlying segmentation model, thus preventing a migration to more powerful state-of-the-art models as the field progresses and 2) the lack of a systematic evaluation to validate consistent performance across the broader medical domain, resulting in a lack of trust when applying these methods to new segmentation problems. To address these issues, we propose a comprehensive scribble supervision benchmark consisting of seven datasets covering a diverse set of anatomies and pathologies imaged with varying modalities. We furthermore propose the systematic use of partial losses, i.e. losses that are only computed on annotated voxels. Contrary to most existing methods, these losses can be seamlessly integrated into state-of-the-art segmentation methods, enabling them to learn from scribble annotations while preserving their original loss formulations. Our evaluation using nnU-Net reveals that while most existing methods suffer from a lack of generalization, the proposed approach consistently delivers state-of-the-art performance. Thanks to its simplicity, our approach presents an embarrassingly simple yet effective solution to the challenges of scribble supervision. Source code as well as our extensive scribble benchmarking suite will be made publicly available upon publication.

Keyword(s): Computer Vision and Pattern Recognition (cs.CV) ; FOS: Computer and information sciences


Contributing Institute(s):
  1. E230 Medizinische Bildverarbeitung (E230)
  2. NWG Interaktives maschinelles Lernen (E290)
Research Program(s):
  1. 315 - Bildgebung und Radioonkologie (POF4-315) (POF4-315)

Appears in the scientific report 2024
Click to display QR Code for this record

The record appears in these collections:
Document types > Reports > Preprints
Public records
Publications database

 Record created 2024-12-10, last modified 2024-12-10



Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)