guest ::
| Home > Publications database > Exploiting the potential of unlabeled endoscopic video data with self-supervised learning. > print |
| Home > Publications database > Exploiting the potential of unlabeled endoscopic video data with self-supervised learning. > print |
| 001 | 134894 | ||
| 005 | 20240229105047.0 | ||
| 024 | 7 | _ | |a 10.1007/s11548-018-1772-0 |2 doi |
| 024 | 7 | _ | |a pmid:29704196 |2 pmid |
| 024 | 7 | _ | |a 1861-6410 |2 ISSN |
| 024 | 7 | _ | |a 1861-6429 |2 ISSN |
| 024 | 7 | _ | |a altmetric:41853440 |2 altmetric |
| 037 | _ | _ | |a DKFZ-2018-00682 |
| 041 | _ | _ | |a eng |
| 082 | _ | _ | |a 610 |
| 100 | 1 | _ | |a Ross, Tobias |0 0000-0002-7094-4926 |b 0 |e First author |
| 245 | _ | _ | |a Exploiting the potential of unlabeled endoscopic video data with self-supervised learning. |
| 260 | _ | _ | |a Berlin |c 2018 |b Springer |
| 336 | 7 | _ | |a article |2 DRIVER |
| 336 | 7 | _ | |a Output Types/Journal article |2 DataCite |
| 336 | 7 | _ | |a Journal Article |b journal |m journal |0 PUB:(DE-HGF)16 |s 1695987787_24399 |2 PUB:(DE-HGF) |
| 336 | 7 | _ | |a ARTICLE |2 BibTeX |
| 336 | 7 | _ | |a JOURNAL_ARTICLE |2 ORCID |
| 336 | 7 | _ | |a Journal Article |0 0 |2 EndNote |
| 500 | _ | _ | |a E132 entspricht E230 |
| 520 | _ | _ | |a Surgical data science is a new research field that aims to observe all aspects of the patient treatment process in order to provide the right assistance at the right time. Due to the breakthrough successes of deep learning-based solutions for automatic image annotation, the availability of reference annotations for algorithm training is becoming a major bottleneck in the field. The purpose of this paper was to investigate the concept of self-supervised learning to address this issue.Our approach is guided by the hypothesis that unlabeled video data can be used to learn a representation of the target domain that boosts the performance of state-of-the-art machine learning algorithms when used for pre-training. Core of the method is an auxiliary task based on raw endoscopic video data of the target domain that is used to initialize the convolutional neural network (CNN) for the target task. In this paper, we propose the re-colorization of medical images with a conditional generative adversarial network (cGAN)-based architecture as auxiliary task. A variant of the method involves a second pre-training step based on labeled data for the target task from a related domain. We validate both variants using medical instrument segmentation as target task.The proposed approach can be used to radically reduce the manual annotation effort involved in training CNNs. Compared to the baseline approach of generating annotated data from scratch, our method decreases exploratively the number of labeled images by up to 75% without sacrificing performance. Our method also outperforms alternative methods for CNN pre-training, such as pre-training on publicly available non-medical (COCO) or medical data (MICCAI EndoVis2017 challenge) using the target task (in this instance: segmentation).As it makes efficient use of available (non-)public and (un-)labeled data, the approach has the potential to become a valuable tool for CNN (pre-)training. |
| 536 | _ | _ | |a 315 - Imaging and radiooncology (POF3-315) |0 G:(DE-HGF)POF3-315 |c POF3-315 |f POF III |x 0 |
| 588 | _ | _ | |a Dataset connected to CrossRef, PubMed, |
| 700 | 1 | _ | |a Zimmerer, David |0 P:(DE-HGF)0 |b 1 |
| 700 | 1 | _ | |a Vemuri, Anant |0 P:(DE-He78)59550e3c9ae4b46b714843863e0db8d9 |b 2 |u dkfz |
| 700 | 1 | _ | |a Isensee, Fabian |0 P:(DE-He78)7ea9af59d03ec7deb982a0e0562358fa |b 3 |u dkfz |
| 700 | 1 | _ | |a Wiesenfarth, Manuel |0 P:(DE-He78)1042737c83ba70ec508bdd99f0096864 |b 4 |u dkfz |
| 700 | 1 | _ | |a Bodenstedt, Sebastian |b 5 |
| 700 | 1 | _ | |a Both, Fabian |b 6 |
| 700 | 1 | _ | |a Kessler, Philip |b 7 |
| 700 | 1 | _ | |a Wagner, Martin |b 8 |
| 700 | 1 | _ | |a Müller, Beat |b 9 |
| 700 | 1 | _ | |a Kenngott, Hannes |b 10 |
| 700 | 1 | _ | |a Speidel, Stefanie |b 11 |
| 700 | 1 | _ | |a Kopp-Schneider, Annette |0 P:(DE-He78)bb6a7a70f976eb8df1769944bf913596 |b 12 |u dkfz |
| 700 | 1 | _ | |a Maier-Hein, Klaus |0 P:(DE-He78)33c74005e1ce56f7025c4f6be15321b3 |b 13 |u dkfz |
| 700 | 1 | _ | |a Maier-Hein, Lena |0 P:(DE-He78)26a1176cd8450660333a012075050072 |b 14 |e Last author |u dkfz |
| 773 | _ | _ | |a 10.1007/s11548-018-1772-0 |g Vol. 13, no. 6, p. 925 - 933 |0 PERI:(DE-600)2235881-X |n 6 |p 925 - 933 |t International journal of computer assisted radiology and surgery |v 13 |y 2018 |x 1861-6429 |
| 909 | C | O | |p VDB |o oai:inrepo02.dkfz.de:134894 |
| 910 | 1 | _ | |a Deutsches Krebsforschungszentrum |0 I:(DE-588b)2036810-0 |k DKFZ |b 0 |6 0000-0002-7094-4926 |
| 910 | 1 | _ | |a Deutsches Krebsforschungszentrum |0 I:(DE-588b)2036810-0 |k DKFZ |b 1 |6 P:(DE-HGF)0 |
| 910 | 1 | _ | |a Deutsches Krebsforschungszentrum |0 I:(DE-588b)2036810-0 |k DKFZ |b 2 |6 P:(DE-He78)59550e3c9ae4b46b714843863e0db8d9 |
| 910 | 1 | _ | |a Deutsches Krebsforschungszentrum |0 I:(DE-588b)2036810-0 |k DKFZ |b 3 |6 P:(DE-He78)7ea9af59d03ec7deb982a0e0562358fa |
| 910 | 1 | _ | |a Deutsches Krebsforschungszentrum |0 I:(DE-588b)2036810-0 |k DKFZ |b 4 |6 P:(DE-He78)1042737c83ba70ec508bdd99f0096864 |
| 910 | 1 | _ | |a Deutsches Krebsforschungszentrum |0 I:(DE-588b)2036810-0 |k DKFZ |b 12 |6 P:(DE-He78)bb6a7a70f976eb8df1769944bf913596 |
| 910 | 1 | _ | |a Deutsches Krebsforschungszentrum |0 I:(DE-588b)2036810-0 |k DKFZ |b 13 |6 P:(DE-He78)33c74005e1ce56f7025c4f6be15321b3 |
| 910 | 1 | _ | |a Deutsches Krebsforschungszentrum |0 I:(DE-588b)2036810-0 |k DKFZ |b 14 |6 P:(DE-He78)26a1176cd8450660333a012075050072 |
| 913 | 1 | _ | |a DE-HGF |b Gesundheit |l Krebsforschung |1 G:(DE-HGF)POF3-310 |0 G:(DE-HGF)POF3-315 |3 G:(DE-HGF)POF3 |2 G:(DE-HGF)POF3-300 |4 G:(DE-HGF)POF |v Imaging and radiooncology |x 0 |
| 914 | 1 | _ | |y 2018 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0200 |2 StatID |b SCOPUS |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0300 |2 StatID |b Medline |
| 915 | _ | _ | |a JCR |0 StatID:(DE-HGF)0100 |2 StatID |b INT J COMPUT ASS RAD : 2015 |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0199 |2 StatID |b Thomson Reuters Master Journal List |
| 915 | _ | _ | |a WoS |0 StatID:(DE-HGF)0111 |2 StatID |b Science Citation Index Expanded |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)0150 |2 StatID |b Web of Science Core Collection |
| 915 | _ | _ | |a DBCoverage |0 StatID:(DE-HGF)1110 |2 StatID |b Current Contents - Clinical Medicine |
| 915 | _ | _ | |a IF < 5 |0 StatID:(DE-HGF)9900 |2 StatID |
| 920 | 1 | _ | |0 I:(DE-He78)E130-20160331 |k E130 |l E130 Intelligente Medizinische Systeme |x 0 |
| 920 | 1 | _ | |0 I:(DE-He78)E132-20160331 |k E132 |l Medizinische Bildverarbeitung |x 1 |
| 920 | 1 | _ | |0 I:(DE-He78)E230-20160331 |k E230 |l E230 Medizinische Bildverarbeitung |x 2 |
| 920 | 1 | _ | |0 I:(DE-He78)C060-20160331 |k C060 |l C060 Biostatistik |x 3 |
| 980 | _ | _ | |a journal |
| 980 | _ | _ | |a VDB |
| 980 | _ | _ | |a I:(DE-He78)E130-20160331 |
| 980 | _ | _ | |a I:(DE-He78)E132-20160331 |
| 980 | _ | _ | |a I:(DE-He78)E230-20160331 |
| 980 | _ | _ | |a I:(DE-He78)C060-20160331 |
| 980 | _ | _ | |a UNRESTRICTED |
| Library | Collection | CLSMajor | CLSMinor | Language | Author |
|---|