The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index; none of the 23 sources its claims cite is checked for support yet.
Self-supervised learning for medical image analysis using image context restoration
Open accessAbstract
Machine learning, particularly deep learning has boosted medical image analysis over the past years. Training a good model based on deep learning requires large amount of labelled data. However, it is often difficult to obtain a sufficient number of labelled images for training. In many scenarios the dataset in question consists of more unlabelled images than labelled ones. Therefore, boosting the performance of machine learning models by using unlabelled as well as labelled data is an important but challenging problem. Self-supervised learning presents one possible solution to this problem. However, existing self-supervised learning strategies applicable to medical images cannot result in significant performance improvement. Therefore, they often lead to only marginal improvements. In this paper, we propose a novel self-supervised learning strategy based on context restoration in order to better exploit unlabelled images. The context restoration strategy has three major features: 1) it learns semantic image features; 2) these image features are useful for different types of subsequent image analysis tasks; and 3) its implementation is simple. We validate the context restoration strategy in three common problems in medical imaging: classification, localization, and segmentation. For classification, we apply and test it to scan plane detection in fetal 2D ultrasound images; to localise abdominal organs in CT images; and to segment brain tumours in multi-modal MR images. In all three cases, self-supervised learning based on context restoration learns useful semantic features and lead to improved machine learning models for the above tasks.
Overview
AI snapshot
Written from the paper’s full text.
TL;DR
The paper proposes context restoration as a self-supervised pretraining task for medical images: randomly swap image patches and train a CNN to restore the original context. Across fetal ultrasound classification, abdominal CT organ localization, and brain MR tumor segmentation, context restoration pretraining outperformed autoencoder, relative-position, context-prediction, and no self-supervision.
Key findings
- Context restoration pretraining improved CNNs in all three evaluated tasks: fetal standard scan plane classification, abdominal multi-organ localization, and brain tumor segmentation. It outperformed other self-supervised strategies and no self-supervision in the reported comparisons.
- For fetal ultrasound classification, when using only a quarter of the training data, context restoration pretraining improved the SonoNet performance the most among the compared pretraining strategies.
- For abdominal CT localization, context restoration pretraining produced more localization improvements than other pretraining methods; in some cases it was comparable to or better than no pretraining on more annotated training data.
- For BraTS 2017 brain tumor segmentation, U-Nets initialized by context restoration pretraining achieved the best performance in total; using 50% of the training set gave similar performance to using the whole training set, with Dice in enhanced tumor core, sensitivity in non-enhanced and enhanced tumor cores, and Hausdorff distances even slightly better.
Methods
- Self-supervised task: given an unlabelled image, randomly select two isolated patches and swap them; repeat T times to disorder context, then train a CNN to restore the original image using an L2 loss.
- Evaluated on three datasets/tasks: fetal 2D ultrasound classification with 2694 examinations and SonoNet-64; abdominal CT multi-organ localization with 150 subjects and a SonoNet-like CNN; BraTS 2017 brain tumor segmentation with 285 subjects, 142 for training/validation and 143 for testing, using a 2D U-Net on 64×64 patches.
- Compared pretraining strategies: autoencoder, relative position prediction, local context prediction, and context restoration; subsequent tasks used whole, half, or quarter of the training set. Training details include 58K iterations for ultrasound classification, 55K for CT localization, and 50K for segmentation.
Limitations
- The paper states that the L2 loss used for context restoration results in blurry restored images.
- The paper reports that data augmentation did not consistently improve performance and sometimes decreased segmentation accuracy; it also notes that self-supervised pretraining was not compared against supervised pretraining because supervised pretraining is difficult in medical imaging due to annotation requirements.
- Evident from the text: evaluation is limited to three medical imaging tasks and datasets, and the paper notes that in brain tumor segmentation the performance differences among self-supervision strategies were not always significant.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
26 Own interpretation · 25 Own result · 21 No basis given · 20 Not checked yet
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Balancing the numbers of instances in each class significantly improves the performance in all three metrics.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Fetal standard scan plane classification
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Initialising by pretrained features, particularly those from context restoration tasks, improves the CNN performance.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Abdominal multi-organ localization
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“A shortcoming is that the L2 loss results in image blur.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Context restoration results
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In all three cases, self-supervised learning based on context restoration learns useful semantic features and lead to improved machine learning models for the above tasks.”
§ Self-supervised learning for medical image analysis using image context restoration > Abstract
plaindirectn = 3- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On quarter of training data, the data augmentation techniques can be advantageous over some self-supervised learning methods such as the CP method.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Fetal standard scan plane classification
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“when learning on half of training images, the F1-scores keep stable in most cases except where the SonoNet is pretrained based on context restoration.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Fetal standard scan plane classification
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our context restoration pretraining improves the SonoNet performance the most.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Fetal standard scan plane classification
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In all cases, the image context restoration achieve qualitatively good results.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Context restoration results
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Data augmentation did not offer performance improvement in many cases.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Abdominal multi-organ localization
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“using 50% of the training set, the proposed self-supervision strategy offers similar performance to using the whole training set.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Brain tumour segmentation
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- It may state two separate claims as one. 18
- The quote only partly states this claim. 1
- Probably not a substantial claim. 21
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“when the SonoNet is trained on quarter of the training data, the precision decreases significantly while there is only slight decrease in terms of the recall.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Fetal standard scan plane classification
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In all three tasks, the pretraining based on our context restoration strategy is superior to other self-supervised learning strategies, as well as no self-supervised training.”
§ Self-supervised learning for medical image analysis using image context restoration > Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When the SonoNet is trained on half of the training data, the precision and recall both decrease, which lead to the decrease of the F1-score.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Fetal standard scan plane classification
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Data augmentation does not lead to improvement when the SonoNet is trained on half data; while it lead to obvious improvement when the SonoNet is trained on quarter of data.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Fetal standard scan plane classification
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The SonoNet pretrained using context restoration can only offers marginal improvement.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Fetal standard scan plane classification
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
The quote only partly states this claim.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“When learning using only a quarter of training images, the SonoNet with feature initialisation from the auto-encoder pretraining still cannot improve the baseline; while SonoNets using other pretraining strategies perform better than the baseline.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Fetal standard scan plane classification
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“in terms of the liver, the CNN performance decreases sharply with half training data; while it remains stable with quarter training data.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Abdominal multi-organ localization
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“Although the CNN pretrained using the RP method on quarter training data outperforms that using context restoration pretraining, it performs much worse in left kidney.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Abdominal multi-organ localization
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The Dice score in enhanced tumour core, the sensitivity in non-enhanced and enhanced tumour cores, and the Hausdorff distances in all aspects are even slightly better.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Brain tumour segmentation
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“pretraining based on relative positions and context prediction tasks improves the segmentations but they are not as good as the pretraining based on the context restoration task.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Brain tumour segmentation
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“For many common problems in medical imaging such as classification, localization, and segmentation, learning image context is key.”
§ Self-supervised learning for medical image analysis using image context restoration > Self-supervision based on context restoration > Context restoration
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In case of subsequent segmentation tasks, the whole CNN architecture can be shared by the pretraining network and the subsequent segmentation network. As a result, almost all the weights of the subsequent segmentation CNN can be initialised using those learned in the self-supervised pretraining. This results in better segmentation results.”
§ Self-supervised learning for medical image analysis using image context restoration > Self-supervision based on context restoration > Network architectures
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“However, the removal of context changes the image intensity distribution. Thus the resulting images belong to another domain and the learned features may not be useful for images in the original domain.”
§ Self-supervised learning for medical image analysis using image context restoration > Related work
What the sources say
- Not checked yetcites Pathak et al., 2016
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The pretrained models from the natural image domain are not useful in the medical imaging domain since the intensity distribution of natural images is different from that of medical images.”
§ Self-supervised learning for medical image analysis using image context restoration > Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
In the paper
“Since each data instance is regarded as one class, the exemplar learning method is difficult to apply to large datasets.”
§ Self-supervised learning for medical image analysis using image context restoration > Related work
What the sources say
- Not checked yetcites Dosovitskiy et al., 2016 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“More precisely, the CNN weights learned in the CP method can be used to initialise subsequent CNNs for classification and segmentation; while CNN weights learned in the RP method can initialise subsequent classification CNNs and only the analysis part of the subsequent segmentation CNNs.”
§ Self-supervised learning for medical image analysis using image context restoration > Related work
What the sources say
- Not checked yetcites Pathak et al., 2016
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
In the paper
“In case of subsequent classification tasks, simple CNN layers with a few deconvolution layers are sufficient (see Fig. 3) (Doersch and Zisserman, 2017). In this condition, the analysis part makes most contributions to the context restoration. Therefore, the feature maps resulting from the analysis part are more useful.”
§ Self-supervised learning for medical image analysis using image context restoration > Self-supervision based on context restoration > Network architectures
What the sources say
- Not checked yetcites Doersch and Zisserman, 2017
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This may because the augmented images do not cover the variance of organ shapes and positions and introduce additional variance to pixel intensities.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Abdominal multi-organ localization
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“The disadvantage of multi-task self-supervised learning is the training requires significant computational resources, i.e. 64 GPUs for approximately 16.8K GPU hours.”
§ Self-supervised learning for medical image analysis using image context restoration > Related work
What the sources say
- Not checked yetcites Doersch and Zisserman, 2017
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
In the paper
“In many medical image analysis problems, localization anatomical structures is a prerequisite.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Abdominal multi-organ localization
What the sources say
- Not checked yetcites Heimann et al., 2009 source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“As suggested by Pathak et al. (2016), the L2 loss is sufficient for feature learning although the outputs from context restoration outputs may be blurry.”
§ Self-supervised learning for medical image analysis using image context restoration > Self-supervision based on context restoration > Network architectures
What the sources say
- Not checked yetcites Pathak et al., 2016
hedgeddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In this scenario, the baseline (i.e. random initialisation) is not far away from the ceiling (i.e. SonoNet on the whole training set). Therefore, it is difficult to obtain improvements.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Fetal standard scan plane classification
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
In the paper
“de Vos et al. (2017) proposed a novel approach which can localize anatomical structures in 3D medical images.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Abdominal multi-organ localization
What the sources say
- Not checked yetcites de Vos et al., 2017 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
In the paper
“The results showed that multitask self-supervised learning improves subsequent tasks more than single-task self-supervised learning.”
§ Self-supervised learning for medical image analysis using image context restoration > Related work
What the sources say
- Not checked yetcites Doersch and Zisserman, 2017
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“However, existing self-supervised learning strategies applicable to medical images cannot result in significant performance improvement. Therefore, they often lead to only marginal improvements.”
§ Self-supervised learning for medical image analysis using image context restoration > Abstract
What the sources say
- Not checked yetcites Doersch et al., 2015
- Not checked yetcites Pathak et al., 2016
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the CNNs for context restoration can be structured in flexible architectures depending on subsequent tasks.”
§ Self-supervised learning for medical image analysis using image context restoration > Discussion and conclusion
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
In the paper
“They are routinely assessed using MR imaging (Bakas et al., 2017b).”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Brain tumour segmentation
What the sources say
- Not checked yetcites Bakas et al., 2017b
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“In computer vision, many CNNs are pretrained before the main task.”
§ Self-supervised learning for medical image analysis using image context restoration > Discussion and conclusion
What the sources say
- Not checked yetcites Ren et al., 2015
- Not checked yetcites Simonyan and Zis-serman, 2014
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“the implementation of the context restoration task is simple and straightforward, meaning that it can be widely used.”
§ Self-supervised learning for medical image analysis using image context restoration > Discussion and conclusion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“2) The augmentation does not introduce any more useful variance in terms of tumour appearance.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Brain tumour segmentation
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“3) The augmentation introduces additional intensity variations which are not meaningful.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Brain tumour segmentation
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
None of the sources cited for this claim have been checked yet.
In the paper
“the Faster R-CNN (Ren et al., 2015) is based on the pretraining of the VGG-Net (Simonyan and Zis-serman, 2014).”
§ Self-supervised learning for medical image analysis using image context restoration > Discussion and conclusion
What the sources say
- Not checked yetcites Ren et al., 2015
- Not checked yetcites Simonyan and Zis-serman, 2014
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“which may because of three reasons: 1) The segmentation is based on patches so a large number of image patches can be sampled.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Brain tumour segmentation
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We conclude from the existing self-supervised feature learning literature that the ideal pretraining task should have similar goal to the subsequent task.”
§ Self-supervised learning for medical image analysis using image context restoration > Discussion and conclusion
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper may give no reason why it holds.
In the paper
“This type of pretraining leads to good detection results in the Faster R-CNN.”
§ Self-supervised learning for medical image analysis using image context restoration > Discussion and conclusion
What the sources say
- Not checked yetcites Ren et al., 2015
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is noteworthy that if less training data leads to significant decrease of results, self-supervised learning is likely to improve the results significantly.”
§ Self-supervised learning for medical image analysis using image context restoration > Experiments and results > Abdominal multi-organ localization
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“if the reduction of training data causes significant performance decrease, the context restoration pretraining can offer significant performance improvement over the baselines.”
§ Self-supervised learning for medical image analysis using image context restoration > Discussion and conclusion
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Compared with the existing strategies such as relative positions and context prediction, solving the context restoration task requires pattern recognition and prediction, which ensures the context restoration task offers more efficient image semantics.”
§ Self-supervised learning for medical image analysis using image context restoration > Discussion and conclusion
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds.
The paper relies on this without support.
Training CNNs only using a small number of labelled images cannot always achieve satisfactory results and does not exploit the potentially large number of unlabelled images that may be available.
“Training CNNs only using the small number of labelled images cannot always achieve satisfactory results and does not exploit the potentially large number of unlabelled images that may be available.”
The paper relies on this without support.
It is usually easier to access a large number of unlabelled medical images rather than a large number of annotated images.
“This means it is usually easier to access a large number of unlabelled medical images rather than a large number of annotated images.”
The paper relies on this without support.
In medical imaging, most images are in greyscale so that no colour information is available.
“In medical imaging, most images are in greyscale so that no colour information is available.”
The paper relies on this without support.
The key challenge for self-supervised learning is identifying a suitable self-supervision task, i.e. generating input and output instance pairs from data.
“The key challenge for self-supervised learning is identifying a suitable self supervision task, i.e. generating input and out-put instance pairs from data.”
The paper relies on this without support.
Manual cropping requires expert knowledge and is costly.
“However, manual cropping requires expert knowledge and costly.”
The paper relies on this without support.
Not all patients have two kidneys.
“This is because not all patients have two kidneys.”
The paper relies on this without support.
Gliomas are the major brain tumours occurring in adults.
“Gliomas are the major brain tumours occurring in adults.”
The paper relies on this without support.
Accurate segmentation of gliomas on MR image is a key step for quantification.
“Accurate segmentation of gliomas on MR image is a key step for quantification.”
The paper relies on this without support.
In medical image analysis, the image context is the common feature for classification, localization/detection, and segmentation tasks.
“Particularly, in medical image analysis, the image context is the common feature for classification, localization/detection, and segmentation tasks.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Self-supervised learning for medical image analysis using image context restoration > Self-supervision based on context restoration > Context restoration
“a new dataset (1)χ˜=f(χ˜) is generated.”
§ Self-supervised learning for medical image analysis using image context restoration > Self-supervision based on context restoration > Context restoration
“xi=g(x˜i)=f−1(x˜i)”
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Densely Connected Convolutional Networks
Huang, G., Liu, Z., van der Maaten, L., & Weinberger, K. Q. (2016) · arXiv · doi:10.48550/arxiv.1608.06993 · Cited by 48,960
Densely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
Cited by
Sorted by citations
Items 101–200 of 573
Yang, P., Yin, X., Lu, H., Hu, Z., Zhang, X., Jiang, R., & Lv, H. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102539 · Cited by 50
Identification of Dental Implant Systems Using a Large-Scale Multicenter Data Set
Park, W., Schwendicke, F., Krois, J., Huh, J.-K., & Lee, J. (2023) · Journal of Dental Research · doi:10.1177/00220345231160750 · Cited by 49
Self-supervised learning framework application for medical image analysis: a review and summary
Zeng, X., Abdullah, N., & Sumari, P. (2024) · BioMedical Engineering OnLine · doi:10.1186/s12938-024-01299-9 · Cited by 54
A descriptive framework for the field of deep learning applications in medical images
Tian, Y., & Fu, S. (2020) · Knowledge-Based Systems · doi:10.1016/j.knosys.2020.106445 · Cited by 45
Self-Supervised Learning Based on Spatial Awareness for Medical Image Analysis
Nguyen, X.-B., Lee, G.-S., Kim, S.-H., & Yang, H.-J. (2020) · IEEE Access · doi:10.1109/access.2020.3021469 · Cited by 48
Guest Editorial Annotation-Efficient Deep Learning: The Holy Grail of Medical Imaging
Tajbakhsh, N., Roth, H. R., Terzopoulos, D., & Liang, J. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3089292 · Cited by 43
A Review of Self-supervised Learning Methods in the Field of Medical Image Analysis
Xu, J. (2021) · International Journal of Image Graphics and Signal Processing · doi:10.5815/ijigsp.2021.04.03 · Cited by 42
CheSS: Chest X-Ray Pre-trained Model via Self-supervised Contrastive Learning
Cho, K., Kim, K., Nam, Y., Jeong, J., Kim, J., Choi, C., Lee, S., Lee, J. S., Woo, S., Hong, G.-S., et al. (2023) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-023-00782-4 · Cited by 42
Liver tumor segmentation using 2.5D UV-Net with multi-scale convolution
Zhang, C., Hua, Q., Chu, Y., & Wang, P. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104424 · Cited by 43
Multi-Scale Variational Graph AutoEncoder for Link Prediction
Guo, Z., Wang, F., Yao, K., Liang, J., & Wang, Z. (2022) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3488560.3498531 · Cited by 42
Upadhyay, A. K., & Bhandari, A. K. (2023) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-023-10028-9 · Cited by 45
Self-supervised 3D anatomy segmentation using self-distilled masked image transformer (SMIT)
Jiang, J., Tyagi, N., Tringale, K., Crane, C., & Veeraraghavan, H. (2022) · International Conference on Medical Image Computing and Computer-Assisted Intervention · doi:10.1007/978-3-031-16440-8_53 · Cited by 70
Medical Transformer: Universal Encoder for 3-D Brain MRI Analysis
Jun, E., Jeong, S., Heo, D.-W., & Suk, H. (2023) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2023.3308712 · Cited by 82
Chitkeshwar, A. K. (2024) · Archives of Computational Methods in Engineering · doi:10.1007/s11831-024-10117-3 · Cited by 48
FCOD: Fast COVID-19 Detector based on deep learning techniques
Panahi, A. H., Rafiei, A., & Rezaee, A. (2020) · Informatics in Medicine Unlocked · doi:10.1016/j.imu.2020.100506 · Cited by 40
Identification of Tumor-Specific MRI Biomarkers Using Machine Learning (ML)
Hajjo, R., Sabbah, D. A., Bardaweel, S. K., & Tropsha, A. (2021) · Diagnostics · doi:10.3390/diagnostics11050742 · Cited by 38
Self-Supervised Tumor Segmentation With Sim2Real Adaptation
Zhang, X., Xie, W., Huang, C., Zhang, Y., Chen, X., Tian, Q. C., & Wang, Y. (2023) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2023.3240844 · Cited by 48
Mazher, M., Razzak, I., Qayyum, A., Tanveer, M., Beier, S., Khan, T. M., & Niederer, S. (2024) · Information Fusion · doi:10.1016/j.inffus.2024.102256 · Cited by 41
Multimodal image encoding pre-training for diabetic retinopathy grading
Hervella, Á. S., Rouco, J., Novo, J., & Ortega, M. (2022) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2022.105302 · Cited by 39
A Web-Based Automated Image Processing Research Platform for Cochlear Implantation-Related Studies
Margeta, J., Hussain, R., Diez, P. L., Morgenstern, A., Demarcy, T., Wang, Z., Gnansia, D., Manzanera, O. M., Vandersteen, C., Delingette, H., et al. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11226640 · Cited by 37
Lacroix, M., Aouad, T., Feydy, J., Biau, D. J., Larousserie, F., Fournier, L. S., & Feydy, A. (2022) · Diagnostic and Interventional Imaging · doi:10.1016/j.diii.2022.10.004 · Cited by 36
Extending and Analyzing Self-supervised Learning Across Domains
Wallace, B., & Hariharan, B. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58574-7_43 · Cited by 35
Self-supervised Contrastive Learning of Multi-view Facial Expressions
Roy, S., & Etemad, A. (2021) · INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · doi:10.1145/3462244.3479955 · Cited by 35
Graph Neural Networks: A bibliometrics overview
Keramatfar, A., Rafiee, M., & Amirkhani, H. (2022) · Machine Learning with Applications · doi:10.1016/j.mlwa.2022.100401 · Cited by 39
auto SMIM: Automatic Superpixel-Based Masked Image Modeling for Skin Lesion Segmentation
Wang, Z., Lyu, J., & Tang, X. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3290700 · Cited by 35
Pseudo-Data Based Self-Supervised Federated Learning for Classification of Histopathological Images
Zhang, Y., Li, Z., Han, X., Ding, S., Li, J., Wang, J., Ying, S., & Shi, J. (2023) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2023.3323540 · Cited by 36
Mohammad‐Rahimi, H., Dianat, O., Abbasi, R., Zahedrozegar, S., Ashkan, A., Motamedian, S. R., Rohban, M. H., & Nosrat, A. (2023) · Journal of Endodontics · doi:10.1016/j.joen.2023.11.004 · Cited by 39
Self-supervised multi-task learning for medical image analysis
Yu, H., & Dai, Q. (2024) · Pattern Recognition · doi:10.1016/j.patcog.2024.110327 · Cited by 34
Chanti, D. A., Duque, V. G., Crouzier, M., Nordez, A., Lacourpaille, L., & Mateus, D. (2021) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2021.3058303 · Cited by 35
Self-Supervised Learning Methods for Label-Efficient Dental Caries Classification
Taleb, A., Rohrer, C., Bergner, B., Leon, G. D., Rodrigues, J. A., Schwendicke, F., Lippert, C., & Krois, J. (2022) · Diagnostics · doi:10.3390/diagnostics12051237 · Cited by 34
Self-supervised learning for medical image analysis: Discriminative, restorative, or adversarial?
Haghighi, F., Taher, M. R. H., Gotway, M. B., & Liang, J. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103086 · Cited by 41
Pérez‐García, F., Dorent, R., Rizzi, M., Cardinale, F., Frazzini, V., Navarro, V., Essert, C., Ollivier, I., Vercauteren, T. K., Sparks, R. E., et al. (2021) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-021-02420-2 · Cited by 33
Addressing Class Imbalance in Semi-supervised Image Segmentation: A Study on Cardiac MRI
Basak, H., Ghosal, S., & Sarkar, R. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16452-1_22 · Cited by 33
Self-supervised learning with self-distillation on COVID-19 medical image classification
Tan, Z., Yu, Y., Meng, J., Liu, S., & Li, W. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107876 · Cited by 35
Self Context and Shape Prior for Sensorless Freehand 3D Ultrasound Reconstruction
Luo, M., Yang, X., Huang, X., Huang, Y., Zou, Y., Hu, X., Ravikumar, N., Frangi, A. F., & Ni, D. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87231-1_20 · Cited by 32
Artificial Intelligence Methodologies for Data Management
Serey, J., Quezada, L., Alfaro, M. D., Fuertes, G., Vargas, M., Ternero, R., Sabattin, J., Durán, C., & Gutiérrez, S. (2021) · Symmetry · doi:10.3390/sym13112040 · Cited by 31
Pre-training in Medical Data: A Survey
Qiu, Y., Lin, F., Chen, W., & Xu, M. (2023) · Machine Intelligence Research · doi:10.1007/s11633-022-1382-8 · Cited by 30
Targeted Self Supervision For Classification On A Small Covid-19 Ct Scan Dataset
Ewen, N., & Khan, N. (2021) · 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi48211.2021.9434047 · Cited by 29
On the use of contrastive learning for standard-plane classification in fetal ultrasound imaging
Migliorelli, G., Fiorentino, M. C., Cosmo, M. D., Villani, F. P., Mancini, A., & Moccia, S. (2024) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2024.108430 · Cited by 31
Medical image foundation models in assisting diagnosis of brain tumors: a pilot study
Chen, M., Zhang, M., Yin, L., Ma, L., Ding, R., Zheng, T., Yue, Q., Lui, S., & Sun, H. (2024) · European Radiology · doi:10.1007/s00330-024-10728-1 · Cited by 32
Prompt tuning for parameter-efficient medical image segmentation
Fischer, M., Bartler, A., & Yang, B. (2023) · Medical Image Analysis · doi:10.1016/j.media.2023.103024 · Cited by 38
Anatomy-aware self-supervised learning for anomaly detection in chest radiographs
Sato, J., Suzuki, Y., Wataya, T., Nishigaki, D., Kita, K., Yamagata, K., Tomiyama, N., & Kido, S. (2023) · iScience · doi:10.1016/j.isci.2023.107086 · Cited by 38
Jiang, Y., Sun, M., Guo, H., Bai, X.-Y., Yan, K., Lu, L., & Xu, M.-F. (2023) · IEEE International Conference on Computer Vision · doi:10.1109/iccv51070.2023.01453 · Cited by 44
Khatri, U., & Kwon, G. (2023) · Bioengineering · doi:10.3390/bioengineering10101225 · Cited by 28
Fischer, M., Hepp, T., Gatidis, S., & Yang, B. (2023) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2022.102174 · Cited by 27
Listen2YourHeart: A Self-Supervised Approach for Detecting Murmur in Heart-Beat Sounds
Ballas, A., Papapanagiotou, V., Delopoulos, A. N., & Diou", C. (2022) · Computing in cardiology · doi:10.22489/cinc.2022.298 · Cited by 27
Self-supervised Training of Graph Convolutional NetworksPreprint
Zhu, Q., Du, B., & Yan, P. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.02380 · Cited by 27
How Transferable Are Self-supervised Features in Medical Image Classification Tasks?Preprint
Truong, T., Mohammadi, S., & Lenga, M. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.10048 · Cited by 32
Rethinking masked image modelling for medical image representation
Xie, Y., Gu, L., Harada, T., Zhang, J., Xia, Y., & Wu, Q. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103304 · Cited by 30
CAiD: Context-Aware Instance Discrimination for Self-supervised Learning in Medical Imaging
Taher, M. R. H., Haghighi, F., Gotway, M. B., & Liang, J. (2022) · PubMed · doi:10.48550/arxiv.2204.07344 · Cited by 26
Wang, Y., Song, D., Wang, W., Rao, S., Wang, X., & Wang, M. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.09.097 · Cited by 28
Remotely Sensed Crop Disease Monitoring by Machine Learning Algorithms: A Review
Zhang, T., Cai, Y., Zhuang, P., & Li, J. (2023) · Unmanned Systems · doi:10.1142/s2301385024500237 · Cited by 28
Wang, Q., Chen, K., Dou, W., & Ma, Y. (2023) · IEEE Transactions on Computational Biology and Bioinformatics · doi:10.1109/tcbb.2023.3246979 · Cited by 29
Beyond Gradients: Exploiting Adversarial Priors in Model Inversion Attacks
Usynin, D., Rueckert, D., & Kaissis, G. A. (2023) · ACM Transactions on Privacy and Security · doi:10.1145/3592800 · Cited by 26
Self-citationA survey on self-supervised methods for visual representation learning
Uelwer, T., Robine, J., Wagner, S. S., Höftmann, M., Upschulte, E., Konietzny, S. G., Behrendt, M., & Stefan Harmeling, B. (2025) · Machine Learning · doi:10.1007/s10994-024-06708-7 · Cited by 61
Deep convolutional neural networks for COVID‐19 automatic diagnosis
Emara, H. M., Shoaib, M. R., Elwekeil, M., El‐Shafai, W., Taha, T. E., El‐Fishawy, A. S., El‐Rabaie, E. M., Alshebeili, S. A., Dessouky, M. I., & El‐Samie, F. E. A. (2021) · Microscopy Research and Technique · doi:10.1002/jemt.23713 · Cited by 25
Deep learning based domain adaptation for mitochondria segmentation on EM volumes
Franco-Barranco, D., Pastor-Tronch, J., González-Marfil, A., Muñoz‐Barrutia, A., & Arganda‐Carreras, I. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.106949 · Cited by 27
Zheng, R., Zhong, Y. Y., Yan, S., Sun, H., Shen, H., & Huang, K. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3204551 · Cited by 25
Dominic, J., Bhaskhar, N., Desai, A., Schmidt, A. M., Rubin, E., Gunel, B., Gold, G. E., Hargreaves, B. A., Lenchik, L., Boutin, R. D., et al. (2023) · Bioengineering · doi:10.3390/bioengineering10020207 · Cited by 27
Torop, M., Kothapalli, S. V. V. N., Sun, Y., Liu, J., Kahali, S., Yablonskiy, D. A., & Kamilov, U. S. (2020) · Magnetic Resonance in Medicine · doi:10.1002/mrm.28344 · Cited by 24
TATL: Task agnostic transfer learning for skin attributes detection
Nguyen, M.-D., Nguyen, T., Vu, H., Pham, Q., Nguyen, M.-D., Nguyen, B. T., & Sonntag, D. (2022) · Medical Image Analysis · doi:10.1016/j.media.2022.102359 · Cited by 24
Wang, Y., Jiang, C., Wu, Y., Lv, T., Sun, H., Liu, Y., Li, L., & Pan, X. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3205167 · Cited by 24
Cai, Z., Li, L., He, H., & Tang, X. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16452-1_9 · Cited by 26
Learning to segment images with classification labels
Ciga, O., & Martel, A. L. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101912 · Cited by 27
Zheng, H., Han, J., Wang, H., Yang, L., Zhao, Z., Wang, C., & Chen, D. Z. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-87193-2_59 · Cited by 23
Gait Recognition with Self-Supervised Learning of Gait Features Based on Vision Transformers
Pinčić, D., Sušanj, D., & Lenac, K. (2022) · Sensors · doi:10.3390/s22197140 · Cited by 23
Context Matters: Graph-based Self-supervised Representation Learning for Medical Images
Sun, L., Yu, K., & Batmanghelich, K. N. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i6.16620 · Cited by 22
Früh, M., Kuestner, T., Nachbar, M., Thorwarth, D., Schilling, A., & Gatidis, S. (2022) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2022.107085 · Cited by 22
Wang, B., Li, Q., & You, Z. (2022) · Neurocomputing · doi:10.1016/j.neucom.2022.12.028 · Cited by 22
Zhang, S., Li, Z., Zhou, H.-Y., Ma, J., & Yu, Y. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.01.012 · Cited by 22
Self-Supervised Interactive Embedding for One-Shot Organ Segmentation
Yang, Y., Wang, B., Zhang, D., Yuan, Y., Yan, Q., Zhao, S., You, Z., & Han, J. (2023) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2023.3265033 · Cited by 23
Li, F., Li, P., Wu, X., Zeng, P., Lyu, G., Fan, Y., Liu, P., Song, H., & Liu, Z. (2023) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2023.107741 · Cited by 22
Medical Image Analysis Through Deep Learning Techniques: A Comprehensive Survey
Balasamy, K., Seethalakshmi, V., & Suganyadevi, S. (2024) · Wireless Personal Communications · doi:10.1007/s11277-024-11428-1 · Cited by 39
Domain adaptation and self-supervised learning for surgical margin detection
Santilli, A., Jamzad, A., Sedghi, A., Kaufmann, M., Logan, K., Wallis, J., Ren, K. Y. M., Janssen, N. N. Y., Merchant, S. J., Engel, J., et al. (2021) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-021-02381-6 · Cited by 22
Self-supervised multimodal reconstruction pre-training for retinal computer-aided diagnosis
Hervella, Á. S., Rouco, J., Novo, J., & Ortega, M. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115598 · Cited by 24
Liu, C., Qiao, M., Jiang, F., Guo, Y., Jin, Z., & Wang, Y. (2021) · Medical Physics · doi:10.1002/mp.15172 · Cited by 22
Chen, K., Wang, Q., & Ma, Y. (2022) · Medical Physics · doi:10.1002/mp.15630 · Cited by 21
Du, X., & Liu, Y. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2021.3126874 · Cited by 21
Learning‐based motion artifact removal networks for quantitative R2∗ mapping
Xu, X., Kothapalli, S. V. V. N., Liu, J., Kahali, S., Gan, W., Yablonskiy, D. A., & Kamilov, U. S. (2022) · Magnetic Resonance in Medicine · doi:10.1002/mrm.29188 · Cited by 21
Chen, W., Li, C., Chen, D., & Luo, X. (2023) · Neural Networks · doi:10.1016/j.neunet.2023.09.001 · Cited by 22
Xu, Z., Rittscher, J., & Ali, S. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3411933 · Cited by 20
Ye, Y., Zhang, J., Chen, Z., & Xia, Y. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3431916 · Cited by 20
Gomaa, A., Huang, Y., Stephan, P., Breininger, K., Frey, B., Doerfler, A., Schnell, O., Delev, D., Coras, R., Donaubauer, A.-J., et al. (2025) · Scientific Reports · doi:10.1038/s41598-025-02026-7 · Cited by 20
Incidental detection of prostate cancer with computed tomography scans
Korevaar, S., Tennakoon, R., Page, M., Brotchie, P., Thangarajah, J., Florescu, C., Sutherland, T., Kam, N. M., & Bab‐Hadiashar, A. (2021) · Scientific Reports · doi:10.1038/s41598-021-86972-y · Cited by 20
Lam, C., Tso, C. F., Green‐Saxena, A., Pellegrini, E., Iqbal, Z., Evans, D., Hoffman, J. L., Calvert, J. S., Mao, Q., & Das, R. (2021) · JMIR Formative Research · doi:10.2196/28028 · Cited by 20
Task-Oriented Self-supervised Learning for Anomaly Detection in Electroencephalography
Zheng, Y., Liu, Z., Mo, R., Chen, Z., Zheng, W., & Wang, R. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16452-1_19 · Cited by 20
Generating and Weighting Semantically Consistent Sample Pairs for Ultrasound Contrastive Learning
Chen, Y., Zhang, C., Ding, C. H. Q., & Liu, L. (2022) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2022.3228254 · Cited by 20
An image registration-based self-supervised Su-Net for carotid plaque ultrasound image segmentation
Ding, J., Zhou, R., Fang, X., Wang, F., Wang, J., Gan, H., & Fenster, A. (2023) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2023.107957 · Cited by 20
Chauhan, A. S., Singh, J., Kumar, S., Saxena, N., Gupta, M., & Verma, P. (2024) · Journal of Integrated Science and Technology · doi:10.62110/sciencein.jist.2024.v12.793 · Cited by 20
Explainable AI in Deep Learning Based Classification of Fetal Ultrasound Image Planes
Harikumar, A., Surendran, S., & Gargi, S. (2024) · Procedia Computer Science · doi:10.1016/j.procs.2024.03.291 · Cited by 23
Self-Supervision vs. Transfer Learning: Robust Biomedical Image Analysis Against Adversarial Attacks
Anand, D., Tank, D. M., Tibrewal, H., & Sethi, A. (2020) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi45749.2020.9098369 · Cited by 20
Artificial intelligence in abdominal and pelvic ultrasound imaging: current applications
Cai, L., & Pfob, A. (2024) · Abdominal Radiology · doi:10.1007/s00261-024-04640-x · Cited by 19
Deep Learning in Digital Breast Tomosynthesis: Current Status, Challenges, and Future Trends
Wang, R., Chen, F., Chen, H., Lin, C. X., Shuai, J., Wu, Y., Ma, L., Hu, X., Wu, M. H., Wang, J., et al. (2025) · MedComm · doi:10.1002/mco2.70247 · Cited by 22
Boundary-aware information maximization for self-supervised medical image segmentation
Peng, J., Wang, P., Pedersoli, M., & Desrosiers, C. (2024) · Medical Image Analysis · doi:10.1016/j.media.2024.103150 · Cited by 22
Peña‐Solórzano, C. A., Albrecht, D. W., Bassed, R., Burke, M. D., & Dimmock, M. (2020) · Forensic Science International · doi:10.1016/j.forsciint.2020.110538 · Cited by 19
An Evaluation of Self-supervised Pre-training for Skin-Lesion Analysis
Chaves, L., Bissoto, A. E., Junior, E. A. D. V., & Avila, S. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-25069-9_11 · Cited by 23
Spatiotemporal Contrastive Learning of Facial Expressions in Videos
Roy, S., & Etemad, A. (2021) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii52823.2021.9597460 · Cited by 18
Free Lunch for Surgical Video Understanding by Distilling Self-supervisions
Ding, X., Liu, Z., & Li, X. (2022) · Lecture notes in computer science · doi:10.1007/978-3-031-16449-1_35 · Cited by 18
Cai, Z., Lin, L., He, H., Cheng, P., & Tang, X. (2024) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2024.3422102 · Cited by 18
Self-Supervised Bi-Channel Transformer Networks for Computer-Aided Diagnosis
Gong, R., Han, X., Wang, J., Ying, S., & Shi, J. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3153902 · Cited by 18
Metadata
- Authors
- Chen, L., Bentley, P., Mori, K., Misawa, K., Fujiwara, M., & Rueckert, D.
- Affiliations
- Imperial College London (GB)
- Nagoya University (JP)
- Aichi Cancer Center (JP)
- Nagoya University Hospital (JP)
- Corresponding author
- Chen, Liang
- Venue
- Medical Image Analysis
- Publisher
- Elsevier BV
- Published
- 2019-12
- Volume
- 58
- Pages
- 101539
- ISSN
- 1361-8415 (ISSN-L)
- PMC
- PMC7613987
- OpenAlex
- W2964744899
- Semantic Scholar
- d6e78069dbbb35592f013187ef3432286def8f18
- Cited by
- 575
- References
- 73
- Citations by year
- 2026: 44 · 2025: 85 · 2024: 99 · 2023: 133 · 2022: 105 · 2021: 74 · 2020: 34 · 2019: 1
- FWCI
- 24.53
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Medical Image Analysis (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Spiral (Imperial College London) (submittedVersion, cc-by-nc-nd)
- Funders
- Wellcome Trust (102431)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Medical Image Segmentation Techniques
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Keywords
- self-supervised learning, unlabeled data, CT images, brain tumor segmentation, multimodal MRI, image classification, image localization, image segmentation
- MeSH terms
- Abdomen, Supervised Machine Learning, Brain Neoplasms, Humans, Magnetic Resonance Imaging, Tomography, X-Ray Computed, Ultrasonography, Prenatal
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
