The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
1399 H&E-stained sentinel lymph node sections of breast cancer patients: the CAMELYON dataset
Open accessAbstract
Background: The presence of lymph node metastases is one of the most important factors in breast cancer prognosis. The most common way to assess regional lymph node status is the sentinel lymph node procedure. The sentinel lymph node is the most likely lymph node to contain metastasized cancer cells and is excised, histopathologically processed, and examined by a pathologist. This tedious examination process is time-consuming and can lead to small metastases being missed. However, recent advances in whole-slide imaging and machine learning have opened an avenue for analysis of digitized lymph node sections with computer algorithms. For example, convolutional neural networks, a type of machine-learning algorithm, can be used to automatically detect cancer metastases in lymph nodes with high accuracy. To train machine-learning models, large, well-curated datasets are needed. Results: We released a dataset of 1,399 annotated whole-slide images (WSIs) of lymph nodes, both with and without metastases, in 3 terabytes of data in the context of the CAMELYON16 and CAMELYON17 Grand Challenges. Slides were collected from five medical centers to cover a broad range of image appearance and staining variations. Each WSI has a slide-level label indicating whether it contains no metastases, macro-metastases, micro-metastases, or isolated tumor cells. Furthermore, for 209 WSIs, detailed hand-drawn contours for all metastases are provided. Last, open-source software tools to visualize and interact with the data have been made available. Conclusions: A unique dataset of annotated, whole-slide digital histopathology images has been provided with high potential for re-use.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
(2017) · Springer eBooks · doi:10.1007/978-3-319-40618-3 · Cited by 17,242
Siegel, R. L., Miller, K. D., & Jemal, A. (2016) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.21332 · Cited by 16,003
SEER Cancer Statistics Review, 1975-2003
Ries, L. A. G., Harkins, D., Krapcho, M. F., Mariotto, A. B., Miller, B., Feuer, E. J., Clegg, L. X., Eisner, M. P., Horner, M., Howlader, N., et al. (2006) · Digital Archive @ GSU · Cited by 11,775
Edge, S. B., & Compton, C. C. (2010) · Annals of Surgical Oncology · doi:10.1245/s10434-010-0985-4 · Cited by 9,029
Ehteshami Bejnordi, B., Veta, M., Johannes van Diest, P., van Ginneken, B., Karssemeijer, N., Litjens, G., van der Laak, J. A. W. M., and the CAMELYON16 Consortium, Hermsen, M., Manson, Q. F., et al. (2017) · JAMA · doi:10.1001/jama.2017.14585 · Cited by 3,293 · cited 1×
“For example, a comparison of algorithms competing in the CAMELYON16 challenge to pathologists in clinical practice was recently published [29].”
Self-citationGiuliano, A. E. (2011) · JAMA · doi:10.1001/jama.2011.90 · Cited by 2,942
Computer vision and pattern recognition
Zheng, N., Loizou, G., Jiang, X., Lan, X., & Li, X. (2007) · International Journal of Computer Mathematics · doi:10.1080/00207160701303912 · Cited by 2,463
Giuliano, A. E., Ballman, K. V., McCall, L., Beitsch, P. D., Brennan, M. B., Kelemen, P. R., Ollila, D. W., Hansen, N. M., Whitworth, P. W., Blumencranz, P. W., et al. (2017) · JAMA · doi:10.1001/jama.2017.11470 · Cited by 1,912
Cited by
The Future of Digital Health with Federated Learning
Rieke, N., Hancox, J., Li, W., Milletari, F., Roth, H., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B., Maier-Hein, K., et al. (2020) · arXiv · doi:10.48550/arxiv.2003.08119 · Cited by 3,495
The future of digital health with federated learning
Rieke, N., Hancox, J., Li, W., Milletarì, F., Roth, H. R., Albarqouni, S., Bakas, S., Galtier, M. N., Landman, B. A., Maier-Hein, K., et al. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00323-1 · Cited by 4,015
Data-efficient and weakly supervised computational pathology on whole-slide images
Lu, M. Y., Williamson, D. F. K., Chen, T. Y., Chen, R. J., Barbieri, M., & Mahmood, F. (2021) · Nature Biomedical Engineering · doi:10.1038/s41551-020-00682-w · Cited by 2,282
Artificial intelligence in digital pathology — new tools for diagnosis and precision oncology
Bera, K., Schalper, K. A., Rimm, D. L., Velcheti, V., & Madabhushi, A. (2019) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-019-0252-y · Cited by 1,698
Deep learning in histopathology: the path to the clinic
van der Laak, J., Litjens, G., & Ciompi, F. (2021) · Nature Medicine · doi:10.1038/s41591-021-01343-4 · Cited by 902
Self-citationDeep neural network models for computational histopathology: A survey
Srinidhi, C. L., Ciga, O., & Martel, A. L. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101813 · Cited by 749
A Multi-Organ Nucleus Segmentation Challenge
Kumar, N., Verma, R., Anand, D., Zhou, Y., Onder, O. F., Tsougenis, E., Chen, H., Heng, P.-A., Li, J., Hu, Z., et al. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2947628 · Cited by 553
Artificial intelligence and computational pathology
Cui, M., & Zhang, D. Y. (2021) · Laboratory Investigation · doi:10.1038/s41374-020-00514-0 · Cited by 544
Integrating spatial gene expression and breast tumour morphology via deep learning
He, B., Bergenstråhle, L., Stenbeck, L., Abid, A., Andersson, A., Borg, Å., Maaskola, J., Lundeberg, J., & Zou, J. (2020) · Nature Biomedical Engineering · doi:10.1038/s41551-020-0578-x · Cited by 507
Abels, E., Pantanowitz, L., Aeffner, F., Zarella, M. D., van der Laak, J., Bui, M. M., Vemuri, V. N., Parwani, A. V., Gibbs, J., Agosto‐Arroyo, E., et al. (2019) · The Journal of Pathology · doi:10.1002/path.5331 · Cited by 459
Self-citationMeasuring Domain Shift for Deep Learning in Histopathology
Stacke, K., Eilertsen, G., Unger, J., & Lundstrom, C. (2021) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2020.3032060 · Cited by 318
Artificial intelligence in diagnostic pathology
Shafi, S., & Parwani, A. V. (2023) · Diagnostic Pathology · doi:10.1186/s13000-023-01375-z · Cited by 315
Self supervised contrastive learning for digital histopathology
Ciga, O., Xu, T., & Martel, A. L. (2022) · Machine Learning with Applications · doi:10.1016/j.mlwa.2021.100198 · Cited by 294
Ahmad, Z., Rahim, S., Zubair, M., & Abdul-Ghafar, J. (2021) · Diagnostic Pathology · doi:10.1186/s13000-021-01085-4 · Cited by 293
Li, X., Li, C., Rahaman, M. M., Sun, H., Li, X., Wu, J., Yao, Y., & Grzegorzek, M. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10121-0 · Cited by 278
On the challenges and perspectives of foundation models for medical image analysis
Zhang, S., & Metaxas, D. (2024) · Medical Image Analysis · doi:10.1016/j.media.2023.102996 · Cited by 274
Translational AI and deep learning in diagnostic pathology
Serag, A., Ion-Margineanu, A., Qureshi, H., McMillan, R., Saint Martin, M.-J., Diamond, J., O'Reilly, P., & Hamilton, P. (2019) · Frontiers in Medicine · doi:10.3389/fmed.2019.00185 · Cited by 274
Big data in basic and translational cancer research
Jiang, P., Sinha, S., Aldape, K., Hannenhalli, S., Sahinalp, C., & Ruppin, E. (2022) · Nature Reviews Cancer · doi:10.1038/s41568-022-00502-0 · Cited by 254
Benchmarking Self-Supervised Learning on Diverse Pathology Datasets
Kang, M., Song, H., Park, S., Yoo, D., & Pereira, S. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00326 · Cited by 187
Concept attribution: explaining cnn decisions to physicians
M., G., V., A., S., M.-M., & H., M. (2020) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2020.103865 · Cited by 95
Vision transformer-based weakly supervised histopathological image analysis of primary brain tumors
Li, Z., Cong, Y., Chen, X., Qi, J., Sun, J., Yan, T., Yang, H., Liu, J., Lu, E., Wang, L., et al. (2023) · iScience · doi:10.1016/j.isci.2022.105872 · Cited by 82
Multiple Instance Captioning: Learning Representations from Histopathology Textbooks and Articles
Gamper, J., & Rajpoot, N. (2021) · 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr46437.2021.01628 · Cited by 75
Predictive uncertainty estimation for out-of-distribution detection in digital pathology
Linmans, J., Elfwing, S., van der Laak, J., & Litjens, G. (2023) · Medical Image Analysis · doi:10.1016/j.media.2022.102655 · Cited by 75
A systematic collection of medical image datasets for deep learning
Li, J., Zhu, G., Hua, C., Feng, M., BasheerBennamoun, Li, P., Lu, X., Song, J., Shen, P., Xu, X., et al. (2021) · arXiv · doi:10.48550/arxiv.2106.12864 · Cited by 61
Banff Digital Pathology Working Group: Going Digital in Transplant Pathology
Farris, A. B., Moghe, I., Wu, S., Hogan, J., Cornell, L. D., Alexander, M. P., Kers, J., Demetris, A. J., Levenson, R. M., Tomaszewski, J., et al. (2020) · American Journal of Transplantation · doi:10.1111/ajt.15850 · Cited by 48
Multi-modality artificial intelligence in digital pathology
Qiao, Y., Zhao, L., Luo, C., Luo, Y., Wu, Y., Li, S., Bu, D., & Zhao, Y. (2022) · Briefings in Bioinformatics · doi:10.1093/bib/bbac367 · Cited by 44
A review of current systems for annotation of cell and tissue images in digital pathology
Korzynska, A., Roszkowiak, L., Zak, J., & Siemion, K. (2021) · Biocybernetics and Biomedical Engineering · doi:10.1016/j.bbe.2021.04.012 · Cited by 26
van Rijthoven, M., Balkenhol, M., Siliņa, K., van der Laak, J., & Ciompi, F. (2021) · Medical Image Analysis · doi:10.1016/j.media.2020.101890 · Cited by 16
Self-citationImproving Representation Learning for Histopathologic Images with Cluster Constraints
Wu, W., Gao, C., DiPalma, J., Vosoughi, S., & Hassanpour, S. (2023) · 2023 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01957 · Cited by 16
Metadata
- Authors
- Litjens, G., Bandi, P., Ehteshami Bejnordi, B., Geessink, O., Balkenhol, M., Bult, P., Halilovic, A., Hermsen, M., van de Loo, R., Vogels, R., Manson, Q. F., Stathonikos, N., Baidoshvili, A., van Diest, P., Wauters, C., van Dijk, M., & van der Laak, J.
- Venue
- GigaScience
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-05-31
- Volume
- 7
- Issue
- 6
- ISSN
- 2047-217X (ISSN-L)
- OpenAlex
- W2805886241
- Cited by
- 418
- References
- 23
- FWCI
- 17.26
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.