Analysis of the Human Protein Atlas Image Classification competition
Open accessThe DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Pinpointing subcellular protein localizations from microscopy images is easy to the trained eye, but challenging to automate. Based on the Human Protein Atlas image collection, we held a competition to identify deep learning solutions to solve this task. Challenges included training on highly imbalanced classes and predicting multiple labels per image. Over 3 months, 2,172 teams participated. Despite convergence on popular networks and training techniques, there was considerable variety among the solutions. Participants applied strategies for modifying neural networks and loss functions, augmenting data and using pretrained networks. The winning models far outperformed our previous effort at multi-label classification of protein localization patterns by ~20%. These models can be used as classifiers to annotate new images, feature extractors to measure pattern similarity or pretrained networks for a wide range of biological applications.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474 · cited 3×
“Both Team 1 and 5 found DenseNet 20 to be more effective than Resnet 19 in terms of neural network architecture.”
BackgroundMethodVery Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148 · cited 2×
“3–11).”
MethodU-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 2×
“Deep neural networks, particularly convolutional neural networks (CNNs) 8 , have been widely applied to perform computer vision tasks such as image classification 11,12 and segmentation 13 .”
BackgroundMethodDensely Connected Convolutional Networks
Huang, G., Liu, Z., Van Der Maaten, L., & Weinberger, K. Q. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.243 · Cited by 48,566
ImageNet Large Scale Visual Recognition Challenge
Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., Bernstein, M., et al. (2015) · International Journal of Computer Vision · doi:10.1007/s11263-015-0816-y · Cited by 39,380
(2014) · Cited by 33,419
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Research works printed but not linked: 1
- Yosinski, J., Clune, J., Bengio, Y. & Lipson, H. How transferable are features in deep neural networks? in Advances in Neural Information Processing Systems Vol. 27 (eds Ghahramani, Z. et al.) 3320–3328 (Curran Associates, Inc., 2014).
Cited by
OpenCell: Endogenous tagging for the cartography of human cellular organization
Cho, N. H., Cheveralls, K. C., Brunner, A.-D., Kim, K., Michaelis, A. C., Raghavan, P., Kobayashi, H., Savy, L., Li, J. Y., Canaj, H., et al. (2022) · Science · doi:10.1126/science.abi6983 · Cited by 567
“Although expert annotation remains the best-performing strategy to curate protein localization ( 49 , 50 ), the low-dimensional description it allows is not well suited for quantitative comparisons.”
BackgroundMethodSegment Anything for Microscopy
Archit, A., Freckmann, L., Nair, S., Khalid, N., Hilt, P., Rajashekar, V., Freitag, M., Teuber, C., Spitzner, M., Tapia Contreras, C., et al. (2025) · Nature Methods · doi:10.1038/s41592-024-02580-4 · Cited by 307
“Figure 2a shows the mean segmentation accuracy 27 (higher is better; see the Methods for details) for the default and LIVECell specialist model, using a separate test set for evaluation.”
The Human Protein Atlas—Spatial localization of the human proteome in health and disease
Digre, A., & Lindskog, C. (2021) · Protein Science · doi:10.1002/pro.3987 · Cited by 244
A high-stringency blueprint of the human proteome
Adhikari, S., Nice, E. C., Deutsch, E. W., Lane, L., Omenn, G. S., Pennington, S. R., Paik, Y.-K., Overall, C. M., Corrales, F. J., Cristea, I. M., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-19045-9 · Cited by 210
Self-citationMacromolecular condensation organizes nucleolar sub-phases to set up a pH gradient
King, M. R., Ruff, K. M., Lin, A. Z., Pant, A., Farag, M., Lalmansingh, J. M., Wu, T., Fossat, M. J., Ouyang, W., Lew, M. D., et al. (2024) · Cell · doi:10.1016/j.cell.2024.02.029 · Cited by 198
“80 For subcellular location, the human protein atlas field category Subcellular location (ICC) was used to extract the accessions of nuclear speckles IDRs, Nuclear bodies IDRs, FC/DFC (Nucleoli fibrillar center) IDRs, and GC (Nucleoli) IDRs.”
MethodSelf-citation
Metadata
- Authors
- Ouyang, W., Winsnes, C. F., Hjelmare, M., Cesnik, A. J., Åkesson, L., Xu, H., Sullivan, D. P., Dai, S., Lan, J., Jinmo, P., Galib, S. M., Henkel, C., Hwang, K., Poplavskiy, D., Tunguz, B., Wolfinger, R. D., Gu, Y., Li, C., Xie, J., Buslov, D., Fironov, S., Kiselev, A., Panchenko, D., Cao, X., Wei, R., Wu, Y., Zhu, X., Tseng, K.-L., Gao, Z., Ju, C., Yi, X., Zheng, H., Kappel, C., & Lundberg, E.
- Affiliations
- Science for Life Laboratory (SE)
- Chan Zuckerberg Biohub San Francisco (US)
- Winning Health Technology Group (China) (CN)
- Missouri University of Science and Technology (US)
- Qualcomm (United States) (US)
- SAS Institute (United States) (US)
- Jilian Technology Group (China) (CN)
- BDO Unicon (Russia) (RU)
- Kharkiv National University of Radio Electronics (UA)
- The University of Texas MD Anderson Cancer Center (US)
- University of Hawaii Cancer Center (US)
- Microsoft Research Asia (China) (CN)
- University of California, Berkeley (US)
- Peking University (CN)
- Leica Microsystems (Germany) (DE)
- Corresponding author
- Lundberg, Emma
- ORCID
- Venue
- Nature Methods
- Published
- 2019-11-28
- Volume
- 16
- Issue
- 12
- Pages
- 1254-1261
- ISSN
- 1548-7091 (ISSN-L)
- 1548-7105
- PMC
- PMC6976526
- OpenAlex
- W2991083105
- Semantic Scholar
- 972d5fd56d8fc554a9a1c01077dd2eb68c51532d
- Cited by
- 131
- References
- 49
- Citations by year
- 2026: 10 · 2025: 21 · 2024: 21 · 2023: 14 · 2022: 29 · 2021: 23 · 2020: 12
- FWCI
- 7.75
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Nature Methods (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- Knut och Alice Wallenbergs Stiftelse (2016.0204)
- Familjen Erling-Perssons Stiftelse (2017-05327)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Biophysics › Cell Image Analysis Techniques
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Machine Learning in Bioinformatics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Keywords
- subcellular protein localization, microscopy image classification, Human Protein Atlas, multi-label classification, class imbalance, data augmentation, pre-trained neural networks, loss functions
- MeSH terms
- Deep Learning, Humans, Image Processing, Computer-Assisted, Microscopy, Fluorescence, Proteins
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Analysis of the Human Protein Atlas Image Classification competition. https://app.cochat.ai/papers/10.1038/s41592-019-0658-6
- The paper
- Ouyang, W., Winsnes, C. F., Hjelmare, M., Cesnik, A. J., Åkesson, L., Xu, H., Sullivan, D. P., Dai, S., Lan, J., Jinmo, P., Galib, S. M., Henkel, C., Hwang, K., Poplavskiy, D., Tunguz, B., Wolfinger, R. D., Gu, Y., Li, C., Xie, J., . . . Lundberg, E. (2019). Analysis of the Human Protein Atlas Image Classification competition. Nature Methods. https://doi.org/10.1038/s41592-019-0658-6
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.