The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Exascale Deep Learning for Climate Analytics
Abstract
We extract pixel-level masks of extreme weather patterns using variants of Tiramisu and DeepLabv3+ neural networks. We describe improvements to the software frameworks, input pipeline, and the network training algorithms necessary to efficiently scale deep learning on the Piz Daint and Summit systems. The Tiramisu network scales to 5300 P100 GPUs with a sustained throughput of 21.0 PF/s and parallel efficiency of 79.0%. DeepLabv3+ scales up to 27360 V100 GPUs with a sustained throughput of 325.8 PF/s and a parallel efficiency of 90.7% in single precision. By taking advantage of the FP16 Tensor Cores, a half-precision version of the DeepLabv3+ network achieves a peak and sustained throughput of 1.13 EF/s and 999.0 PF/s respectively.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · arXiv · doi:10.48550/arxiv.1802.02611 · Cited by 20,063
Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01234-2_49 · Cited by 20,054
A logical calculus of the ideas immanent in nervous activity
McCulloch, W. S., & Pitts, W. (1943) · The Bulletin of Mathematical Biophysics · doi:10.1007/bf02478259 · Cited by 18,566
The perceptron: A probabilistic model for information storage and organization in the brain.
Rosenblatt, F. (1958) · Psychological Review · doi:10.1037/h0042519 · Cited by 12,280
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules
Gómez-Bombarelli, R., Wei, J. N., Duvenaud, D., Hernández-Lobato, J. M., Sánchez-Lengeling, B., Sheberla, D., Aguilera-Iparraguirre, J., Hirzel, T. D., Adams, R. P., & Aspuru-Guzik, A. (2018) · ACS Central Science · doi:10.1021/acscentsci.7b00572 · Cited by 3,106
The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation
Jegou, S., Drozdzal, M., Vazquez, D., Romero, A., & Bengio, Y. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.156 · Cited by 1,736
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules.
Gómez‐Bombarelli, R., Wei, J. N., Duvenaud, D., Hernández-Lobato, J. M., Sánchez-Lengeling, B., Sheberla, D., Aguilera‐Iparraguirre, J., Hirzel, T. D., Adams, R. P., & Aspuru‐Guzik, A. (2018) · Cambridge University Engineering Department Publications Database · doi:10.17863/cam.34134 · Cited by 1,703
Machine learning at the energy and intensity frontiers of particle physics
Radovic, A., Williams, M., Rousseau, D., Kagan, M., Bonacorsi, D., Himmel, A., Aurisano, A., Terao, K., & Wongjirad, T. (2018) · Nature · doi:10.1038/s41586-018-0361-2 · Cited by 475
Horovod: fast and easy distributed deep learning in TensorFlow
Sergeev, A., & Balso, M. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.05799 · Cited by 472
Large Batch Training of Convolutional Networks
You, Y., Gitman, I., & Ginsburg, B. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.03888 · Cited by 463
Shields, C. A., Rutz, J. J., Leung, L.-Y., Ralph, F. M., Wehner, M., Kawzenuk, B., Lora, J. M., McClenny, E., Osborne, T., Payne, A. E., et al. (2018) · Geoscientific Model Development · doi:10.5194/gmd-11-2455-2018 · Cited by 369
Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets
Liu, Y., Racah, E., Prabhat, Correa, J., Khosrowshahi, A., Lavers, D. A., Kunkel, K. E., Wehner, M. F., & Collins, W. D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.01156 · Cited by 292
Deep neural networks to enable real-time multimessenger astrophysics
George, D., & Huerta, E. A. (2018) · Physical Review D · doi:10.1103/physrevd.97.044039 · Cited by 281
Jia, X., Song, S., He, W., Wang, Y., Rong, H., Zhou, F., Xie, L., Guo, Z., Yang, Y., Yu, L.-W., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.11205 · Cited by 281
Extremely Large Minibatch SGD: Training ResNet-50 on ImageNet in 15 Minutes
Akiba, T., Suzuki, S., & Fukuda, K. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.04325 · Cited by 260
CosmoFlow: Using Deep Learning to Learn the Universe at Scale
Mathuriya, A., Bard, D., Mendygral, P., Meadows, L., Arnemann, J., Shao, L., He, S., Karna, T., Moise, D., Pennycook, S. J., et al. (2018) · SC18: International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1109/sc.2018.00068 · Cited by 132 · cited 1×
“In recent years, the scientific community has begun to adopt deep learning methods and frameworks as tools for scientific analysis and discovery [13], [14], [15], [16], [17], [18].”
BackgroundSelf-citationLat-Net: Compressing Lattice Boltzmann Flow Simulations using Deep Neural NetworksPreprint
Hennigh, O. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1705.09036 · Cited by 94
A Comprehensive Physics-Informed Machine Learning Framework for Predictive Turbulence ModelingPreprint
Wang, J., Wu, J., Ling, J., Iaccarino, G., & Xiao, H. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.07102 · Cited by 76
TECA: A Parallel Toolkit for Extreme Climate Analysis
Prabhat, Rübel, O., Byna, S., Wu, K. J., Li, F., Wehner, M. F., & Bethel, W. (2012) · Procedia Computer Science · doi:10.1016/j.procs.2012.04.093 · Cited by 62
ChainerMN: Scalable Distributed Deep Learning FrameworkPreprint
Akiba, T., Fukuda, K., & Suzuki, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1710.11351 · Cited by 58
CosmoFlow: Using Deep Learning to Learn the Universe at ScalePreprint
Mathuriya, A., Bard, D., Mendygral, P. J., Meadows, L., Arnemann, J., Shao, L., He, S., Kärnä, T., Moise, D., Pennycook, S. J., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1808.04728 · Cited by 48
TECA: Petascale Pattern Recognition for Climate Science
Prabhat, Byna, S., Vishwanath, V., et al. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-23117-4_37 · Cited by 31
Big Data in Climate: Opportunities and Challenges for Machine Learning
Karpatne, A., & Kumar, V. (2017) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3097983.3105810 · Cited by 23
GlobeNet: Convolutional Neural Networks for Typhoon Eye Tracking from Remote Sensing ImageryPreprint
Hong, S., Kim, S., Joh, M., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.03417 · Cited by 23
Cited by
Physics-informed machine learning
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., & Yang, L. (2021) · Nature Reviews Physics · doi:10.1038/s42254-021-00314-5 · Cited by 8,718
Deep Learning for Spatio-Temporal Data Mining: A Survey
Wang, S., Cao, J., & Yu, P. S. (2022) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2020.3025580 · Cited by 822
WeatherBench: A Benchmark Data Set for Data‐Driven Weather Forecasting
Rasp, S., Dueben, P. D., Scher, S., Weyn, J. A., Mouatadid, S., & Thuerey, N. (2020) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2020ms002203 · Cited by 663
PPINN: Parareal physics-informed neural network for time-dependent PDEs
Meng, X., Li, Z., Zhang, D., & Karniadakis, G. E. (2020) · Computer Methods in Applied Mechanics and Engineering · doi:10.1016/j.cma.2020.113250 · Cited by 654
Graph Neural Controlled Differential Equations for Traffic Forecasting
Choi, J., Choi, H., Hwang, J., & Park, N. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i6.20587 · Cited by 349
Metadata
- Authors
- Kurth, T., Treichler, S., Romero, J., Mudigonda, M., Luehr, N., Phillips, E., Mahesh, A., Matheson, M., Deslippe, J., Fatica, M., Prabhat, P., & Houston, M.
- Venue
- SC18: International Conference for High Performance Computing, Networking, Storage and Analysis
- Publisher
- IEEE
- Published
- 2018-11
- Pages
- 649-660
- ISSN
- 2167-4337 (ISSN-L)
- OpenAlex
- W2952046647
- Cited by
- 278
- References
- 27
- FWCI
- 36.13
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.