The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
FireWorks: a dynamic workflow system designed for high‐throughput applications
Open accessAbstract
Summary: This paper introduces FireWorks, a workflow software for running high‐throughput calculation workflows at supercomputing centers. FireWorks has been used to complete over 50 million CPU‐hours worth of computational chemistry and materials science calculations at the National Energy Research Supercomputing Center. It has been designed to serve the demanding high‐throughput computing needs of these applications, with extensive support for (i) concurrent execution through job packing, (ii) failure detection and correction, (iii) provenance and reporting for long‐running projects, (iv) automated duplicate detection, and (v) dynamic workflows (i.e., modifying the workflow graph during runtime). We have found that these features are highly relevant to enabling modern data‐driven and high‐throughput science applications, and we discuss our implementation strategy that rests on Python and NoSQL databases (MongoDB). Finally, we present performance data and limitations of our approach along with planned future work. Copyright © 2015 John Wiley & Sons, Ltd.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Commentary: The Materials Project: A materials genome approach to accelerating materials innovation
Jain, A., Ong, S. P., Hautier, G., Chen, W., Richards, W. D., Dacek, S., Cholia, S., Gunter, D., Skinner, D., Ceder, G., et al. (2013) · APL Materials · doi:10.1063/1.4812323 · Cited by 13,094
Self-citationExploring Network Structure, Dynamics, and Function Using NetworkX
Hagberg, A. A., Schult, D. A., & Swart, P. J. (2008) · Proceedings of the Python in Science Conference · doi:10.25080/tcwv9851 · Cited by 7,477
Architectural styles and the design of network-based software architectures
Fielding, R. T., & Taylor, R. N. (2000) · Cited by 5,094
Python Materials Genomics (pymatgen): A robust, open-source python library for materials analysis
Ong, S. P., Richards, W. D., Jain, A., Hautier, G., Kocher, M., Cholia, S., Gunter, D., Chevrier, V. L., Persson, K. A., & Ceder, G. (2013) · Computational Materials Science · doi:10.1016/j.commatsci.2012.10.028 · Cited by 4,534
Self-citationIPython: A System for Interactive Scientific Computing
Perez, F., & Granger, B. E. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.53 · Cited by 4,009
Goecks, J., Nekrutenko, A., Taylor, J., & The Galaxy Team (2010) · Genome Biology · doi:10.1186/gb-2010-11-8-r86 · Cited by 3,453
Python for scientific computing
Oliphant, T. E. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.58 · Cited by 3,303 · cited 1×
“[7]–[9] As a high-level language, Python allows scientists (whose primary background is not in computing) to relatively easily”
BackgroundGlobus: a Metacomputing Infrastructure Toolkit
Foster, I., & Kesselman, C. (1997) · The International Journal of Supercomputer Applications and High Performance Computing · doi:10.1177/109434209701100205 · Cited by 3,133
Advances in methods and algorithms in a modern quantum chemistry program package
Shao, Y., Molnar, L. F., Jung, Y., Kussmann, J., Ochsenfeld, C., Brown, S. T., Gilbert, A. T. B., Slipchenko, L. V., Levchenko, S. V., O’Neill, D. P., et al. (2006) · Phys. Chem. Chem. Phys. · doi:10.1039/b517914a · Cited by 2,799
ABINIT: First-principles approach to material and nanosystem properties
Gonze, X., Amadon, B., Anglade, P.-M., Beuken, J.-M., Bottin, F., Boulanger, P., Bruneval, F., Caliste, D., Caracas, R., Côté, M., et al. (2009) · Computer Physics Communications · doi:10.1016/j.cpc.2009.07.007 · Cited by 2,701
Self-citation
Cited by
MDAnalysis: A Python Package for the Rapid Analysis of Molecular Dynamics Simulations
Gowers, R., Linke, M., Barnoud, J., Reddy, T., Melo, M., Seyler, S., Domański, J., Dotson, D., Buchoux, S., Kenney, I., et al. (2016) · Proceedings of the Python in Science Conference · doi:10.25080/majora-629e541a-00e · Cited by 2,026
Recent developments in the general atomic and molecular electronic structure system
Barca, G. M. J., Bertoni, C., Carrington, L., Datta, D., De Silva, N., Deustua, J. E., Fedorov, D. G., Gour, J. R., Gunina, A. O., Guidez, E., et al. (2020) · The Journal of Chemical Physics · doi:10.1063/5.0005188 · Cited by 1,443
A universal graph deep learning interatomic potential for the periodic table
Chen, C., & Ong, S. P. (2022) · Nature Computational Science · doi:10.1038/s43588-022-00349-3 · Cited by 1,140
Self-citationUnsupervised word embeddings capture latent knowledge from materials science literature
Tshitoyan, V., Dagdelen, J., Weston, L., Dunn, A., Rong, Z., Kononova, O., Persson, K. A., Ceder, G., & Jain, A. (2019) · Nature · doi:10.1038/s41586-019-1335-8 · Cited by 1,123
Self-citationSurface energies of elemental crystals
Tran, R., Xu, Z., Radhakrishnan, B., Winston, D., Sun, W., Persson, K. A., & Ong, S. P. (2016) · Scientific Data · doi:10.1038/sdata.2016.80 · Cited by 1,047
Self-citationPerformance and Cost Assessment of Machine Learning Interatomic Potentials
Zuo, Y., Chen, C., Li, X., Deng, Z., Chen, Y., Behler, J., Csányi, G., Shapeev, A. V., Thompson, A. P., Wood, M. A., et al. (2020) · The Journal of Physical Chemistry A · doi:10.1021/acs.jpca.9b08723 · Cited by 968
Self-citationThe thermodynamic scale of inorganic crystalline metastability
Sun, W., Dacek, S. T., Ong, S. P., Hautier, G., Jain, A., Richards, W. D., Gamst, A. C., Persson, K. A., & Ceder, G. (2016) · Science Advances · doi:10.1126/sciadv.1600225 · Cited by 961
Self-citationTran, K., & Ulissi, Z. W. (2018) · Nature Catalysis · doi:10.1038/s41929-018-0142-1 · Cited by 920
From DFT to machine learning: recent approaches to materials science–a review
Schleder, G. R., Padilha, A. C. M., Acosta, C. M., Costa, M., & Fazzio, A. (2019) · Journal of Physics: Materials · doi:10.1088/2515-7639/ab084b · Cited by 852
Data‐Driven Materials Science: Status, Challenges, and Perspectives
Himanen, L., Geurts, A., Foster, A. S., & Rinke, P. (2019) · Advanced Science · doi:10.1002/advs.201900808 · Cited by 808
The Abinitproject: Impact, environment and recent developments
Gonze, X., Amadon, B., Antonius, G., Arnardi, F., Baguet, L., Beuken, J.-M., Bieder, J., Bottin, F., Bouchet, J., Bousquet, E., et al. (2020) · Computer Physics Communications · doi:10.1016/j.cpc.2019.107042 · Cited by 744
Self-citationSelf-Driving Laboratories for Chemistry and Materials Science
Tom, G., Schmid, S. P., Baird, S. G., Cao, Y., Darvish, K., Hao, H., Lo, S., Pablo-García, S., Rajaonson, E. M., Skreta, M., et al. (2024) · Chemical Reviews · doi:10.1021/acs.chemrev.4c00055 · Cited by 707
A Critical Review of Machine Learning of Energy Materials
Chen, C., Zuo, Y., Ye, W., Li, X., Deng, Z., & Ong, S. P. (2020) · Advanced Energy Materials · doi:10.1002/aenm.201903242 · Cited by 609
Self-citationBig-Data Science in Porous Materials: Materials Genomics and Machine Learning
Jablonka, K. M., Ongari, D., Moosavi, S. M., & Smit, B. (2020) · Chemical Reviews · doi:10.1021/acs.chemrev.0c00004 · Cited by 599
Computational Screening of Cathode Coatings for Solid-State Batteries
Xiao, Y., Miara, L. J., Wang, Y., & Ceder, G. (2019) · Joule · doi:10.1016/j.joule.2019.02.006 · Cited by 451
The Role of Machine Learning in the Understanding and Design of Materials
Moosavi, S. M., Jablonka, K. M., & Smit, B. (2020) · Journal of the American Chemical Society · doi:10.1021/jacs.0c09105 · Cited by 433
Thermodynamic limit for synthesis of metastable inorganic materials
Aykol, M., Dwaraknath, S. S., Sun, W., & Persson, K. A. (2018) · Science Advances · doi:10.1126/sciadv.aaq0148 · Cited by 427
Self-citationDunn, A., Wang, Q., Ganose, A., Dopp, D., & Jain, A. (2020) · npj Computational Materials · doi:10.1038/s41524-020-00406-3 · Cited by 411
Self-citationUlissi, Z. W., Tang, M. T., Xiao, J., Liu, X., Torelli, D. A., Karamad, M., Cummins, K., Hahn, C., Lewis, N. S., Jaramillo, T. F., et al. (2017) · ACS Catalysis · doi:10.1021/acscatal.7b01648 · Cited by 387
Zhou, J., Shen, L., Costa, M. D., Persson, K. A., Ong, S. P., Huck, P., Lu, Y., Ma, X., Chen, Y., Tang, H., et al. (2019) · Scientific Data · doi:10.1038/s41597-019-0097-3 · Cited by 377
Self-citationNandy, A., Duan, C., Taylor, M. G., Liu, F., Steeves, A. H., & Kulik, H. J. (2021) · Chemical Reviews · doi:10.1021/acs.chemrev.1c00347 · Cited by 358
Mathew, K., Montoya, J. H., Faghaninia, A., Dwarakanath, S., Aykol, M., Tang, H., Chu, I.-H., Smidt, T., Bocklund, B., Horton, M., et al. (2017) · Computational Materials Science · doi:10.1016/j.commatsci.2017.07.030 · Cited by 358
Self-citationABINIT: Overview and focus on selected capabilities
Romero, A. H., Allan, D. C., Amadon, B., Antonius, G., Applencourt, T., Baguet, L., Bieder, J., Bottin, F., Bouchet, J., Bousquet, E., et al. (2020) · The Journal of Chemical Physics · doi:10.1063/1.5144261 · Cited by 338
Self-citationData-Driven First-Principles Methods for the Study and Design of Alkali Superionic Conductors
Deng, Z., Zhu, Z., Chu, I.-H., & Ong, S. P. (2017) · Chemistry of Materials · doi:10.1021/acs.chemmater.6b02648 · Cited by 321
Self-citationHuber, S. P., Zoupanos, S., Uhrin, M., Talirz, L., Kahle, L., Häuselmann, R., Gresch, D., Müller, T., Yakutovich, A. V., Andersen, C. W., et al. (2020) · Scientific Data · doi:10.1038/s41597-020-00638-4 · Cited by 314
A database to enable discovery and design of piezoelectric materials
de Jong, M., Chen, W., Geerlings, H., Asta, M., & Persson, K. A. (2015) · Scientific Data · doi:10.1038/sdata.2015.53 · Cited by 310
Self-citationChu, I.-H., Kompella, C. S., Nguyen, H., Zhu, Z., Hy, S., Deng, Z., Meng, Y. S., & Ong, S. P. (2016) · Scientific Reports · doi:10.1038/srep33733 · Cited by 290
Self-citationGPAW: An open Python package for electronic structure calculations
Mortensen, J. J., Larsen, A. H., Kuisma, M., Ivanov, A. V., Taghizadeh, A., Peterson, A., Haldar, A., Dohn, A. O., Schäfer, C., Jónsson, E. Ö., et al. (2024) · The Journal of Chemical Physics · doi:10.1063/5.0182685 · Cited by 287
Parsl: Pervasive Parallel Programming in Python
Babuji, Y., Woodard, A., Li, Z., Katz, D. S., Clifford, B., Kumar, R., Lacinski, L., Chard, R., Wozniak, J. M., Foster, I., et al. (2019) · Proceedings of the 28th International Symposium on High-Performance Parallel and Distributed Computing · doi:10.1145/3307681.3325400 · Cited by 270
Petousis, I., Mrdjenovich, D., Ballouz, E., Liu, M., Winston, D., Chen, W., Graf, T., Schladt, T. D., Persson, K. A., & Prinz, F. B. (2017) · Scientific Data · doi:10.1038/sdata.2016.134 · Cited by 263
Self-citationChen, W., Pöhls, J.-H., Hautier, G., Broberg, D., Bajaj, S., Aydemir, U., Gibbs, Z. M., Zhu, H., Asta, M., Snyder, G. J., et al. (2016) · Journal of Materials Chemistry C · doi:10.1039/c5tc04339e · Cited by 260
Self-citationZhu, Z., Chu, I.-H., Deng, Z., & Ong, S. P. (2015) · Chemistry of Materials · doi:10.1021/acs.chemmater.5b03656 · Cited by 258
Self-citationComplex strengthening mechanisms in the NbMoTaW multi-principal element alloy
Li, X.-G., Chen, C., Zheng, H., Zuo, Y., & Ong, S. P. (2020) · npj Computational Materials · doi:10.1038/s41524-020-0339-0 · Cited by 255
Self-citationJain, A., Hautier, G., Ong, S. P., & Persson, K. (2016) · Journal of Materials Research · doi:10.1557/jmr.2016.80 · Cited by 244
Self-citationSimultaneous cross-evaluation of heterogeneous E. coli datasets via mechanistic simulation
Macklin, D. N., Ahn-Horst, T. A., Choi, H., Ruggero, N. A., Carrera, J., Mason, J. C., Sun, G., Agmon, E., DeFelice, M. M., Maayan, I., et al. (2020) · Science · doi:10.1126/science.aav3751 · Cited by 151
Bosoni, E., Beal, L., Bercx, M., Blaha, P., Blügel, S., Bröder, J., Callsen, M., Cottenier, S., Degomme, A., Dikan, V., et al. (2023) · Nature Reviews Physics · doi:10.1038/s42254-023-00655-3 · Cited by 89
Self-citationMachine learning in materials design: Algorithm and application*
Song, Z., Chen, X., Meng, F., Cheng, G., Wang, C., Sun, Z., & Yin, W.-J. (2020) · Chinese Physics B · doi:10.1088/1674-1056/abc0e3 · Cited by 63
Learn-and-Match Molecular Cations for Perovskites
Park, H., Mall, R., Alharbi, F. H., Sanvito, S., Tabet, N., Bensmail, H., & El-Mellouhi, F. (2019) · The Journal of Physical Chemistry A · doi:10.1021/acs.jpca.9b06208 · Cited by 50
gmxapi: A GROMACS-native Python interface for molecular dynamics with ensemble and plugin support
Irrgang, M. E., Davis, C., & Kasson, P. M. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1009835 · Cited by 25
Blum, V., Asahi, R., Autschbach, J., Bannwarth, C., Bihlmayer, G., Blügel, S., Burns, L. A., Crawford, T. D., Dawson, W., de Jong, W. A., et al. (2024) · Electronic Structure · doi:10.1088/2516-1075/ad48ec · Cited by 24
Self-citation
Metadata
- Authors
- Jain, A., Ong, S. P., Chen, W., Medasani, B., Qu, X., Kocher, M., Brafman, M., Petretto, G., Rignanese, G., Hautier, G., Gunter, D., & Persson, K. A.
- Venue
- Concurrency and Computation: Practice and Experience
- Publisher
- Wiley
- Published
- 2015-05-18
- Volume
- 27
- Issue
- 17
- Pages
- 5037-5059
- ISSN
- 1532-0626 (ISSN-L)
- 1532-0634
- OpenAlex
- W1798528872
- Cited by
- 547
- References
- 32
- FWCI
- 61.11
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.