The DOI matches its DataCite record; 81 of the 81 references it cites were found in a registry or an index.
DPA-2: a large atomic model as a multi-task learner
Open accessAbstract
The rapid advancements in artificial intelligence (AI) are catalyzing transformative changes in atomic modeling, simulation, and design. AI-driven potential energy models have demonstrated the capability to conduct large-scale, long-duration simulations with the accuracy of ab initio electronic structure methods. However, the model generation process remains a bottleneck for large-scale applications. We propose a shift towards a model-centric ecosystem, wherein a large atomic model (LAM), pre-trained across multiple disciplines, can be efficiently fine-tuned and distilled for various downstream tasks, thereby establishing a new framework for molecular modeling. In this study, we introduce the DPA-2 architecture as a prototype for LAMs. Pre-trained on a diverse array of chemical and materials systems using a multi-task approach, DPA-2 demonstrates superior generalization capabilities across multiple downstream tasks compared to the traditional single-task pre-training and fine-tuning methodologies. Our approach sets the stage for the development and broad application of LAMs in molecular and materials simulation research.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, commonly, the universal MLPs are trained on datasets comprising only close-to-equilibrium structures25,27–29, hence caution is needed when applying them to activated events.”
From A reactive neural network framework for water-loaded acidic zeolites (2024) · cites this paper as [28]
In the citing paper
“Two paradigms dominate the MLP field currently: (i) training of universal MLP that cover large parts of the chemical space with dozens of elements, but with limited coverage of the configuration space, e.g., not considering all relevant chemical reactions with the associated transition states, e.g., OC22, CHGNet, and others25–29”
From A reactive neural network framework for water-loaded acidic zeolites (2024) · cites this paper as [28]
Citations
Cites
Generalized Gradient Approximation Made Simple
Perdew, J. P., Burke, K., & Ernzerhof, M. (1996) · Physical Review Letters · doi:10.1103/physrevlett.77.3865 · Cited by 215,824
Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set
Kresse, G., & Furthmüller, J. (1996) · Physical Review B · doi:10.1103/physrevb.54.11169 · Cited by 123,652
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Kresse, G., & Furthmüller, J. (1996) · Computational Materials Science · doi:10.1016/0927-0256(96)00008-0 · Cited by 76,871
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
Self-Consistent Equations Including Exchange and Correlation Effects
Kohn, W., & Sham, L. J. (1965) · Physical Review · doi:10.1103/physrev.140.a1133 · Cited by 64,135
Hohenberg, P., & Kohn, W. (1964) · Physical Review · doi:10.1103/physrev.136.b864 · Cited by 53,541
Commentary: The Materials Project: A materials genome approach to accelerating materials innovation
Jain, A., Ong, S. P., Hautier, G., Chen, W., Richards, W. D., Dacek, S., Cholia, S., Gunter, D., Skinner, D., Ceder, G., et al. (2013) · APL Materials · doi:10.1063/1.4812323 · Cited by 13,094
Representation Learning: A Review and New Perspectives
Bengio, Y., Courville, A., & Vincent, P. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2013.50 · Cited by 13,001
Unified Approach for Molecular Dynamics and Density-Functional Theory
Car, R., & Parrinello, M. (1985) · Physical Review Letters · doi:10.1103/physrevlett.55.2471 · Cited by 10,889
Cited by
Sorted by citations
A foundation model for atomistic materials chemistry
Batatia, I., Benner, P., Chiang, Y., Elena, A. M., Kovács, D. P., Riebesell, J., Advincula, X. R., Asta, M., Avaylon, M., Baldwin, W. J., et al. (2025) · The Journal of Chemical Physics · doi:10.1063/5.0297006 · Cited by 1,147
Focassio, B., Freitas, L. P. M., & Schleder, G. R. (2024) · ACS Applied Materials & Interfaces · doi:10.1021/acsami.4c03815 · Cited by 140
DeePMD-kit v3: A Multiple-Backend Framework for Machine Learning Potentials
Zeng, J., Zhang, D., Peng, A., Zhang, X., He, S., Wang, Y., Liu, X., Bi, H., Li, Y., Cai, C., et al. (2025) · Journal of Chemical Theory and Computation · doi:10.1021/acs.jctc.5c00340 · Cited by 123
Self-citationA predictive machine learning force-field framework for liquid electrolyte development
Gong, S., Zhang, Y., Mu, Z., Pu, Z., Wang, H., Han, X., Yu, Z., Chen, M., Zheng, T., Wang, Z., et al. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01009-7 · Cited by 123
Self-citationEnabling large language models for real-world materials discovery
Miret, S., & Krishnan, N. M. A. (2025) · Nature Machine Intelligence · doi:10.1038/s42256-025-01058-y · Cited by 138
Metadata
- Authors
- Zhang, D., Liu, X., Zhang, X., Zhang, C., Cai, C., Bi, H., Du, Y., Qin, X., Peng, A., Huang, J., Li, B., Shan, Y., Zeng, J., Zhang, Y., Liu, S., Li, Y., Chang, J., Wang, X., Zhou, S., Liu, J., Luo, X., Wang, Z., Jiang, W., Wu, J., Yang, Y., Yang, J., Yang, M., Gong, F.-Q., Zhang, L., Shi, M., Dai, F.-Z., York, D. M., Liu, S., Zhu, T., Zhong, Z., Lv, J., Cheng, J., Jia, W., Chen, M., Ke, G., E, W., Zhang, L., & Wang, H.
- Affiliations
- Peking University (CN)
- Chinese Academy of Sciences (CN)
- East China Normal University (CN)
- Rutgers, The State University of New Jersey (US)
- Westlake University (CN)
- Princeton University (US)
- Xihua University (CN)
- Jilin University (CN)
- Italian Institute of Technology (IT)
- Xiamen University (CN)
- New York University Shanghai (CN)
- Corresponding author
- Zhang, Linshuang
- Zhang, Linfeng
- Wang, Han
- ORCID
- Zhang, Duo
- Liu, Xinzijian
- Zhang, Xiangyu
- Zhang, Chengqian
- Cai, Chun
- Qin, Xuejian
- Peng, Anyang
- Huang, Jiameng
- Li, Bowen
- Shan, Yifan
- Zeng, Jinzhe
- Zhang, Yuzhi
- Liu, Siyuan
- Li, Yifan
- Chang, Junhan
- Wang, Xinyan
- Zhou, Shuo
- Liu, Jianchuan
- Luo, Xiaoshan
- Wang, Zhenyu
- Jiang, Wanrun
- Wu, Jing
- Yang, Yudi
- Yang, Jiyuan
- Yang, Manyi
- Gong, Fu-Qiang
- Dai, Fu-Zhi
- York, Darrin M.
- Liu, Shi
- Zhong, Zhicheng
- Lv, Jian
- Cheng, Jun
- Jia, Weile
- Chen, Mohan
- Ke, Guolin
- Zhang, Linfeng
- Wang, Han
- Venue
- arXiv
- Publisher
- arXiv
- Published
- 2023
- Volume
- 10
- Issue
- 1
- ISSN
- 2057-3960 (ISSN-L)
- arXiv
- 2312.15492
- PMC
- PMC12369844
- OpenAlex
- W4405574099
- Cited by
- 155
- References
- 81
- Citations by year
- 2026: 63 · 2025: 86 · 2024: 6
- FWCI
- 15.10
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc-nd
- arxiv.org/licenses/nonexclusive-distrib/1.0/
- Locations
- npj Computational Materials (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University)
- Funders
- National Science Foundation (2209718)
- U.S. Department of Energy (DESC0019394)
- National Natural Science Foundation of China (92270001, 91961204, 22225302, 12122103, 12288101, 12122401, 12074007, 22173032, 12034009, 22222303, 12135002)
- National Institutes of Health
- National Science Fund for Distinguished Young Scholars (22225302)
- National Institute of General Medical Sciences (R01GM107485)
- Natural Science Foundation of Zhejiang Province (2022XHSJJ006)
- Topics
- Physical Sciences › Materials Science › Materials Chemistry › Machine Learning in Materials Science
- Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Advanced Chemical Physics Studies
- Life Sciences › Pharmacology, Toxicology and Pharmaceutics › Drug Discovery › Computational Drug Discovery Methods
- Keywords
- multi-task learning, pre-training, fine-tuning, knowledge distillation, molecular simulation, materials simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
