Assessing the performance of MM/PBSA and MM/GBSA methods. 4. Accuracies of MM/PBSA and MM/GBSA methodologies evaluated by various simulation protocols using PDBbind data set.
Abstract
By using different evaluation strategies, we systemically evaluated the performance of Molecular Mechanics/Generalized Born Surface Area (MM/GBSA) and Molecular Mechanics/Poisson-Boltzmann Surface Area (MM/PBSA) methodologies based on more than 1800 protein-ligand crystal structures in the PDBbind database. The results can be summarized as follows: (1) for the one-protein-family/one-binding-ligand case which represents the unbiased protein-ligand complex sampling, both MM/GBSA and MM/PBSA methodologies achieve approximately equal accuracies at the interior dielectric constant of 4 (with rp = 0.408 ± 0.006 of MM/GBSA and rp = 0.388 ± 0.006 of MM/PBSA based on the minimized structures); while for the total dataset (1864 crystal structures), the overall best Pearson correlation coefficient (rp = 0.579 ± 0.002) based on MM/GBSA is better than that of MM/PBSA (rp = 0.491 ± 0.003), indicating that biased sampling may significantly affect the accuracy of the predicted result (some protein families contain too many instances and can bias the overall predicted accuracy). Therefore, family based classification is needed to evaluate the two methodologies; (2) the prediction accuracies of MM/GBSA and MM/PBSA for different protein families are quite different with rp ranging from 0 to 0.9, whereas the correlation and ranking scores (an averaged rp/rs over a list of protein folds and also representing the unbiased sampling) given by MM/PBSA (rp-score = 0.506 ± 0.050 and rs-score = 0.481 ± 0.052) are comparable to those given by MM/GBSA (rp-score = 0.516 ± 0.047 and rs-score = 0.463 ± 0.047) at the fold family level; (3) for the overall prediction accuracies, molecular dynamics (MD) simulation may not be quite necessary for MM/GBSA (rp-minimized = 0.579 ± 0.002 and rp-1ns = 0.564 ± 0.002), but is needed for MM/PBSA (rp-minimized = 0.412 ± 0.003 and rp-1ns = 0.491 ± 0.003). However, for the individual systems, whether to use MD simulation is depended. (4) both MM/GBSA and MM/PBSA may be unable to give successful predictions for the ligands with high formal charges, with the Pearson correlation coefficient ranging from 0.621 ± 0.003 (neutral ligands) to 0.125 ± 0.142 (ligands with a formal charge of 5). Therefore, it can be summarized that, although MM/GBSA and MM/PBSA perform similarly in the unbiased dataset, for the currently available crystal structures in the PDBbind database, compared with MM/GBSA, which may be used in multi-target comparisons, MM/PBSA is more sensitive to the investigated systems, and may be more suitable for individual-target-level binding free energy ranking. This study may provide useful guidance for the post-processing of docking based studies.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
MM-GBSA is less sensitive to the investigated systems and is more suitable to be used in general cases than MM-PBSA.
“They concluded that although similar results were observed, MM-GBSA is less sensitive to the investigated systems and is more suitable to be used in general cases (e.g., reverse docking, which is widely used to predict the receptor target(s) of a compound).”
From Empirical scoring functions for structure-based virtual screening: applications, critical aspects, and challenges (2018) · cites this paper as Sun et al., 2014
Cites
Thompson, J. (1997) · Nucleic Acids Research · doi:10.1093/nar/25.24.4876 · Cited by 39,119 · see citing works
Comparison of simple potential functions for simulating liquid water
Jorgensen, W. L., Chandrasekhar, J., Madura, J., Impey, R., & Klein, M. (1983) · The Journal of Chemical Physics · doi:10.1063/1.445869 · Cited by 38,335 · see citing works
Particle mesh Ewald: An N⋅log(N) method for Ewald sums in large systems
Darden, T., York, D., & Pedersen, L. (1993) · The Journal of Chemical Physics · doi:10.1063/1.464397 · Cited by 29,588 · see citing works
Ryckaert, J., Ciccotti, G., & Berendsen, H. (1977) · Journal of Computational Physics · doi:10.1016/0021-9991(77)90098-5 · Cited by 19,525 · see citing works
Development and testing of a general amber force field
Wang, J.-M., Wolf, R., Caldwell, J., Kollman, P., & Case, D. (2004) · Journal of Computational Chemistry · doi:10.1002/jcc.20035 · Cited by 18,318 · see citing works
Murzin, A. G., Brenner, S. E., Hubbard, T., & Chothia, C. (1995) · Journal of Molecular Biology · doi:10.1016/s0022-2836(05)80134-2 · Cited by 6,412 · see citing works
Automatic atom type and bond type perception in molecular mechanical calculations
Wang, J., Wang, W., Kollman, P. A., & Case, D. A. (2006) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2005.12.005 · Cited by 5,517 · see citing works
Duan, Y., Wu, C., Chowdhury, S., Lee, M. C., Xiong, G., Zhang, W., Yang, R., Cieplak, P., Luo, R., Lee, T.-S., et al. (2003) · Journal of Computational Chemistry · doi:10.1002/jcc.10349 · Cited by 4,271 · see citing works
Jakalian, A., Jack, D. B., & Bayly, C. I. (2002) · Journal of Computational Chemistry · doi:10.1002/jcc.10128 · Cited by 3,428 · see citing works
Hou, T., Wang, J., Li, Y., & Wang, W. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci100275a · Cited by 2,800 · see citing works
Self-citationOnufriev, A., Bashford, D., & Case, D. A. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20033 · Cited by 2,507 · see citing works
Approximate atomic surfaces from linear combinations of pairwise overlaps (LCPO)
Weiser, J., Shenkin, P. S., & Still, W. C. (1999) · Journal of Computational Chemistry · doi:10.1002/(sici)1096-987x(19990130)20:2 · Cited by 1,209 · see citing works
The VSGB 2.0 model: A next generation energy model for high resolution protein structure modeling
Li, J., Abel, R., Zhu, K., Cao, Y., Zhao, S., & Friesner, R. A. (2011) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.23106 · Cited by 1,181 · see citing works
Wang, R., Fang, X., Lu, Y., & Wang, S. (2004) · Journal of Medicinal Chemistry · doi:10.1021/jm030580l · Cited by 1,137 · see citing works
Free Energy Via Molecular Simulation: Applications to Chemical and Biomolecular Systems
Beveridge, D. L., & DiCapua, F. M. (1989) · Annual Review of Biophysics and Biophysical Chemistry · doi:10.1146/annurev.bb.18.060189.002243 · Cited by 1,088 · see citing works
Gohlke, H., Kiel, C., & Case, D. (2003) · Journal of Molecular Biology · doi:10.1016/s0022-2836(03)00610-7 · Cited by 1,087 · see citing works
Kelly, C. P., Cramer, C. J., & Truhlar, D. G. (2006) · The Journal of Physical Chemistry B · doi:10.1021/jp063552y · Cited by 1,018 · see citing works
Cui, J. J., Tran‐Dubé, M., Shen, H., Nambu, M. D., Kung, P., Pairish, M., Jia, L., Meng, J. J., Funk, L. A., Botrous, I., et al. (2011) · Journal of Medicinal Chemistry · doi:10.1021/jm2007613 · Cited by 953 · see citing works
The PDBbind database: methodologies and updates
Wang, R., Fang, X., Lu, Y., Yang, C.-Y., & Wang, S. (2005) · Journal of Medicinal Chemistry · doi:10.1021/jm048957q · Cited by 933 · see citing works
Hawkins, G. D., Cramer, C. J., & Truhlar, D. G. (1996) · The Journal of Physical Chemistry · doi:10.1021/jp961710n · Cited by 891 · see citing works
Gohlke, H., & Klebe, G. (2002) · Angewandte Chemie International Edition · doi:10.1002/1521-3773(20020802)41:15 · Cited by 843 · see citing works
Rocchia, W., Alexov, E., & Honig, B. H. (2001) · The Journal of Physical Chemistry B · doi:10.1021/jp010454y · Cited by 838 · see citing works
Hou, T., Wang, J., Li, Y., & Wang, W. (2010) · Journal of Computational Chemistry · doi:10.1002/jcc.21666 · Cited by 766 · see citing works
Self-citationPairwise solute descreening of solute charges from a dielectric medium
Hawkins, G. D., Cramer, C. J., & Truhlar, D. G. (1995) · Chemical Physics Letters · doi:10.1016/0009-2614(95)01082-k · Cited by 715 · see citing works
Wang, J., Morin, P. E., Wang, W., & Kollman, P. A. (2001) · Journal of the American Chemical Society · doi:10.1021/ja003834q · Cited by 709 · see citing works
Chandonia, J. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkh034 · Cited by 529 · see citing works
Comparative Assessment of Scoring Functions on a Diverse Test Set
Cheng, T., Li, X., Li, Y., Liu, Z., & Wang, R. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci9000053 · Cited by 514 · see citing works
Self-citationKuhn, B., & Kollman, P. A. (2000) · Journal of Medicinal Chemistry · doi:10.1021/jm000241h · Cited by 506 · see citing works
Xu, L., Sun, H., Li, Y., Wang, J., & Hou, T. (2013) · The Journal of Physical Chemistry B · doi:10.1021/jp404160y · Cited by 477 · see citing works
Self-citationThe Impact of Structural Genomics: Expectations and Outcomes
Chandonia, J., & Brenner, S. E. (2006) · Science · doi:10.1126/science.1121018 · Cited by 377 · see citing works
The implementation of a fast and accurate QM/MM potential method in Amber
Walker, R. C., Crowley, M. F., & Case, D. (2008) · Journal of Computational Chemistry · doi:10.1002/jcc.20857 · Cited by 377 · see citing works
Perspective on Free-Energy Perturbation Calculations for Chemical Equilibria
Jorgensen, W. L., & Thomas, L. L. (2008) · Journal of Chemical Theory and Computation · doi:10.1021/ct800011m · Cited by 371 · see citing works
Greenidge, P. A., Krämer, C., Mozziconacci, J., & Wolf, R. M. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300425v · Cited by 336 · see citing works
Mobley, D. L., Chodera, J. D., & Dill, K. A. (2006) · The Journal of Chemical Physics · doi:10.1063/1.2221683 · Cited by 316 · see citing works
Computational alanine scanning of the 1:1 human growth hormone–receptor complex
Huo, S., Massova, I., & Kollman, P. A. (2001) · Journal of Computational Chemistry · doi:10.1002/jcc.1153 · Cited by 305 · see citing works
Weis, A., Katebzadeh, K., Söderhjelm, P., Nilsson, I., & Ryde, U. (2006) · Journal of Medicinal Chemistry · doi:10.1021/jm0608210 · Cited by 267 · see citing works
Hou, T., & Yu, R. (2007) · Journal of Medicinal Chemistry · doi:10.1021/jm0609162 · Cited by 262 · see citing works
Self-citationThe Experimental Uncertainty of Heterogeneous Public Ki Data
Krämer, C., Kalliokoski, T., Gedeck, P., & Vulpetti, A. (2012) · Journal of Medicinal Chemistry · doi:10.1021/jm300131x · Cited by 234 · see citing works
Genheden, S., Kühn, O., Mikulskis, P., Hoffmann, D. E., & Ryde, U. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci3001919 · Cited by 215 · see citing works
Hou, T., Li, N., Li, Y., & Wang, W. (2012) · Journal of Proteome Research · doi:10.1021/pr3000688 · Cited by 204 · see citing works
Self-citationCompensating Enthalpic and Entropic Changes Hinder Binding Affinity Optimization
Lafont, V., Armstrong, A. A., Ohtaka, H., Kiso, Y., Amzel, L. M., & Freire, E. (2007) · Chemical Biology & Drug Design · doi:10.1111/j.1747-0285.2007.00519.x · Cited by 195 · see citing works
Hou, T., Zhang, W., Case, D. A., & Wang, W. (2008) · Journal of Molecular Biology · doi:10.1016/j.jmb.2007.12.054 · Cited by 192 · see citing works
Self-citationDiscovery of a Potential Allosteric Ligand Binding Site in CDK2
Betzi, S., Alam, R., Martin, M. P., Lubbers, D. J., Han, H., Jakkaraj, S., Georg, G. I., & Schönbrunn, E. (2011) · ACS Chemical Biology · doi:10.1021/cb100410m · Cited by 191 · see citing works
Tan, C., Yang, L., & Luo, R. (2006) · The Journal of Physical Chemistry B · doi:10.1021/jp063479b · Cited by 176 · see citing works
Wang, W., Lim, W. A., Jakalian, A., Wang, J., Wang, J., Luo, R., Bayly, C. I., & Kollman, P. A. (2001) · Journal of the American Chemical Society · doi:10.1021/ja003164o · Cited by 134 · see citing works
Characterization of Domain-Peptide Interaction Interface
Hou, T., Xu, Z., Zhang, W., McLaughlin, W. A., Case, D. A., Xu, Y., & Wang, W. (2008) · Molecular & Cellular Proteomics · doi:10.1074/mcp.m800450-mcp200 · Cited by 101 · see citing works
Self-citationCHARMM-GUI Ligand Binder for Absolute Binding Free Energy Calculations and Its Application
Jo, S., Jiang, W., Lee, H.-S., Roux, B., & Im, W. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300505n · Cited by 94 · see citing works
Sun, H., Li, Y., Li, D., & Hou, T. (2013) · Journal of Chemical Information and Modeling · doi:10.1021/ci400188q · Cited by 91 · see citing works
Self-citationYing, Y., Qin, J., Liu, H., & Yao, X. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci100427j · Cited by 90 · see citing works
Xue, W., Pan, D., Yang, Y., Liu, H., & Yao, X. (2011) · Antiviral Research · doi:10.1016/j.antiviral.2011.11.007 · Cited by 88 · see citing works
Predicting drug resistance of the HIV‐1 protease using molecular interaction energy components
Hou, T., Zhang, W., Wang, J., & Wang, W. (2008) · Proteins Structure Function and Bioinformatics · doi:10.1002/prot.22192 · Cited by 88 · see citing works
Self-citationDetecting and understanding combinatorial mutation patterns responsible for HIV drug resistance
Zhang, J., Hou, T., Wang, W., et al. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0907304107 · Cited by 85 · see citing works
Self-citationHou, T., Zhu, L., Chen, L., & Xu, X. (2002) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci025552a · Cited by 84 · see citing works
Self-citationLiu, H., & Yao, X. (2009) · Molecular Pharmaceutics · doi:10.1021/mp900131p · Cited by 82 · see citing works
Hou, T., Guo, S., & Xu, X. (2002) · The Journal of Physical Chemistry B · doi:10.1021/jp015516z · Cited by 82 · see citing works
Self-citationMaffucci, I., & Contini, A. (2013) · Journal of Chemical Theory and Computation · doi:10.1021/ct400045d · Cited by 81 · see citing works
Comparison of the Efficiency of the LIE and MM/GBSA Methods to Calculate Ligand-Binding Energies
Genheden, S., & Ryde, U. (2011) · Journal of Chemical Theory and Computation · doi:10.1021/ct200163c · Cited by 80 · see citing works
Binding Affinities of Factor Xa Inhibitors Estimated by Thermodynamic Integration and MM/GBSA
Genheden, S., Nilsson, I., & Ryde, U. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci100458f · Cited by 79 · see citing works
Xue, W., Jin, X., Ning, L., Wang, M., Liu, H., & Yao, X. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300541c · Cited by 75 · see citing works
Prediction of peptides binding to the PKA RIIα subunit using a hierarchical strategy
Hou, T., Li, Y., & Wang, W. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr294 · Cited by 67 · see citing works
Self-citationCan MM‐PBSA calculations predict the specificities of protein kinase inhibitors?
Page, C. S., & Bates, P. A. (2006) · Journal of Computational Chemistry · doi:10.1002/jcc.20534 · Cited by 58 · see citing works
Gao, C., Park, M.-S., & Stern, H. A. (2010) · Biophysical Journal · doi:10.1016/j.bpj.2009.11.018 · Cited by 54 · see citing works
Mikulskis, P., Genheden, S., Rydberg, P., Sandberg, L., Olsen, L., & Ryde, U. (2011) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-011-9524-z · Cited by 50 · see citing works
Yang, Y., Liu, H., & Yao, X. (2012) · Molecular BioSystems · doi:10.1039/c2mb25042j · Cited by 48 · see citing works
Cui, Y., Zheng, Q., Zhang, J., Xue, Q., Wang, Y., & Zhang, H. (2013) · Journal of Chemical Information and Modeling · doi:10.1021/ci400553w · Cited by 41 · see citing works
Xu, L., Li, Y., Li, L., Zhou, S., & Hou, T. (2012) · Molecular BioSystems · doi:10.1039/c2mb25146a · Cited by 38 · see citing works
Self-citationMuzzioli, E., Río, A. D., & Rastelli, G. (2011) · Chemical Biology & Drug Design · doi:10.1111/j.1747-0285.2011.01140.x · Cited by 36 · see citing works
Structural and Energetic Analyses of SNPs in Drug Targets and Implications for Drug Therapy
Sun, H., Ji, F., Fu, L.-Y., Wang, Z., & Zhang, H. (2013) · Journal of Chemical Information and Modeling · doi:10.1021/ci400457v · Cited by 27 · see citing works
Self-citationXu, Z., Hou, T., Li, N., Xu, Y., & Wang, W. T. (2011) · Molecular & Cellular Proteomics · doi:10.1074/mcp.o111.010389 · Cited by 26 · see citing works
Self-citationChen, L., Zhang, J., Yu, L., et al. (2012) · The Journal of Physical Chemistry B · doi:10.1021/jp305860h · Cited by 23 · see citing works
Zhu, S., Travis, S., & Elcock, A. (2013) · Journal of Chemical Theory and Computation · doi:10.1021/ct400104x · Cited by 21 · see citing works
ADAPT: A molecular mechanics approach for studying the structural properties of long DNA sequences
Lafontaine, I., & Lavery, R. (2000) · Biopolymers · doi:10.1002/1097-0282(2000)56:4 · Cited by 21 · see citing works
Xue, Q., Zhang, J., Zheng, Q., et al. (2013) · Langmuir · doi:10.1021/la402354r · Cited by 21 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Wang, Z., Sun, H., Yao, X., Li, D., Xu, L., Li, Y., Tian, S., & Hou, T. (2016) · Physical Chemistry Chemical Physics · doi:10.1039/c6cp01555g · Cited by 946 · see citing works
Self-citationGuedes, I. A., Pereira, F. S. S., & Dardenne, L. E. (2018) · Frontiers in Pharmacology · doi:10.3389/fphar.2018.01089 · Cited by 331 · see citing works
Cheng, W., & Ng, C. A. (2018) · Environmental Science & Technology · doi:10.1021/acs.est.8b01268 · Cited by 141 · see citing works
Schneider, M., Rosam, M., Glaser, M., Patronov, A., Shah, H., Back, K. C., Daake, M. A., Buchner, J., & Antes, I. (2016) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.25084 · Cited by 51 · see citing works
- Authors
- Sun, H., Li, Y., Tian, S., Xu, L., & Hou, T.
- Affiliations
- Soochow University (CN)
- Zhejiang University (CN)
- Corresponding author
- Hou, Tingjun
- Venue
- Phys. Chem. Chem. Phys.
- Publisher
- Royal Society of Chemistry (RSC)
- Published
- 2014
- Volume
- 16
- Issue
- 31
- Pages
- 16719-16729
- ISSN
- 1463-9076 (ISSN-L)
- 1463-9084
- OpenAlex
- W2025116694
- Cited by
- 738
- References
- 73
- Citations by year
- 2026: 47 · 2025: 48 · 2024: 78 · 2023: 85 · 2022: 73 · 2021: 72 · 2020: 78 · 2019: 68 · 2018: 67 · 2017: 49 · 2016: 38 · 2015: 30 · 2014: 4
- FWCI
- 42.00
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Physical Chemistry Chemical Physics (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Computational Theory and Mathematics › Computational Drug Discovery Methods
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Protein Structure and Dynamics
- Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Advanced Chemical Physics Studies
- Keywords
- MM-PBSA, MM-GBSA, binding free energy prediction, protein-ligand binding affinity, PDBbind, dielectric constant, molecular dynamics simulation, binding affinity ranking, Poisson-Boltzmann equation, generalized Born, binding site flexibility
- MeSH terms
- Ligands, Molecular Conformation, Reproducibility of Results, Databases, Protein, Molecular Dynamics Simulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review