The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Evaluation of the performance of four molecular docking programs on a diverse set of protein‐ligand complexes
Abstract
Many molecular docking programs are available nowadays, and thus it is of great practical value to evaluate and compare their performance. We have conducted an extensive evaluation of four popular commercial molecular docking programs, including Glide, GOLD, LigandFit, and Surflex. Our test set consists of 195 protein‐ligand complexes with high‐resolution crystal structures (resolution ≤2.5 Å) and reliable binding data [dissociation constant (Kd) or inhibition constant (Ki)], which are selected from the PDBbind database with an emphasis on diversity. The top‐ranked solutions produced by these programs are compared to the native ligand binding poses observed in crystal structures. Glide and GOLD demonstrate better accuracy than the other two on the entire test set. Their results are also less sensitive to the starting structures for docking. Comparison of the results produced by these programs at three different computation levels reveal that their accuracy are not always proportional to CPU cost as one may expect. The binding scores of the top‐ranked solutions produced by these programs are in low to moderate correlations with experimentally measured binding data. Further analyses on the outcomes of these programs on three suites of subsets of protein‐ligand complexes indicate that these programs are less capable to handle really flexible ligands and relatively flat binding sites, and they have different preferences to hydrophilic/hydrophobic binding sites. Our evaluation can help other researchers to make reasonable choices among available molecular docking programs. It is also valuable for program developers to improve their methods further. © 2010 Wiley Periodicals, Inc. J Comput Chem, 2010
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Berman, H. M. (2000) · Nucleic Acids Research · doi:10.1093/nar/28.1.235 · Cited by 40,196
van der Waals Volumes and Radii
Bondi, A. (1964) · The Journal of Physical Chemistry · doi:10.1021/j100785a001 · Cited by 19,350
Jorgensen, W. L., Maxwell, D. S., & Tirado-Rives, J. (1996) · Journal of the American Chemical Society · doi:10.1021/ja9621760 · Cited by 15,409
CHARMM: A program for macromolecular energy, minimization, and dynamics calculations
Brooks, B. R., Bruccoleri, R. E., Olafson, B. D., States, D. J., Swaminathan, S., & Karplus, M. (1983) · Journal of Computational Chemistry · doi:10.1002/jcc.540040211 · Cited by 14,944
Friesner, R. A., Banks, J. L., Murphy, R. B., Halgren, T. A., Klicic, J. J., Mainz, D. T., Repasky, M. P., Knoll, E. H., Shelley, M., Perry, J. K., et al. (2004) · Journal of Medicinal Chemistry · doi:10.1021/jm0306430 · Cited by 10,057
Development and validation of a genetic algorithm for flexible docking 1 1Edited by F. E. Cohen
Jones, G., Willett, P., Glen, R. C., Leach, A. R., & Taylor, R. (1997) · Journal of Molecular Biology · doi:10.1006/jmbi.1996.0897 · Cited by 6,763
The interpretation of protein structures: Estimation of static accessibility
Lee, B., & Richards, F. M. (1971) · Journal of Molecular Biology · doi:10.1016/0022-2836(71)90324-x · Cited by 5,850
Halgren, T. A., Murphy, R. B., Friesner, R. A., Beard, H. S., Frye, L. L., Pollard, W. T., & Banks, J. L. (2004) · Journal of Medicinal Chemistry · doi:10.1021/jm030644s · Cited by 5,177
ZINC − A Free Database of Commercially Available Compounds for Virtual Screening
Irwin, J. J., & Shoichet, B. K. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci049714+ · Cited by 4,058
A Critical Assessment of Docking Programs and Scoring Functions
Warren, G. L., Andrews, C. W., Capelli, A.-M., Clarke, B., LaLonde, J., Lambert, M. H., Lindvall, M., Nevins, N., Semus, S. F., Senger, S., et al. (2006) · Journal of Medicinal Chemistry · doi:10.1021/jm050362n · Cited by 1,814
Eldridge, M. D., Murray, C. W., Auton, T. R., Paolini, G. V., & Mee, R. P. (1997) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1007996124545 · Cited by 1,686
Molecular recognition of receptor sites using a genetic algorithm with a description of desolvation
Jones, G., Willett, P., & Glen, R. C. (1995) · Journal of Molecular Biology · doi:10.1016/s0022-2836(95)80037-9 · Cited by 1,546
Virtual screening of chemical libraries
Shoichet, B. K. (2004) · Nature · doi:10.1038/nature03197 · Cited by 1,425
Surflex: Fully Automatic Flexible Molecular Docking Using a Molecular Similarity-Based Search Engine
Jain, A. N. (2003) · Journal of Medicinal Chemistry · doi:10.1021/jm020406h · Cited by 1,348
Benchmarking sets for molecular docking.
Huang, N., Shoichet, B. K., & Irwin, J. J. (2006) · Journal of Medicinal Chemistry · doi:10.1021/jm0608356 · Cited by 1,318
Wang, R., Lai, L., & Wang, S. (2002) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1016357811882 · Cited by 1,191
Self-citationWang, R., Fang, X., Lu, Y., & Wang, S. (2004) · Journal of Medicinal Chemistry · doi:10.1021/jm030580l · Cited by 1,133
Self-citationB�hm, H.-J. (1994) · Journal of Computer-Aided Molecular Design · doi:10.1007/bf00126743 · Cited by 1,011
A General and Fast Scoring Function for Protein−Ligand Interactions: A Simplified Potential Approach
Muegge, I., & Martin, Y. C. (1999) · Journal of Medicinal Chemistry · doi:10.1021/jm980536j · Cited by 1,007
LigandFit: a novel method for the shape-directed rapid docking of ligands to protein active sites
Venkatachalam, C. M., Jiang, X., Oldfield, T., & Waldman, M. (2003) · Journal of Molecular Graphics and Modelling · doi:10.1016/s1093-3263(02)00164-x · Cited by 1,002
Structure-Based Strategies for Drug Design and Discovery
Kuntz, I. D. (1992) · Science · doi:10.1126/science.257.5073.1078 · Cited by 989
The PDBbind database: methodologies and updates
Wang, R., Fang, X., Lu, Y., Yang, C.-Y., & Wang, S. (2005) · Journal of Medicinal Chemistry · doi:10.1021/jm048957q · Cited by 933
Self-citationComparative evaluation of 11 scoring functions for molecular docking.
Wang, R., Lu, Y., & Wang, S. (2003) · Journal of Medicinal Chemistry · doi:10.1021/jm0203783 · Cited by 849
Self-citationBissantz, C., Folkers, G., & Rognan, D. (2000) · Journal of Medicinal Chemistry · doi:10.1021/jm001044l · Cited by 740
Gehlhaar, D. K., Verkhivker, G. M., Rejto, P. A., Sherman, C. J., Fogel, D. R., Fogel, L. J., & Freer, S. T. (1995) · Chemistry & Biology · doi:10.1016/1074-5521(95)90050-0 · Cited by 684
Structure-based virtual screening: an overview
Lyne, P. D. (2002) · Drug Discovery Today · doi:10.1016/s1359-6446(02)02483-2 · Cited by 662
Diverse, High-Quality Test Set for the Validation of Protein−Ligand Docking Performance
Hartshorn, M. J., Verdonk, M. L., Chessari, G., Brewerton, S. C., Mooij, W. T. M., Mortenson, P. N., & Murray, C. W. (2007) · Journal of Medicinal Chemistry · doi:10.1021/jm061277y · Cited by 625
Jain, A. N. (1996) · Journal of Computer-Aided Molecular Design · doi:10.1007/bf00124474 · Cited by 606
Evaluation of Docking Performance: Comparative Data on Docking Algorithms
Kontoyianni, M., McClellan, L. M., & Sokol, G. S. (2004) · Journal of Medicinal Chemistry · doi:10.1021/jm0302997 · Cited by 600
Jain, A. N. (2007) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-007-9114-2 · Cited by 587
Comparative evaluation of eight docking tools for docking and virtual screening accuracy
Kellenberger, E., Rodrigo, J., Muller, P., & Rognan, D. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20149 · Cited by 577
Comparative Assessment of Scoring Functions on a Diverse Test Set
Cheng, T., Li, X., Li, Y., Liu, Z., & Wang, R. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci9000053 · Cited by 513
Self-citationRemarks about protein structure precision
Cruickshank, D. W. J. (1999) · Acta Crystallographica Section D Biological Crystallography · doi:10.1107/s0907444998012645 · Cited by 483
Assessing Scoring Functions for Protein−Ligand Interactions
Ferrara, P., Gohlke, H., Price, D. J., Klebe, G., & Brooks, C. L. (2004) · Journal of Medicinal Chemistry · doi:10.1021/jm030489h · Cited by 481
Virtual screening strategies in drug discovery
McInnes, C. (2007) · Current Opinion in Chemical Biology · doi:10.1016/j.cbpa.2007.08.033 · Cited by 469
Comparison of Several Molecular Docking Programs: Pose Prediction and Virtual Screening Accuracy
Cross, J. B., Thompson, D. C., Rai, B. K., Baber, J. C., Fan, K. Y., Hu, Y., & Humblet, C. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci900056c · Cited by 446
A detailed comparison of current docking and scoring methods on systems of pharmaceutical relevance
Perola, E., Walters, W. P., & Charifson, P. S. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20088 · Cited by 446
Böhm, H.-J. (1998) · Journal of Computer-Aided Molecular Design · doi:10.1023/a:1007999920146 · Cited by 431
Modeling water molecules in protein-ligand docking using GOLD.
Verdonk, M. L., Chessari, G., Cole, J. C., Hartshorn, M. J., Murray, C. W., Nissink, J. W. M., Taylor, R. D., & Taylor, R. (2005) · Journal of Medicinal Chemistry · doi:10.1021/jm050543p · Cited by 393
LigScore: a novel scoring function for predicting binding affinities
Krammer, A., Kirchhoff, P. D., Jiang, X., Venkatachalam, C. M., & Waldman, M. (2005) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2004.11.007 · Cited by 382
Flexible docking using tabu search and an empirical estimate of binding affinity
Baxter, C. A., Murray, C. W., Clark, D. E., Westhead, D. R., & Eldridge, M. D. (1998) · Proteins: Structure, Function, and Genetics · doi:10.1002/(sici)1097-0134(19981115)33:3<367::aid-prot6>3.0.co;2-w · Cited by 375
Comparing protein–ligand docking programs is difficult
Cole, J. C., Murray, C. W., Nissink, J. W. M., Taylor, R. D., & Taylor, R. (2005) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20497 · Cited by 371
General and targeted statistical potentials for protein–ligand interactions
Mooij, W. T. M., & Verdonk, M. L. (2005) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20588 · Cited by 368
Hammerhead: fast, fully automated docking of flexible ligands to protein binding sites
Welch, W., Ruppert, J., & Jain, A. N. (1996) · Chemistry & Biology · doi:10.1016/s1074-5521(96)90093-9 · Cited by 365
Comparative study of several algorithms for flexible ligand docking
Bursulaya, B. D., Totrov, M., Abagyan, R., & Brooks, C. L. (2003) · Journal of Computer-Aided Molecular Design · doi:10.1023/b:jcam.0000017496.76572.6f · Cited by 358
Muegge, I. (2006) · Journal of Medicinal Chemistry · doi:10.1021/jm050038s · Cited by 303
Serhan, C. N. (1996) · Nature · doi:10.1038/384023a0 · Cited by 234
On Evaluating Molecular-Docking Methods for Pose Prediction and Enrichment Factors
Chen, H., Lyne, P. D., Giordanetto, F., Lovell, T., & Li, J. (2006) · Journal of Chemical Information and Modeling · doi:10.1021/ci0503255 · Cited by 226
Wang, R., Lu, Y., Fang, X., & Wang, S. (2004) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci049733j · Cited by 224
Self-citationAutomatic identification and representation of protein binding sites for molecular docking
Ruppert, J., Welch, W., & Jain, A. N. (1997) · Protein Science · doi:10.1002/pro.5560060302 · Cited by 207
Comparison of Automated Docking Programs as Virtual Screening Tools
Cummings, M. D., DesJarlais, R. L., Gibbs, A. C., Mohan, V., & Jaeger, E. P. (2005) · Journal of Medicinal Chemistry · doi:10.1021/jm049798d · Cited by 207
Evaluations of Molecular Docking Programs for Virtual Screening
Onodera, K., Satou, K., & Hirota, H. (2007) · Journal of Chemical Information and Modeling · doi:10.1021/ci7000378 · Cited by 197
Recent Advances in Docking and Scoring
Krovat, E., Steindl, T., & Langer, T. (2005) · Current Computer Aided-Drug Design · doi:10.2174/1573409052952314 · Cited by 196
Recent advances in structure-based rational drug design
Gane, P. J., & Dean, P. M. (2000) · Current Opinion in Structural Biology · doi:10.1016/s0959-440x(00)00105-6 · Cited by 192
Zhou, Z., Felts, A. K., Friesner, R. A., & Levy, R. M. (2007) · Journal of Chemical Information and Modeling · doi:10.1021/ci7000346 · Cited by 165
Ph4Dock: Pharmacophore-Based Protein−Ligand Docking
Goto, J.-I., Kataoka, R., & Hirayama, N. (2004) · Journal of Medicinal Chemistry · doi:10.1021/jm0493818 · Cited by 104
Evaluation of library ranking efficacy in virtual screening
Kontoyianni, M., Sokol, G. S., & McClellan, L. M. (2004) · Journal of Computational Chemistry · doi:10.1002/jcc.20141 · Cited by 103
A practical approach to docking of zinc metalloproteinase inhibitors
Hu, X., Baláž, Š., & Shelver, W. H. (2004) · Journal of Molecular Graphics and Modelling · doi:10.1016/j.jmgm.2003.11.002 · Cited by 93
Parrill, A. L., & Reddy, M. R. (1999) · ACS symposium series · doi:10.1021/bk-1999-0719 · Cited by 90
Gehlhaar, D. K., Bouzida, D., & Rejto, P. A. (1999) · ACS symposium series · doi:10.1021/bk-1999-0719.ch019 · Cited by 82
Colman, P. M. (1994) · Current Opinion in Structural Biology · doi:10.1016/0959-440x(94)90268-2 · Cited by 75
Structure-based screening and design in drug discovery
van Dongen, M. J. P., Weigelt, J., Uppenberg, J., Schultz, J., & Wikström, M. (2002) · Drug Discovery Today · doi:10.1016/s1359-6446(02)02233-x · Cited by 71
Modelling prior distributions of atoms for macromolecular refinement and completion
Roversi, P., Blanc, E., Vonrhein, C., Evans, G., & Bricogne, G. (2000) · Acta Crystallographica Section D Biological Crystallography · doi:10.1107/s0907444900008490 · Cited by 62
Evaluation and application of multiple scoring functions for a virtual screening experiment
Xing, L., Hodgkin, E. E., Liu, Q., & Sedlock, D. M. (2004) · Journal of Computer-Aided Molecular Design · doi:10.1023/b:jcam.0000047812.39758.ab · Cited by 60
Kirkpatrick, P. N. (2004) · Nature Reviews Drug Discovery · doi:10.1038/nrd1364 · Cited by 56
Structure-based approaches to drug design and virtual screening.
Waszkowycz, B. (2002) · PubMed · Cited by 51
Predicting protein–ligand binding affinities: a low scoring game?
Marsden, P. M., Puvanendrampillai, D., Mitchell, J. B. O., & Glen, R. C. (2004) · Organic & Biomolecular Chemistry · doi:10.1039/b409570g · Cited by 48
Calculating Partition Coefficients of Peptides by the Addition Method
Tao, P., Wang, R., & Lai, L. (1999) · Journal of Molecular Modeling · doi:10.1007/s008940050118 · Cited by 40
Self-citation
Cited by
Molecular Docking: A Powerful Approach for Structure-Based Drug Discovery
Meng, X.-Y., Zhang, H.-X., Mezei, M., & Cui, M. (2011) · Current Computer Aided-Drug Design · doi:10.2174/157340911795677602 · Cited by 3,771
Computational Methods in Drug Discovery
Sliwoski, G., Kothiwale, S., Meiler, J., & Lowe, E. W. (2014) · Pharmacological Reviews · doi:10.1124/pr.112.007336 · Cited by 2,160
Software for molecular docking: a review
Pagadala, N. S., Syed, K., & Tuszynski, J. (2017) · Biophysical Reviews · doi:10.1007/s12551-016-0247-1 · Cited by 1,522
Halogen Bonding: An Interim Discussion
Politzer, P., & Murray, J. S. (2013) · ChemPhysChem · doi:10.1002/cphc.201200799 · Cited by 689
Forging the basis for developing protein-ligand interaction scoring functions.
Liu, Z., Su, M., Han, L., Liu, J., Yang, Q., Li, Y., & Wang, R. (2017) · Accounts of Chemical Research · doi:10.1021/acs.accounts.6b00491 · Cited by 493
Self-citation
Metadata
- Authors
- Li, X., Li, Y., Cheng, T., Liu, Z., & Wang, R.
- Venue
- Journal of Computational Chemistry
- Publisher
- Wiley
- Published
- 2010-06-07
- Volume
- 31
- Issue
- 11
- Pages
- 2109-2125
- ISSN
- 0192-8651 (ISSN-L)
- 1096-987X
- OpenAlex
- W2064572456
- Cited by
- 303
- References
- 68
- FWCI
- 33.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.