The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Comparative Assessment of Scoring Functions on a Diverse Test Set
Abstract
Scoring functions are widely applied to the evaluation of protein-ligand binding in structure-based drug design. We have conducted a comparative assessment of 16 popular scoring functions implemented in main-stream commercial software or released by academic research groups. A set of 195 diverse protein-ligand complexes with high-resolution crystal structures and reliable binding constants were selected through a systematic nonredundant sampling of the PDBbind database and used as the primary test set in our study. All scoring functions were evaluated in three aspects, that is, "docking power", "ranking power", and "scoring power", and all evaluations were independent from the context of molecular docking or virtual screening. As for "docking power", six scoring functions, including GOLD::ASP, DS::PLP1, DrugScore(PDB), GlideScore-SP, DS::LigScore, and GOLD::ChemScore, achieved success rates over 70% when the acceptance cutoff was root-mean-square deviation < 2.0 A. Combining these scoring functions into consensus scoring schemes improved the success rates to 80% or even higher. As for "ranking power" and "scoring power", the top four scoring functions on the primary test set were X-Score, DrugScore(CSD), DS::PLP, and SYBYL::ChemScore. They were able to correctly rank the protein-ligand complexes containing the same type of protein with success rates around 50%. Correlation coefficients between the experimental binding constants and the binding scores computed by these scoring functions ranged from 0.545 to 0.644. Besides the primary test set, each scoring function was also tested on four additional test sets, each consisting of a certain number of protein-ligand complexes containing one particular type of protein. Our study serves as an updated benchmark for evaluating the general performance of today's scoring functions. Our results indicate that no single scoring function consistently outperforms others in all three aspects. Thus, it is important in practice to choose the appropriate scoring functions for different purposes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Friesner, R. A., Banks, J. L., Murphy, R. B., Halgren, T. A., Klicic, J. J., Mainz, D. T., Repasky, M. P., Knoll, E. H., Shelley, M., Perry, J. K., et al. (2004) · Journal of Medicinal Chemistry · doi:10.1021/jm0306430 · Cited by 10,057
Development and validation of a genetic algorithm for flexible docking 1 1Edited by F. E. Cohen
Jones, G., Willett, P., Glen, R. C., Leach, A. R., & Taylor, R. (1997) · Journal of Molecular Biology · doi:10.1006/jmbi.1996.0897 · Cited by 6,763
ZINC − A Free Database of Commercially Available Compounds for Virtual Screening
Irwin, J. J., & Shoichet, B. K. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci049714+ · Cited by 4,058
Benchmarking sets for molecular docking.
Huang, N., Shoichet, B. K., & Irwin, J. J. (2006) · Journal of Medicinal Chemistry · doi:10.1021/jm0608356 · Cited by 1,318
Massova, I., & Kollman, P. A. (2000) · Perspectives in Drug Discovery and Design · doi:10.1023/a:1008763014207 · Cited by 1,015
The PDBbind database: methodologies and updates
Wang, R., Fang, X., Lu, Y., Yang, C.-Y., & Wang, S. (2005) · Journal of Medicinal Chemistry · doi:10.1021/jm048957q · Cited by 933
Self-citationComparative evaluation of 11 scoring functions for molecular docking.
Wang, R., Lu, Y., & Wang, S. (2003) · Journal of Medicinal Chemistry · doi:10.1021/jm0203783 · Cited by 849
Self-citationBissantz, C., Folkers, G., & Rognan, D. (2000) · Journal of Medicinal Chemistry · doi:10.1021/jm001044l · Cited by 740
Charifson, P. S., Corkery, J. J., Murcko, M. A., & Walters, W. P. (1999) · Journal of Medicinal Chemistry · doi:10.1021/jm990352k · Cited by 698
Comparative evaluation of eight docking tools for docking and virtual screening accuracy
Kellenberger, E., Rodrigo, J., Muller, P., & Rognan, D. (2004) · Proteins: Structure, Function, and Bioinformatics · doi:10.1002/prot.20149 · Cited by 577
Cited by
Ballester, P. J., & Mitchell, J. B. O. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq112 · Cited by 989
KDEEP: Protein–Ligand Absolute Binding Affinity Prediction via 3D-Convolutional Neural Networks
Jiménez, J., Škalič, M., Martínez-Rosell, G., & De Fabritiis, G. (2018) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.7b00650 · Cited by 926
Comparative Assessment of Scoring Functions: The CASF-2016 Update
Su, M., Yang, Q., Du, Y., Feng, G., Liu, Z., Li, Y., & Wang, R. (2019) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.8b00545 · Cited by 824
Self-citationRole of computer-aided drug design in modern drug discovery
Macalino, S. J. Y., Gosu, V., Hong, S., & Choi, S. (2015) · Archives of Pharmacal Research · doi:10.1007/s12272-015-0640-5 · Cited by 762
A Structure-Based Drug Discovery Paradigm
Batool, M., Ahmad, B., & Choi, S. (2019) · International Journal of Molecular Sciences · doi:10.3390/ijms20112783 · Cited by 744
Metadata
- Authors
- Cheng, T., Li, X., Li, Y., Liu, Z., & Wang, R.
- Venue
- Journal of Chemical Information and Modeling
- Publisher
- American Chemical Society (ACS)
- Published
- 2009-04-09
- Volume
- 49
- Issue
- 4
- Pages
- 1079-1093
- ISSN
- 1549-9596 (ISSN-L)
- 1549-960X
- OpenAlex
- W1993403967
- Cited by
- 513
- References
- 10
- FWCI
- 27.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparative Assessment of Scoring Functions on a Diverse Test Set. https://app.cochat.ai/papers/10.1021/ci9000053
- The paper
- Cheng, T., Li, X., Li, Y., Liu, Z., & Wang, R. (2009). Comparative Assessment of Scoring Functions on a Diverse Test Set. Journal of Chemical Information and Modeling. https://doi.org/10.1021/ci9000053
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.