The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Exploring Chemical Space for Drug Discovery Using the Chemical Universe Database
Open accessAbstract
Herein we review our recent efforts in searching for bioactive ligands by enumeration and virtual screening of the unknown chemical space of small molecules. Enumeration from first principles shows that almost all small molecules (>99.9%) have never been synthesized and are still available to be prepared and tested. We discuss open access sources of molecules, the classification and representation of chemical space using molecular quantum numbers (MQN), its exhaustive enumeration in form of the chemical universe generated databases (GDB), and examples of using these databases for prospective drug discovery. MQN-searchable GDB, PubChem, and DrugBank are freely accessible at www.gdb.unibe.ch.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Lipinski, C. A., Lombardo, F., Dominy, B. W., & Feeney, P. J. (2001) · Advanced Drug Delivery Reviews · doi:10.1016/s0169-409x(00)00129-0 · Cited by 18,139
Lipinski, C. A., Lombardo, F., Dominy, B. W., & Feeney, P. J. (1997) · Advanced Drug Delivery Reviews · doi:10.1016/s0169-409x(96)00423-1 · Cited by 11,385
Friesner, R. A., Banks, J. L., Murphy, R. B., Halgren, T. A., Klicic, J. J., Mainz, D. T., Repasky, M. P., Knoll, E. H., Shelley, M., Perry, J. K., et al. (2004) · Journal of Medicinal Chemistry · doi:10.1021/jm0306430 · Cited by 10,057
Weininger, D. (1988) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00057a005 · Cited by 7,436
Honeycomb Carbon: A Review of Graphene
Allen, M. J., Tung, V. C., & Kaner, R. B. (2010) · Chemical Reviews · doi:10.1021/cr900070d · Cited by 6,998
ChEMBL: a large-scale bioactivity database for drug discovery
Gaulton, A., Bellis, L. J., Bento, A. P., Chambers, J., Davies, M., Hersey, A., Light, Y., McGlinchey, S., Michalovich, D., Al-Lazikani, B., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gkr777 · Cited by 4,382
ZINC − A Free Database of Commercially Available Compounds for Virtual Screening
Irwin, J. J., & Shoichet, B. K. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci049714+ · Cited by 4,058
BindingDB: a web-accessible database of experimentally determined protein-ligand binding affinities
Liu, T., Lin, Y., Wen, X., Jorissen, R. N., & Gilson, M. K. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkl999 · Cited by 2,124
HMDB: a knowledgebase for the human metabolome
Wishart, D. S., Knox, C., Guo, A. C., Eisner, R., Young, N., Gautam, B., Hau, D. D., Psychogios, N., Dong, E., Bouatra, S., et al. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkn810 · Cited by 1,873
DrugBank 3.0: a comprehensive resource for 'Omics' research on drugs
Knox, C., Law, V., Jewison, T., Liu, P., Ly, S., Frolkis, A., Pon, A., Banco, K., Mak, C., Neveu, V., et al. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkq1126 · Cited by 1,831
Willett, P., Barnard, J. M., & Downs, G. M. (1998) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci9800211 · Cited by 1,765
PubChem: a public information system for analyzing bioactivities of small molecules
Wang, Y., Xiao, J., Suzek, T. O., Zhang, J., Wang, J., & Bryant, S. H. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp456 · Cited by 1,467
A ‘Rule of Three’ for fragment-based lead discovery?
Congreve, M., Carr, R., Murray, C., & Jhoti, H. (2003) · Drug Discovery Today · doi:10.1016/s1359-6446(03)02831-9 · Cited by 1,354
Benchmarking sets for molecular docking.
Huang, N., Shoichet, B. K., & Irwin, J. J. (2006) · Journal of Medicinal Chemistry · doi:10.1021/jm0608356 · Cited by 1,318
PubChem: Integrated Platform of Small Molecules and Biological Activities
(2008) · Annual Reports in Computational Chemistry · doi:10.1016/s1574-1400(08)00012-1 · Cited by 1,263
Hit and lead generation: beyond high-throughput screening
Bleicher, K. H., Böhm, H.-J., Müller, K., & Alanine, A. I. (2003) · Nature Reviews Drug Discovery · doi:10.1038/nrd1086 · Cited by 1,056
Dobson, C. M. (2004) · Nature · doi:10.1038/nature03192 · Cited by 1,003
Comparison of Shape-Matching and Docking as Virtual Screening Tools
Hawkins, P. C. D., Skillman, A. G., & Nicholls, A. (2007) · Journal of Medicinal Chemistry · doi:10.1021/jm0603365 · Cited by 993
Computer-based de novo design of drug-like molecules
Schneider, G., & Fechner, U. (2005) · Nature Reviews Drug Discovery · doi:10.1038/nrd1799 · Cited by 948
The Design of Leadlike Combinatorial Libraries
Teague, S. J., Davis, A. M., Leeson, P. D., & Oprea, T. (1999) · Angewandte Chemie International Edition · doi:10.1002/(sici)1521-3773(19991216)38:24<3743::aid-anie3743>3.0.co;2-u · Cited by 870
970 Million Druglike Small Molecules for Virtual Screening in the Chemical Universe Database GDB-13
Blum, L. C., & Reymond, J.-L. (2009) · Journal of the American Chemical Society · doi:10.1021/ja902302h · Cited by 860
Self-citationCelie, P. H. N., van Rossum-Fikkert, S. E., van Dijk, W. J., Brejc, K., Smit, A. B., & Sixma, T. K. (2004) · Neuron · doi:10.1016/s0896-6273(04)00115-1 · Cited by 781
Lewell, X. Q., Judd, D. B., Watson, S. P., & Hann, M. M. (1998) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci970429i · Cited by 691
Virtual ligand screening: strategies, perspectives and limitations
Klebe, G. (2006) · Drug Discovery Today · doi:10.1016/j.drudis.2006.05.012 · Cited by 664
Yeast Two-Hybrid, a Powerful Tool for Systems Biology
Brückner, A., Polge, C., Lentze, N., Auerbach, D., & Schlattner, U. (2009) · International Journal of Molecular Sciences · doi:10.3390/ijms10062763 · Cited by 617
Isolation and Structure of Higher Diamondoids, Nanometer-Sized Diamond Molecules
Dahl, J. E., Liu, S. G., & Carlson, R. M. K. (2003) · Science · doi:10.1126/science.1078239 · Cited by 604
The Comparative Toxicogenomics Database: update 2013
Davis, A. P., Murphy, C. G., Johnson, R., Lay, J. M., Lennon-Hopkins, K., Saraceni-Richards, C., Sciaky, D., King, B. L., Rosenstein, M. C., Wiegers, T. C., et al. (2013) · Nucleic Acids Research · doi:10.1093/nar/gks994 · Cited by 497
Fink, T., & Reymond, J.-L. (2007) · Journal of Chemical Information and Modeling · doi:10.1021/ci600423u · Cited by 457
Self-citationFrom atoms and bonds to three-dimensional atomic coordinates: automatic model builders
Sadowski, J., & Gasteiger, J. (1993) · Chemical Reviews · doi:10.1021/cr00023a012 · Cited by 414
Diamonds are a Chemist's Best Friend: Diamondoid Chemistry Beyond Adamantane
Schwertfeger, H., Fokin, A. A., & Schreiner, P. R. (2008) · Angewandte Chemie International Edition · doi:10.1002/anie.200701684 · Cited by 413
SMPDB: The Small Molecule Pathway Database
Frolkis, A., Knox, C., Lim, E., Jewison, T., Law, V., Hau, D. D., Liu, P., Gautam, B., Ly, S., Guo, A. C., et al. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkp1002 · Cited by 375
Chemography: The Art of Navigating in Chemical Space
Oprea, T. I., & Gottfries, J. (2001) · Journal of Combinatorial Chemistry · doi:10.1021/cc0000388 · Cited by 353
Virtual Exploration of the Small‐Molecule Chemical Universe below 160 Daltons
Fink, T., Bruggesser, H., & Reymond, J. (2005) · Angewandte Chemie International Edition · doi:10.1002/anie.200462457 · Cited by 353
Self-citationChemical space as a source for new drugs
Reymond, J.-L., van Deursen, R., Blum, L. C., & Ruddigkeit, L. (2010) · MedChemComm · doi:10.1039/c0md00020e · Cited by 347
Self-citationGeppert, H., Vogt, M., & Bajorath, J. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci900419k · Cited by 327
Kirkpatrick, P., & Ellis, C. (2004) · Nature · doi:10.1038/432823a · Cited by 327
Ertl, P. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci0255782 · Cited by 292
Novel Chemical Space Exploration via Natural Products
Rosén, J., Gottfries, J., Muresan, S., Backlund, A., & Oprea, T. I. (2009) · Journal of Medicinal Chemistry · doi:10.1021/jm801514w · Cited by 280
ChemBank: a small-molecule screening and cheminformatics resource database
Seiler, K. P., George, G. A., Happ, M. P., Bodycombe, N. E., Carrinski, H. A., Norton, S., Brudz, S., Sullivan, J. P., Muhlich, J., Serrano, M., et al. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm843 · Cited by 280
Bioactivity-Guided Navigation of Chemical Space
Bon, R. S., & Waldmann, H. (2010) · Accounts of Chemical Research · doi:10.1021/ar100014h · Cited by 245
The Comparative Toxicogenomics Database: update 2011
Davis, A. P., King, B. L., Mockus, S., Murphy, C. G., Saraceni-Richards, C., Rosenstein, M., Wiegers, T., & Mattingly, C. J. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkq813 · Cited by 235
BindingDB: A Web-Accessible Molecular Recognition Database
Chen, X., Liu, M., & Gilson, M. (2001) · Combinatorial Chemistry & High Throughput Screening · doi:10.2174/1386207013330670 · Cited by 223
A question of size: the eukaryotic proteome and the problems in defining it
Harrison, P. M. (2002) · Nucleic Acids Research · doi:10.1093/nar/30.5.1083 · Cited by 222
Bodnar, A. L., Cortes-Burgos, L. A., Cook, K. K., Dinh, D. M., Groppi, V. E., Hajos, M., Higdon, N. R., Hoffmann, W. E., Hurst, R. S., Myers, J. K., et al. (2005) · Journal of Medicinal Chemistry · doi:10.1021/jm049363q · Cited by 216
Comparison of the NCI Open Database with Seven Large Chemical Structural Databases
Voigt, J. H., Bienfait, B., Wang, S., & Nicklaus, M. C. (2001) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci000150t · Cited by 216
ChemDB: a public database of small molecules and related chemoinformatics resources
Chen, J., Swamidass, S. J., Dou, Y., Bruand, J., & Baldi, P. (2005) · Bioinformatics · doi:10.1093/bioinformatics/bti683 · Cited by 186
Pierce, A. C., Rao, G., & Bemis, G. W. (2004) · Journal of Medicinal Chemistry · doi:10.1021/jm030543u · Cited by 185
Warr, W. A. (2009) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-009-9260-9 · Cited by 176
Novel software tools for chemical diversity
Pearlman, R. S., & Smith, K. M. (1998) · Perspectives in Drug Discovery and Design · doi:10.1023/a:1027232610247 · Cited by 175
Biton, B., Bergis, O. E., Galli, F., Nedelec, A., Lochead, A. W., Jegham, S., Godet, D., Lanneau, C., Santamaria, R., Chesney, F., et al. (2007) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301189 · Cited by 173
Molecular complexity and fragment-based drug discovery: ten years on
Leach, A. R., & Hann, M. M. (2011) · Current Opinion in Chemical Biology · doi:10.1016/j.cbpa.2011.05.008 · Cited by 169
Lederberg, J., Sutherland, G. L., Buchanan, B. G., Feigenbaum, E. A., Robertson, A. V., Duffield, A. M., & Djerassi, C. (1969) · Journal of the American Chemical Society · doi:10.1021/ja01039a025 · Cited by 169
The enumeration of chemical space
Reymond, J., Ruddigkeit, L., Blum, L. C., & van Deursen, R. (2012) · Wiley Interdisciplinary Reviews Computational Molecular Science · doi:10.1002/wcms.1104 · Cited by 148
Self-citationBauknecht, H., Zell, A., Bayer, H., Levi, P. A., Wagener, M., Sadowski, J., & Gasteiger, J. (1996) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci960346m · Cited by 138
Classification of Organic Molecules by Molecular Quantum Numbers
Nguyen, K. T., Blum, L. C., van Deursen, R., & Reymond, J. (2009) · ChemMedChem · doi:10.1002/cmdc.200900317 · Cited by 119
Self-citationThe in silico world of virtual libraries
Leach, A. R. (2000) · Drug Discovery Today · doi:10.1016/s1359-6446(00)01516-6 · Cited by 107
Danziger, D. J., & Dean, P. M. (1989) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1989.0015 · Cited by 106
Relationships between Molecular Complexity, Biological Activity, and Structural Diversity
Schuffenhauer, A., Brown, N., Selzer, P. M., Ertl, P., & Jacoby, E. (2005) · Journal of Chemical Information and Modeling · doi:10.1021/ci0503558 · Cited by 102
Recent developments in automated structure elucidation of natural products
Steinbeck, C. (2004) · Natural Product Reports · doi:10.1039/b400678j · Cited by 99
Similarity Searching and Scaffold Hopping in Synthetically Accessible Combinatorial Chemistry Spaces
Boehm, M., Wu, T.-Y., Claussen, H., & Lemmen, C. (2008) · Journal of Medicinal Chemistry · doi:10.1021/jm0707727 · Cited by 97
Walker, D. P., Wishka, D. G., Piotrowski, D. W., Jia, S., Reitz, S. C., Yates, K. M., Myers, J. K., Vetman, T. N., Margolis, B. J., Jacobsen, E. J., et al. (2006) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2006.09.019 · Cited by 95
Processing and classification of chemical data inspired by insect olfaction
Schmuker, M., & Schneider, G. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0705683104 · Cited by 93
Public Chemical Compound Databases
Williams, A. J. (2013) · PubMed · doi:10.6084/m9.figshare.654769 · Cited by 85
Ulens, C., Akdemir, A., Jongejan, A., van Elk, R., Bertrand, S., Anastassis Perrakis, A., Leurs, R., Smit, A. B., Sixma, T. K., Bertrand, D., et al. (2009) · Journal of Medicinal Chemistry · doi:10.1021/jm801400g · Cited by 83
Cayley, E. (1875) · Berichte der deutschen chemischen Gesellschaft · doi:10.1002/cber.18750080252 · Cited by 83
Knowledge-Based Approach to de Novo Design Using Reaction Vectors
Patel, H., Bodkin, M. J., Chen, B., & Gillet, V. J. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci800413m · Cited by 82
Medina‐Franco, J. L., Maggiora, G. M., Giulianotti, M. A., Pinilla, C., & Houghten, R. A. (2007) · Chemical Biology & Drug Design · doi:10.1111/j.1747-0285.2007.00579.x · Cited by 82
Voyages to the (un)known: adaptive design of bioactive compounds
Schneider, G., Hartenfeller, M., Reutlinger, M., Tanrikulu, Y., Proschak, E., & Schneider, P. (2008) · Trends in biotechnology · doi:10.1016/j.tibtech.2008.09.005 · Cited by 79
Visualisation and subsets of the chemical universe database GDB-13 for virtual screening
Blum, L. C., van Deursen, R., & Reymond, J. (2011) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-011-9436-y · Cited by 62
Self-citationvan Deursen, R., Blum, L. C., & Reymond, J. (2010) · Journal of Chemical Information and Modeling · doi:10.1021/ci100237q · Cited by 62
Self-citationRecent Trends and Observations in the Design of High-Quality Screening Collections
Renner, S., Popov, M., Schuffenhauer, A., ROTH, H. ‐., Breitenstein, W., Marzinzik, A. L., Lewis, I., Krastel, P., Nigsch, F., Jenkins, J. L., et al. (2011) · Future Medicinal Chemistry · doi:10.4155/fmc.11.15 · Cited by 61
Systems Biology and Systems Chemistry: New Directions for Drug Discovery
Brown, J. B., & Okuno, Y. (2012) · Chemistry & Biology · doi:10.1016/j.chembiol.2011.12.012 · Cited by 53
Anticipating drug side effects by comparative pharmacology
García-Serna, R., & Mestres, J. (2010) · Expert Opinion on Drug Metabolism & Toxicology · doi:10.1517/17425255.2010.509343 · Cited by 52
Khalifa, A. A., Harańczyk, M., & Holliday, J. D. (2009) · Journal of Chemical Information and Modeling · doi:10.1021/ci8004644 · Cited by 48
Luethi, E., Nguyen, K. T., Bürzle, M., Blum, L. C., Suzuki, Y., Hediger, M. A., & Reymond, J. (2010) · Journal of Medicinal Chemistry · doi:10.1021/jm100959g · Cited by 45
Self-citationScaffold Topologies. 2. Analysis of Chemical Databases
Wester, M. J., Pollock, S. N., Coutsias, E. A., Allu, T. K., Mureşan, S., & Oprea, T. I. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci700342h · Cited by 44
Scaffold Topologies. 1. Exhaustive Enumeration up to Eight Rings
Pollock, S. N., Coutsias, E. A., Wester, M. J., & Oprea, T. I. (2008) · Journal of Chemical Information and Modeling · doi:10.1021/ci7003412 · Cited by 44
Discovery of NMDA Glycine Site Inhibitors from the Chemical Universe Database GDB
Nguyen, K. T., Syed, S., Urwyler, S., Bertrand, S., Bertrand, D., & Reymond, J. (2008) · ChemMedChem · doi:10.1002/cmdc.200800198 · Cited by 42
Self-citationBayesian Methods in Virtual Screening and Chemical Biology
Bender, A. (2010) · Methods in molecular biology · doi:10.1007/978-1-60761-839-3_7 · Cited by 39
Exploring the Chemical Space of Known and Unknown Organic Small Molecules at www.gdb.unibe.ch
Reymond, J., Blum, L. C., & van Deursen, R. (2011) · CHIMIA International Journal for Chemistry · doi:10.2533/chimia.2011.863 · Cited by 34
Self-citationBlum, L. C., van Deursen, R., Bertrand, S., Mayer, M., Burgi, J. J., Bertrand, D., & Reymond, J. (2011) · Journal of Chemical Information and Modeling · doi:10.1021/ci200410u · Cited by 33
Self-citationDias, J. R. (2010) · Chemical Society Reviews · doi:10.1039/b913686j · Cited by 29
Visualisation of the chemical space of fragments, lead-like and drug-like molecules in PubChem
van Deursen, R., Blum, L. C., & Reymond, J. (2011) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-011-9437-x · Cited by 29
Self-citationGarcı́a-Delgado, N., Bertrand, S., Nguyen, K. T., van Deursen, R., Bertrand, D., & Reymond, J. (2010) · ACS Medicinal Chemistry Letters · doi:10.1021/ml100125f · Cited by 28
Self-citationThe Benefits of Constructing Leads from Fragment Hits
Foloppe, N. (2011) · Future Medicinal Chemistry · doi:10.4155/fmc.11.46 · Cited by 27
A Survey and New Results on Computer Enumeration of Polyhex and Fusene Hydrocarbons
Brinkmann, G., Caporossi, G., & Hansen, P. (2003) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci025526c · Cited by 25
Nguyen, K. T., Luethi, E., Syed, S., Urwyler, S., Bertrand, S., Bertrand, D., & Reymond, J. (2009) · Bioorganic & Medicinal Chemistry Letters · doi:10.1016/j.bmcl.2009.04.021 · Cited by 22
Self-citationvan der Horst, E., Peironcely, J. E., van Westen, G. J. P., van den Hoven, O. O., Galloway, W. R. J. D., Spring, D. R., Wegner, J. K., van Vlijmen, H., IJzerman, A. P., Overington, J. P., et al. (2011) · Current Topics in Medicinal Chemistry · doi:10.2174/156802611796391230 · Cited by 22
Cluster analysis of the DrugBank chemical space using molecular quantum numbers
Awale, M., & Reymond, J. (2012) · Bioorganic & Medicinal Chemistry · doi:10.1016/j.bmc.2012.03.017 · Cited by 18
Self-citationMontelione, G. T., & Szyperski, T. (2010) · PubMed · Cited by 12
What we have learned from crystal structures of proteins to receptor function
Reymond, J., van Deursen, R., & Bertrand, D. (2011) · Biochemical Pharmacology · doi:10.1016/j.bcp.2011.07.061 · Cited by 8
Self-citationThe art and practice of structure-based drug design: A molecular modeling perspective
(1996) · doi:10.1002/(sici)1098-1128(199601)16:1<3::aid-med1>3.0.co;2-6
(1998) · doi:10.1002/(sici)1096-987x(19981115)19:14<1639::aid-jcc10>3.0.co;2-b
Cited by
Enumeration of 166 Billion Organic Small Molecules in the Chemical Universe Database GDB-17
Ruddigkeit, L., van Deursen, R., Blum, L. C., & Reymond, J.-L. (2012) · Journal of Chemical Information and Modeling · doi:10.1021/ci300415d · Cited by 1,505
Self-citationDeep learning for computational chemistry
Goh, G. B., Hodas, N. O., & Vishnu, A. (2017) · Journal of Computational Chemistry · doi:10.1002/jcc.24764 · Cited by 809
Reymond, J.-L. (2015) · Accounts of Chemical Research · doi:10.1021/ar500432k · Cited by 720
Self-citationNPClassifier: A Deep Neural Network-Based Structural Classification Tool for Natural Products
Kim, H. W., Wang, M., Leber, C. A., Nothias, L.-F., Reher, R., Kang, K. B., van der Hooft, J. J. J., Dorrestein, P. C., Gerwick, W. H., & Cottrell, G. W. (2021) · Journal of Natural Products · doi:10.1021/acs.jnatprod.1c00399 · Cited by 551
Recent advances in spirocyclization of indole derivatives
Bariwal, J., Voskressensky, L. G., & Van der Eycken, E. V. (2018) · Chemical Society Reviews · doi:10.1039/c7cs00508c · Cited by 422
Metadata
- Authors
- Reymond, J.-L., & Awale, M.
- Venue
- ACS Chemical Neuroscience
- Publisher
- American Chemical Society (ACS)
- Published
- 2012-05-03
- Volume
- 3
- Issue
- 9
- Pages
- 649-657
- ISSN
- 1948-7193 (ISSN-L)
- OpenAlex
- W2151971404
- Cited by
- 326
- References
- 93
- FWCI
- 17.31
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.