The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Optimization and testing of mass spectral library search algorithms for compound identification
Abstract
Five algorithms proposed in the literature for library search identification of unknown compounds from their low resolution mass spectra were optimized and tested by matching test spectra against reference spectra in the NIST-EPA-NIH Mass Spectral Database. The algorithms were probability-based matching (PBM), dot-product, Hertz et al. similarity index, Euclidean distance, and absolute value distance. The test set consisted of 12,592 alternate spectra of about 8000 compounds represented in the database. Most algorithms were optimized by varying their mass weighting and intensity scaling factors. Rank in the list of candidatc compounds was used as the criterion for accuracy. The best performing algorithm (75% accuracy for rank 1) was the dot-product function that measures the cosine of the angle between spectra represented as vectors. Other methods in order of performance were the Euclidean distance (72%), absolute value distance (68%) PBM (65%), and Hertz et al. (64%). Intensity scaling and mass weighting were important in the optimized algorithms with the square root of the intensity scale nearly optimal and the square or cube the best mass weighting power. Several more complex schemes also were tested, but had little effect on the results. A modest improvement in the performance of the dot-product algorithm was made by adding a term that gave additional weight to relative peak intensities for spectra with many peaks in common.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Matching measured MS/MS to libraries160 of reference MS/MS spectra with known structures, organized into libraries, is a common approach within the natural products field.”
From Connecting metabolome and phenotype: recent advances in functional metabolomics tools for the identification of bioactive natural products (2024) · cites this paper as [160]
Citations
Cites
Identification of mass spectra by computer-searching a file of known spectra
Hertz, H. S., Hites, R. A., & BIEMANN, K. (1971) · Analytical Chemistry · doi:10.1021/ac60301a009 · Cited by 305
Estimating probabilities of correct identification from results of mass spectral library searches
Stein, S. E. (1994) · Journal of the American Society for Mass Spectrometry · doi:10.1016/1044-0305(94)85022-4 · Cited by 231
Self-citationProbability based matching of mass spectra. Rapid identification of specific compounds in mixtures
McLafferty, F. W., Hertel, R. H., & Villwock, R. D. (1974) · Organic Mass Spectrometry · doi:10.1002/oms.1210090710 · Cited by 177
Computer methods in analytical mass spectrometry. Identification of an unknown compound in a catalog
Crawford, L., & Morrison, J. D. (1968) · Analytical Chemistry · doi:10.1021/ac60266a027 · Cited by 119
Computer-Enhanced Analytical Spectroscopy
(1990) · Springer eBooks · doi:10.1007/978-1-4684-1312-0 · Cited by 106
Atwater, B. L., Stauffer, D. B., McLafferty, F. W., & Peterson, D. W. (1985) · Analytical Chemistry · doi:10.1021/ac00281a028 · Cited by 71
The Evaluation of Mass Spectral Search Algorithms
Rasmussen, G. T., & ISENHOUR, T. L. (1979) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci60019a014 · Cited by 69
Retrieval and interpretative computer programs for mass spectrometry
McLafferty, F. W., & Stauffer, D. B. (1985) · Journal of Chemical Information and Computer Sciences · doi:10.1021/ci00047a021 · Cited by 67
Performance prediction and evaluation of systems for computer identification of spectra
McLafferty, F. W. (1977) · Analytical Chemistry · doi:10.1021/ac50017a036 · Cited by 40
Comparative Evaluations of Mass Spectral Data Bases
McLafferty, F. W., Stauffer, D. B., & Loh, S. Y. (1991) · Journal of the American Society for Mass Spectrometry · doi:10.1016/1044-0305(91)85011-t · Cited by 37
Research works printed but not linked: 3
- Sokolow S., 1978, The Finnigan Library Search Program
- Pellizarri E. D., 1985, Comparative Evaluation of GC/MS Data Analysis Processing
- Pesya G. M., 1975, Computerized Structure Retrieval and Interpretation of Mass Spectra: The Design and Evaluation of a Probability Based Matching System Using a Large Data Base
Cited by
Sorted by citations
Items 701–800 of 886
Sampling Probes Microfabricated from Parylene-C for In Vivo Neurochemical Monitoring
White, T. S., Bain, I., Cain, C. N., Popov, P., Evans, C. R., & Kennedy, R. T. (2025) · ACS Measurement Science Au · doi:10.1021/acsmeasuresciau.5c00102 · Cited by 1
Refining EI-MS library search results through atomic-level insights
Ashyrmamatov, I., Ucak, U. V., & Lee, J. (2025) · Communications Chemistry · doi:10.1038/s42004-025-01706-9 · Cited by 1
High-Throughput Mass Spectral Library Searching of Small Molecules in R with NIST MSPepSearch
Samokhin, A. S., & Khrisanfov, M. (2025) · Journal of the American Society for Mass Spectrometry · doi:10.1021/jasms.5c00322 · Cited by 1
OctoChemDB: An Aggregated Database for Small Molecule Identification Using High-Resolution MS Data
Silvestre, R., Martinent, R., Menin, L., Gasilova, N., Mutel, V., Portmann, C., & Patiny, L. (2026) · Analytical Chemistry · doi:10.1021/acs.analchem.5c06761 · Cited by 1
Deconvolution of Mass Spectra Through Particle Swarm Optimization: An Industrial Experience
Correale, R., Lutton, É., Mongardi, G., Squillero, G., Todino, R., & Tonda, A. P. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-23607-4_26 · Cited by 1
Brezins, M., Chazeau, B., Marchand, N., Durand, A., Gille, G., Bourjot, R., Prévôt, A. S. H., Jaffrezo, J., Uzu, G., & D’Anna, B. (2026) · Aerosol Research · doi:10.5194/ar-4-231-2026 · Cited by 1
Shi, J., Zhang, J., Zhou, X., Zhang, D., Qi, H., Chen, S., Hou, Y., Jia, Z., & Wu, C. (2026) · Acta Pharmaceutica Sinica B · doi:10.1016/j.apsb.2026.07.026 · Cited by 1
Todorović, D., & Здравковски, З. (2011) · Macedonian Journal of Chemistry and Chemical Engineering · doi:10.20450/mjcce.2011.74 · Cited by 1
Dynamic multiple spectral similarity measures for compound identification
Cao, L., Zhang, Z.-S., & Zhang, J. (2013) · International Congress on Image and Signal Processing (CISP) · doi:10.1109/cisp.2013.6743866 · Cited by 1
Pelled, O., Abrahám, A., Weinstein, M., German, U., & Alfassi, Z. B. (2010) · Radiation Measurements · doi:10.1016/j.radmeas.2010.06.065 · Cited by 1
A new hybrid probability-based method for identifying proteins and protein modifications
Wang, P., & Wilson, S. R. (2013) · IEEE Conference on Computational Intelligence in Bioinformatics and Computational Biology (CIBCB) · doi:10.1109/cibcb.2013.6595381 · Cited by 1
Cao, L., Zhang, Z.-S., & Zhang, J. (2014) · International Conference on Systems and Informatics (ICSAI) · doi:10.1109/icsai.2014.7009416 · Cited by 1
Mass Informatics: From Mass Spectrometry Peaks to Biological Pathways
Askenazi, M., & Linial, M. (2013) · Israel Journal of Chemistry · doi:10.1002/ijch.201200076 · Cited by 1
Practical Aspects of Electron Ionization
Gross, J. H. (2017) · Springer eBooks · doi:10.1007/978-3-319-54398-7_5 · Cited by 1
Zhang, J., Li, J., Ding, B., Qiao, Q., Wang, H., Liang, Y., Song, P., Wu, Y., Wang, C., Tang, K., et al. (2024) · Rapid Communications in Mass Spectrometry · doi:10.1002/rcm.9752 · Cited by 1
Sharma, S., Sharma, P., Dhaliwal, H. S., & Sharma, V. (2024) · Chemistry of Natural Compounds · doi:10.1007/s10600-024-04489-y · Cited by 1
Gautam, G., Sharma, S., Sharma, P., Sharma, S., & Sharma, V. (2024) · Chemistry of Natural Compounds · doi:10.1007/s10600-024-04548-4 · Cited by 1
How to Train Your Neural Network for Molecular Structure Generation from Mass Spectra?
Zhao, K., Liu, Y., Dian, L., Sun, S., & Cui, X. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822742 · Cited by 1
Deep Representation Learning for Electron Ionization Mass Spectra Retrieval
Liu, S., Zhang, X., Jiao, A., Sun, S., Dian, L., & Cui, X. (2024) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm62325.2024.10822853 · Cited by 1
Empowering chemists to mine high-throughput mass spectrometry datasets
(2025) · Nature Methods · doi:10.1038/s41592-025-02661-y · Cited by 1
CoSpred: Machine Learning Workflow to Predict Tandem Mass Spectrum in Proteomics
Xue, L., Tiwary, S., Bordyuh, M., Beltran, P. M. J., & Stanton, R. V. (2025) · PROTEOMICS · doi:10.1002/pmic.70004 · Cited by 1
A GC-MS Database of Nitrogen-Rich Volatile Compounds
Sholokhova, A. Y., Borovikova, S. A., Kosyakov, D. S., & Matyushin, D. D. (2025) · Toxics · doi:10.3390/toxics13110986 · Cited by 1
Spectral library searching for peptide identification in proteomics
Lam, H. (2012) · Statistics and Its Interface · doi:10.4310/sii.2012.v5.n1.a4 · Cited by 1
Combine Multiple Mass Spectral Similarity Measures for Compound Identification in GC-MS
Liao, L.-H., Zhu, Y.-F., Cao, L., & Zhang, J. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-09330-7_31 · Cited by 1
Comparative Analysis of MALDI-TOF Mass Spectrometric Data in Proteomics: A Case Study
Prete, E. D., d’Esposito, D., Mazzeo, M. F., Siciliano, R. A., & Facchiano, A. M. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-44332-4_12 · Cited by 1
Use of Molecular Weight and Elemental Composition as an Additional Constraint in Library Search
Samokhin, A. S., Sotnezova, K. M., & Revelsky, I. A. (2018) · Journal of Analytical Chemistry · doi:10.1134/s1061934818140071 · Cited by 1
High-Performance Remote Radioactive Material Identification of Mixtures
Ayhan, B., Kwan, C., Islam, K. A., Stavola, A., Hendry, S., & Li, J. (2021) · IEEE Transactions on Nuclear Science · doi:10.1109/tns.2021.3130412 · Cited by 1
From data to forensic insight using chemometrics
van Asten, A. (2023) · Elsevier eBooks · doi:10.1016/b978-0-12-820715-4.00012-2 · Cited by 1
Vector representation as a tool for detecting characteristic uranium peaks
Forney, A. M. (2012) · DigitalGeorgetown (Georgetown University Library) · Cited by 1
Pelled, O., Bonardi, M. L., German, U., Groppi, F., & Alfassi, Z. B. (2006) · Applied Radiation and Isotopes · doi:10.1016/j.apradiso.2006.07.006 · Cited by 1
Bioinformatics for proteomics.
Ahrens, C. H., Jespersen, H. M., & Schandorff, S. (2005) · PubMed · Cited by 1
THE DIRECT COST OF SYPHILIS TO THE CITY OF MONTREAL.
Cormia, F. E. (1940) · PubMed Central · Cited by 1
Predicting Electron-Ionization Mass Spectrometry using Neural NetworksPreprint
Wei, J. N., Belanger, D., Adams, R. P., & Sculley, D. (2018) · arXiv (Cornell University) · Cited by 1
Computer Methods in Mass Spectrometry for Chemical Structure Assignment*
Вармуза, К. (2010) · Elsevier eBooks · doi:10.1016/b978-0-12-374413-5.00126-3 · Cited by 1
GC×GC-MS and parallel 2DLC-MS based untargeted metabolomics.
Prodhan, M. A. I. (2019) · ThinkIR: The University of Louisville's Institutional Repository (University of Louisville) · doi:10.18297/etd/3307 · Cited by 1
Statistical Assessment of the Significance of Fracture Fits in Trace Evidence
Brooks, E. K. (2020) · doi:10.33915/etd.7704 · Cited by 1
SIMILE enables alignment of fragmentation mass spectra with statistical significancePreprint
Treen, D. G. C., Northen, T. R., & Bowen, B. P. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.02.24.432767 · Cited by 1
Information Measures for Multisensor Systems
Minor, C. P., Gezo, J. C., & Johnson, K. (2013) · doi:10.21236/ada591226 · Cited by 1
Introduction To LC–MS Technology
Niessen, W. M. A., & C., R. A. C. (2017) · Wiley eBooks · doi:10.1002/9781119294269.ch1 · Cited by 2
Applied and Computational Mathematics Division :
Boisvert, R. F. (2022) · doi:10.6028/nist.ir.8423 · Cited by 1
Slobodnı́k, J., Γιαννακόπουλος, Θ., Τhomaidis, Ν. S., & Alygizakis, N. A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4091494 · Cited by 1
Fortenberry, C. F., Walker, M. J., Zhang, Y., Mitroo, D., Brune, W. H., & Williams, B. J. (2017) · doi:10.5194/acp-2017-576-supplement · Cited by 1
Identifying Fentanyl with Mass Spectral LibrariesPreprint
Kearsley, A. J., & Moorthy, A. S. (2021) · ChemRxiv · doi:10.26434/chemrxiv.14176952 · Cited by 1
Hartler, J. (2015) · Springer eBooks · doi:10.1007/978-94-007-7864-1_12-1 · Cited by 1
Yamaguchi, R., Takeda, S., Yamada, M., Kakiuchi, T., & Imamura, Y. (2023) · ChemRxiv · doi:10.26434/chemrxiv-2023-54f89 · Cited by 1
Diversité chimique et potentialités antivirales d'Euphorbiacées tropicales
Rémy, S. (2019) · theses.fr (ABES) · doi:10.70675/d535d4f6ze297z4e33z965az6b622a16f280 · Cited by 1
Alfassi, Z. B., Pelled, O., German, U., Cincu, E., Manea, I., & Woods, M. (2008) · AIP conference proceedings · doi:10.1063/1.2979077
Activity Determination and Localization of Radioactive Point Source in a Large Medium
Alfassi, Z. B. (2008) · Encyclopedia of Analytical Chemistry · doi:10.1002/9780470027318.a9022
Algorithms for the analysis of MALDI peptide mass fingerprint spectra for proteomics
Monigatti, F. (2005) · edoc (University of Basel) · doi:10.5451/unibas-003639075
Signal variation in single particle aerosol mass spectrometry
Wissner-Gross, Z. D. (2007) · DSpace@MIT (Massachusetts Institute of Technology)
Sabareesh, V., & Sahal, D. (2015) · International Journal of Mass Spectrometry · doi:10.1016/j.ijms.2015.08.024
Robroeks, C. M. H. H. T. (2010) · Research Publications (Maastricht University) · doi:10.26481/dis.20100527cr
Metabolic Networks from a Systems Perspective
Weckwerth, W., & Steuer, R. (2005) · Springer eBooks · doi:10.1007/0-387-25240-1_15
An efficient approach for compound identification based on the frequency features of mass spectra
Sun, Z.-L., Lam, K., & Zhang, J. (2015) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2015.01.019
Alfassi, Z. B. (2009) · Radiation Protection Dosimetry · doi:10.1093/rpd/ncp166
Elektronenstoßionisation in der Praxis
Gross, J. H. (2012) · Springer eBooks · doi:10.1007/978-3-8274-2981-0_5
Hadrévi, J. (2012) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
The Localization Of Gamma Emitting Point Source In A Large Medium By Multi Detectors Measurement
Alfassi, Z. B. (2009) · NATO science for peace and security series. B, Physics and biophysics · doi:10.1007/978-1-4020-9600-6_2
Computational mass spectrometry for small
Hufsky, F. (2013)
Improved characterization of primary and secondary carbonaceous particles
Russell, L. M. (2013)
Mending the pieces: Computational mass spectrometry for small molecule fragmentation
Hufsky, F., & Scheubert, K. (2015)
Study of Exhaust Emission Components of SI Combustion by Using GC×GC-TOFMS
Nakano, M., Tomata, R., Kuriki, D., & Okawa, K. (2015) · SAE technical papers on CD-ROM/SAE technical paper series · doi:10.4271/2015-01-1948
Gertsiuk, M. (2014) · Science and innovation · doi:10.15407/scine10.02.068
Compound Identification Using Random Projection for Gas Chromatography-Mass Spectrometry Data
Cao, L., Zhang, Z.-S., Chen, P., & Zhang, J. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-22053-6_71
Fitz, B. D. (2015) · ResearchWorks at the University of Washington (University of Washington)
A Mass Spectra-Based Compound-Identification Approach with a Reduced Reference Library
Sun, Z.-L., Lam, K., & Zhang, J. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39482-9_77
An Emerging Tool for Understanding Metabolic Systems
Hean, S., Khoo, G., & Al‐Rubeai, M. (2007)
Peptide Spectrum Matching via Database Search and Spectral Library Search
Netzel, B. C., & Dasari, S. (2016) · Royal Society of Chemistry eBooks · doi:10.1039/9781782626732-00039
Matsuda, F. (2017) · Journal of Computer Aided Chemistry · doi:10.2751/jcac.18.24
MyCompoundID MS/MS Search and DnsID through Web-based Applications
Tang, C. (2015) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r36q1sv1j
ノルマルヘプタン-空気ストイキSI 燃焼から排出される燃焼生成物の検討
道王, 中., & 広平, 大. (2013) · 自動車技術会論文集 · doi:10.11351/jsaeronbun.44.1193
混合気温度と当量比がn-heptane の自着火過程で生成される化合物に及ぼす影響
道王, 中., 諒, 遠., 拓哉, 井., 昇太, 田., 凌, 新., 幸秀, 永., & 北川, 敏. (2017) · 自動車技術会論文集 · doi:10.11351/jsaeronbun.48.1247
Toluene の自着火過程におけるn-Heptane 添加の反応促進効果および 自着火過程で生成される化合物の検討
道王, 中., 諒, 遠., INAGE, M., 凌, 新., 健太, 河., 峻峰, 侯., 幸秀, 永., & 北川, 敏. (2018) · 自動車技術会論文集 · doi:10.11351/jsaeronbun.49.30
Efficient Mass Spectra Prediction through Container Orchestration with a Scientific Workflow.
Hanussek, M., Bartusch, F., Krüger, J., & Kohlbacher, O. (2017)
Yevtushenko, T. V., Omelchun, Y. A., & Novozhytska, J. M. (2017) · Bulletin Veterinary biotechnology · doi:10.31073/vet_biotech30-08
Salghuna, N. N., Prasad, P. R. C., & Rama Rao, N. (2018) · Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing · doi:10.1109/whispers.2018.8747248
A History of the Development of Mass Spectral Databases
Sparkman, O. D. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-043848-1.00204-2
Sensitive and specific spectral library searching with COSS and PercolatorPreprint
Shiferaw, G. A., Gabriels, R., Bouwmeester, R., Bossche, T. V. D., Vandermarliere, E., Martens, L., & Volders, P. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.09.438700
Yin, Q., Wang, Y., Yin, X., & Pan, Y. (2021) · The Analyst · doi:10.1039/d1an01206a
Detecting Electromagnetic Geographical Environment Changes Based on the Frequency‐Intensity Curve
Huang, Y., Wang, M., Qiu, Q., Miao, L., Zhang, H., Qin, J., Min, X., & Sheng, Y. (2021) · Journal of Sensors · doi:10.1155/2021/8819402
도미솔 (2021) · Seoul National University Open Repository (Seoul National University)
Hübschmann, H. (2001) · doi:10.1002/9783527612857.ch3
Instrumentation and Techniques of Mass Spectrometry
(2002) · CRC Press eBooks · doi:10.1201/9781420042696.ch2
Mass-to-Charge Ratio Set Matching: A Novel and Efficient Compound Identification Method
Hu, Y., Yu, J., Xie, C., Tang, K., & Wu, Y. (2022) · Journal of AOAC International · doi:10.1093/jaoacint/qsac026
Gertsiuk, M. (2014) · Nauka ta innovacii · doi:10.15407/scin10.02.075
Computer Methods in Mass Spectrometry for Chemical Structure Assignment
Вармуза, К. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-803224-4.00126-6
Wan, K., Vidavsky, I., & Gross, M. L. (2003) · Journal of the American Society for Mass Spectrometry · doi:10.1016/s1044-0305(02)00915-7
Äijälä, M., Heikkinen, L. M., Fröhlich, R., Canonaco, F., Prévôt, A. S. H., Junninen, H., Petäjä, T., Kulmala, M., Worsnop, D. R., & Ehn, M. (2016) · doi:10.5194/acp-2016-632-supplement
4 Techniques for library searches
(1996) · Data handling in science and technology · doi:10.1016/s0922-3487(96)80068-2
Raghavan, M., Zaitouna, A. J., & Kaur, A. (2020) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.733930138.793578400
The American Society for Mass Spectrometry
Varmuza, K., Spectrometry, M., & Varmuza, K. (1994) · Journal of the American Society for Mass Spectrometry · doi:10.1016/1044-0305(94)90013-2
Machine Learning Models for Detecting Fentanyl Analogs from Mass SpectraPreprint
Koshute, P. T., Hagan, N., & Jameson, N. J. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3924913
(2022) · Atmospheric chemistry and physics · doi:10.5194/acp-2022-297-rc1
(2022) · Atmospheric chemistry and physics · doi:10.5194/acp-2022-297-rc2
Liang, Y. (2022) · Atmospheric chemistry and physics · doi:10.5194/acp-2022-297-ac1
Metadata
- Authors
- Stein, S. E., & Scott, D. R.
- Affiliations
- Environmental Protection Agency (US)
- National Institute of Standards and Technology (US)
- ORCID
- Stein, Stephen E.
- Venue
- Journal of the American Society for Mass Spectrometry
- Publisher
- American Chemical Society (ACS)
- Published
- 1994-09-01
- Volume
- 5
- Issue
- 9
- Pages
- 859-866
- ISSN
- 1044-0305 (ISSN-L)
- OpenAlex
- W2028421938
- Cited by
- 882
- References
- 15
- Citations by year
- 2026: 36 · 2025: 62 · 2024: 72 · 2023: 73 · 2022: 66 · 2021: 57 · 2020: 39 · 2019: 35 · 2018: 39 · 2017: 47 · 2016: 30 · 2015: 40 · 2014: 33 · 2013: 39 · 2012: 33
- FWCI
- 2.65
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of the American Society for Mass Spectrometry (publishedVersion)
- PubMed (publishedVersion)
- Funders
- U.S. Environmental Protection Agency
- National Institute of Standards and Technology
- Topics
- Physical Sciences › Chemistry › Spectroscopy › Mass Spectrometry Techniques and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Metabolomics and Mass Spectrometry Studies
- Physical Sciences › Chemistry › Analytical Chemistry › Spectroscopy and Chemometric Analyses
- Keywords
- mass spectral library search, compound identification, low resolution mass spectra, Euclidean distance, intensity scaling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review