The DOI matches its Crossref record; 94 of the 94 references it cites were found in a registry or an index.
Flow cytometric bacterial cell counts challenge conventional heterotrophic plate counts for routine microbiological drinking water monitoring
Open accessAbstract
Drinking water utilities and researchers continue to rely on the century-old heterotrophic plate counts (HPC) method for routine assessment of general microbiological water quality. Bacterial cell counting with flow cytometry (FCM) is one of a number of alternative methods that challenge this status quo and provide an opportunity for improved water quality monitoring. After more than a decade of application in drinking water research, FCM methodology is optimised and established for routine application, supported by a considerable amount of data from multiple full-scale studies. Bacterial cell concentrations obtained by FCM enable quantification of the entire bacterial community instead of the minute fraction of cultivable bacteria detected with HPC (typically < 1% of all bacteria). FCM measurements are reproducible with relative standard deviations below 3% and can be available within 15 min of samples arriving in the laboratory. High throughput sample processing and complete automation are feasible and FCM analysis is arguably less expensive than HPC when measuring more than 15 water samples per day, depending on the laboratory and selected staining procedure(s). Moreover, many studies have shown FCM total (TCC) and intact (ICC) cell concentrations to be reliable and robust process variables, responsive to changes in the bacterial abundance and relevant for characterising and monitoring drinking water treatment and distribution systems. The purpose of this critical review is to initiate a constructive discussion on whether FCM could replace HPC in routine water quality monitoring. We argue that FCM provides a faster, more descriptive and more representative quantification of bacterial abundance in drinking water.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Standard methods: For the examination of water and waste water
(1990) · Analytical Biochemistry · doi:10.1016/0003-2697(90)90598-4 · Cited by 72,091
Standard methods for the examination of water and wastewater
(2012) · Choice Reviews Online · doi:10.5860/choice.49-6910 · Cited by 14,205
Reagent and laboratory contamination can critically impact sequence-based microbiome analyses
Salter, S. J., Cox, M. J., Turek, E. M., Calus, S. T., Cookson, W. O., Moffatt, M. F., Turner, P., Parkhill, J., Loman, N. J., & Walker, A. W. (2014) · BMC Biology · doi:10.1186/s12915-014-0087-z · Cited by 3,463
Shapiro, H. M. (2003) · Wiley eBooks · doi:10.1002/0471722731 · Cited by 2,671
A new medium for the enumeration and subculture of bacteria from potable water
Reasoner, D. J., & Geldreich, E. E. (1985) · Applied and Environmental Microbiology · doi:10.1128/aem.49.1.1-7.1985 · Cited by 2,300
A new view of the tree of life
Hug, L. A., Baker, B. J., Anantharaman, K., Brown, C. T., Probst, A. J., Castelle, C. J., Butterfield, C. N., Hernsdorf, A. W., Amano, Y., Ise, K., et al. (2016) · Nature Microbiology · doi:10.1038/nmicrobiol.2016.48 · Cited by 2,039
Nadkarni, M. A., Martin, F. E., Jacques, N. A., & Hunter, N. (2002) · Microbiology · doi:10.1099/00221287-148-1-257 · Cited by 1,938
Inactivation credit of UV radiation for viruses, bacteria and protozoan (oo)cysts in water: A review
Hijnen, W. A. M., Beerendonk, E. F., & Medema, G. J. (2006) · Water Research · doi:10.1016/j.watres.2005.10.030 · Cited by 1,591
Staley, J. T., & Konopka, A. (1985) · Annual Review of Microbiology · doi:10.1146/annurev.mi.39.100185.001541 · Cited by 1,570
Isolating "Uncultivable" Microorganisms in Pure Culture in a Simulated Natural Environment
Kaeberlein, T., Lewis, K., & Epstein, S. S. (2002) · Science · doi:10.1126/science.1070633 · Cited by 1,237
Recent findings on the viable but nonculturable state in pathogenic bacteria
Oliver, J. D. (2010) · FEMS Microbiology Reviews · doi:10.1111/j.1574-6976.2009.00200.x · Cited by 1,203
The viable but nonculturable state in bacteria.
Oliver, J. D. (2005) · PubMed · Cited by 1,032
Cultivation of the ubiquitous SAR11 marine bacterioplankton clade
Rappé, M. S., Connon, S. A., Vergin, K. L., & Giovannoni, S. J. (2002) · Nature · doi:10.1038/nature00917 · Cited by 1,018
THE MEASUREMENT OF ADENOSINE TRIPHOSPHATE IN THE OCEAN AND ITS ECOLOGICAL SIGNIFICANCE1
Holm‐Hansen, O., & Booth, C. R. (1966) · Limnology and Oceanography · doi:10.4319/lo.1966.11.4.0510 · Cited by 704
Microbial diversity and the genetic nature of microbial species
Achtman, M., & Wagner, M. (2008) · Nature Reviews Microbiology · doi:10.1038/nrmicro1872 · Cited by 617
Critical assessment of automated flow cytometry data analysis techniques
The FlowCAP Consortium, Aghaeepour, N., The DREAM Consortium, Finak, G., Hoos, H., Mosmann, T. R., Brinkman, R., Gottardo, R., & Scheuermann, R. H. (2013) · Nature Methods · doi:10.1038/nmeth.2365 · Cited by 598
Hammes, F., Berney, M., Wang, Y., Vital, M., Köster, O., & Egli, T. (2008) · Water Research · doi:10.1016/j.watres.2007.07.009 · Cited by 586
Self-citationKell, D. B., Kaprelyants, A. S., Weichart, D. H., Harwood, C. R., & Barer, M. R. (1998) · Antonie van Leeuwenhoek · doi:10.1023/a:1000664013047 · Cited by 581
Cellular nucleotide measurements and applications in microbial ecology
Karl, D. M. (1980) · Microbiological Reviews · doi:10.1128/mmbr.44.4.739-796.1980 · Cited by 556
Biological Stability of Drinking Water: Controlling Factors, Methods, and Challenges
Prest, E. I., Hammes, F., van Loosdrecht, M. C. M., & Vrouwenvelder, J. S. (2016) · Frontiers in Microbiology · doi:10.3389/fmicb.2016.00045 · Cited by 505
Self-citationMicrobial ecology of drinking water distribution systems
Berry, D., Xi, C., & Raskin, L. (2006) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2006.05.007 · Cited by 453
Siderophores from Neighboring Organisms Promote the Growth of Uncultured Bacteria
D'Onofrio, A., Crawford, J. M., Stewart, E. J., Witt, K., Gavrish, E., Epstein, S., Clardy, J., & Lewis, K. (2010) · Chemistry & Biology · doi:10.1016/j.chembiol.2010.02.010 · Cited by 453
Bacterial Community Structure in the Drinking Water Microbiome Is Governed by Filtration Processes
Pinto, A. J., Xi, C., & Raskin, L. (2012) · Environmental Science & Technology · doi:10.1021/es302042t · Cited by 419
Measurement and interpretation of microbial adenosine tri-phosphate (ATP) in aquatic environments
Hammes, F., Goldschmidt, F., Vital, M., Wang, Y., & Egli, T. W. (2010) · Water Research · doi:10.1016/j.watres.2010.04.015 · Cited by 405
Self-citationHeterotrophic plate count bacteria—what is their significance in drinking water?
Allen, M. J., Edberg, S. C., & Reasoner, D. J. (2004) · International Journal of Food Microbiology · doi:10.1016/j.ijfoodmicro.2003.08.017 · Cited by 387
Absolute quantification of microbial taxon abundances
Props, R., Kerckhof, F.-M., Rubbens, P., De Vrieze, J., Hernandez Sanabria, E., Waegeman, W., Monsieurs, P., Hammes, F., & Boon, N. (2017) · The ISME Journal · doi:10.1038/ismej.2016.117 · Cited by 379
Self-citationHammes, F. A., & Egli, T. (2005) · Environmental Science & Technology · doi:10.1021/es048277c · Cited by 333
Self-citationNocker, A., Sossa, K. E., & Camper, A. K. (2007) · Journal of Microbiological Methods · doi:10.1016/j.mimet.2007.04.014 · Cited by 312
Lautenschlager, K., Boon, N., Wang, Y., Egli, T. W., & Hammes, F. (2010) · Water Research · doi:10.1016/j.watres.2010.07.032 · Cited by 307
Self-citationPrest, E. I., Hammes, F., Kötzsch, S., van Loosdrecht, M. C. M., & Vrouwenvelder, J. S. (2013) · Water Research · doi:10.1016/j.watres.2013.07.051 · Cited by 306
Self-citationRapid, cultivation-independent assessment of microbial viability in drinking water
Berney, M., Vital, M., Hülshoff, I., Weilenmann, H.-U., Egli, T., & Hammes, F. (2008) · Water Research · doi:10.1016/j.watres.2008.07.017 · Cited by 272
Self-citationMethodological approaches for studying the microbial ecology of drinking water distribution systems
Douterelo, I., Boxall, J. B., Deines, P., Sekar, R., Fish, K. E., & Biggs, C. A. (2014) · Water Research · doi:10.1016/j.watres.2014.07.008 · Cited by 260
Comparison of Blue Nucleic Acid Dyes for Flow Cytometric Enumeration of Bacteria in Aquatic Systems
Lebaron, P., Parthuisot, N., & Catala, P. (1998) · Applied and Environmental Microbiology · doi:10.1128/aem.64.5.1725-1730.1998 · Cited by 259
Past, present and future applications of flow cytometry in aquatic microbiology
Wang, Y., Hammes, F., De Roy, K., Verstraete, W., & Boon, N. (2010) · Trends in Biotechnology · doi:10.1016/j.tibtech.2010.04.006 · Cited by 247
Self-citationBartram, J. (2013) · Water Intelligence Online · doi:10.2166/9781780405940 · Cited by 233
Development of biomass in a drinking water granular active carbon (GAC) filter
Velten, S., Boller, M., Köster, O., Helbing, J., Weilenmann, H.-U., & Hammes, F. (2011) · Water Research · doi:10.1016/j.watres.2011.09.017 · Cited by 231
Self-citationThe phenomenon of microbial uncultivability
Epstein, S. (2013) · Current Opinion in Microbiology · doi:10.1016/j.mib.2013.08.003 · Cited by 223
Uncultured microorganisms as a source of secondary metabolites
Lewis, K., Epstein, S., D'Onofrio, A., & Ling, L. L. (2010) · The Journal of Antibiotics · doi:10.1038/ja.2010.87 · Cited by 215
Hoefel, D., Grooby, W. L., Monis, P. T., Andrews, S., & Saint, C. P. (2003) · Journal of Microbiological Methods · doi:10.1016/s0167-7012(03)00201-x · Cited by 214
Lautenschlager, K., Hwang, C., Ling, F., Liu, W.-T., Boon, N., Köster, O., Egli, T., & Hammes, F. (2014) · Water Research · doi:10.1016/j.watres.2014.05.035 · Cited by 213
Self-citationCytometric methods for measuring bacteria in water: advantages, pitfalls and applications
Hammes, F., & Egli, T. (2010) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-010-3646-3 · Cited by 207
Self-citationIsolation and characterization of low nucleic acid (LNA)-content bacteria
Wang, Y., Hammes, F., Boon, N., Chami, M., & Egli, T. (2009) · The ISME Journal · doi:10.1038/ismej.2009.46 · Cited by 204
Self-citationDrinking water microbiology — from measurement to management
Proctor, C. R., & Hammes, F. (2015) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2014.12.014 · Cited by 199
Self-citationPinto, A. J., Schroeder, J., Lunn, M., Sloan, W., & Raskin, L. (2014) · mBio · doi:10.1128/mbio.01135-14 · Cited by 188
Heterotrophic bacteria in drinking water distribution system: a review
Chowdhury, S. (2011) · Environmental Monitoring and Assessment · doi:10.1007/s10661-011-2407-x · Cited by 176
Besmer, M. D., Weissbrodt, D. G., Kratochvil, B. E., Sigrist, J. ⁄. R. A., Weyland, M. S., & Hammes, F. (2014) · Frontiers in Microbiology · doi:10.3389/fmicb.2014.00265 · Cited by 162
Self-citationCultivation-independent Assessment of Bacterial Viability
Hammes, F., Berney, M., & Egli, T. W. (2010) · Advances in biochemical engineering, biotechnology · doi:10.1007/10_2010_95 · Cited by 159
Self-citationDetection and Cultivation of Soil Verrucomicrobia
Sangwan, P., Kovac, S., Davis, K. E. R., Sait, M. L., & Janssen, P. H. (2005) · Applied and Environmental Microbiology · doi:10.1128/aem.71.12.8402-8410.2005 · Cited by 159
Disinfection of bacteria attached to granular activated carbon
LeChevallier, M. W., Hassenauer, T. S., Camper, A. K., & McFeters, G. A. (1984) · Applied and Environmental Microbiology · doi:10.1128/aem.48.5.918-923.1984 · Cited by 156
Routine bacterial analysis with automated flow cytometry
Nevel, S. V., Kötzsch, S., Weilenmann, H., Boon, N., & Hammes, F. (2013) · Journal of Microbiological Methods · doi:10.1016/j.mimet.2013.05.007 · Cited by 144
Self-citationBuesing, N., & Gessner, M. O. (2002) · Aquatic Microbial Ecology · doi:10.3354/ame027029 · Cited by 133
Flow cytometry for fast microbial community fingerprinting
Roy, K. D., Clement, L., Thas, O., Wang, Y., & Boon, N. (2011) · Water Research · doi:10.1016/j.watres.2011.11.076 · Cited by 132
Self-citationFoladori, P., Bruni, L., Tamburini, S., & Ziglio, G. (2010) · Water Research · doi:10.1016/j.watres.2010.04.027 · Cited by 129
Growth of Vibrio cholerae O1 Ogawa Eltor in freshwater
Vital, M., Füchslin, H. P., Hammes, F., & Egli, T. W. (2007) · Microbiology · doi:10.1099/mic.0.2006/005173-0 · Cited by 128
Self-citationBiological Instability in a Chlorinated Drinking Water Distribution Network
Neščerecka, A., Rubulis, J., Vital, M., Juhna, T., & Hammes, F. (2014) · PLoS ONE · doi:10.1371/journal.pone.0096354 · Cited by 125
Self-citationHammes, F., Broger, T., Weilenmann, H., Vital, M., Helbing, J., Bosshart, U., Huber, P., Odermatt, R. P., & Sonnleitner, B. (2012) · Cytometry Part A · doi:10.1002/cyto.a.22048 · Cited by 117
Self-citationNeščerecka, A., Hammes, F., & Juhna, T. (2016) · Journal of Microbiological Methods · doi:10.1016/j.mimet.2016.10.022 · Cited by 117
Self-citationSiebel, E., Wang, Y., Egli, T. W., & Hammes, F. (2008) · Drinking water engineering and science · doi:10.5194/dwes-1-1-2008 · Cited by 115
Self-citationGillespie, S., Lipphaus, P., Green, J., Parsons, S. A., Weir, P., Juskowiak, K., Jefferson, B., Jarvis, P. R., & Nocker, A. (2014) · Water Research · doi:10.1016/j.watres.2014.07.029 · Cited by 110
Santos, Q. M. B.-D. L., Schroeder, J. L., Sevillano, M., Sungthong, R., Ijaz, U. Z., Sloan, W. T., & Pinto, A. J. (2016) · Environmental Science Water Research & Technology · doi:10.1039/c6ew00030d · Cited by 109
Capturing the uncultivated majority
Green, B. D., & Keller, M. (2006) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2006.05.004 · Cited by 103
Phe, M.-H., Dossot, M., Guilloteau, H., & Block, J. C. (2005) · Water Research · doi:10.1016/j.watres.2005.06.002 · Cited by 100
Wert, E. C., Dong, M., & Rosario‐Ortiz, F. L. (2013) · Water Research · doi:10.1016/j.watres.2013.04.038 · Cited by 97
Lisle, J. T., Pyle, B. H., & McFeters, G. A. (1999) · Letters in Applied Microbiology · doi:10.1046/j.1365-2672.1999.00572.x · Cited by 96
Pepper, I. L., Rusin, P. A., Quintanar, D. R., Haney, C. J., Josephson, K. L., & Gerba, C. P. (2003) · International Journal of Food Microbiology · doi:10.1016/j.ijfoodmicro.2003.08.021 · Cited by 87
Recent applications of flow cytometry in aquatic microbial ecology
Troussellier, M., Courties, C., & Vaquer, A. (1993) · Biology of the Cell · doi:10.1016/0248-4900(93)90121-t · Cited by 85
Modeling of heterotrophic bacteria counts in a water distribution system
Francisque, A., Rodríguez, M. J., Miranda-Moreno, L., Sadiq, R., & Proulx, F. (2008) · Water Research · doi:10.1016/j.watres.2008.11.030 · Cited by 81
Microbiological tap water profile of a medium-sized building and effect of water stagnation
Lipphaus, P., Hammes, F., Kötzsch, S., Green, J., Gillespie, S., & Nocker, A. (2013) · Environmental Technology · doi:10.1080/09593330.2013.839748 · Cited by 80
Self-citationBesmer, M. D., Epting, J., Page, R. M., Sigrist, J. A., Huggenberger, P., & Hammes, F. (2016) · Scientific Reports · doi:10.1038/srep38462 · Cited by 78
Self-citationRichardson, H. Y., Nichols, G. L., Lane, C., LAKE, I. R., & Hunter, P. R. (2009) · Water Research · doi:10.1016/j.watres.2009.02.035 · Cited by 74
Cytometric fingerprints: evaluation of new tools for analyzing microbial community dynamics
Koch, C., Harnisch, F., Schröder, U., & Müller, S. (2014) · Frontiers in Microbiology · doi:10.3389/fmicb.2014.00273 · Cited by 74
Influence of Phosphate on Bacterial Adhesion onto Iron Oxyhydroxide in Drinking Water
Appenzeller, B. M. R., Duval, Y. B., Thomas, F., & Block, J. C. (2002) · Environmental Science & Technology · doi:10.1021/es010155m · Cited by 73
Behavior and stability of adenosine triphosphate (ATP) during chlorine disinfection
Neščerecka, A., Juhna, T., & Hammes, F. (2016) · Water Research · doi:10.1016/j.watres.2016.05.087 · Cited by 72
Self-citationCharacterization of Bacterial Growth by Means of Flow Microfluorometry
Bailey, J. E., Fazel‐Madjlessi, J., McQuitty, D. N., Lee, Y. N., Allred, J. C., & Oro, J. A. (1977) · Science · doi:10.1126/science.412254 · Cited by 70
On-line bacteriological detection in water
López, R., Tusell, P., Cortina, J. L., Courtois, S., & Cortina, J. L. (2012) · TrAC Trends in Analytical Chemistry · doi:10.1016/j.trac.2012.10.010 · Cited by 67
Selection of NF membrane to improve quality of chemically treated surface water
Liikanen, R., Miettinen, I. T., & Laukkanen, R. (2003) · Water Research · doi:10.1016/s0043-1354(02)00412-8 · Cited by 66
Brognaux, A., Han, S., Sørensen, S. J., Lebeau, F., Thonart, P., & Delvigne, F. (2013) · Microbial Cell Factories · doi:10.1186/1475-2859-12-100 · Cited by 63
Besmer, M. D., & Hammes, F. (2016) · Water Research · doi:10.1016/j.watres.2016.10.041 · Cited by 61
Self-citationMultispot live‐image autofocusing for high‐throughput microscopy of fluorescently stained bacteria
Zeder, M., & Pernthaler, J. (2009) · Cytometry Part A · doi:10.1002/cyto.a.20770 · Cited by 59
Monfort, P., & Baleux, B. (1992) · Cytometry · doi:10.1002/cyto.990130213 · Cited by 58
Paau, A. S., Cowles, J. R., & Oro, J. A. (1977) · Canadian Journal of Microbiology · doi:10.1139/m77-175 · Cited by 57
Zur Untersuchung von pathogenen Organismen (1881)
Koch, R. A. (2018) · Klassische Texte der Wissenschaft · doi:10.1007/978-3-662-56454-7_3 · Cited by 56
Pianetti, A., Falcioni, T., Bruscolini, F., Sabatini, L., Sisti, E., & Papa, S. (2005) · Applied and Environmental Microbiology · doi:10.1128/aem.71.12.7948-7954.2005 · Cited by 51
Nevel, S. V., Roy, K. D., & Boon, N. (2013) · FEMS Microbiology Ecology · doi:10.1111/1574-6941.12145 · Cited by 48
Self-citationYang, L., Wu, L., Zhu, S., Long, Y. T., Hang, W., & Yan, X. (2009) · Analytical Chemistry · doi:10.1021/ac902524a · Cited by 47
Ma, L., Mao, G., Liu, J., Yu, H., Gao, G., & Wang, Y. (2013) · Water Science & Technology · doi:10.2166/wst.2013.426 · Cited by 42
Establishment of HPC(R2A) for regrowth control in non-chlorinated distribution systems
Uhl, W., & Schaule, G. (2003) · International Journal of Food Microbiology · doi:10.1016/j.ijfoodmicro.2003.08.010 · Cited by 41
Overview of flow cytometry and image analysis in biological oceanography and limnology
Legendre, L., & Yentsch, C. M. (1989) · Cytometry · doi:10.1002/cyto.990100505 · Cited by 37
Zur Untersuchung von pathogenen Organismen
Koch, R. A. (2010) · Publication server of the Robert Koch Institute (Robert Kock Institute) · doi:10.25646/5071 · Cited by 33
Kahlisch, L., Henne, K., Gröbe, L., Brettar, I., & Höfle, M. G. (2011) · Microbial Ecology · doi:10.1007/s00248-011-9918-4 · Cited by 30
Molecular analysis of the bacterial drinking water community with respect to live/dead status
Kahlisch, L., Henne, K., Groebe, L., Draheim, J., Höfle, M. G., & Brettar, I. (2010) · Water Science & Technology · doi:10.2166/wst.2010.773 · Cited by 29
Wen, G., Ma, J., Huang, T., & Egli, T. W. (2014) · Journal of Hazardous Materials · doi:10.1016/j.jhazmat.2014.08.020 · Cited by 17
Methods for microbiological quality assessment in drinking water: a comparative study
Helmi, K., Barthod, F., Méheut, G., Henry, A., Poty, F., Laurent, F., & Charni-Ben-Tabassi, N. (2014) · Journal of Water and Health · doi:10.2166/wh.2014.056 · Cited by 16
Bacterial growth in batch-operated membrane filtration systems for drinking water treatment
Mimoso, J., Pronk, W., Morgenroth, E., & Hammes, F. (2015) · Separation and Purification Technology · doi:10.1016/j.seppur.2015.09.070 · Cited by 15
Self-citation
Cited by
Improving End-User Trust in the Quality of Commercial Probiotic Products
Jackson, S. A., Schoeni, J. L., Vegge, C., Pane, M., Stahl, B., Bradley, M., Goldman, V. S., Burguière, P., Atwater, J. B., & Sanders, M. E. (2019) · Frontiers in Microbiology · doi:10.3389/fmicb.2019.00739 · Cited by 192
Methods to quantify biological contaminants in microalgae cultures
Di Caprio, F. (2020) · Algal Research · doi:10.1016/j.algal.2020.101943 · Cited by 87
Travnickova, E., Mikula, P., Oprsal, J., Bohacova, M., Kubac, L., Kimmer, D., Soukupova, J., & Bittner, M. (2019) · AMB Express · doi:10.1186/s13568-019-0909-z · Cited by 74
Metadata
- Authors
- Van Nevel, S., Koetzsch, S., Proctor, C. R., Besmer, M. D., Prest, E. I., Vrouwenvelder, J. S., Knezev, A., Boon, N., & Hammes, F.
- Venue
- Water Research
- Publisher
- Elsevier BV
- Published
- 2017-04
- Volume
- 113
- Pages
- 191-206
- ISSN
- 0043-1354 (ISSN-L)
- OpenAlex
- W2586171209
- Cited by
- 256
- References
- 94
- FWCI
- 14.89
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.