The DOI matches its Crossref record; 63 of the 63 references it cites were found in a registry or an index.
The Society for Immunotherapy of Cancer statement on best practices for multiplex immunohistochemistry (IHC) and immunofluorescence (IF) staining and validation
Open accessAbstract
Objectives: The interaction between the immune system and tumor cells is an important feature for the prognosis and treatment of cancer. Multiplex immunohistochemistry (mIHC) and multiplex immunofluorescence (mIF) analyses are emerging technologies that can be used to help quantify immune cell subsets, their functional state, and their spatial arrangement within the tumor microenvironment. Methods: The Society for Immunotherapy of Cancer (SITC) convened a task force of pathologists and laboratory leaders from academic centers as well as experts from pharmaceutical and diagnostic companies to develop best practice guidelines for the optimization and validation of mIHC/mIF assays across platforms. Results: Representative outputs and the advantages and disadvantages of mIHC/mIF approaches, such as multiplexed chromogenic IHC, multiplexed immunohistochemical consecutive staining on single slide, mIF (including multispectral approaches), tissue-based mass spectrometry, and digital spatial profiling are discussed. Conclusions: mIHC/mIF technologies are becoming standard tools for biomarker studies and are likely to enter routine clinical practice in the near future. Careful assay optimization and validation will help ensure outputs are robust and comparable across laboratories as well as potentially across mIHC/mIF platforms. Quantitative image analysis of mIHC/mIF output and data management considerations will be addressed in a complementary manuscript from this task force.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Fiji: an open-source platform for biological-image analysis
Schindelin, J., Arganda-Carreras, I., Frise, E., Kaynig, V., Longair, M., Pietzsch, T., Preibisch, S., Rueden, C., Saalfeld, S., Schmid, B., et al. (2012) · Nature Methods · doi:10.1038/nmeth.2019 · Cited by 66,890
PD-1 and PD-L1 Immune Checkpoint Blockade to Treat Breast Cancer
Hartkopf, A. D., Taran, F.-A., Wallwiener, M., Walter, C. B., Krämer, B., Grischke, E.-M., & Brucker, S. Y. (2016) · Breast Care · doi:10.1159/000453569 · Cited by 30,845
Object recognition from local scale-invariant features
Lowe, D. G. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790410 · Cited by 16,472 · cited 1×
“Software is used for image alignment/registration of the sequential tissue scans 48–52 to minimize and correct for potential microscopic changes on the tissue section that occur after each cycle and/or movement of the slide within the scanner rack.”
Robust enumeration of cell subsets from tissue expression profiles
Newman, A. M., Liu, C. L., Green, M. R., Gentles, A. J., Feng, W., Xu, Y., Hoang, C. D., Diehn, M., & Alizadeh, A. A. (2015) · Nature Methods · doi:10.1038/nmeth.3337 · Cited by 13,224
PD-1 blockade induces responses by inhibiting adaptive immune resistance
Tumeh, P. C., Harview, C. L., Yearley, J. H., Shintaku, I. P., Taylor, E. J. M., Robert, L., Chmielowski, B., Spasic, M., Henry, G., Ciobanu, V., et al. (2014) · Nature · doi:10.1038/nature13954 · Cited by 6,609
The Immune Landscape of Cancer
Thorsson, V., Gibbs, D. L., Brown, S. D., Wolf, D., Bortone, D. S., Ou Yang, T.-H., Porta-Pardo, E., Gao, G. F., Plaisier, C. L., Eddy, J. A., et al. (2018) · Immunity · doi:10.1016/j.immuni.2018.03.023 · Cited by 5,870
Self-citationPredictive correlates of response to the anti-PD-L1 antibody MPDL3280A in cancer patients
Herbst, R. S., Soria, J.-C., Kowanetz, M., Fine, G. D., Hamid, O., Gordon, M. S., Sosman, J. A., McDermott, D. F., Powderly, J. D., Gettinger, S. N., et al. (2014) · Nature · doi:10.1038/nature14011 · Cited by 5,231
Highly multiplexed imaging of tumor tissues with subcellular resolution by mass cytometry
Giesen, C., Wang, H. A. O., Schapiro, D., Zivanovic, N., Jacobs, A., Hattendorf, B., Schüffler, P. J., Grolimund, D., Buhmann, J. M., Brandt, S., et al. (2014) · Nature Methods · doi:10.1038/nmeth.2869 · Cited by 1,951
Oncolytic virotherapy promotes intratumoral T cell infiltration and improves anti-PD-1 immunotherapy
Ribas, A., Dummer, R., Puzanov, I., VanderWalde, A., Andtbacka, R. H. I., Michielin, O., Olszanski, A. J., Malvehy, J., Cebon, J., Fernandez, E., et al. (2017) · Cell · doi:10.1016/j.cell.2017.08.027 · Cited by 1,520
Deep profiling of mouse splenic architecture with CODEX multiplexed imaging
Goltsev, Y., Samusik, N., Kennedy-Darling, J., Bhate, S., Hale, M., Vazquez, G., Black, S., & Nolan, G. P. (2018) · Cell · doi:10.1016/j.cell.2018.07.010 · Cited by 1,501 · cited 4×
“…suggest that it may be possible to increase this number to ~30–60 individual mIF targets using a cyclic staining approach where non- TSA-based, low-plex fluorescence assays are cycled on the same sample and then assembled using image analysis algorithms, 54–56 similar to what is done for MCISSS.”
InfluentialHirsch, F. R., Varella-Garcia, M., Bunn, P. A., Di Maria, M. V., Veve, R., Bremnes, R. M., Barón, A. E., Zeng, C., & Franklin, W. A. (2003) · Journal of Clinical Oncology · doi:10.1200/jco.2003.11.069 · Cited by 1,477
Mass Cytometry: Single Cells, Many Features
Spitzer, M. H., & Nolan, G. P. (2016) · Cell · doi:10.1016/j.cell.2016.04.019 · Cited by 1,199
Keren, L., Bosse, M., Marquez, D., Angoshtari, R., Jain, S., Varma, S., Yang, S.-R., Kurian, A., Van Valen, D., West, R., et al. (2018) · Cell · doi:10.1016/j.cell.2018.08.039 · Cited by 1,183 · cited 1×
“61 In contrast to optical methods that quantify immunofluorescence or immunoperoxidase via fluorescent or chromogenic reporters, EMS-IHC detects elemental mass tags attached to primary antibodies directly in the tissue of interest.”
Multiplexed ion beam imaging of human breast tumors
Angelo, M., Bendall, S. C., Finck, R., Hale, M. B., Hitzman, C., Borowsky, A. D., Levenson, R. M., Lowe, J. B., Liu, S. D., Zhao, S., et al. (2014) · Nature Medicine · doi:10.1038/nm.3488 · Cited by 1,108
Self-citationTrakEM2 Software for Neural Circuit Reconstruction
Cardona, A., Saalfeld, S., Schindelin, J., Arganda-Carreras, I., Preibisch, S., Longair, M., Tomancak, P., Hartenstein, V., & Douglas, R. J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038011 · Cited by 1,013
Chen, P.-L., Roh, W., Reuben, A., Cooper, Z. A., Spencer, C. N., Prieto, P. A., Miller, J. P., Bassett, R. L., Gopalakrishnan, V., Wani, K., et al. (2016) · Cancer Discovery · doi:10.1158/2159-8290.cd-15-1545 · Cited by 988
Self-citationStack, E. C., Wang, C., Roman, K. A., & Hoyt, C. C. (2014) · Methods · doi:10.1016/j.ymeth.2014.08.016 · Cited by 768
Self-citationHighly multiplexed single-cell analysis of formalin-fixed, paraffin-embedded cancer tissue
Gerdes, M. J., Sevinsky, C. J., Sood, A., Adak, S., Bello, M. O., Bordwell, A., Can, A., Corwin, A., Dinn, S., Filkins, R. J., et al. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1300136110 · Cited by 724
Lin, J.-R., Izar, B., Wang, S., Yapp, C., Mei, S., Shah, P. M., Santagata, S., & Sorger, P. K. (2018) · eLife · doi:10.7554/elife.31657 · Cited by 692
Neoadjuvant nivolumab modifies the tumor immune microenvironment in resectable glioblastoma
Schalper, K. A., Rodriguez-Ruiz, M. E., Diez-Valle, R., López-Janeiro, A., Porciuncula, A., Idoate, M. A., Inogés, S., de Andrea, C., López-Diaz de Cerio, A., Tejada, S., et al. (2019) · Nature Medicine · doi:10.1038/s41591-018-0339-5 · Cited by 642
Self-citationA proposal for validation of antibodies
Uhlen, M., Bandrowski, A., Carr, S., Edwards, A., Ellenberg, J., Lundberg, E., Rimm, D. L., Rodriguez, H., Hiltke, T., Snyder, M., et al. (2016) · Nature Methods · doi:10.1038/nmeth.3995 · Cited by 626
Self-citationLu, S., Stein, J. E., Rimm, D. L., Wang, D. W., Bell, J. M., Johnson, D. B., Sosman, J. A., Schalper, K. A., Anders, R. A., Wang, H., et al. (2019) · JAMA Oncology · doi:10.1001/jamaoncol.2019.1549 · Cited by 607
Self-citationCottrell, T. R., Thompson, E. D., Forde, P. M., Stein, J. E., Duffield, A. S., Anagnostou, V., Rekhtman, N., Anders, R. A., Cuda, J. D., Illei, P. B., et al. (2018) · Annals of Oncology · doi:10.1093/annonc/mdy218 · Cited by 592
Self-citationBordeaux, J., Welsh, A. W., Agarwal, S., Killiam, E., Baquero, M. T., Hanna, J. A., Anagnostou, V. K., & Rimm, D. L. (2010) · BioTechniques · doi:10.2144/000113382 · Cited by 589
Self-citationTsujikawa, T., Kumar, S., Borkar, R. N., Azimi, V., Thibault, G., Chang, Y. H., Balter, A., Kawashima, R., Choe, G., Sauer, D., et al. (2017) · Cell Reports · doi:10.1016/j.celrep.2017.03.037 · Cited by 568
Tumor immune profiling predicts response to anti–PD-1 therapy in human melanoma
Daud, A. I., Loo, K., Pauli, M. L., Sanchez-Rodriguez, R., Sandoval, P. M., Taravati, K., Tsai, K., Nosrati, A., Nardo, L., Alvarado, M. D., et al. (2016) · Journal of Clinical Investigation · doi:10.1172/jci87324 · Cited by 525
Immune Modulation in Cancer with Antibodies
Page, D. B., Postow, M. A., Callahan, M. K., Allison, J. P., & Wolchok, J. D. (2014) · Annual Review of Medicine · doi:10.1146/annurev-med-092012-112807 · Cited by 515
Spectral imaging: Principles and applications
Garini, Y., Young, I. T., & McNamara, G. (2006) · Cytometry Part A · doi:10.1002/cyto.a.20311 · Cited by 482
MIBI-TOF: A multiplexed imaging platform relates cellular phenotypes and tissue structure
Keren, L., Bosse, M., Thompson, S., Risom, T., Vijayaragavan, K., McCaffrey, E., Marquez, D., Angoshtari, R., Greenwald, N. F., Fienberg, H., et al. (2019) · Science Advances · doi:10.1126/sciadv.aax5851 · Cited by 431
Self-citationImplications of the tumor immune microenvironment for staging and therapeutics
Taube, J. M., Galon, J., Sholl, L. M., Rodig, S. J., Cottrell, T. R., Giraldo, N. A., Baras, A. S., Patel, S. S., Anders, R. A., Rimm, D. L., et al. (2018) · Modern Pathology · doi:10.1038/modpathol.2017.156 · Cited by 358
Self-citationChang, Q., Ornatsky, O. I., Siddiqui, I., Loboda, A., Baranov, V. I., & Hedley, D. W. (2017) · Cytometry Part A · doi:10.1002/cyto.a.23053 · Cited by 300
McCabe, A., Dolled-Filhart, M., Camp, R. L., & Rimm, D. L. (2005) · JNCI: Journal of the National Cancer Institute · doi:10.1093/jnci/dji427 · Cited by 292
Self-citationA Map of Human Type 1 Diabetes Progression by Imaging Mass Cytometry
Damond, N., Engler, S., Zanotelli, V. R. T., Schapiro, D., Wasserfall, C. H., Kusmartseva, I., Nick, H. S., Thorel, F., Herrera, P. L., Atkinson, M. A., et al. (2019) · Cell Metabolism · doi:10.1016/j.cmet.2018.11.014 · Cited by 292
Fitzgibbons, P. L., Bradley, L. A., Fatheree, L. A., Alsabeh, R., Fulton, R. S., Goldsmith, J. D., Haas, T. S., Karabakhtsian, R. G., Loykasek, P. A., Marolt, M. J., et al. (2014) · Archives of Pathology & Laboratory Medicine · doi:10.5858/arpa.2013-0610-cp · Cited by 280
Shi, S., Shi, Y., & Taylor, C. R. (2011) · Journal of Histochemistry & Cytochemistry · doi:10.1369/jhc.2010.957191 · Cited by 280
FAIR: Flexible Algorithms for Image Registration
Modersitzki, J. (2009) · Society for Industrial and Applied Mathematics eBooks · doi:10.1137/1.9780898718843 · Cited by 279
Parra, E. R., Uraoka, N., Jiang, M., Cook, P., Gibbons, D., Forget, M.-A., Bernatchez, C., Haymaker, C., Wistuba, I. I., & Rodriguez-Canales, J. (2017) · Scientific Reports · doi:10.1038/s41598-017-13942-8 · Cited by 266
Self-citationMagic peptides, magic antibodies: Guidelines for appropriate controls for immunohistochemistry
Saper, C. B., & Sawchenko, P. E. (2003) · Journal of Comparative Neurology · doi:10.1002/cne.10858 · Cited by 250
Recommended Principles and Practices for Validating Clinical Molecular Pathology Tests
Jennings, L., Van Deerlin, V. M., & Gulley, M. L. (2009) · Archives of Pathology & Laboratory Medicine · doi:10.5858/133.5.743 · Cited by 250
FAIR: Flexible Algorithms for Image Registration
Modersitzki, J. (2009) · Cited by 241
Identifying baseline immune-related biomarkers to predict clinical outcome of immunotherapy
Gnjatic, S., Bronte, V., Brunet, L. R., Butler, M. O., Disis, M. L., Galon, J., Hakansson, L. G., Hanks, B. A., Karanikas, V., Khleif, S. N., et al. (2017) · Journal for ImmunoTherapy of Cancer · doi:10.1186/s40425-017-0243-4 · Cited by 228
Self-citationRecommendations for Improved Standardization of Immunohistochemistry
Goldstein, N. S., Hewitt, S. M., Taylor, C. R., Yaziji, H., & Hicks, D. G. (2007) · Applied Immunohistochemistry & Molecular Morphology · doi:10.1097/pai.0b013e31804c7283 · Cited by 220
Masucci, G. V., Cesano, A., Hawtin, R., Janetzki, S., Zhang, J., Kirsch, I., Dobbin, K. K., Alvarez, J., Robbins, P. B., Selvan, S. R., et al. (2016) · Journal for ImmunoTherapy of Cancer · doi:10.1186/s40425-016-0178-1 · Cited by 202
In-depth tissue profiling using multiplexed immunohistochemical consecutive staining on single slide
Remark, R., Merghoub, T., Grabe, N., Litjens, G., Damotte, D., Wolchok, J. D., Merad, M., & Gnjatic, S. (2016) · Science Immunology · doi:10.1126/sciimmunol.aaf6925 · Cited by 190
Self-citationAn open letter to our readers on the use of antibodies
Saper, C. B. (2005) · Journal of Comparative Neurology · doi:10.1002/cne.20839 · Cited by 187
Heat-induced antigen retrieval: Mechanisms and application to histochemistry
Yamashita, S. (2007) · Progress in Histochemistry and Cytochemistry · doi:10.1016/j.proghi.2006.09.001 · Cited by 177
Toki, M. I., Merritt, C. R., Wong, P. F., Smithy, J. W., Kluger, H. M., Syrigos, K. N., Ong, G. T., Warren, S. E., Beechem, J. M., & Rimm, D. L. (2019) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-19-0104 · Cited by 167
Self-citationNegoescu, A., Labat-Moleur, F., Lorimier, P., Lamarcq, L., Guillermet, C., Chambaz, E., & Brambilla, E. (1994) · Journal of Histochemistry & Cytochemistry · doi:10.1177/42.3.7508473 · Cited by 165
Danilova, L., Wang, H., Sunshine, J., Kaunitz, G. J., Cottrell, T. R., Xu, H., Esandrio, J., Anders, R. A., Cope, L., Pardoll, D. M., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1607836113 · Cited by 161
Self-citationTsang, H. F., Xue, V. W., Koh, S. P., Chiu, Y.-M., Ng, L. P. W., & Wong, S. C. C. (2016) · Expert Review of Molecular Diagnostics · doi:10.1080/14737159.2017.1268533 · Cited by 159
Pirici, D. N., Mogoantă, L., Kumar‐Singh, S., Pirici, I., Mărgăritescu, C., Simionescu, C., & Stănescu, R. (2009) · Journal of Histochemistry & Cytochemistry · doi:10.1369/jhc.2009.953240 · Cited by 145
Technical pitfalls potentially affecting diagnoses in immunohistochemistry
Bussolati, G., & Leonardo, E. (2008) · Journal of Clinical Pathology · doi:10.1136/jcp.2007.047720 · Cited by 144
Feng, Z., Puri, S., Moudgil, T. L., Wood, W. J., Hoyt, C. C., Wang, C., Urba, W. J., Curti, B. D., Bifulco, C. B., & Fox, B. A. (2015) · Journal for ImmunoTherapy of Cancer · doi:10.1186/s40425-015-0091-z · Cited by 138
Self-citationSpatiotemporal segregation of human marginal zone and memory B cell populations in lymphoid tissue
Zhao, Y., Uduman, M., Siu, J. H. Y., Tull, T. J., Sanderson, J. D., Wu, Y.-C. B., Zhou, J. Q., Petrov, N., Ellis, R., Todd, K., et al. (2018) · Nature Communications · doi:10.1038/s41467-018-06089-1 · Cited by 117
Analytic Variability in Immunohistochemistry Biomarker Studies
Anagnostou, V., Welsh, A., Giltnane, J. M., Siddiqui, S., Liceaga, C., Gustavson, M. D., Syrigos, K. N., Reiter, J. L., & Rimm, D. L. (2010) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-10-0097 · Cited by 111
Self-citationConservation of immune gene signatures in solid tumors and prognostic implications
Chifman, J., Pullikuth, A., Chou, J. W., Bedognetti, D., & Miller, L. D. (2016) · BMC Cancer · doi:10.1186/s12885-016-2948-z · Cited by 109
Stein, J. E., Soni, A., Danilova, L., Cottrell, T. R., Gajewski, T. F., Hodi, F. S., Bhatia, S., Urba, W. J., Sharfman, W. H., Wind‐Rotolo, M., et al. (2019) · Annals of Oncology · doi:10.1093/annonc/mdz019 · Cited by 77
Self-citationAktürk, G., Sweeney, R. E., Remark, R., Mérad, M., & Gnjatic, S. (2019) · Methods in molecular biology · doi:10.1007/978-1-4939-9773-2_23 · Cited by 69
Self-citationBogen, S., Vani, K., & Sompuram, S. (2009) · Biotechnic & Histochemistry · doi:10.3109/10520290903039078 · Cited by 66
Patch-Based Nonlinear Image Registration for Gigapixel Whole Slide Images
Lotz, J., Olesch, J., Muller, B., Polzin, T., Galuschka, P., Lotz, J. M., Heldmann, S., Laue, H., González‐Vallinas, M., Warth, A., et al. (2015) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2015.2503122 · Cited by 46
Proof of the quantitative potential of immunofluorescence by mass spectrometry
Toki, M. I., Cecchi, F., Hembrough, T., Syrigos, K. N., & Rimm, D. L. (2017) · Laboratory Investigation · doi:10.1038/labinvest.2016.148 · Cited by 46
Self-citationDouble Autoimmunostaining with Glycine Treatment
Hasui, K., Takatsuka, T., Sakamoto, R., et al. (2003) · Journal of Histochemistry & Cytochemistry · doi:10.1177/002215540305100907 · Cited by 26
Simultaneous, Multiplexed Detection of RNA and Protein on the NanoString® nCounter® Platform
Warren, S. E. (2018) · Methods in molecular biology · doi:10.1007/978-1-4939-7834-2_5 · Cited by 24
Research works printed but not linked: 6
- 10.1369/jhc.6P6945.2006 · doi:10.1369/jhc.6p6945.2006
- Gustavson, 2013, Tissue microarrays: leaping the gap between research and clinical adoption, Per Med, 10, 441, 10.2217/pme.13.42 · DOI
- 10.1043/1543-2165-133.5.743 · doi:10.1043/1543-2165-133.5.743
- Dillon, 1998, The expression of p120ctn protein in breast cancer is independent of alpha- and beta-catenin and E-cadherin, Am J Pathol, 152, 75
- Surace M , DaCosta K , Huntley A , et al . Automated multiplex immunofluorescence panel for Immuno-oncology studies on formalin-fixed carcinoma tissue specimens. J Vis Exp 2019. doi:doi:10.3791/58390. [Epub ahead of print: 21 Jan 2019]. · doi:10.3791/58390
- 10.1158/1538-7445.SABCS18-LB-318 · doi:10.1158/1538-7445.sabcs18-lb-318
Cited by
He, S., Bhatt, R., Brown, C., Brown, E. A., Buhr, D. L., Chantranuvatana, K., Danaher, P., Dunaway, D., Garrison, R. G., Geiss, G., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-022-01483-z · Cited by 814
Clinical relevance of tumour-associated macrophages
Pittet, M. J., Michielin, O., & Migliorini, D. (2022) · Nature Reviews Clinical Oncology · doi:10.1038/s41571-022-00620-6 · Cited by 731
Digital pathology and artificial intelligence in translational medicine and clinical practice
Baxi, V., Edwards, R., Montalto, M., & Saha, S. (2022) · Modern Pathology · doi:10.1038/s41379-021-00919-2 · Cited by 592
Spatial profiling technologies illuminate the tumor microenvironment
Elhanani, O., Ben-Uri, R., & Keren, L. (2023) · Cancer Cell · doi:10.1016/j.ccell.2023.01.010 · Cited by 510
The emerging landscape of spatial profiling technologies
Moffitt, J. R., Lundberg, E., & Heyn, H. (2022) · Nature Reviews Genetics · doi:10.1038/s41576-022-00515-3 · Cited by 419
Metadata
- Authors
- Taube, J. M., Akturk, G., Angelo, M., Engle, E. L., Gnjatic, S., Greenbaum, S., Greenwald, N. F., Hedvat, C. V., Hollmann, T. J., Juco, J., Parra, E. R., Rebelatto, M. C., Rimm, D. L., Rodriguez-Canales, J., Schalper, K. A., Stack, E. C., Ferreira, C. S., Korski, K., Lako, A., Rodig, S. J., Schenck, E., Steele, K. E., Surace, M. J., Tetzlaff, M. T., von Loga, K., Wistuba, I. I., & Bifulco, C. B.
- Venue
- Journal for ImmunoTherapy of Cancer
- Publisher
- BMJ
- Published
- 2020-05
- Volume
- 8
- Issue
- 1
- Pages
- e000155
- ISSN
- 2051-1426 (ISSN-L)
- OpenAlex
- W3024300243
- Cited by
- 283
- References
- 63
- FWCI
- 11.95
- Type
- journal article
- Language
- en
- Update notices
- correction (2020-06-03)
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.