Data Normalization Strategies for MicroRNA Quantification
Abstract
BACKGROUND: Different technologies, such as quantitative real-time PCR or microarrays, have been developed to measure microRNA (miRNA) expression levels. Quantification of miRNA transcripts implicates data normalization using endogenous and exogenous reference genes for data correction. However, there is no consensus about an optimal normalization strategy. The choice of a reference gene remains problematic and can have a serious impact on the actual available transcript levels and, consequently, on the biological interpretation of data. CONTENT: In this review article we discuss the reliability of the use of small RNAs, commonly reported in the literature as miRNA expression normalizers, and compare different strategies used for data normalization. SUMMARY: A workflow strategy is proposed for normalization of miRNA expression data in an attempt to provide a basis for the establishment of a global standard procedure that will allow comparison across studies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Short RNAs commonly used as a reference, including RNU6 and let-7a-5p, showed relatively high expression levels.
“Short RNAs commonly used as a reference, including RNU6 and let-7a-5p (ref. 52), showed relatively high expression levels.”
From An integrated expression atlas of miRNAs and their promoters in human and mouse (2017) · cites this paper as [52]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Analysis of Relative Gene Expression Data Using Real-Time Quantitative PCR and the 2−ΔΔCT Method
Livak, K. J., & Schmittgen, T. D. (2001) · Methods · doi:10.1006/meth.2001.1262 · Cited by 180,860 · see citing works
The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments
Bustin, S. A., Benes, V., Garson, J. A., Hellemans, J., Huggett, J., Kubista, M., Mueller, R., Nolan, T., Pfaffl, M. W., Shipley, G. L., et al. (2009) · Clinical Chemistry · doi:10.1373/clinchem.2008.112797 · Cited by 16,303 · see citing works
Regulation of microRNA biogenesis
Ha, M., & Kim, V. N. (2014) · Nature Reviews Molecular Cell Biology · doi:10.1038/nrm3838 · Cited by 5,462 · see citing works
MicroRNAs in cancer: biomarkers, functions and therapy
Hayes, J., Peruzzi, P. P., & Lawler, S. (2014) · Trends in Molecular Medicine · doi:10.1016/j.molmed.2014.06.005 · Cited by 2,049 · see citing works
Tumor-Induced Osteoclast miRNA Changes as Regulators and Biomarkers of Osteolytic Bone Metastasis
Ell, B., Mercatali, L., Ibrahim, T., Campbell, N., Schwarzenbach, H., Pantel, K., Amadori, D., & Kang, Y. (2013) · Cancer Cell · doi:10.1016/j.ccr.2013.09.008 · Cited by 266 · see citing works
Flagged first, then by citations
Research works printed but not linked: 84
- [2]Bartel DP Micrornas: Genomics, biogenesis, mechanism, and function Cell 2004 116 281 97 14744438
- [3]Calin GA Croce CM Microrna-cancer connection: The beginning of a new tale Cancer Res 2006 66 7390 4 16885332
- [4]Montagner S Deho L Monticelli S Micrornas in hematopoietic development BMC immunology 2014 15 14 24678908 PMC4000146
- [5]Piccoli MT Gupta SK Thum T Noncoding rnas as regulators of cardiomyocyte proliferation and death Journal of molecular and cellular cardiology 2015 25665459
- [6]Sacco J Adeli K Micrornas: Emerging roles in lipid and lipoprotein metabolism Current opinion in lipidology 2012 23 220 5 22488426
- [7]Bartel DP Micrornas: Target recognition and regulatory functions Cell 2009 136 215 33 19167326 PMC3794896
- [8]Ardekani AM Naeini MM The role of micrornas in human diseases Avicenna journal of medical biotechnology 2010 2 161 79 23407304 PMC3558168
- [9]Schwarzenbach H Nishida N Calin GA Pantel K Clinical relevance of circulating cell-free micrornas in cancer Nature reviews Clinical oncology 2014 11 145 56 24492836
- [10]van Schooneveld E Wildiers H Vergote I Vermeulen PB Dirix LY Van Laere SJ Dysregulation of micrornas in breast cancer and their potential role as prognostic and predictive biomarkers in patient management Breast Cancer Res 2015 17 21 25849621 PMC4332424
- [11]Chen X Liang H Zhang J Zen K Zhang CY Horizontal transfer of micrornas: Molecular mechanisms and clinical applications Protein & cell 2012 3 28 37 22314808 PMC4875218
- [13]Pimentel F Bonilla P Ravishankar YG Contag A Gopal N LaCour S Technology in microrna profiling: Circulating micrornas as noninvasive cancer biomarkers in breast cancer Journal of laboratory automation 2014 25524488
- [14]Tiberio P Callari M Angeloni V Daidone MG Appierto V Challenges in using circulating mirnas as cancer biomarkers Biomed Res Int 2015 2015 731479 25874226 PMC4385632
- [15]Biassoni R Raso A Mrna and microrna purity and integrity: The key to success in expression profiling Springer New York 2014 24740220
- [16]Li J Smyth P Flavin R Cahill S Denning K Aherne S Comparison of mirna expression patterns using total rna extracted from matched samples of formalin-fixed paraffin-embedded (ffpe) cells and snap frozen cells BMC biotechnology 2007 7 36 17603869 PMC1914054
- [17]Monleau M Bonnel S Gostan T Blanchard D Courgnaud V Lecellier CH Comparison of different extraction techniques to profile micrornas from human sera and peripheral blood mononuclear cells BMC genomics 2014 15 395 24885883 PMC4041998
- [18]Glynn CL Khan S Kerin MJ Dwyer RM Isolation of secreted micrornas (mirnas) from cell-conditioned media MicroRNA 2013 2 14 9 25070711
- [19]Weber JA Baxter DH Zhang S Huang DY Huang KH Lee MJ The microrna spectrum in 12 body fluids Clinical chemistry 2010 56 1733 41 20847327 PMC4846276
- [20]Rani S Microrna profiling of exosomes isolated from biofluids and conditioned media Methods in molecular biology 2014 1182 131 44 25055907
- [21]Ibberson D Benes V Muckenthaler MU Castoldi M Rna degradation compromises the reliability of microrna expression profiling BMC biotechnology 2009 9 102 20025722 PMC2805631
- [22]Kim DJ Linnstaedt S Palma J Park JC Ntrivalas E Kwak-Kim JY Plasma components affect accuracy of circulating cancer-related microrna quantitation The Journal of molecular diagnostics: JMD 2012 14 71 80 22154918 PMC3338348
- [23]Farina NH Wood ME Perrapato SD Francklyn CS Stein GS Stein JL Lian JB Standardizing analysis of circulating microrna: Clinical and biological relevance Journal of cellular biochemistry 2014 115 805 11 24357537 PMC3992702
- [24]MacLellan SA MacAulay C Lam S Garnis C Pre-profiling factors influencing serum microrna levels BMC clinical pathology 2014 14 27 25093010 PMC4107491
- [25]Witwer KW Buzas EI Bemis LT Bora A Lasser C Lotvall J Standardization of sample collection, isolation and analysis methods in extracellular vesicle research Journal of extracellular vesicles 2013 2 eCollection 2013 PMC3760646 24009894
- [26]Liu R Chen X Du Y Yao W Shen L Wang C Serum microrna expression profile as a biomarker in the diagnosis and prognosis of pancreatic cancer Clinical chemistry 2012 58 610 8 22194634
- [27]Vasilescu C Rossi S Shimizu M Tudor S Veronese A Ferracin M Microrna fingerprints identify mir-150 as a plasma prognostic marker in patients with sepsis PloS one 2009 4 e7405 19823581 PMC2756627
- [28]Aushev VN Zborovskaya IB Laktionov KK Girard N Cros MP Herceg Z Krutovskikh V Comparisons of microrna patterns in plasma before and after tumor removal reveal new biomarkers of lung squamous cell carcinoma PloS one 2013 8 e78649 24130905 PMC3793941
- [29]Fang L Li H Wang L Hu J Jin T Wang J Yang BB Microrna-17-5p promotes chemotherapeutic drug resistance and tumour metastasis of colorectal cancer by repressing pten expression Oncotarget 2014 5 2974 87 24912422 PMC4102784
- [30]Oksvold MP Kullmann A Forfang L Kierulf B Li M Brech A Expression of b-cell surface antigens in subpopulations of exosomes released from b-cell lymphoma cells Clinical therapeutics 2014 36 847 62 e1 24952935
- [31]Boing AN van der Pol E Grootemaat AE Coumans FA Sturk A Nieuwland R Single-step isolation of extracellular vesicles by size-exclusion chromatography Journal of extracellular vesicles 2014 3 PMC4159761 25279113
- [32]Mathivanan S Lim JW Tauro BJ Ji H Moritz RL Simpson RJ Proteomics analysis of a33 immunoaffinity-purified exosomes released from the human colon tumor cell line lim1215 reveals a tissue-specific protein signature Molecular & cellular proteomics: MCP 2010 9 197 208 19837982 PMC2830834
- [33]Witwer KW Circulating microrna biomarker studies: Pitfalls and potential solutions Clinical chemistry 2015 61 56 63 25391989
- [34]Haider BA Baras AS McCall MN Hertel JA Cornish TC Halushka MK A critical evaluation of microrna biomarkers in non-neoplastic disease PloS one 2014 9 e89565 24586876 PMC3935874
- [35]Benes V Castoldi M Expression profiling of microrna using real-time quantitative pcr, how to use it and what is available Methods 2010 50 244 9 20109550
- [36]Thomson JM Parker JS Hammond SM Microarray analysis of mirna gene expression Methods in enzymology 2007 427 107 22 17720481
- [37]Sato F Tsuchiya S Terasawa K Tsujimoto G Intra-platform repeatability and inter-platform comparability of microrna microarray technology PloS one 2009 4 e5540 19436744 PMC2677665
- [38]Mestdagh P Van Vlierberghe P De Weer A Muth D Westermann F Speleman F Vandesompele J A novel and universal method for microrna rt-qpcr data normalization Genome biology 2009 10 R64 19531210 PMC2718498
- [39]Meyer SU Pfaffl MW Ulbrich SE Normalization strategies for microrna profiling experiments: A ‘normal’ way to a hidden layer of complexity? Biotechnology letters 2010 32 1777 88 20703800
- [41]Rai SN Ray HE Yuan X Pan J Hamid T Prabhu SD Statistical analysis of repeated microrna high-throughput data with application to human heart failure: A review of methodology Open access medical statistics 2012 2012 21 31 24738042 PMC3984897
- [42]Bustin SA Beaulieu JF Huggett J Jaggi R Kibenge FS Olsvik PA Miqe precis: Practical implementation of minimum standard guidelines for fluorescence-based quantitative real-time pcr experiments BMC molecular biology 2010 11 74 20858237 PMC2955025
- [43]Chugh P Dittmer DP Potential pitfalls in microrna profiling Wiley Interdiscip Rev RNA 2012 3 601 16 22566380 PMC3597218
- [44]Yan W Li R Liu Y Yang P Wang Z Zhang C Microrna expression patterns in the malignant progression of gliomas and a 5-microrna signature for prognosis Oncotarget 2014 5 12908 15 25415048 PMC4350338
- [45]Yau TO Wu CW Dong Y Tang CM Ng SS Chan FK Microrna-221 and microrna-18a identification in stool as potential biomarkers for the non-invasive diagnosis of colorectal carcinoma British journal of cancer 2014 111 1765 71 25233396 PMC4453736
- [46]Liu WJ Xu Q Sun LP Dong QG He CY Yuan Y Expression of serum let-7c, let-7i, and let-7f microrna with its target gene, pepsinogen c, in gastric cancer and precancerous disease Tumour biology: the journal of the International Society for Oncodevelopmental Biology and Medicine 2014 25549793
- [47]Wang J Pei Y Zhong Y Jiang S Shao J Gong J Altered serum micrornas as novel diagnostic biomarkers for atypical coronary artery disease PloS one 2014 9 e107012 25198728 PMC4157840
- [48]Kuhlmann JD Baraniskin A Hahn SA Mosel F Bredemeier M Wimberger P Circulating u2 small nuclear rna fragments as a novel diagnostic tool for patients with epithelial ovarian cancer Clinical chemistry 2014 60 206 13 24212085
- [49]Spiekermann M Dieckmann KP Balks T Bullerdiek J Belge G Is relative quantification dispensable for the measurement of micrornas as serum biomarkers in germ cell tumors? Anticancer research 2015 35 117 21 25550541
- [50]Wang X Gardiner EJ Cairns MJ Optimal consistency in microrna expression analysis using reference-gene-based normalization Mol Biosyst 2015 11 1235 40 25797570
- [51]Serafin A Foco L Blankenburg H Picard A Zanigni S Zanon A Identification of a set of endogenous reference genes for mirna expression studies in parkinson’s disease blood samples BMC research notes 2014 7 715 25304816 PMC4209045
- [52]Roth C Rack B Muller V Janni W Pantel K Schwarzenbach H Circulating micrornas as blood-based markers for patients with primary and metastatic breast cancer Breast Cancer Res 2010 12 R90 21047409 PMC3046429
- [54]Song J Bai Z Han W Zhang J Meng H Bi J Identification of suitable reference genes for qpcr analysis of serum microrna in gastric cancer patients Digestive diseases and sciences 2012 57 897 904 22198701
- [55]Shen Y Tian F Chen Z Li R Ge Q Lu Z Amplification-based method for microrna detection Biosens Bioelectron 2015 71 322 31 25930002
- [56]Benz F Roderburg C Vargas Cardenas D Vucur M Gautheron J Koch A U6 is unsuitable for normalization of serum mirna levels in patients with sepsis or liver fibrosis Experimental & molecular medicine 2013 45 e42 24052167 PMC3789266
- [57]Gee HE Buffa FM Camps C Ramachandran A Leek R Taylor M The small-nucleolar rnas commonly used for microrna normalisation correlate with tumour pathology and prognosis British journal of cancer 2011 104 1168 77 21407217 PMC3068486
- [58]Xiang M Zeng Y Yang R Xu H Chen Z Zhong J U6 is not a suitable endogenous control for the quantification of circulating micrornas Biochemical and biophysical research communications 2014 454 210 4 25450382
- [59]Andersen CL Jensen JL Orntoft TF Normalization of real-time quantitative reverse transcription-pcr data: A model-based variance estimation approach to identify genes suited for normalization, applied to bladder and colon cancer data sets Cancer Res 2004 64 5245 50 15289330
- [60]Lamba V Ghodke-Puranik Y Guan W Lamba JK Identification of suitable reference genes for hepatic microrna quantitation BMC research notes 2014 7 129 24606728 PMC3995942
- [61]Vandesompele J De Preter K Pattyn F Poppe B Van Roy N De Paepe A Speleman F Accurate normalization of real-time quantitative rt-pcr data by geometric averaging of multiple internal control genes Genome biology 2002 3 RESEARCH0034 12184808 PMC126239
- [62]Ratert N Meyer HA Jung M Mollenkopf HJ Wagner I Miller K Reference mirnas for mirnaome analysis of urothelial carcinomas PloS one 2012 7 e39309 22745731 PMC3380005
- [63]Wotschofsky Z Meyer HA Jung M Fendler A Wagner I Stephan C Reference genes for the relative quantification of micrornas in renal cell carcinomas and their metastases Analytical biochemistry 2011 417 233 41 21741950
- [64]Torres A Torres K Wdowiak P Paszkowski T Maciejewski R Selection and validation of endogenous controls for microrna expression studies in endometrioid endometrial cancer tissues Gynecologic oncology 2013 130 588 94 23811003
- [65]Han HS Jo YN Lee JY Choi SY Jeong Y Yun J Lee OJ Identification of suitable reference genes for the relative quantification of micrornas in pleural effusion Oncology letters 2014 8 1889 95 25202432 PMC4156210
- [66]Muller V Gade S Steinbach B Loibl S von Minckwitz G Untch M Changes in serum levels of mir-21, mir-210, and mir-373 in her2-positive breast cancer patients undergoing neoadjuvant therapy: A translational research project within the geparquinto trial Breast cancer research and treatment 2014 147 61 8 25086636
- [67]McDermott AM Kerin MJ Miller N Identification and validation of mirnas as endogenous controls for rq-pcr in blood specimens for breast cancer studies PloS one 2013 8 e83718 24391813 PMC3877087
- [68]Schaefer A Jung M Miller K Lein M Kristiansen G Erbersdobler A Jung K Suitable reference genes for relative quantification of mirna expression in prostate cancer Experimental & molecular medicine 2010 42 749 58 20890088 PMC2992854
- [69]Delfino KR Rodriguez-Zas SL Transcription factor-microrna-target gene networks associated with ovarian cancer survival and recurrence PloS one 2013 8 e58608 23554906 PMC3595291
- [71]Hu Z Dong J Wang LE Ma H Liu J Zhao Y Serum microrna profiling and breast cancer risk: The use of mir-484/191 as endogenous controls Carcinogenesis 2012 33 828 34 22298638
- [72]Liu J Gao J Du Y Li Z Ren Y Gu J Combination of plasma micrornas with serum ca19-9 for early detection of pancreatic cancer Int J Cancer 2012 131 683 91 21913185
- [73]Xiao G Tang H Wei W Li J Ji L Ge J Aberrant expression of microrna-15a and microrna-16 synergistically associates with tumor progression and prognosis in patients with colorectal cancer Gastroenterology research and practice 2014 2014 364549 25435873 PMC4236961
- [74]Zuo Z Calin GA de Paula HM Medeiros LJ Fernandez MH Shimizu M Circulating micrornas let-7a and mir-16 predict progression-free survival and overall survival in patients with myelodysplastic syndrome Blood 2011 118 413 5 21602527 PMC3293748
- [75]Peltier HJ Latham GJ Normalization of microrna expression levels in quantitative rt-pcr assays: Identification of suitable reference rna targets in normal and cancerous human solid tissues RNA 2008 14 844 52 18375788 PMC2327352
- [76]Hu J Wang Z Liao BY Yu L Gao X Lu S Human mir-1228 as a stable endogenous control for the quantification of circulating micrornas in cancer patients Int J Cancer 2014 135 1187 94 24488924
- [77]Zhu HT Dong QZ Wang G Zhou HJ Ren N Jia HL Identification of suitable reference genes for qrt-pcr analysis of circulating micrornas in hepatitis b virus-infected patients Molecular biotechnology 2012 50 49 56 21567136
- [78]Sanders I Holdenrieder S Walgenbach-Brunagel G von Ruecker A Kristiansen G Muller SC Ellinger J Evaluation of reference genes for the analysis of serum mirna in patients with prostate cancer, bladder cancer and renal cell carcinoma International journal of urology: official journal of the Japanese Urological Association 2012 19 1017 25 22788411
- [79]Shen Y Li Y Ye F Wang F Wan X Lu W Xie X Identification of mir-23a as a novel microrna normalizer for relative quantification in human uterine cervical tissues Experimental & molecular medicine 2011 43 358 66 21519184 PMC3128914
- [80]Tang G Shen X Lv K Wu Y Bi J Shen Q Different normalization strategies might cause inconsistent variation in circulating micrornas in patients with hepatocellular carcinoma Med Sci Monit 2015 21 617 24 25719241 PMC4345856
- [81]Wang L Liu Y Du L Li J Jiang X Zheng G Identification and validation of reference genes for the detection of serum micrornas by reverse transcriptionquantitative polymerase chain reaction in patients with bladder cancer Mol Med Rep 2015 12 615 22 25738263
- [82]Li Y Zhang L Liu F Xiang G Jiang D Pu X Identification of endogenous controls for analyzing serum exosomal mirna in patients with hepatitis b or hepatocellular carcinoma Dis Markers 2015 2015 893594 25814782 PMC4357047
- [83]Wang P Yang D Zhang H Wei X Ma T Cheng Z Early detection of lung cancer in serum by a panel of microrna biomarkers Clinical lung cancer 2014 25639977
- [84]Dong BL Wang Z Zhang Z Wang J Clinical significance of microrna-24 expression in esophageal squamous cell carcinoma Neoplasma 2015 62 250 8 25591590
- [85]Xu T Liao Z O’Reilly MS Levy LB Welsh JW Wang LE Serum inflammatory mirnas predict radiation esophagitis in patients receiving definitive radiochemotherapy for non-small cell lung cancer Radiotherapy and oncology: journal of the European Society for Therapeutic Radiology and Oncology 2014 113 379 84 25466375
- [86]Liu M Liu J Wang L Wu H Zhou C Zhu H Association of serum microrna expression in hepatocellular carcinomas treated with transarterial chemoembolization and patient survival PloS one 2014 9 e109347 25275448 PMC4183700
- [87]Anadol E Schierwagen R Elfimova N Tack K Schwarze-Zander C Eischeid H Circulating micrornas as a marker for liver injury in human immunodeficiency virus patients Hepatology 2015 61 46 55 25125218
- [88]Becker C Hammerle-Fickinger A Riedmaier I Pfaffl MW Mrna and microrna quality control for rt-qpcr analysis Methods 2010 50 237 43 20079844
- [89]Sourvinou IS Markou A Lianidou ES Quantification of circulating mirnas in plasma: Effect of preanalytical and analytical parameters on their isolation and stability The Journal of molecular diagnostics: JMD 2013 15 827 34 23988620
Cited by
Sorted by citations
Current and future perspectives of liquid biopsies in genomics-driven oncology
Heitzer, E., Haque, I. S., Roberts, C. E. S., & Speicher, M. R. (2019) · Nature Reviews Genetics · doi:10.1038/s41576-018-0071-5 · Cited by 1,557 · see citing works
An integrated expression atlas of miRNAs and their promoters in human and mouse
The FANTOM Consortium, de Rie, D., Abugessaisa, I., Alam, T., Arner, E., Arner, P., Ashoor, H., Åström, G., Babina, M., Bertin, N., et al. (2017) · Nature Biotechnology · doi:10.1038/nbt.3947 · Cited by 561 · see citing works
Moon, G. J., Sung, J. H., Kim, D. H., Kim, E. H., Cho, Y. H., Son, J. P., Cha, J. M., & Bang, O. Y. (2019) · Translational Stroke Research · doi:10.1007/s12975-018-0668-1 · Cited by 166 · see citing works
Toward the promise of microRNAs - Enhancing reproducibility and rigor in microRNA research
Witwer, K. W., & Halushka, M. K. (2016) · RNA Biology · doi:10.1080/15476286.2016.1236172 · Cited by 151 · see citing works
Identification of stable senescence‐associated reference genes
Hernandez‐Segura, A., Rubingh, R., & Demaria, M. (2019) · Aging Cell · doi:10.1111/acel.12911 · Cited by 54 · see citing works
Novel Approach to Fecal Occult Blood Testing by Assay of Erythrocyte-Specific microRNA Markers
Wu, C. W., Cao, X., Berger, C. K., Foote, P. H., Mahoney, D. W., Simonson, J. A., Anderson, B. W., Yab, T. C., Taylor, W. R., Boardman, L. A., et al. (2017) · Digestive Diseases and Sciences · doi:10.1007/s10620-017-4627-6 · Cited by 37 · see citing works
- Authors
- Schwarzenbach, H., da Silva, A. M., Calin, G., & Pantel, K.
- Affiliations
- Department of Tumour Biology, Center of Experimental Medicine, University Cancer Center Hamburg, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Department of Experimental Therapeutics and The Center for RNA Interference and Non-Coding RNAs, The University of Texas MD Anderson Cancer Center, Houston, TX
- Venue
- Clinical Chemistry
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-11-01
- Volume
- 61
- Issue
- 11
- Pages
- 1333-1342
- ISSN
- 0009-9147
- 1530-8561
- PMC
- PMC4890630
- Cited by
- 426
- References
- 5
- Language
- en
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Funders
- FCT–Fundação para a Ciência e a Tecnologia (SFRH/BD/85968/2012)
- NIH/NCI (1UH2TR00943-01, 1 R01 CA182905-01)
- University of Texas MD Anderson Cancer Center (P50 CA093459)
- Melanoma Foundation (2P50CA127001)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review