The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
Over the last decade, the introduction of microarray technology has had a profound impact on gene expression research. The publication of studies with dissimilar or altogether contradictory results, obtained using different microarray platforms to analyze identical RNA samples, has raised concerns about the reliability of this technology. The MicroArray Quality Control (MAQC) project was initiated to address these concerns, as well as other performance and data analysis issues. Expression data on four titration pools from two distinct reference RNA samples were generated at multiple test sites using a variety of microarray-based and alternative technology platforms. Here we describe the experimental design and probe mapping efforts behind the MAQC project. We show intraplatform consistency across test sites as well as a high level of interplatform concordance in terms of genes identified as differentially expressed. This study provides a resource that represents an important first step toward establishing a framework for the use of microarrays in clinical and regulatory settings.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Next, we applied the |log 2 fold-change|>1 filter advocated in the MAQC study on microarrays, 10 and for microarrays observed a reduction in the eFDR to below 1.5%, save for one outlier site (Figs 3c,d).”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [10]
In the citing paper
“Studies on microarrays have shown that results of typical statistical differential expression tests thresholded by p -value need to be filtered and sorted by effect strength (fold-change) in order to attain robust comparisons across platforms and sites. 10”
From A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium (2014) · cites this paper as [10]
In the citing paper
“The Microarray Quality Control (MAQC) Consortium landmark study10 examined the degree of variance within and across many different microarray platforms and found similar coefficients of variation between platforms.”
From Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study (2014) · cites this paper as [10]
In the citing paper
“prior work comparing microarray platforms and methods showed high levels of inter-platform concordance for the ability to detect differentially expressed genes.”
From Multi-platform assessment of transcriptome profiling using RNA-seq in the ABRF next-generation sequencing study (2014) · cites this paper as [10]
Citations
Cites
In silico prediction of protein-protein interactions in human macrophages
Souiai, O., Guerfali, F., Ben Miled, S., Brun, C., & Benkahla, A. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-157 · Cited by 10,803
Significance analysis of microarrays applied to the ionizing radiation response
Tusher, V. G., Tibshirani, R., & Chu, G. (2001) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.091062498 · Cited by 10,568
Pruitt, K. D., Tatusova, T., & Maglott, D. R. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkl842 · Cited by 4,481 · cited 1×
“We mapped the probes (see Supplementary Methods online and Supplementary Notes online) to the RefSeq human mRNA databas”
Method"Stemness": Transcriptional Profiling of Embryonic and Adult Stem Cells
Ramalho-Santos, M., Yoon, S., Matsuzaki, Y., Mulligan, R. C., & Melton, D. A. (2002) · Science · doi:10.1126/science.1072530 · Cited by 1,709
Pruitt, K. D. (2004) · Nucleic Acids Research · doi:10.1093/nar/gki025 · Cited by 1,660 · cited 1×
“We mapped the probes (see Supplementary Methods online and Supplementary Notes online) to the RefSeq human mRNA database 31 (http://www.ncbi.nlm.nih.gov/RefSeq) and to the AceView database 32 (http://www.ncbi.nlm.nih.gov/IEB/Research/Acembly), a less curated but more comprehensive database, which…”
MethodA Stem Cell Molecular Signature
Ivanova, N. B., Dimos, J. T., Schaniel, C., Hackney, J. A., Moore, K. A., & Lemischka, I. R. (2002) · Science · doi:10.1126/science.1073823 · Cited by 1,542
Prediction of cancer outcome with microarrays: a multiple random validation strategy
Michiels, S., Koscielny, S., & Hill, C. (2005) · The Lancet · doi:10.1016/s0140-6736(05)17866-0 · Cited by 1,025 · cited 1×
“, raising doubts about the repeatability, reproducibility and comparability of microarray technolog”
BackgroundMultiple-laboratory comparison of microarray platforms
Irizarry, R. A., Warren, D., Spencer, F., Kim, I. F., Biswal, S., Frank, B. C., Gabrielson, E., Garcia, J. G. N., Geoghegan, J., Germino, G., et al. (2005) · Nature Methods · doi:10.1038/nmeth756 · Cited by 862
Self-citationEvaluation of gene expression measurements from commercial microarray platforms
Tan, P. K. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg763 · Cited by 706
Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer
Ein-Dor, L., Zuk, O., & Domany, E. (2006) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0601231103 · Cited by 689 · cited 1×
“…to appear in peer-reviewed journals 9,10 , raising doubts about the repeatability, reproducibility and comparability of microarray technology 11–13 , several studies have also been recently published showing increased reproducibility of microarray data generated at different test sites and/or…”
Background
Research works printed but not linked: 1
- Reid, L.H. The value of a proficiency testing program to monitor performance in microarray laboratories. Pharm. Discov. 5, 20–25 (2005).
Cited by
Items 401–500 of 1,004
Ferg, M., Sanges, R., Gehrig, J., Kiss, J., Bauer, M., Lovas, A., Szabo, M., Yang, L., Straehle, U., Pankratz, M. J., et al. (2007) · The EMBO Journal · doi:10.1038/sj.emboj.7601821 · Cited by 67
“The pFOL876 plasmid in a pCS2þ vector with an Escherichia coli IS30 transposase gene was used to make control mRNA (Szabo et al, 2003).”
MethodWang, D., Peregrina, K., Dhima, E., Lin, E. Y., Mariadason, J. M., & Augenlicht, L. H. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1017668108 · Cited by 70
“a balance of sensitivity, specificity, and reproducibility (38, 39).”
BackgroundThe use of transcriptomic biomarkers for personalized medicine
Heidecker, B., & Hare, J. M. (2007) · Heart Failure Reviews · doi:10.1007/s10741-007-9004-7 · Cited by 67
“As a potential example, we demonstrated that angiotensin-converting enzyme-2 was up-regulated in NICM but not ICM heart tissue [20], suggesting, perhaps, a novel etiology specific therapeutic approach.”
BackgroundHarrill, A. H., & Rusyn, I. (2008) · Expert Opinion on Drug Metabolism & Toxicology · doi:10.1517/17425255.4.11.1379 · Cited by 71
The role of molecular analysis in breast cancer
Geyer, F. C., Marchiò, C., & Reis-Filho, J. S. (2008) · Pathology · doi:10.1080/00313020802563536 · Cited by 88
“For instance, up to 15% of error in qualitative assessment of gene expression has been demonstrated when the optimal samples were analysed with the same platform and protocols in different laboratories.(74)”
MethodMamrut, S., Avidan, N., Staun-Ram, E., Ginzburg, E., Truffault, F., Berrih‐Aknin, S., & Miller, A. (2015) · Epigenetics · doi:10.1080/15592294.2015.1084462 · Cited by 73
“We cannot rule out that this difference might be due to sex-associated differences in expression, but the most plausible explanation is the difference between gene expression platforms (Affymetrix versus Illumina).(34,35) Despite the limited overlap, the lists of top enriched pathways with a Z-score>1.”
BackgroundMethodDing, L.-H., Xie, Y., Park, S., Xiao, G., & Story, M. D. (2008) · Nucleic Acids Research · doi:10.1093/nar/gkn234 · Cited by 65
Pharmacogenetics in Acute Lymphoblastic Leukemia
Cheok, M. H.-C., Pottier, N., Kager, L., & Evans, W. E. (2008) · Seminars in Hematology · doi:10.1053/j.seminhematol.2008.09.002 · Cited by 77
Fan, X., Lobenhofer, E. K., Chen, M., Shi, W., Huang, J., Luo, J., Zhang, J., Walker, S. J., Chu, T.-M., Li, L., et al. (2010) · The Pharmacogenomics Journal · doi:10.1038/tpj.2010.34 · Cited by 67
“19 Briefly, each probe sequence from both platforms was BLASTed against the RefSeq database.”
BackgroundMethodSelf-citationUsing DNA microarrays to study gene expression in closely related species
Oshlack, A., Chabot, A. E., Smyth, G. K., & Gilad, Y. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm111 · Cited by 65
“Tests of differential expression were conducted using empirical Bayes-moderated t-tests, which ensure stable inference, even with small sample size ( Smyth, 2004 ).”
MethodInfluentialSnyder‐Talkington, B. N., Qian, Y. R., Castranova, V., & Guo, N. L. (2012) · Journal of Toxicology and Environmental Health Part B · doi:10.1080/10937404.2012.736856 · Cited by 68
Wirbisky, S. E., Weber, G. J., Sepúlveda, M. S., Xiao, C., Cannon, J. R., & Freeman, J. L. (2015) · Toxicology · doi:10.1016/j.tox.2015.04.016 · Cited by 66
“…list of differentially expressed genes for each atrazine treatment using recommendations from the Microarray Quality Consortium (Guo et al. 2006; Shi et al. 2006) was first determined by genes consistently expressed using an ANOVA in SAS software (p<0.05) and substantially altered with a mean…”
MethodInfluentialSelf-citationA detection instrument for enhanced-fluorescence and label-free imaging on photonic crystal surfaces
Block, I. D., Mathias, P. C., Ganesh, N., Jones, S. I., Dorvel, B. R., Chaudhery, V., Vodkin, L. O., Bashir, R., & Cunningham, B. T. (2009) · Optics Express · doi:10.1364/oe.17.013222 · Cited by 65
The IL-4Rα pathway in macrophages and its potential role in silica-induced pulmonary fibrosis
Migliaccio, C. T., Buford, M. C., Jessop, F., & Holian, A. (2008) · Journal of Leukocyte Biology · doi:10.1189/jlb.0807533 · Cited by 65
Molecular Predictors in Glioblastoma: Toward Personalized Therapy
Colman, H., & Aldape, K. (2008) · Archives of Neurology · doi:10.1001/archneur.65.7.877 · Cited by 75
“In addition, technical variability (eg, sample quality) and differences in statistical methods used to identify the top genes may contribute to a lack of reproducibility in gene lists.(50) One method to overcome these limitations is to examine multiple data sets systematically to identify genes that repeatedly correla…”
MethodChatterjee, N., Kim, Y., Yang, J., Roca, C. P., Joo, S., & Choi, J. (2016) · Nanotoxicology · doi:10.1080/17435390.2016.1267273 · Cited by 66
“01 and fold change >2, following the recommendations for microarray studies (Shi et al., 2006).”
BackgroundMethodInfluentialQing, T., Mahmood, M., Zheng, Y., Biris, A. S., Shi, L. M., & Casciano, D. A. (2017) · Journal of Applied Toxicology · doi:10.1002/jat.3528 · Cited by 67
“…Liu et al., 2009; Liu et al., 2010; Mane, Evans, Cooper, et al., 2009; Shi, Reid, et al., 2006; Rao, Shepherd, Bruno, Liu, & Miecznikowski, 2013; Shi et al., 2006; Shi et al., 2010; Wen et al., 2010) with ranking by fold change of expression values in reads per million after filtering genes…”
BackgroundSelf-citationRole of RelA of Streptococcus mutans in Global Control of Gene Expression
Nascimento, M. M., Lemos, J. A., Abranches, J., Lin, V. K., & Burne, R. A. (2008) · Journal of Bacteriology · doi:10.1128/jb.01395-07 · Cited by 65
“A description of the advantages of using a reference RNA in microarray studies is presented elsewhere (32, 48 ).”
BackgroundTranscriptome profiling in neurodegenerative disease
Courtney, E., Kornfeld, S., Janitz, K., & Janitz, M. (2010) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2010.08.018 · Cited by 71
The first decade and beyond of transcriptional profiling in schizophrenia
Sequeira, P. A., Martin, M. V., & Vawter, M. P. (2012) · Neurobiology of Disease · doi:10.1016/j.nbd.2011.03.001 · Cited by 64
“Commercial, mainly oligonucleotide based arrays (Affymetrix, Nimblegen, Codelink , Agilent), with more consistent chemistries, more probesets, and better statistical analysis procedures tend to yield higher reproducibility across laboratories (Shi et al., 2006).”
Baumbusch, L., Aarøe, J., Johansen, F., Hicks, J., Sun, H., Bruhn, L., Gunderson, K., Naume, B., Kristensen, V., Liestøl, K., et al. (2008) · BMC Genomics · doi:10.1186/1471-2164-9-379 · Cited by 64
“A comparative analysis of expression platforms has previously been performed for gene expression measurements [7-10].”
MethodSelf-citationRohrbeck, A., Neukirchen, J., Rosskopf, M., Pardillos, G. G., Geddert, H., Schwalen, A., Gabbert, H. E., von Haeseler, A., Pitschke, G., Schott, M., et al. (2008) · Journal of Translational Medicine · doi:10.1186/1479-5876-6-69 · Cited by 64
van Duuren, J. B. J. H., Puchałka, J., Mars, A. E., Bücker, R., Eggink, G., Wittmann, C., & dos Santos, V. A. P. M. (2013) · BMC Biotechnology · doi:10.1186/1472-6750-13-93 · Cited by 64
“are obtained [36].”
Sánchez, D. H., Szymański, J., Erban, A., Udvardi, M. K., & Kopka, J. (2009) · Plant Cell & Environment · doi:10.1111/j.1365-3040.2009.02047.x · Cited by 63
“Forty-eight per cent of the robust significant correlations found in L. japonicus Gifu under control conditions (2006 and 2007) were also declared significant in control L. japonicus MG20 plants.”
Pontoriero, G. F., Deschamps, P. A., Ashery‐Padan, R., Wong, R., Yang, Y., Zavadil, J., Cvekl, A., Sullivan, S., Williams, T., & West‐Mays, J. A. (2008) · Developmental Dynamics · doi:10.1002/dvdy.21445 · Cited by 64
Griffin, M. J., Zhou, Y., Kang, S., Zhang, X., Mikkelsen, T. S., & Rosen, E. D. (2013) · Journal of Biological Chemistry · doi:10.1074/jbc.m113.491936 · Cited by 67
“This combination of p value and -fold change threshold serves to eliminate most false positives (28).”
BackgroundFerraresso, S., Vitulo, N., Mininni, A. N., Romualdi, C., Cardazzo, B., Negrisolo, E., Reinhardt, R., Canário, A. V. M., Patarnello, T., & Bargelloni, L. (2008) · BMC Genomics · doi:10.1186/1471-2164-9-580 · Cited by 62
Huang, L., Zuo, Z., Zhang, Y., Wu, M., Lin, J. J., & Wang, C. (2014) · Chemosphere · doi:10.1016/j.chemosphere.2014.02.078 · Cited by 62
“Probes with a substantial likelihood of differential expression under treatment conditions were identified using simple t-tests combined with mean fold change in accordance with recommendations from the Microarray Quality Control Consortium (Guo et al. 2006; Shi et al. 2006).”
MethodSelf-citationMaron, J. L., Johnson, K. L., Slonim, D. K., Lai, C., Ramoni, M. F., Alterovitz, G., Jarrah, Z., Yang, Z., & Bianchi, D. W. (2007) · Journal of Clinical Investigation · doi:10.1172/jci29959 · Cited by 66
Evidence that alternative transcriptional initiation is largely nonadaptive
Xu, C., Park, J., & Zhang, J. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000197 · Cited by 69
Chepelev, N. L., Moffat, I. D., Labib, S., Bourdon-Lacombe, J., Kuo, B. Y.-L., Buick, J. K., Lemieux, F., Malik, A. I., Halappanavar, S. S., Williams, A., et al. (2015) · Critical Reviews in Toxicology · doi:10.3109/10408444.2014.973935 · Cited by 61
“Extensive work in this fi eld has demonstrated that although these platforms have varying degrees of sensitivity, the data produced from one platform are generally quite reproducible on another (e.g., Shi et al. 2006, Yauk and Berndt 2007).”
BackgroundMeyer, S. U., Kaiser, S., Wagner, C., Thirion, C., & Pfaffl, M. W. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038946 · Cited by 57
“Unlike for mRNA expression microarrays, comprehensive quality control and standardization studies [7] are rather limited for microRNA microarrays.”
BackgroundValidated gene targets associated with curatively treated advanced serous ovarian carcinoma
Barlin, J. N., Jelinic, P., Olvera, N., Bogomolniy, F., Bisogna, M., Dao, F., Barakat, R. R., Dennis, S., & Levine, D. A. (2012) · Gynecologic Oncology · doi:10.1016/j.ygyno.2012.11.018 · Cited by 63
Lee, P.-S., Tsang, S. W., Moses, M. A., Trayes-Gibson, Z., Hsiao, L.-L., Jensen, R., Squillace, R., & Kwiatkowski, D. J. (2010) · American Journal of Respiratory Cell and Molecular Biology · doi:10.1165/rcmb.2009-0050oc · Cited by 63
“In the microarray quality control studies, the measurements of gene expression changes on these microarrays exhibited a high level of concordance with other microarray platforms and with quantitative RT-PCR (25).”
MethodSelf-citationTorres‐Martín, M., Lassaletta, L., San-Román-Montero, J., de Campos, J. M., Isla, A., Gavilán, J., Meléndez, B., Pinto, G. R., Burbano, R. M. R., Castresana, J. S., et al. (2013) · International Journal of Oncology · doi:10.3892/ijo.2013.1798 · Cited by 69
Whole blood transcriptome analysis in amyotrophic lateral sclerosis: A biomarker study
van Rheenen, W., Diekstra, F. P., Harschnitz, O., Westeneng, H., van Eijk, K. R., Saris, C. G. J., Groen, E. J. N., van Es, M. A., Blauw, H. M., van Vught, P. W. J., et al. (2018) · PLoS ONE · doi:10.1371/journal.pone.0198874 · Cited by 68
“Because the combination of p-values with the fold change to determine differential expression has proven more robust than p-values alone, we combined both parameters to define differential expression [19].”
MethodObserving metabolic functions at the genome scale
Schwartz, J., Gaugain, C., Nacher, J. C., de Daruvar, A., & Kanehisa, M. I. (2007) · Genome biology · doi:10.1186/gb-2007-8-6-r123 · Cited by 71
Atienzar, F. A., Blomme, E. A., Chen, M., Hewitt, P., Kenna, J. G., Labbe, G., Moulin, F., Pognan, F., Roth, A. B., Suter-Dick, L., et al. (2016) · BioMed Research International · doi:10.1155/2016/9737920 · Cited by 59
Li, X., Cooper, N. G. F., O’Toole, T. E., & Rouchka, E. C. (2020) · BMC Genomics · doi:10.1186/s12864-020-6502-7 · Cited by 66
Alternative methods for regulatory toxicology – a state-of-the-art review
Andrew, W., Filipe, V. B. J., Bremer‐Hoffmann, S., Julien, B., Casati, S., Coecke, S., Corvi, R., Desprez, B., Coralie, D., Varvara, G., et al. (2014) · Joint Research Centre (European Commission) · doi:10.2788/11111 · Cited by 77
Walewski, J. L., Ge, F., Gagner, M., Inabnet, W. B., Pomp, A., Branch, A. D., & Berk, P. D. (2009) · Obesity Surgery · doi:10.1007/s11695-009-0002-9 · Cited by 61
“The consensus report of a major conference sponsored by all of the major government science agencies in 2006 concluded that an n=5 per group was sufficient for most microarray analyses [58].”
BackgroundHuang, H., & Qu, H. (2011) · Analytica Chimica Acta · doi:10.1016/j.aca.2011.09.031 · Cited by 62
Fumagalli, D., Blanchet-Cohen, A., Brown, D. N., Desmedt, C., Gacquer, D., Michiels, S., Rothé, F., Majjaj, S., Salgado, R., Larsimont, D., et al. (2014) · BMC Genomics · doi:10.1186/1471-2164-15-1008 · Cited by 64
“Of note, these values are similar to or higher than the correlation observed across different microarray platforms [64].”
ResultSelf-citationZhang, M., Chen, M., & Tong, W. (2012) · Chemical Research in Toxicology · doi:10.1021/tx200320e · Cited by 58
Self-citationSutherland, J. J., Jolly, R. A., Goldstein, K. M., & Stevens, J. L. (2016) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1004847 · Cited by 61
“Percent overlap is a qualitative metric popularized by the MAQC initiative[3, 23, 24] which simply reports what percentage of the top-ranked features overlap between two experiments.”
BackgroundMethodInfluentialPyfferoen, L., Brabants, E., Everaert, C., Cabooter, N. D., Heyns, K., Deswarte, K., Vanheerswynghels, M., Prijck, S. D., Wagemans, G., Dullaers, M., et al. (2016) · OncoImmunology · doi:10.1080/2162402x.2016.1253655 · Cited by 64
“001 as a form of correcting for multiple testing.(13) Compared to peritumoral lung CD11bC DCs, 37 genes were upregulated and 103 genes were downregulated in CD11bC TIDCs (full expression data available under accession number GSE85044) (Fig.”
BackgroundVeeraragavan, S., Wan, Y.-W., Connolly, D. R., Hamilton, S. M., Ward, C. S., Soriano, S., Pitcher, M. R., McGraw, C. M., Huang, S. G., Green, J. R., et al. (2016) · Human Molecular Genetics · doi:10.1093/hmg/ddw178 · Cited by 59
Bimodal gene expression patterns in breast cancer
Bessarabova, M., Kirillov, E., Shi, W., Bugrim, A. E., Nikolsky, Y., & Nikolskaya, T. (2010) · BMC Genomics · doi:10.1186/1471-2164-11-s1-s8 · Cited by 58
“Platform compatibility and minimization of «dimensionality» are two major problems in meta-analysis, where «gene signatures» consisting of individual genes are notorious for poor reproducibility [40-44,23].”
BackgroundMethodInfluentialOchsner, S. A., Steffen, D. L., Hilsenbeck, S. G., Chen, E. S., Watkins, C. J. C. H., & McKenna, N. J. (2008) · Cancer Research · doi:10.1158/0008-5472.can-08-3492 · Cited by 64
“S1, the largest source of variance between datasets can be attributed to the ‘‘laboratory’’ effect for both the early and late time points, a general phenomenon for microarrays identified by a recent large-scale study (18).”
BackgroundScarr, E., Udawela, M., Thomas, E. A., & Dean, B. (2016) · Molecular Psychiatry · doi:10.1038/mp.2016.195 · Cited by 61
A generic Transcriptomics Reporting Framework (TRF) for ‘omics data processing and analysis
Gant, T. W., Sauer, U. G., Zhang, S., Chorley, B. N., Hackermüller, J., Perdichizzi, S., Tollefsen, K. E., van Ravenzwaay, B., Yauk, C. L., Tong, W., et al. (2017) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2017.11.001 · Cited by 58
Self-citationInvasive Breast Cancer: Recognition of Molecular Subtypes
Strehl, J. D., Wachter, D. L., Fasching, P. A., Beckmann, M. W., & Hartmann, A. (2011) · Breast Care · doi:10.1159/000331339 · Cited by 59
Global transcriptional analysis of the stringent response in Enterococcus faecalis
Gaca, A. O., Abranches, J., Kajfasz, J. K., & Lemos, J. A. (2012) · Microbiology · doi:10.1099/mic.0.060236-0 · Cited by 58
virtualArray: a R/bioconductor package to merge raw data from different microarray platforms
Heider, A., & Alt, R. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-75 · Cited by 63
“In the past, this has mostly been done via metaanalysis studies, such as the microarray quality control consortium (MAQC) study I, comparing the outcomes of different microarray projects [4,5].”
ResultCharacterization and Clinical Evaluation of CD10+ Stroma Cells in the Breast Cancer Microenvironment
Desmedt, C., Majjaj, S., Kheddoumi, N., Singhal, S. K., Haibe‐Kains, B., Ouriaghli, F. E., Chaboteaux, C., Michiels, S., Lallemand, F., Journé, F., et al. (2012) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-11-0383 · Cited by 61
Perturbation of Defense Pathways by Low-Dose Arsenic Exposure in Zebrafish Embryos
Mattingly, C. J., Hampton, T. H., Brothers, K. M., Griffin, N. E., & Planchart, A. (2009) · Environmental Health Perspectives · doi:10.1289/ehp.0900555 · Cited by 61
“Second, we implemented a non parametric fold-change ranking approach as recommended by the MAQC Consortium (Guo et al. 2006; Shi et al. 2006) by which we selected genes with a) at least a ± 1.4-fold change between control and exposed data sets and b) substantial within-group consistency as…”
MethodInfluentialLu, J., Kerns, R. T., Peddada, S. D., & Bushel, P. R. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr241 · Cited by 66
“Hence, the quality and the reproducibility of the data become critically important (6,7).”
BackgroundProtein phosphatase 1-dependent transcriptional programs for long-term memory and plasticity
Gräff, J., Koshibu, K., Jouvenceau, A., Dutar, P., & Mansuy, I. M. (2010) · Learning & Memory · doi:10.1101/lm.1766510 · Cited by 64
“2, based on recommendations from the Microarray Quality Control Comparison project (Guo et al. 2006; Shi et al. 2006).”
MethodUtilizing toxicogenomic data to understand chemical mechanism of action in risk assessment
Wilson, V. S., Keshava, N., Hester, S., Segal, D., Chiu, W. A., Thompson, C. M., & Euling, S. Y. (2011) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2011.01.017 · Cited by 61
Self-citationSystems Biology Approaches for Discovering Biomarkers for Traumatic Brain Injury
Feala, J., AbdulHameed, M. D. M., Yu, C., Dutta, B., Yu, X., Schmid, K. E., Dave, J. R., Tortella, F. C., & Reifman, J. (2013) · Journal of Neurotrauma · doi:10.1089/neu.2012.2631 · Cited by 61
“Oligonucleotide platforms are more common, have standardized data-processing pipelines,(57) and are more reproducible than cDNA microarrays.(58)”
Bootstrap-based differential gene expression analysis for RNA-Seq data with and without replicates
Seesi, S. A., Temate‐Tiagueu, Y., Zelikovsky, A., & Măndoiu, I. (2014) · BMC Genomics · doi:10.1186/1471-2164-15-s8-s2 · Cited by 63
Exploration of Sialic Acid Diversity and Biology Using Sialoglycan Microarrays
Deng, L., Chen, X., & Varki, A. P. (2013) · Biopolymers · doi:10.1002/bip.22314 · Cited by 59
MacConaill, L. E., Van Hummelen, P., Meyerson, M., & Hahn, W. C. (2011) · Cancer Discovery · doi:10.1158/2159-8290.cd-11-0110 · Cited by 54
Putative psychosis genes in the prefrontal cortex: combined analysis of gene expression microarrays
Choi, K. H., Elashoff, M. R., Higgs, B. W., Song, J. C., Kim, S., Sabunciyan, S., Diglisic, S., Yolken, R. H., Knable, M. B., Torrey, Ε. F., et al. (2008) · BMC Psychiatry · doi:10.1186/1471-244x-8-87 · Cited by 58
“Such guidelines have been suggested by the MicroArray Quality Control (MAQC) I project to maximize reproducibility of differential expression across platforms [24].”
BackgroundLei, S., Wu, S., Li, L.-M., Deng, F., Xiao, S., Jiang, C., Chen, Y., Jiang, H., Yang, F., Tan, L., et al. (2008) · Bone · doi:10.1016/j.bone.2008.05.016 · Cited by 59
“The technology has substantially improved in recent years and shown reliable and repeatable results across various labs and platforms [11,12].”
BackgroundSelf-citationSerum-Induced Differentiation of Human Meibomian Gland Epithelial Cells
Sullivan, D. A., Liu, Y., Kam, W. R., Ding, J., Green, K. M., Shaffer, S. A., Hatton, M. P., & Liu, S. (2014) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.13-13407 · Cited by 57
“Standardized hybridization intensity values were adjusted by adding a constant, so that the lowest intensity value for any sample was equal to 16.(15) Normalized data were evaluated without log transformation and statistical analyses were performed with Student’s t-test (2tailed, unpaired).”
MethodSelf-citationMicroarray analysis in pulmonary hypertension
Hoffmann, J., Wilhelm, J., Olschewski, A., & Kwapiszewska, G. (2016) · European Respiratory Journal · doi:10.1183/13993003.02030-2015 · Cited by 58
Turnbull, A., Selli, Ç., Martínez-Pérez, C., Fernando, A., Renshaw, L., Keys, J., Figueroa, J. D., He, X., Tanioka, M., Munro, A. F., et al. (2020) · BMC Bioinformatics · doi:10.1186/s12859-020-3365-5 · Cited by 57
Expression profiling technology: its contribution to our understanding of breast cancer
Rakha, E. A., El‐Sayed, M. E., Reis-Filho, J. S., & Ellis, I. O. (2007) · Histopathology · doi:10.1111/j.1365-2559.2007.02894.x · Cited by 57
“Furthermore, some signatures suffer from a lack of reproducibility in independent studies, and multiple signatures have been shown to have prognostic significance in the same cohort of patients.(94) All of these findings have raised critical suspicion about the reliability of these results and their clinical relevance…”
BackgroundCuration of over 10 000 transcriptomic studies to enable data reuse
Lim, N., Tesar, S., Belmadani, M., Poirier‐Morency, G., Mancarci, B. O., Sicherman, J., Jacobson, M., Leong, J., Tan, P., & Pavlidis, P. (2021) · Database · doi:10.1093/database/baab006 · Cited by 64
“It is well established that a high correlation of gene expression profiles between replicate samples is a good indicator of data reproducibility (50, 51).”
BackgroundSárvári, M., Kalló, I., Hrabovszky, E., Solymosi, N., & Liposits, Z. (2014) · PLoS ONE · doi:10.1371/journal.pone.0088540 · Cited by 62
BeadArray Expression Analysis Using Bioconductor
Ritchie, M. E., Dunning, M., Smith, M. L., Shi, W., & Lynch, A. G. (2011) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1002276 · Cited by 64
“character(x), 4 + ":")[[1]][1])) 5 > spos <- as.”
MethodInfluentialExpression profiling with RNA from formalin-fixed, paraffin-embedded material
Oberli, A., Popovici, V. C., Delorenzi, M., Baltzer, A., Antonov, J., Matthey, S., Aebi, S. P., Altermatt, H. J., & Jaggi, R. B. (2008) · BMC Medical Genomics · doi:10.1186/1755-8794-1-9 · Cited by 56
“Many of these studies including meta-analyses have revealed genes and biological functions of their products which are relevant for classification and prognosis [9,10].”
Can subtle changes in gene expression be consistently detected with different microarray platforms?
Pedotti, P., 't Hoen, P. A., Vreugdenhil, E., Schenk, G. J., Vossen, R. H., Ariyurek, Y., de Hollander, M., Kuiper, R., van Ommen, G. J., den Dunnen, J. T., et al. (2008) · BMC Genomics · doi:10.1186/1471-2164-9-124 · Cited by 52
“The choice of the type of cut-off is still a matter of debate, and several authors suggested using a mixed cut-off of pvalues and Fold Changes (FCs) [21,24].”
BackgroundMethodResultInfluentialTranscriptome of the human retina, retinal pigmented epithelium and choroid
Tian, L., Kazmierkiewicz, K. L., Bowman, A. S., Li, M., Curcio, C. A., & Stambolian, D. E. (2015) · Genomics · doi:10.1016/j.ygeno.2015.01.008 · Cited by 57
Lu, C., & King, R. D. (2009) · Bioinformatics · doi:10.1093/bioinformatics/btp360 · Cited by 53
“A recent large-scale comparison of microarrays with other techniques has shown that microarrays have good accuracy (Canales et al., 2006).”
BackgroundGenomic analysis suggests higher susceptibility of children to air pollution
van Leeuwen, D. M., Pedersen, M., Hendriksen, P. J. M., Boorsma, A., van Herwijnen, M. H. M., Gottschalk, R. W. H., Kirsch‐Volders, M., Knudsen, L. E., Šrám, R. J., Bajak, E., et al. (2008) · Carcinogenesis · doi:10.1093/carcin/bgn065 · Cited by 56
Liu, Q., Hu, Y., Stucky, A., Li, F., Zhong, J. F., & Wang, K. (2020) · BMC Genomics · doi:10.1186/s12864-020-07207-4 · Cited by 71
Lack of correct data format and comparability limits future integrative microarray research
Larsson, O. S., & Sandberg, R. (2006) · Nature Biotechnology · doi:10.1038/nbt1106-1322 · Cited by 56
Increased NKCC1 expression in arachnoid cysts supports secretory basis for cyst formation
Helland, C. A., Aarhus, M., Knappskog, P. M., Olsson, L. K., Lund‐Johansen, M., Amiry-Moghaddam, M. R., & Wester, K. G. (2010) · Experimental Neurology · doi:10.1016/j.expneurol.2010.05.002 · Cited by 55
The Future of Toxicity Testing
Andersen, M. E., Al‐Zoughool, M., Croteau, M. C., Westphal, M., & Krewski, D. R. (2010) · Journal of Toxicology and Environmental Health Part B · doi:10.1080/10937404.2010.483933 · Cited by 60
“Another important statute is the Federal Insecticide, Fungicide, and Rodenticide Act (FIFRA), also administered by the U.S. EPA.”
BackgroundInfluentialHebels, D. G. A. J., Sveje, K. M., de Kok, M. C., van Herwijnen, M. H. M., Kuhnle, G., Engels, L. G. J. B., Vleugels-Simon, C. B. E. M., Mares, W. G. N., Pierik, M. J., Masclee, A., et al. (2011) · Food and Chemical Toxicology · doi:10.1016/j.fct.2011.10.038 · Cited by 55
Understanding Prognostic Gene Expression Signatures in Lung Cancer
Zhu, C., Pintilie, M., John, T., Strumpf, D., Shepherd, F. A., Der, S. D., Jurišica, I., & Tsao, M. (2009) · Clinical Lung Cancer · doi:10.3816/clc.2009.n.045 · Cited by 55
Çolak, D., Alaiya, A. A., Kaya, N., Muiya, N. P., Al‐Harazi, O., Shinwari, Z., Andres, E., & Dzimiri, N. (2016) · PLoS ONE · doi:10.1371/journal.pone.0162669 · Cited by 61
A fuzzy gene expression-based computational approach improves breast cancer prognostication
Haibe‐Kains, B., Desmedt, C., Rothé, F., Piccart, M. J., Sotiriou, C. P., & Bontempi, G. (2010) · Genome biology · doi:10.1186/gb-2010-11-2-r18 · Cited by 55
Individual mRNA expression profiles reveal the effects of specific microRNAs
Arora, A., & Simpson, D. A. C. (2008) · Genome biology · doi:10.1186/gb-2008-9-5-r82 · Cited by 63
Left ventricular global transcriptional profiling in human end-stage dilated cardiomyopathy
Çolak, D., Kaya, N., Al‐Zahrani, J., AlBakheet, A., Muiya, P., Andres, E., Quackenbush, J. F., & Dzimiri, N. (2009) · Genomics · doi:10.1016/j.ygeno.2009.03.003 · Cited by 57
“Several studies have been performed using different microarray-based and other techniques to evaluate alterations in gene expression in DCM [22–26], and recently intraplatform consistency in terms of sample sources as well as a high level of interplatform concordance with respect to genes identified as differentially…”
MethodPloski, J. E., Park, K. W., Ping, J., Monsey, M. S., & Schafe, G. E. (2010) · Journal of Neurochemistry · doi:10.1111/j.1471-4159.2009.06491.x · Cited by 52
“Importantly, the MAQC Consortium has reported that this approach can be successful in identifying reproducible gene lists (Shi et al. 2006).”
BackgroundCallari, M., Dugo, M., Musella, V., Marchesi, E., Chiorino, G., Grand, M. M., Pierotti, M. A., Daidone, M. G., Canevari, S., & Cecco, L. D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0045105 · Cited by 57
“This type of approach mirrored the one followed in its first phase study by the MicroArray Quality Control (MAQC) consortium, aiming to assess the inter-platform and interlaboratory reproducibility of gene-expression microarray data using two different RNAs (human brain and a universal human reference) [18].”
Ach, R. A., Floore, A. N., Curry, B., Lazar, V., Glas, A. M., Pover, R., Tsalenko, A., Ripoche, H., Cardoso, F., d'Assignies, M. S., et al. (2007) · BMC Genomics · doi:10.1186/1471-2164-8-148 · Cited by 54
Global gene expression analysis of bovine blastocysts produced by multiple methods
Zhou, W., Xiang, T., Walker, S., Farrar, V. R., Hwang, E., Findeisen, B., Sadeghieh, S., Arenivas, F., Abruzzese, R. V., & Polejaeva, I. A. (2007) · Molecular Reproduction and Development · doi:10.1002/mrd.20797 · Cited by 54
Self-citationJones, W. D., Gong, B., Novoradovskaya, N., Li, D., Kusko, R. L., Richmond, T., Johann, D. J., Bişğin, H., Sahraeian, S. M. E., Bushel, P. R., et al. (2021) · Genome biology · doi:10.1186/s13059-021-02316-z · Cited by 59
Self-citationLi, S. S.-L., Liu, Y.-H., Tseng, C.-N., Chung, T.-L., Lee, T.-Y., & Singh, S. (2006) · Stem Cells and Development · doi:10.1089/scd.2006.15.532 · Cited by 54
Self-citationGenomics and proteomics analysis of cultured primary rat hepatocytes
Beigel, J., Fella, K., Kramer, P.-J., Kröger, M., & Hewitt, P. (2007) · Toxicology in Vitro · doi:10.1016/j.tiv.2007.06.019 · Cited by 55
Assessing the impact of human genome annotation choice on RNA-seq expression estimates
Wu, P.-Y., Phan, J. H., & Wang, M. D. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-s11-s8 · Cited by 54
“For MAQC samples (SRA: SRP000727), we use the publicly available MAQC-I dataset that used a TaqMan RT-qPCR assay to profile 1,044 genes for both the Human Brain Reference RNA (HBRR) and Universal Human Reference RNA (UHRR) samples [27] (GEO accession number: GSE5350).”
MethodLi, Z., Xu, H., Zheng, W., Lam, S. H., & Gong, Z. (2013) · PLoS ONE · doi:10.1371/journal.pone.0077292 · Cited by 53
“As it has been previously reported that the actual measured quantity of differential expression (fold change or ratio) is more consistent and reproducible in identifying differentially expressed genes than the statistical significance (pvalue) [16,17], in the present study, we selected differentially expressed genes b…”
BackgroundBiomarkers of human gastrointestinal tract regions
Comelli, E. M., Lariani, S., Zwahlen, M.-C., Fotopoulos, G., Holzwarth, J. A., Cherbut, C., Dorta, G. O., Corthesy-Theulaz, I. E., & Grigorov, M. (2009) · Mammalian Genome · doi:10.1007/s00335-009-9212-7 · Cited by 58
Maouche, S., Poirier, O., Godefroy, T., Olaso, R., Gut, I. G., Collet, J. P., Montalescot, G., & Cambien, F. (2008) · BMC Genomics · doi:10.1186/1471-2164-9-302 · Cited by 56
“According to the results of the MAQC project the Affymetrix and Illumina arrays provide highly reproducible results [Fig. 2 in [ 4 ]] that correlate well with single gene expression measurements obtained by RT-PCR and TaqMan assays [Fig. 4 in [7]].”
BackgroundResult'Omics analysis of low dose acetaminophen intake demonstrates novel response pathways in humans
Jetten, M. J., Gaj, S., Ruiz‐Aracama, A., de Kok, T. M. C. M., van Delft, J. H. M., Lommen, A., van Someren, E. P., Jennen, D. G. J., Claessen, S. M. H., Peijnenburg, A., et al. (2012) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2012.01.009 · Cited by 54
“Significant Analyses of Micro-arrays (SAM) was performed to find differentially expressed genes (DEGs) (Shi et al., 2006; Tusher et al., 2001).”
BackgroundChoi, S., Choi, J.-H., Park, C., Ahn, C., Hong, S. J., & Lim, D. (2012) · Journal of Cellular Physiology · doi:10.1002/jcp.24076 · Cited by 52
Metadata
- Authors
- MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., Kawasaki, E. S., Lee, K. Y., Luo, Y., Sun, Y. A., Willey, J. C., Setterquist, R. A., Fischer, G. M., Tong, W., Dragan, Y. P., Dix, D. J., Frueh, F. W., Goodsaid, F. M., Herman, D., Jensen, R. V., Johnson, C. D., Lobenhofer, E. K., Puri, R. K., Scherf, U., Thierry-Mieg, J., Wang, C., Wilson, M., Wolber, P. K., Zhang, L., Amur, S., Bao, W., Barbacioru, C. C., Lucas, A. B., Bertholet, V., Boysen, C., Bromley, B., Brown, D., Brunner, A., Canales, R., Cao, X. M., Cebula, T. A., Chen, J. J., Cheng, J., Chu, T.-M., Chudin, E., Corson, J., Corton, J. C., Croner, L. J., Davies, C., Davison, T. S., Delenstarr, G., Deng, X., Dorris, D., Eklund, A. C., Fan, X.-H., Fang, H., Fulmer-Smentek, S., Fuscoe, J. C., Gallagher, K., Ge, W., Guo, L., Guo, X., Hager, J., Haje, P. K., Han, J., Han, T., Harbottle, H. C., Harris, S. C., Hatchwell, E., Hauser, C. A., Hester, S., Hong, H., Hurban, P., Jackson, S. A., Ji, H., Knight, C. R., Kuo, W. P., LeClerc, J. E., Levy, S., Li, Q.-Z., Liu, C., Liu, Y., Lombardi, M. J., Ma, Y., Magnuson, S. R., Maqsodi, B., McDaniel, T., Mei, N., Myklebost, O., Ning, B., Novoradovskaya, N., Orr, M. S., Osborn, T. W., Papallo, A., Patterson, T. A., Perkins, R. G., Peters, E. H., Peterson, R., Philips, K. L., Pine, P. S., Pusztai, L., Qian, F., Ren, H., Rosen, M., Rosenzweig, B. A., Samaha, R. R., Schena, M., Schroth, G. P., Shchegrova, S., Smith, D. D., Staedtler, F., Su, Z., Sun, H., Szallasi, Z., Tezak, Z., Thierry-Mieg, D., Thompson, K. L., Tikhonova, I., Turpaz, Y., Vallanat, B., Van, C., Walker, S. J., Wang, S. J., Wang, Y., Wolfinger, R., Wong, A., Wu, J., Xiao, C., Xie, Q., Xu, J., Yang, W., Zhang, L., Zhong, S., Zong, Y., & Slikker, W.
- Affiliations
- Affymetrix (United States) (US)
- Illumina (United States) (US)
- Agilent Technologies (United States) (US)
- National Cancer Institute (US)
- National Center for Toxicological Research (US)
- Environmental Protection Agency (US)
- United States Food and Drug Administration (US)
- National Institutes of Health (US)
- University of Massachusetts Boston (US)
- Asuragen (United States) (US)
- Center for Biologics Evaluation and Research (US)
- Cedars-Sinai Medical Center (US)
- SAS Institute (United States) (US)
- Center for Food Safety and Applied Nutrition (US)
- Biogen (United States) (US)
- Yale University (US)
- Center for Veterinary Medicine (US)
- Cold Spring Harbor Laboratory (US)
- Sanford Burnham Prebys Medical Discovery Institute (US)
- Stanford Medicine (US)
- Harvard University (US)
- Vanderbilt University (US)
- The University of Texas Southwestern Medical Center (US)
- The University of Texas at Dallas (US)
- GenUs BioSystems (United States) (US)
- Oslo University Hospital (NO)
- The University of Texas MD Anderson Cancer Center (US)
- Luminex (United States) (US)
- Wake Forest University Health Sciences (US)
- University of Illinois Urbana-Champaign (US)
- ORCID
- Jones, Wendell D
- Collins, Patrick J
- Luo, Yuling
- Sun, Yongming Andrew
- Willey, James C
- Tong, Weida
- Frueh, Felix W
- Goodsaid, Federico M
- Johnson, Charles D
- Puri, Raj K
- Scherf, Uwe
- Wang, Charles
- Bao, Wenjun
- Brown, Donna
- Chen, James J
- Cheng, Jing
- Corton, J Christopher
- Croner, Lisa J
- Deng, Xutao
- Eklund, Aron C
- Fang, Hong
- Guo, Lei
- Guo, Xu
- Han, Jing
- Han, Tao
- Harbottle, Heather C
- Harris, Stephen C
- Hatchwell, Eli
- Hester, Susan
- Hong, Huixiao
- Jackson, Scott A
- Ji, Hanlee
- Levy, Shawn
- Li, Quan-Zhen
- Liu, Chunmei
- Liu, Ying
- Ma, Yunqing
- Mei, Nan
- Myklebost, Ola
- Ning, Baitang
- Patterson, Tucker A
- Pusztai, Lajos
- Qian, Feng
- Schroth, Gary P
- Su, Zhenqiang
- Sun, Hongmei
- Tikhonova, Irina
- Turpaz, Yaron
- Walker, Stephen J
- Wang, Sue Jane
- Wang, Yonghong
- Wong, Alex
- Wu, Jie
- Xiao, Chunlin
- Xie, Qian
- Xu, Jun
- Yang, Wen
- Zhang, Liang
- Zhong, Sheng
- Slikker, William
- Venue
- Nature Biotechnology
- Published
- 2006-09-01
- Volume
- 24
- Issue
- 9
- Pages
- 1151-1161
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC3272078
- OpenAlex
- W2010637767
- Cited by
- 2,126
- References
- 43
- Citations by year
- 2026: 21 · 2025: 25 · 2024: 23 · 2023: 39 · 2022: 37 · 2021: 60 · 2020: 43 · 2019: 59 · 2018: 68 · 2017: 87 · 2016: 87 · 2015: 98 · 2014: 122 · 2013: 155 · 2012: 160
- FWCI
- 87.96
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature Biotechnology (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) (submittedVersion)
- Funders
- U.S. Environmental Protection Agency
- National Institutes of Health (Z99 LM999999, Z99 HL999999, Z99 MH999999, Z99CL999999)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Molecular Biology Techniques and Applications
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Keywords
- probe mapping, differentially expressed genes, microarray data analysis
- MeSH terms
- Equipment Design, Quality Assurance, Health Care, Quality Control, Sensitivity and Specificity, United States, Reproducibility of Results, Equipment Failure Analysis, Oligonucleotide Array Sequence Analysis, Gene Expression Profiling
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.