Talking the talk, but not walking the walk: RT-qPCR as a paradigm for the lack of reproducibility in molecular research

Analysis of Relative Gene Expression Data Using Real-Time Quantitative PCR and the 2−ΔΔCT Method

Livak, K. J., & Schmittgen, T. D. (2001) · Methods · doi:10.1006/meth.2001.1262 · Cited by 180,860 · see citing works

A new mathematical model for relative quantification in real-time RT-PCR

Pfaffl, M. W. (2001) · Nucleic Acids Research · doi:10.1093/nar/29.9.e45 · Cited by 34,610 · see citing works

Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes

Vandesompele, J., De Preter, K., Pattyn, F., Poppe, B., Van Roy, N., De Paepe, A., & Speleman, F. (2002) · Genome Biology · doi:10.1186/gb-2002-3-7-research0034 · Cited by 20,038 · see citing works

The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments

Bustin, S. A., Benes, V., Garson, J. A., Hellemans, J., Huggett, J., Kubista, M., Mueller, R., Nolan, T., Pfaffl, M. W., Shipley, G. L., et al. (2009) · Clinical Chemistry · doi:10.1373/clinchem.2008.112797 · Cited by 16,303 · see citing works

Why Most Published Research Findings Are False

Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505 · see citing works

1,500 scientists lift the lid on reproducibility

Baker, M. (2016) · Nature · doi:10.1038/533452a · Cited by 4,209 · see citing works

qBase relative quantification framework and software for management and automated analysis of real-time quantitative PCR data

Hellemans, J., Mortier, G., De Paepe, A., Speleman, F., & Vandesompele, J. (2007) · Genome Biology · doi:10.1186/gb-2007-8-2-r19 · Cited by 4,023 · see citing works

Assumption-free analysis of quantitative real-time polymerase chain reaction (PCR) data

Ramakers, C. R. B., Ruijter, J. M., Deprez, R. H. L., & Moorman, A. F. M. (2003) · Neuroscience Letters · doi:10.1016/s0304-3940(02)01423-4 · Cited by 3,718 · see citing works

Amplification efficiency: linking baseline and bias in the analysis of quantitative PCR data

Ruijter, J. M., Ramakers, C., Hoogaars, W. M. H., Karlen, Y., Bakker, O., van den Hoff, M. J. B., & Moorman, A. F. M. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp045 · Cited by 3,043 · see citing works

Raise standards for preclinical cancer research

Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · see citing works

BET Bromodomain Inhibition as a Therapeutic Strategy to Target c-Myc

Delmore, J. E., Issa, G. C., Lemieux, M. E., Rahl, P. B., Shi, J., Jacobs, H. M., Kastritis, E., Gilpatrick, T., Paranal, R. M., Qi, J., et al. (2011) · Cell · doi:10.1016/j.cell.2011.08.017 · Cited by 2,820 · see citing works

The RIN: an RNA integrity number for assigning integrity values to RNA measurements

Schroeder, A., Mueller, O., Stocker, S., Salowsky, R., Leiber, M., Gassmann, M., Lightfoot, S., Menzel, W., Granzow, M., & Ragg, T. (2006) · BMC Molecular Biology · doi:10.1186/1471-2199-7-3 · Cited by 2,623 · see citing works

Quantification of mRNA using real-time reverse transcription PCR (RT-PCR): trends and problems

Bustin, S. A. (2002) · Journal of Molecular Endocrinology · doi:10.1677/jme.0.0290023 · Cited by 2,553 · see citing works

A coding-independent function of gene and pseudogene mRNAs regulates tumour biology

Poliseno, L., Salmena, L., Zhang, J., Carver, B. S., Haveman, W. J., & Pandolfi, P. P. (2010) · Nature · doi:10.1038/nature09144 · Cited by 2,313 · see citing works

Quantification of mRNA using real-time RT-PCR

Nolan, T., Hands, R. E., & Bustin, S. A. (2006) · Nature Protocols · doi:10.1038/nprot.2006.236 · Cited by 2,247 · see citing works

The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements

MAQC Consortium, Shi, L., Shi, L., Reid, L. H., Jones, W. D., Shippy, R., Warrington, J. A., Baker, S. C., Collins, P. J., de Longueville, F., et al. (2006) · Nature Biotechnology · doi:10.1038/nbt1239 · Cited by 2,126 · see citing works

A novel method for real time quantitative RT-PCR.Preprint

Gibson, U. E., Heid, C., & Williams, P. M. (1996) · Genome Research · doi:10.1101/gr.6.10.995 · Cited by 2,090 · see citing works

Believe it or not: how much can we rely on published data on potential drug targets?

Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888 · see citing works

Increasing value and reducing waste in research design, conduct, and analysis

Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597 · see citing works

The real-time polymerase chain reaction

Kubista, M., Andrade, J. M., Bengtsson, M., Forootan, A., Jonák, J., Lind, K., Sindelka, R., Sjöback, R., Sjögreen, B., Strömbom, L., et al. (2006) · Molecular Aspects of Medicine · doi:10.1016/j.mam.2005.12.007 · Cited by 1,515 · see citing works

RNA integrity and the effect on the real-time qRT-PCR performance

Fleige, S., & Pfaffl, M. W. (2006) · Molecular Aspects of Medicine · doi:10.1016/j.mam.2005.12.003 · Cited by 1,488 · see citing works

How to increase value and reduce waste when research priorities are set

Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62229-1 · Cited by 1,436 · see citing works

Analyzing and minimizing PCR amplification bias in Illumina sequencing libraries

Aird, D., Ross, M. G., Chen, W.-S., Danielsson, M., Fennell, T., Russ, C., Jaffe, D. B., Nusbaum, C., & Gnirke, A. (2011) · Genome Biology · doi:10.1186/gb-2011-12-2-r18 · Cited by 1,174 · see citing works

Quantitative RT-PCR: Pitfalls and Potential

Freeman, W. M., Walker, S. J., & Vrana, K. E. (1999) · BioTechniques · doi:10.2144/99261rv01 · Cited by 1,149 · see citing works

Pitfalls of quantitative real-time reverse-transcription polymerase chain reaction.

Bustin, S. A., & Nolan, T. (2004) · PubMed · Cited by 1,036 · see citing works

Reproducibility in Science: Improving the Standard for Basic and Preclinical Research

Begley, C. G., & Ioannidis, J. P. A. (2015) · Circulation Research · doi:10.1161/circresaha.114.303819 · Cited by 1,035 · see citing works

Biomedical research: increasing value, reducing waste.

Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Salman, R. A.-S., Chan, A.-W., & Glasziou, P. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62329-6 · Cited by 1,003 · see citing works

A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium

SEQC/MAQC-III Consortium (2014) · Nature Biotechnology · doi:10.1038/nbt.2957 · Cited by 983 · see citing works

The Digital MIQE Guidelines: Minimum Information for Publication of Quantitative Digital PCR Experiments

Huggett, J. F., Foy, C. A., Benes, V., Emslie, K., Garson, J. A., Haynes, R., Hellemans, J., Kubista, M., Mueller, R. D., Nolan, T., et al. (2013) · Clinical Chemistry · doi:10.1373/clinchem.2013.206375 · Cited by 859 · see citing works

Experimental validation of novel and conventional approaches to quantitative real-time PCR data analysis

Peirson, S. N. (2003) · Nucleic Acids Research · doi:10.1093/nar/gng073 · Cited by 841 · see citing works

Inhibition of PCR by components of food samples, microbial diagnostic assays and DNA-extraction solutions

Rossen, L., Nørskov, P., Holmstrøm, K., et al. (1992) · International Journal of Food Microbiology · doi:10.1016/0168-1605(92)90017-w · Cited by 828 · see citing works

Rescuing US biomedical research from its systemic flaws

Alberts, B., Kirschner, M. W., Tilghman, S., & Varmus, H. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1404402111 · Cited by 817 · see citing works

Translating RNA sequencing into clinical diagnostics: opportunities and challenges

Byron, S. A., Keuren‐Jensen, K. R. V., Engelthaler, D. M., Carpten, J. D., & Craig, D. W. (2016) · Nature Reviews Genetics · doi:10.1038/nrg.2016.10 · Cited by 805 · see citing works

How to do successful gene expression analysis using real-time PCR

Derveaux, S., Vandesompele, J., & Hellemans, J. (2009) · Methods · doi:10.1016/j.ymeth.2009.11.001 · Cited by 791 · see citing works

How to Make More Published Research True

Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760 · see citing works

Developmental basis of sexually dimorphic digit ratios

Zheng, Z., & Cohn, M. J. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1108312108 · Cited by 663 · see citing works

Removing technical variability in RNA-seq data using conditional quantile normalization

Hansen, K. D., Irizarry, R. A., & WU, Z. (2012) · Biostatistics · doi:10.1093/biostatistics/kxr054 · Cited by 607 · see citing works

How good is a PCR efficiency estimate: Recommendations for precise and robust qPCR efficiency assessments

Svec, D., Tichopad, A., Novosadova, V., Pfaffl, M. W., & Kubista, M. (2015) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2015.01.005 · Cited by 601 · see citing works

Towards standardization of RNA quality assessment using user-independent classifiers of microcapillary electrophoresis traces

Imbeaud, S. (2005) · Nucleic Acids Research · doi:10.1093/nar/gni054 · Cited by 530 · see citing works

Guidelines for validation of qualitative real-time PCR methods

Broeders, S., Huber, I., Grohmann, L., Berben, G., Taverniers, I., Mazzara, M., Roosens, N. H. C., & Morisset, D. (2014) · Trends in Food Science & Technology · doi:10.1016/j.tifs.2014.03.008 · Cited by 474 · see citing works

Influence of DNA extraction methods, PCR inhibitors and quantification methods on real-time PCR assay of biotechnology-derived traits

Demeke, T., & Jenkins, G. R. (2009) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-009-3150-9 · Cited by 411 · see citing works

Properties of the Reverse Transcription Reaction in mRNA Quantification

Ståhlberg, A., Håkansson, J., Xian, X., Semb, H., & Kubista, M. (2004) · Clinical Chemistry · doi:10.1373/clinchem.2003.026161 · Cited by 409 · see citing works

qpcR: an R package for sigmoidal model selection in quantitative real-time polymerase chain reaction analysis

Ritz, C., & Spiess, A. (2008) · Bioinformatics · doi:10.1093/bioinformatics/btn227 · Cited by 391 · see citing works

Why the need for qPCR publication guidelines?—The case for MIQE

Bustin, S. A. (2009) · Methods · doi:10.1016/j.ymeth.2009.12.006 · Cited by 374 · see citing works

Statistical significance of quantitative PCR

Karlen, Y., McNair, A., Perseguers, S., Mazza, C., & Mermod, N. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-131 · Cited by 373 · see citing works

Public Availability of Published Research Data in High-Impact Journals

Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024357 · Cited by 363 · see citing works

Maximizing sensitivity and specificity of PCR by preamplification heating

D’Aquila, R. T., Bechtel, L. J., Videler, J. A., et al. (1991) · Nucleic Acids Research · doi:10.1093/nar/19.13.3749 · Cited by 362 · see citing works

Quantitative or semi-quantitative PCR: reality versus myth.Preprint

Ferre, F. (1992) · Genome Research · doi:10.1101/gr.2.1.1 · Cited by 351 · see citing works

Translation of highly promising basic science research into clinical applications

Contopoulos-Ioannidis, D. G., Ntzani, E. E., & Ioannidis, J. P. A. (2003) · The American Journal of Medicine · doi:10.1016/s0002-9343(03)00013-5 · Cited by 323 · see citing works

Length and GC-Biases During Sequencing Library Amplification: A Comparison of Various Polymerase-Buffer Systems with Ancient and Modern DNA Sequencing Libraries

Dabney, J., & Meyer, M. (2012) · BioTechniques · doi:10.2144/000113809 · Cited by 316 · see citing works

An open investigation of the reproducibility of cancer biology research

Errington, T. M., Iorns, E., Gunn, W., Tan, F. E., Lomax, J., & Nosek, B. A. (2014) · eLife · doi:10.7554/elife.04333 · Cited by 312 · see citing works

RNA-seq: technical variability and sampling

McIntyre, L. M., Lopiano, K. K., Morse, A. M., Amin, V., Oberg, A. L., Young, L. J., & Nuzhdin, S. V. (2011) · BMC Genomics · doi:10.1186/1471-2164-12-293 · Cited by 285 · see citing works

The need for transparency and good practices in the qPCR literature

Bustin, S. A., Benes, V., Garson, J., Hellemans, J., Huggett, J., Kubista, M., Mueller, R., Nolan, T., Pfaffl, M. W., Shipley, G., et al. (2013) · Nature Methods · doi:10.1038/nmeth.2697 · Cited by 281 · see citing works

SPUD: A quantitative PCR assay for the detection of inhibitors in nucleic acid preparations

Nolan, T., Hands, R., Ogunkolade, W. B., & Bustin, S. A. (2006) · Analytical Biochemistry · doi:10.1016/j.ab.2006.01.051 · Cited by 258 · see citing works

Differential susceptibility of PCR reactions to inhibitors: an important and unrecognised phenomenon

Huggett, J. F., Novak, T., Garson, J. A., Green, C., Morris-Jones, S. D., Miller, R. F., & Zumla, A. (2008) · BMC Research Notes · doi:10.1186/1756-0500-1-70 · Cited by 250 · see citing works

Modern biomedical research: an internally self-consistent universe with little contact with medical reality?

Horrobin, D. F. (2003) · Nature Reviews Drug Discovery · doi:10.1038/nrd1012 · Cited by 248 · see citing works

Improving Validation Practices in “Omics” Research

Ioannidis, J. P. A., & Khoury, M. J. (2011) · Science · doi:10.1126/science.1211811 · Cited by 246 · see citing works

Announcement: Reducing our irreproducibility

(2013) · Nature · doi:10.1038/496398a · Cited by 243 · see citing works

Comparison of Reverse Transcriptases in Gene Expression Analysis

Ståhlberg, A., Kubista, M., & Pfaffl, M. (2004) · Clinical Chemistry · doi:10.1373/clinchem.2004.035469 · Cited by 240 · see citing works

Intra-Platform Repeatability and Inter-Platform Comparability of MicroRNA Microarray Technology

Sato, F., Tsuchiya, S., Terasawa, K., & Tsujimoto, G. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005540 · Cited by 214 · see citing works

Reproducible Research: Moving toward Research the Public Can Really Trust

Laine, C., Goodman, S. N., Griswold, M. E., & Sox, H. C. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-6-200703200-00154 · Cited by 213 · see citing works

Sigmoidal curve-fitting redefines quantitative real-time PCR with the prospective of developing automated high-throughput applications

Rutledge, R. G. (2004) · Nucleic Acids Research · doi:10.1093/nar/gnh177 · Cited by 209 · see citing works

Measurable impact of RNA quality on gene expression results from quantitative PCR

Vermeulen, J., Preter, K. D., Lefever, S., Nuytens, J., Vloed, F. D., Derveaux, S., Hellemans, J., Speleman, F., & Vandesompele, J. (2011) · Nucleic Acids Research · doi:10.1093/nar/gkr065 · Cited by 207 · see citing works

Chipping away at the chip bias: RNA degradation in microarray analysis

Auer, H., Liyanarachchi, S., Newsom, D. L., Klisovic, M. I., Marcucci, U., & Kornacker, K. (2003) · Nature Genetics · doi:10.1038/ng1203-292 · Cited by 201 · see citing works

Checklist for optimization and validation of real‐time PCR assays

Raymaekers, M., Smets, R., Maes, B., et al. (2009) · Journal of Clinical Laboratory Analysis · doi:10.1002/jcla.20307 · Cited by 194 · see citing works

Oligo(dT) primer generates a high frequency of truncated cDNAs through internal poly(A) priming during reverse transcription

Nam, D., Lee, S., Zhou, G., Cao, X., Wang, C., Clark, T. W., Chen, J., Rowley, J. D., & Wang, S. M. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.092140899 · Cited by 193 · see citing works

A survey of tools for the analysis of quantitative PCR (qPCR) data

Pabinger, S., Rödiger, S., Kriegner, A., Vierlinger, K., & Weinhäusel, A. (2014) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2014.08.002 · Cited by 189 · see citing works

Comparing the normalization methods for the differential analysis of Illumina high-throughput RNA-Seq data

Li, P., Piao, Y., Shon, H. S., & Ryu, K. H. (2015) · BMC Bioinformatics · doi:10.1186/s12859-015-0778-7 · Cited by 188 · see citing works

Limitations are not properly acknowledged in the scientific literature

Ioannidis, J. P. A. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.09.011 · Cited by 180 · see citing works

Standardisation of data from real-time quantitative PCR methods – evaluation of outliers and comparison of calibration curves

Burns, M. J., Nixon, G. J., Foy, C. A., et al. (2005) · BMC Biotechnology · doi:10.1186/1472-6750-5-31 · Cited by 179 · see citing works

Evaluation of Digital PCR for Absolute RNA Quantification

Sanders, R., Mason, D. J., Foy, C. A., & Huggett, J. F. (2013) · PLoS ONE · doi:10.1371/journal.pone.0075296 · Cited by 174 · see citing works

Microarray reality checks in the context of a complex disease

Miklos, G. L. G., & Maleszka, R. (2004) · Nature Biotechnology · doi:10.1038/nbt965 · Cited by 173 · see citing works

Differential meta-analysis of RNA-seq data from multiple studies

Rau, A., Marot, G., & Jaffrézic, F. (2014) · BMC Bioinformatics · doi:10.1186/1471-2105-15-91 · Cited by 167 · see citing works

DIRECT DETECTION OF HIV RNA EXPRESSION IN SEROPOSITIVE SUBJECTS

Hart, C. E., Spira, T. J., Moore, J., et al. (1988) · The Lancet · doi:10.1016/s0140-6736(88)90639-3 · Cited by 148 · see citing works

Real-time, fluorescence-based quantitative PCR: a snapshot of current procedures and preferences

Bustin, S. A. (2005) · Expert Review of Molecular Diagnostics · doi:10.1586/14737159.5.4.493 · Cited by 144 · see citing works

Reverse Transcriptase (RT) Inhibition of PCR at Low Concentrations of Template and Its Implications for Quantitative RT-PCR

Chandler, D. P., Wagnon, C. A., & Bolton, H. (1998) · Applied and Environmental Microbiology · doi:10.1128/aem.64.2.669-677.1998 · Cited by 141 · see citing works

Diagnosis of Invasive Aspergillosis by a Commercial Real-Time PCR Assay for Aspergillus DNA in Bronchoalveolar Lavage Fluid Samples from High-Risk Patients Compared to a Galactomannan Enzyme Immunoassay

Torelli, R., Sanguinetti, M., Moody, A., Pagano, L., Caira, M., Carolis, E. D., Fuso, L., PASCALE, G. D., Bello, G., Antonelli, M. M., et al. (2011) · Journal of Clinical Microbiology · doi:10.1128/jcm.05026-11 · Cited by 133 · see citing works

Coamplified positive control detects inhibition of polymerase chain reactions

Cone, R. W., Hobson, A. C., & Huang, M. (1992) · Journal of Clinical Microbiology · doi:10.1128/jcm.30.12.3185-3189.1992 · Cited by 132 · see citing works

Evolution and Translation of Research Findings: From Bench to Where

Ioannidis, J. P. A. (2006) · PLoS Clinical Trials · doi:10.1371/journal.pctr.0010036 · Cited by 129 · see citing works

Irreproducibility in Preclinical Biomedical Research: Perceptions, Uncertainties, and Knowledge Gaps

Jarvis, M. F., & Williams, M. (2016) · Trends in Pharmacological Sciences · doi:10.1016/j.tips.2015.12.001 · Cited by 129 · see citing works

Perverse incentives

Stephan, P. (2012) · Nature · doi:10.1038/484029a · Cited by 126 · see citing works

Is Molecular Profiling Ready for Use in Clinical Decision Making?

Ioannidis, J. P. A. (2007) · The Oncologist · doi:10.1634/theoncologist.12-3-301 · Cited by 126 · see citing works

Analysis of one-step and two-step real-time RT-PCR using SuperScript III.

Wacker, M., & Godard, M. P. (2005) · PubMed Central · Cited by 126 · see citing works

Impact of RNA Quality on Reference Gene Expression Stability

Perez-Novo, C. A., Claeys, C., Speleman, F., et al. (2005) · BioTechniques · doi:10.2144/05391bm05 · Cited by 125 · see citing works

Concentration of the Most-Cited Papers in the Scientific Literature: Analysis of Journal Ecosystems

Ioannidis, J. P. A. (2006) · PLoS ONE · doi:10.1371/journal.pone.0000005 · Cited by 122 · see citing works

Reliability of reverse transcription-polymerase chain reaction (RT-PCR)-based assays for the detection of circulating tumour cells: a quality-assurance initiative of the EORTC melanoma cooperative group

Keilholz, U., Willhauck, M., Rimoldi, D., et al. (1998) · European Journal of Cancer · doi:10.1016/s0959-8049(97)10105-8 · Cited by 120 · see citing works

Antibodies as Thermolabile Switches: High Temperature Triggering for the Polymerase Chain Reaction

Sharkey, D. J., Scalice, E. R., Christy, K. G., et al. (1994) · Nature Biotechnology · doi:10.1038/nbt0594-506 · Cited by 114 · see citing works

Efficiency of DNA replication in the polymerase chain reaction

Stolovitzky, G., & Cecchi, G. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.23.12947 · Cited by 112 · see citing works

Differential priming of RNA templates during cDNA synthesis markedly affects both accuracy and reproducibility of quantitative competitive reverse-transcriptase PCR

ZHANG, J., & Byrne, C. D. (1999) · Biochemical Journal · doi:10.1042/bj3370231 · Cited by 106 · see citing works

Discovery of blood transcriptomic markers for depression in animal models and pilot validation in subjects with early-onset major depression

PAJER, K. A., Andrus, B. M., Gardner, W. P., Lourie, A., Strange, B., Campo, J. V., Bridge, J. A., Blizinsky, K. D., Dennis, K., Vedell, P. T., et al. (2012) · Translational Psychiatry · doi:10.1038/tp.2012.26 · Cited by 105 · see citing works

Cancer reproducibility project releases first results

Baker, M., & Dolgin, E. (2017) · Nature · doi:10.1038/541269a · Cited by 104 · see citing works

QA/QC: challenges and pitfalls facing the microarray community and regulatory agencies

Shi, L. M., Tong, W., Goodsaid, F. M., Frueh, F. W., Fang, H., Han, T., Fuscoe, J. C., & Casciano, D. A. (2004) · Expert Review of Molecular Diagnostics · doi:10.1586/14737159.4.6.761 · Cited by 103 · see citing works

Toward reliable biomarker signatures in the age of liquid biopsies - how to standardize the small RNA-Seq workflow

Buschmann, D., Haberberger, A., Kirchner, B., Spornraft, M., Riedmaier, I., Schelling, G., & Pfaffl, M. W. (2016) · Nucleic Acids Research · doi:10.1093/nar/gkw545 · Cited by 102 · see citing works

Variation in RNA-Seq Transcriptome Profiles of Peripheral Whole Blood from Healthy Individuals with and without Globin Depletion

Shin, H., Shannon, C. P., Fishbane, N., Ruan, J., Zhou, M., Balshaw, R. F., Wilson-McManus, J., Ng, R. T., McManus, B. M., & Tebbutt, S. J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0091041 · Cited by 89 · see citing works

Improved reproducibility by assuring confidence in measurements in biomedical research

Plant, A. L., Locascio, L. E., May, W. E., & Gallagher, P. D. (2014) · Nature Methods · doi:10.1038/nmeth.3076 · Cited by 89 · see citing works

Sources of error in the retracted scientific literature

Casadevall, A., Steen, R. G., & Fang, F. C. (2014) · The FASEB Journal · doi:10.1096/fj.14-256735 · Cited by 89 · see citing works

Secondary structure in the 3' UTR of EGF and the choice of reverse transcriptases affect the detection of message diversity by RT-PCR.

Brooks, E. M., Sheflin, L. G., & Spaulding, S. W. (1995) · PubMed · Cited by 88 · see citing works

The misuse and abuse of statistics in biomedical research

Thiese, M. S., Arnold, Z. C., & Walker, S. D. (2015) · Biochemia Medica · doi:10.11613/bm.2015.001 · Cited by 87 · see citing works

Systematic evaluation of medium-throughput mRNA abundance platforms

Prokopec, S. D., Watson, J. D., Waggott, D. M., Smith, A. B., Wu, A. H., Okey, A. B., Pohjanvirta, R., & Boutros, P. C. (2012) · RNA · doi:10.1261/rna.034710.112 · Cited by 87 · see citing works

Variability of the Reverse Transcription Step: Practical Implications

Bustin, S. A., Dhillon, H. S., Kirvell, S. L., Greenwood, C., Parker, M. J., Shipley, G. L., & Nolan, T. (2014) · Clinical Chemistry · doi:10.1373/clinchem.2014.230615 · Cited by 86 · see citing works

DNA polymerase preference determines PCR priming efficiency

Pan, W., Byrne-Steele, M. L., Wang, C., Lu, S., Clemmons, S., Zahorchak, R. J., & Han, J. (2014) · BMC Biotechnology · doi:10.1186/1472-6750-14-10 · Cited by 84 · see citing works

Blood transcriptomic biomarkers in adult primary care patients with major depressive disorder undergoing cognitive behavioral therapy

Redei, E. E., Andrus, B. M., Kwasny, M. J., Seok, J., Cai, X., Ho, J., & Mohr, D. C. (2014) · Translational Psychiatry · doi:10.1038/tp.2014.66 · Cited by 83 · see citing works

When Should Potentially False Research Findings Be Considered Acceptable?

Djulbegović, B., & Hozo, I. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040026 · Cited by 77 · see citing works

Primer Sequence Disclosure: A Clarification of the MIQE Guidelines

Bustin, S. A., Beneš, V., Garson, J. A., Hellemans, J., Huggett, J. F., Kubista, M., Mueller, R. D., Nolan, T., Pfaffl, M. W., Shipley, G. L., et al. (2011) · Clinical Chemistry · doi:10.1373/clinchem.2011.162958 · Cited by 76 · see citing works

RT-qPCR and RT-Digital PCR: A Comparison of Different Platforms for the Evaluation of Residual Disease in Chronic Myeloid Leukemia

Alikian, M., Whale, A. S., Akiki, S. J., Piechocki, K., Torrado, C., Myint, T., Cowen, S., Griffiths, M., Reid, A. G., Apperley, J. F., et al. (2016) · Clinical Chemistry · doi:10.1373/clinchem.2016.262824 · Cited by 74 · see citing works

QPCR: Application for real-time PCR data management and analysis

Pabinger, S., Thallinger, G., Snajder, R., et al. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-268 · Cited by 69 · see citing works

Performance characteristics for the quantitation of plasma HIV-1 RNA using branched DNA signal amplification technology.

Todd, J., Pachl, C. A., White, R., et al. (1995) · PubMed · Cited by 66 · see citing works

Comprehensive molecular screening: from the RT-PCR to the RNA-seq.

Costa, C., Giménez-Capitán, A. A., Karachaliou, N., & Rosell, R. (2013) · Europe PMC (PubMed Central) · doi:10.3978/j.issn.2218-6751.2013.02.05 · Cited by 66 · see citing works

Molecular assessment of tumour stage and disease recurrence using PCR-based assays

Bustin, S. A., & Dorudi, S. (1998) · Molecular Medicine Today · doi:10.1016/s1357-4310(98)01324-0 · Cited by 61 · see citing works

Quantitative measurement of mRNAs by polymerase chain reaction

Delidow, B. C., Peluso, J. J., & White, B. A. (1989) · Gene Analysis Techniques · doi:10.1016/0735-0651(89)90002-2 · Cited by 59 · see citing works

Critical appraisal of quantitative PCR results in colorectal cancer research: Can we rely on published qPCR results?

Dijkstra, J. R., van Kempen, L. C., Nagtegaal, I. D., & Bustin, S. A. (2014) · Molecular Oncology · doi:10.1016/j.molonc.2013.12.016 · Cited by 59 · see citing works

The reproducibility of biomedical research: Sleepers awake!

Bustin, S. A. (2014) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2015.01.002 · Cited by 56 · see citing works

Expectations, validity, and reality in omics

Ioannidis, J. P. A. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.002 · Cited by 54 · see citing works

Robust interlaboratory reproducibility of a gene expression signature measurement consistent with the needs of a new generation of diagnostic tools

Ach, R. A., Floore, A. N., Curry, B., Lazar, V., Glas, A. M., Pover, R., Tsalenko, A., Ripoche, H., Cardoso, F., d'Assignies, M. S., et al. (2007) · BMC Genomics · doi:10.1186/1471-2164-8-148 · Cited by 54 · see citing works

Impact factors: Use and abuse in biomedical research

Coleman, R. (1999) · The Anatomical Record · doi:10.1002/(sici)1097-0185(19990415)257:2 · Cited by 53 · see citing works

Consensus guidelines for microarray gene expression analyses in leukemia from three European leukemia networks

Staal, F. J. T., Cario, G., Cazzaniga, G., Haferlach, T., Heuser, M., Hofmann, W. ‐., Mills, K., Schrappe, M., Stanulla, M., Wingen, L. U., et al. (2006) · Leukemia · doi:10.1038/sj.leu.2404274 · Cited by 53 · see citing works

Comprehensive Assessments of RNA-seq by the SEQC Consortium: FDA-Led Efforts Advance Precision Medicine

Xu, J., Gong, B., Wu, L., Thakkar, S., Hong, H., & Tong, W. (2016) · Pharmaceutics · doi:10.3390/pharmaceutics8010008 · Cited by 52 · see citing works

Quantification of RNA integrity and its use for measurement of transcript number

Brisco, M. J., & Morley, A. A. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks588 · Cited by 51 · see citing works

Managing risks in drug discovery: reproducibility of published findings

Kannt, A., & Wieland, T. (2016) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-016-1216-8 · Cited by 51 · see citing works

Reverse transcription/polymerase chain reaction (RT/PCR) amplification of very small numbers of transcripts: the risk in misinterpreting negative results.

Melo, J. V., Yan, X. H., Diamond, J., et al. (1996) · PubMed · Cited by 45 · see citing works

Replication Study: BET bromodomain inhibition as a therapeutic strategy to target c-Myc

Aird, F., Kandela, I. K., Mantis, C., & Reproducibility Project: Cancer Biology (2017) · eLife · doi:10.7554/elife.21253 · Cited by 45 · see citing works

Reproducibility, Fidelity, and Discriminant Validity of mRNA Amplification for Microarray Analysis from Primary Hematopoietic Cells

Li, L., Roden, J., Shapiro, B. E., et al. (2005) · Journal of Molecular Diagnostics · doi:10.1016/s1525-1578(10)60008-6 · Cited by 44 · see citing works

Multi-platform comparison of ten commercial master mixes for probe-based real-time polymerase chain reaction detection of bioterrorism threat agents for surge preparedness

Buzard, G. S., Baker, D., Wolcott, M., et al. (2012) · Forensic Science International · doi:10.1016/j.forsciint.2012.10.003 · Cited by 40 · see citing works

Assessment of RNA Quality by Semi-Quantitative RT-PCR of Multiple Regions of a Long Ubiquitous mRNA

Swift, G. H., Peyton, M. J., & MacDonald, R. J. (2000) · BioTechniques · doi:10.2144/00283rr01 · Cited by 40 · see citing works

Use of an RNA folding algorithm to choose regions for amplification by the polymerase chain reaction

Pallansch, L. A., Beswick, H. T., Talian, J. C., et al. (1990) · Analytical Biochemistry · doi:10.1016/0003-2697(90)90254-7 · Cited by 39 · see citing works

Importance of pre-analytical steps for transcriptome and RT-qPCR analyses in the context of the phase II randomised multicentre trial REMAGUS02 of neoadjuvant chemotherapy in breast cancer patients

de Crémoux, P., Valet, F., Gentien, D., Lehmann‐Che, J., Scott, V., Tran‐Perennou, C., Barbaroux, C., Servant, N., Vacher, S., Sigal‐Zafrani, B., et al. (2011) · BMC Cancer · doi:10.1186/1471-2407-11-215 · Cited by 38 · see citing works

Unreliable Real-Time PCR Analysis of Human Endogenous Retrovirus-W (HERV-W) RNA Expression and DNA Copy Number in Multiple Sclerosis

Garson, J. A., Huggett, J. F., Bustin, S. A., Pfaffl, M. W., Beneš, V., Vandesompele, J., & Shipley, G. L. (2009) · AIDS Research and Human Retroviruses · doi:10.1089/aid.2008.0270 · Cited by 34 · see citing works

Quality management and influential factors for the detection of single metastatic cancer cells by reverse transcriptase polymerase chain reaction.

Jung, R., Ahmad‐Nejad, P., Wimmer, M., et al. (1997) · PubMed · Cited by 34 · see citing works

Incorporation of Measurement of DNA Integrity into qPCR Assays

Brisco, M. J., Latham, S., Bartley, P. A., & Morley, A. A. (2010) · BioTechniques · doi:10.2144/000113567 · Cited by 33 · see citing works

Monoclonal antibodies prepared against the DNA polymerase from Thermus aquaticus are potent inhibitors of enzyme activity

Scalice, E. R., Sharkey, D. J., & Daiss, J. L. (1994) · Journal of Immunological Methods · doi:10.1016/0022-1759(94)90102-3 · Cited by 31 · see citing works

Must try harder

(2012) · Nature · doi:10.1038/483509a · Cited by 31 · see citing works

RNA biomarkers in colorectal cancer

Bustin, S. A., & Murphy, J. (2012) · Methods · doi:10.1016/j.ymeth.2012.10.003 · Cited by 29 · see citing works

Sensitivity, specificity, and reproducibility of RNA-Seq differential expression calls

Łabaj, P. P., & Kreil, D. P. (2016) · Biology Direct · doi:10.1186/s13062-016-0169-7 · Cited by 29 · see citing works

Cross-Platform Evaluation of Commercial Real-Time SYBR Green RT-PCR Kits for Sensitive and Rapid Detection of European BatLyssavirusType 1

Meyer, E. P., de Garam, C. P., Schereffer, J. L., Marchal, C., Robardet, E., & Cliquet, F. (2015) · BioMed Research International · doi:10.1155/2015/839518 · Cited by 28 · see citing works

Characterization of West Nile virus (WNV) isolates from Assam, India: Insights into the circulating WNV in northeastern India

Chowdhury, P., Khan, S. A., Dutta, P., et al. (2013) · Comparative Immunology Microbiology and Infectious Diseases · doi:10.1016/j.cimid.2013.10.006 · Cited by 27 · see citing works

Intrinsic secondary structure of human TNFR-I mRNA influences the determination of gene expression by RT-PCR

Kuo, K., Leung, M. F., & Leung, W.-C. (1997) · Molecular and Cellular Biochemistry · doi:10.1023/a:1006862304381 · Cited by 26 · see citing works

The Inherent Drawbacks of the Pressure to Publish in Health Sciences: Good or Bad Science

Dinis‐Oliveira, R. J., & Magalhães, T. (2015) · F1000Research · doi:10.12688/f1000research.6809.2 · Cited by 26 · see citing works

Reproducibility in research

Siegel, V. (2011) · Disease Models & Mechanisms · doi:10.1242/dmm.008037 · Cited by 25 · see citing works

The FDA’s Experience with Emerging Genomics Technologies—Past, Present, and Future

Xu, J., Thakkar, S., Gong, B., & Tong, W. (2016) · The AAPS Journal · doi:10.1208/s12248-016-9917-y · Cited by 24 · see citing works

Five Years MIQE Guidelines: The Case of the Arabian Countries

Nour, A. M. A., Azhar, E. I., Damanhouri, G. A., & Bustin, S. A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0088266 · Cited by 22 · see citing works

Molecular evidence‐based medicine

Ioannidis, J. P. A. (2007) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2007.01794.x · Cited by 22 · see citing works

Improving the reliability of peer-reviewed publications: We are all in it together

Bustin, S. A., & Nolan, T. (2016) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2015.11.002 · Cited by 22 · see citing works

Evaluation of Various Real-Time Reverse Transcription Quantitative PCR Assays for Norovirus Detection

Yoo, J. E., Lee, C., Park, S., et al. (2017) · Journal of Microbiology and Biotechnology · doi:10.4014/jmb.1612.12026 · Cited by 20 · see citing works

Differential Expression Analysis for RNA-Seq Data

Gupta, R., Dewan, I., Bharti, R., & Bhattacharya, A. (2012) · ISRN Bioinformatics · doi:10.5402/2012/817508 · Cited by 19 · see citing works

Further confirmation needed

(2012) · Nature Biotechnology · doi:10.1038/nbt.2335 · Cited by 19 · see citing works

The Effects of Nested Primer Binding Sites on the Reproducibility of PCR: Mathematical Modeling and Computer Simulation Studies

Schierwater, B., Metzler, D., Krüger, K., et al. (1996) · Journal of Computational Biology · doi:10.1089/cmb.1996.3.235 · Cited by 17 · see citing works

Reproducibility of biomedical research – The importance of editorial vigilance

Bustin, S. A., & Huggett, J. F. (2017) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2017.01.002 · Cited by 17 · see citing works

Polymerase chain reaction detection of circulating tumour cells. EORTC Melanoma Cooperative Group, Immunotherapy Subgroup.

Keilholz, U., Willhauck, M., Scheibenbogen, C., et al. (1997) · PubMed · Cited by 16 · see citing works

Effect of RNA concentration on cDNA synthesis for DNA amplification.Preprint

Williams, W. V., Rosenbaum, H., & Weiner, D. B. (1992) · Genome Research · doi:10.1101/gr.2.1.86 · Cited by 15 · see citing works

Poor sensitivity, specificity, and reproducibility of detection of HIV-1 DNA in serum by polymerase chain reaction. The Transfusion Safety Study Group.

Busch, M. P., Henrard, D. R., HEWLETT, I. K., et al. (1992) · PubMed · Cited by 14 · see citing works

Transparency of Reporting in Molecular Diagnostics

Bustin, S. A. (2013) · International Journal of Molecular Sciences · doi:10.3390/ijms140815878 · Cited by 13 · see citing works

Raising standards

(2013) · Nature Neuroscience · doi:10.1038/nn.3391 · Cited by 13 · see citing works

qPCR-DAMS: a database tool to analyze, manage, and store both relative and absolute quantitative real-time PCR data

Jin, N., He, K., & Liu, L. (2006) · Physiological Genomics · doi:10.1152/physiolgenomics.00233.2005 · Cited by 11 · see citing works

Raising standards

(2013) · Nature Medicine · doi:10.1038/nm0513-508 · Cited by 10 · see citing works

[Letter to the Editor] Many commercial Hot-Start Polymerases Demonstrate Activity Prior to Thermal Activation

Stevens, A. J., Appleby, S. L., & Kennedy, M. A. (2016) · BioTechniques · doi:10.2144/000114481 · Cited by 8 · see citing works

In silico tools for qPCR assay design and data analysis.

Bustin, S., Bergkvist, A., & Nolan, T. (2011) · Methods in molecular biology · doi:10.1007/978-1-61779-176-5_18 · Cited by 7 · see citing works

Error minimization algorithm for comparative quantitative PCR analysis: Q-Anal

OConnor, W., & Runquist, E. A. (2008) · Analytical Biochemistry · doi:10.1016/j.ab.2008.03.041 · Cited by 7 · see citing works

Raising standards

(2013) · Nature Structural & Molecular Biology · doi:10.1038/nsmb.2590 · Cited by 7 · see citing works

Raising standards

(2013) · Nature Immunology · doi:10.1038/ni.2603 · Cited by 7 · see citing works

Raising standards

(2013) · Nature Biotechnology · doi:10.1038/nbt.2588 · Cited by 6 · see citing works

Raising standards

(2013) · Nature Genetics · doi:10.1038/ng.2621 · Cited by 6 · see citing works

Raising reporting standards

(2013) · Nature Cell Biology · doi:10.1038/ncb2752 · Cited by 5 · see citing works

Studies on Scratch Tests in Atopic Dermatitis, and Comparison with the Intracutaneous Method*†

Narins, S. R. (1949) · Journal of Investigative Dermatology · doi:10.1038/jid.1949.8 · Cited by 3 · see citing works

Biological Variation, Reproducibility, and Predictability of Experimental Research in Animals

Svendsen, O., & Hansen, A. K. (1999) · Medical radiology · doi:10.1007/978-3-642-59814-2_3 · Cited by 2 · see citing works

miRNA extracted from extracellular vesicles is a robust biomarker of amyotrophic lateral sclerosis

Banack, S. A., Dunlop, R. A., Stommel, E. W., Mehta, P., & Cox, P. A. (2022) · Journal of the Neurological Sciences · doi:10.1016/j.jns.2022.120396 · Cited by 54 · see citing works

Identification of human gene research articles with wrongly identified nucleotide sequences

Park, Y., West, R. A., Pathmendra, P., Favier, B., Stoeger, T., Capes-Davis, A., Cabanac, G., Labbé, C., & Byrne, J. A. (2022) · Life Science Alliance · doi:10.26508/lsa.202101203 · Cited by 37 · see citing works

Misspellings or “miscellings”—Non‐verifiable and unknown cell lines in cancer research publications

Oste, D. J., Pathmendra, P., Richardson, R. A. K., Johnson, G., Ao, Y., Arya, M. D., Enochs, N. R., Hussein, M., Kang, J., Lee, A., et al. (2024) · International Journal of Cancer · doi:10.1002/ijc.34995 · Cited by 18 · see citing works

Formal and Precise Analysis of Soundness of Several Shuffling Schemes

Peng, K., & Bao, F. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16280-0_9

A New Notion of Soundness in Bare Public-Key Model

Cheung, S., Deng, X., Lee, C. H., et al. (2003) · Lecture notes in computer science · doi:10.1007/3-540-36413-7_23

On Generating *-Sound Nets with SubstitutionPreprint

Sroka, J., & Hidders, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1208.2654

Deduction soundness

Böhl, F., Cortier, V., & Warinschi, B. (2013) · doi:10.1145/2508859.2516711 · Cited by 11 · see citing works

Instantiating nets and their applications to workflow nets

Ţiplea, F. L., & Tiplea, A. (2005) · International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC) · doi:10.1109/synasc.2005.39 · Cited by 5 · see citing works