p-Curve and p-Hacking in Observational Research
Open accessThe DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
The p-curve, the distribution of statistically significant p-values of published studies, has been used to make inferences on the proportion of true effects and on the presence of p-hacking in the published literature. We analyze the p-curve for observational research in the presence of p-hacking. We show by means of simulations that even with minimal omitted-variable bias (e.g., unaccounted confounding) p-curves based on true effects and p-curves based on null-effects with p-hacking cannot be reliably distinguished. We also demonstrate this problem using as practical example the evaluation of the effect of malaria prevalence on economic growth between 1960 and 1996. These findings call recent studies into question that use the p-curve to infer that most published research findings are based on true effects in the medical literature and in a wide range of disciplines. p-values in observational research may need to be empirically calibrated to be interpretable with respect to the commonly used significance threshold of 0.05. Violations of randomization in experimental studies may also result in situations where the use of p-curves is similarly unreliable.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The use of statistical methods has been demonstrated to be suboptimal in some fields.”
From How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation (2018) · cites this paper as [22]
In the citing paper
“Methodological criticisms suggest that these and similar studies may be underestimating the true impact of P -hacking (11, 12).”
From Is science really facing a reproducibility crisis, and do we need it to? (2018) · cites this paper as [11]
In the citing paper
“P-hacking22,23 (where investigators perform multiple analyses sequentially, for example by adding more samples or excluding some potential outliers until the desired thresholds of statistical significance are achieved)”
From How to design preclinical studies in nanomedicine and cell therapy to maximize the prospects of clinical translation (2018) · cites this paper as [22]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Self-citationWitten, I. H. (2008) · Cited by 9,143
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“The p -curve was also used to infer that most studies actually analyze true effects challenging previous claims [36].”
MethodSelf-citationGreene, W. (2000) · University of Maribor digital library (University of Maribor) · Cited by 3,746
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239 · cited 3×
“However, there is evidence that the incentive system of academic publishing fosters scientists to even engage in questionable research practices to search for and select statistically significant results [9,10].”
BackgroundLet's Take the Con out of Econometrics
Leamer, E. E. (2026) · Journal of Business Cycle Research · doi:10.1007/s41549-026-00137-2 · Cited by 2,202
Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (BACE) Approach
Sala-i-Martin, X., Doppelhofer, G., & Miller, R. I. (2004) · American Economic Review · doi:10.1257/0002828042002570 · Cited by 2,112
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 1×
“However, there is evidence that the incentive system of academic publishing fosters scientists to even engage in questionable research practices to search for and select statistically significant results [9,10].”
Background
Cited by
Items 101–200 of 230
Scientific self-correction: the Bayesian way
Romero, F., & Sprenger, J. (2020) · Synthese · doi:10.1007/s11229-020-02697-x · Cited by 18
Hedge Fund Performance: A Quantitative Survey
Yang, F., Havránek, T., Iršová, Z., & Novák, J. (2022) · Journal of Economic Surveys · doi:10.1111/joes.12574 · Cited by 17
Developments in the Design, Conduct, and Reporting of Child Health Trials
Baba, A., Aregbesola, A., Caldwell, P. H. Y., Elliott, S. A., Elsman, E. B. M., Fernandes, R. M., Hartling, L., Heath, A., Kelly, L. E., Preston, J., et al. (2024) · PEDIATRICS · doi:10.1542/peds.2024-065799 · Cited by 16
When the levee breaks: A forecasting model of violent and nonviolent dissent
Pinckney, J. C., & RezaeeDaryakenari, B. (2022) · International Interactions · doi:10.1080/03050629.2022.2090933 · Cited by 16
“For seminal articles on p-hacking, see Bruns and Ioannidis (2016) and Ioannidis (2005).”
Backgroundp-Hacking in Experimental Audit Research
Khan, M. J., & Tronnes, P. C. (2018) · Behavioral Research in Accounting · doi:10.2308/bria-52183 · Cited by 16
Estimating the extent of selective reporting: An application to economics
Bruns, S. B., Deressa, T. K., Stanley, T. D., Doucouliagos, H., & Ioannidis, J. P. A. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1711 · Cited by 15
“…of statistically significant findings incentives researchers to provide such findings 11,12 and the underlying mechanism is predominantly known as selective reporting or publication selection bias, 13 such as p -hacking, 14,15 HARKing (Hypothesis After Results are Known), 16 and publication bias.”
InfluentialSelf-citationp-Hacking and Publication Bias Interact to Distort Meta-Analytic Effect Size EstimatesPreprint
Friese, M., & Frankenbach, J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/bvm58 · Cited by 15
Financial Incentives and Performance: A Meta-Analysis of Economics EvidencePreprint
Cala, P., Havranek, T., Irsova, Z., Matoušek, J., Irsova, Z., & Novák, J. (2022) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/wbe9k · Cited by 15
Bruns, S. B., König, J., & Stern, D. I. (2018) · Energy Economics · doi:10.1016/j.eneco.2018.10.007 · Cited by 14
Self-citationSkilled and Unskilled Labor Are Less Substitutable than Commonly ThoughtPreprint
Havránek, T., Iršová, Z., Laslopová, Ľ., & Zeynalova, O. (2020) · RePEc: Research Papers in Economics · Cited by 14
A modern method of multiple working hypotheses to improve inference in ecology
Yanco, S. W., McDevitt, A., Trueman, C. N., Hartley, L., & Wunder, M. B. (2020) · Royal Society Open Science · doi:10.1098/rsos.200231 · Cited by 13
Evaluation of a Meta-Analysis of Ambient Air Quality as a Risk Factor for Asthma Exacerbation
Kindzierski, W. B., Young, S. S., Meyer, T. G., & Dunn, J. (2021) · Journal of Respiration · doi:10.3390/jor1030017 · Cited by 13
Is menu design effective? A p-curving analysis
Chark, R., & Michael Man Him, I. P. (2022) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2022.103378 · Cited by 12
Sports Metaresearch: An Emerging Discipline of Sport Science and Medicine
Warmenhoven, J., Menaspà, P., Borg, D. N., Vazire, S., White, N. M., Sainani, K. L., Nimphius, S., Coutts, A. J., & Impellizzeri, F. M. (2025) · Sports Medicine · doi:10.1007/s40279-025-02181-x · Cited by 11
“Violations of randomisation in experimental studies can also result in situations where p -curves are unreliable [72].”
The Power of Tests for Detecting p -Hacking
Elliott, G., Kudrin, N., & Wüthrich, K. (2025) · The Review of Economics and Statistics · doi:10.1162/rest.a.1688 · Cited by 11
“…CDF, and Υt1(p;α, h, ρ) = 1 + Φ ( zh(α)−ρzh(p)√ 1−ρ2 ) , if p ≤ α, 2Φ ( zh(p) √ 1−ρ 1+ρ ) , if p > α. 7For simplicity, we consider a setting where Z1i and Z2i do not enter the true model so that their omission does not lead to omitted variable biases (unlike, e.g., in Bruns and Ioannidis, 2016).”
Misstatements, misperceptions, and mistakes in controlling for covariates in observational research
Yu, X. D., Zoh, R. S., Fluharty, D. A., Mestre, L. M., Valdez, D., Tekwe, C. D., Vorland, C. J., Jamshidi‐Naeini, Y., Chiou, S. H., Lartey, S. T., et al. (2024) · eLife · doi:10.7554/elife.82268 · Cited by 11
“Unfortunately, we have substantial evidence from many sources that many investigators instead choose analytical approaches, including the treatment of covariates, that serve their interests (e.g. Head et al., 2015 ; Wicherts et al., 2016 ; Bruns and Ioannidis, 2016 ).”
BackgroundOpenness and Reproducibility: Insights from a Model-Centric ApproachPreprint
Baumgaertner, B. O., Devezer, B., Buzbas, E. O., & Nardin, L. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.04525 · Cited by 13
“P-hacking is a form of data dredging to find statistically significant results and is a misapplication of proper statistical methodology (Bruns and Ioannidis, 2016; Munafò et al., 2017).”
MethodKaramitros, G., Johnson, J., Gergoudis, F. R., Giannas, E., Torres-Guzman, R. A., Lamaris, G. A., & Lineaweaver, W. C. (2026) · Annals of Plastic Surgery · doi:10.1097/sap.0000000000004738 · Cited by 11
Brož, V. (2024) · Journal of Financial Regulation and Compliance · doi:10.1108/jfrc-01-2024-0007 · Cited by 10
Misconducts in research and methods to uphold research integrity
Rao, K. N., Mair, M. D., Arora, R. D., Dange, P., & Nagarkar, N. M. (2024) · Indian Journal of Cancer · doi:10.4103/ijc.ijc_4_23 · Cited by 10
Financial Incentives and Performance: A Meta-Analysis of Experiments in Economics
Cala, P., Havránek, T., Iršová, Z., Lušková, M., Matousek, J., & Novák, J. (2026) · Journal of Political Economy Microeconomics · doi:10.1086/743543 · Cited by 9
Hu, H.-F., Moody, G. D., & Galletta, D. F. (2023) · Communications of the Association for Information Systems · doi:10.17705/1cais.05241 · Cited by 9
Importance of Replication, The
Holden, C. J., & Goodwin, G. S. (2020) · Springer eBooks · doi:10.1007/978-3-319-24612-3_1352 · Cited by 9
Fernandez, E. J., Brereton, J. E., & Tuke, J. (2025) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2025.106804 · Cited by 8
Problems and alternatives of testing significance using null hypothesis and P-value in food research
Choi, W.-S. (2023) · Food Science and Biotechnology · doi:10.1007/s10068-023-01348-4 · Cited by 9
Holbert, R. L., Hardy, B. W., Park, E., Robinson, N. W., Jung, H., Zeng, C., Drouin, E., & Sweeney, K. (2018) · Annals of the International Communication Association · doi:10.1080/23808985.2018.1459198 · Cited by 8
“Engaging in a practice of this kind is all the more important for areas of study grounded in observational studies analyzing small effects with large sample sizes (see Bruns & Ioannidis, 2016).”
BackgroundInfluentialMacedonia, C. R., Johnson, C. T., & Rajapakse, I. (2017) · Obstetrics and Gynecology · doi:10.1097/aog.0000000000001865 · Cited by 8
THE (NON‐)SIGNIFICANCE OF REPORTING ERRORS IN ECONOMICS: EVIDENCE FROM THREE TOP JOURNALS
Pütz, P., & Bruns, S. B. (2020) · Journal of Economic Surveys · doi:10.1111/joes.12397 · Cited by 7
“(2017) find evidence of an inflation of significant p28 values suggesting p-hacking (Simmons et al., 2011; Bruns and Ioannidis, 2016; Leamer, 1983), HARKing (Kerr, 1998) 29 and publication bias (Franco et al.”
BackgroundSelf-citationFanelli, D. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0004 · Cited by 7
Indirect evidence of reporting biases was found in a survey of medical research studies
Albarqouni, L., López-López, J. A., & Higgins, J. P. T. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.11.013 · Cited by 7
“We are unable to draw any conclusions about whether the observed distribution is due to data manipulation (‘p-hacking’) or genuine effects, because as Bruns and Ioannidis suggested[24], p-curves may neither identify genuine effects nor p-hacking in observational research.”
BackgroundP-hacking in academic research
Ingre, M. (2016) · DiVA (Stockholm University) · doi:10.6084/m9.figshare.3393664 · Cited by 7
When Does Monetary Policy Sway House Prices? A Meta-AnalysisPreprint
Bajzík, J., Ehrenbergerová, D., & Havránek, T. (2021) · RePEc: Research Papers in Economics · doi:10.31222/osf.io/npeqs · Cited by 7
Ayorinde, A., Williams, I., Mannion, R., Song, F., Skrybant, M., Lilford, R. J., & Chen, Y. (2020) · Health Services and Delivery Research · doi:10.3310/hsdr08330 · Cited by 6
“Positive 237 (79) 150 (75) 74 (74) 76 (76) 87 (87) 38 (76) 49 (98)”
How to Identify and How to Conduct Research that Is Informative and Reproducible
Zickfeld, J., & Schubert, T. W. (2019) · Theory and history in the human and social sciences · doi:10.1007/978-3-030-33099-6_9 · Cited by 5
Detecting Evidential Value and P-Hacking With the P-curve tool: A Word of Caution
Erdfelder, E., & Heck, D. W. (2019) · doi:10.23668/psycharchives.2399 · Cited by 5
Bayesian evaluation of effect size after replicating an original studyPreprint
van Aert, R. C. M., & van Assen, M. A. L. M. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/g3sne · Cited by 6
Improving Replication in Endometrial Omics: Understanding the Influence of the Menstrual Cycle
Chung, J., & Rogers, P. A. W. (2025) · International Journal of Molecular Sciences · doi:10.3390/ijms26020857 · Cited by 4
“Simulations by Bruns and Ioannidis [75] have demonstrated that uncorrected confounding can lead to false positive results that are indistinguishable from true effects.”
Quantinar: a blockchain peer-to-peer ecosystem for modern data analytics
Bag, R. C., Spilak, B., Winkel, J., & Härdle, W. K. (2024) · Computational Statistics · doi:10.1007/s00180-024-01529-7 · Cited by 4
“Practices like p -hacking (Bruns and Ioannidis 2016) and HARKing (Kerr 1998), employed to meet academic expectations, compromise the integrity of research.”
Holden, C. J., & Goodwin, G. S. (2018) · Springer eBooks · doi:10.1007/978-3-319-28099-8_1352-1 · Cited by 4
Death of the Hypothesis: Researchers Do Not Report A Priori Beliefs in General Medicine Journals
Chaitoff, A. M., Zheutlin, A. R., Roy, S., & Niforatos, J. D. (2021) · Journal of General Internal Medicine · doi:10.1007/s11606-021-06750-4 · Cited by 3
Niche Overlap in Forest Tree Species Precludes a Positive Diversity–Productivity Relationship
Blackstone, K. M. S., McNickle, G. G., Ritzi, M. V., Nelson, T. M., Hardiman, B. S., Montague, M. S., Jacobs, D. F., & Couture, J. J. (2025) · Plants · doi:10.3390/plants14152271 · Cited by 3
Ni, H., Price, P. C., & Jones, C. J. (2024) · School Psychology Review · doi:10.1080/2372966x.2024.2365618 · Cited by 3
“Some researchers have raised concerns about p -curve analysis more generally, suggesting that it can be misleading under some conditions (e.g., Bruns & Ioannidis, 2016; McShane et al., 2016; Bartoš & Schimmack, 2022; Ulrich & Miller, 2015; van Aert et al., 2016).”
Preventable sources of bias in subgroup analyses and secondary outcomes of randomized trials
Núñez, I., & Belaunzarán-Zamudio, P. F. (2024) · Contemporary Clinical Trials · doi:10.1016/j.cct.2024.107641 · Cited by 3
Servitization and firm performance: a p-curve analysis
Latan, H., Jabbour, A. B. L. D. S., Jabbour, C. J. C., Ali, M., & Filho, M. G. (2024) · Journal of Business and Industrial Marketing · doi:10.1108/jbim-07-2023-0392 · Cited by 3
Brown, M., McGrath, R. E., & Sacco, D. F. (2022) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/15562646221083384 · Cited by 3
“However, it remains unclear whether these previous analyzes’ results were based in the encouragement of best practices without considering systemic means designed specifically for that purpose (Bruns & Ioannidis, 2016; Erdfelder & Heck, 2019).”
BackgroundBier, D. M. (2017) · Annual Review of Nutrition · doi:10.1146/annurev-nutr-071715-050801 · Cited by 3
Czy (i komu) potrzebne są czasopisma naukowe? Kontekst nauk społecznych
Brzeziński, J. M. (2021) · Ruch Prawniczy Ekonomiczny i Socjologiczny · doi:10.14746/rpeis.2021.83.2.2 · Cited by 3
Dissertation R.C.M. van AertPreprint
van Aert, R. C. M. (2018) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/eqhjd · Cited by 3
Contributions towards understanding and building sustainable sciencePreprint
Hartgerink, C. H. J. (2019) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/4wtpc · Cited by 3
Publication and Identification Biases in Measuring the Intertemporal Substitution of Labor SupplyPreprint
Havránek, T., Horváth, R., & Elminejad, A. (2021) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/nshqx · Cited by 3
Um framework para o planejamento de experimentos controlados na pesquisa de chatbots educacionais
Paschoal, L. N. (2024) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.55.2024.tde-18032025-134125 · Cited by 3
Comparative analysis of Registered Reports and the standard research literature
O'Mahony, A. (2023) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 3
Mitigating LLM-based p-Hacking by Preregistering for the Next LLMPreprint
Thomas, M., Gligorić, K., & Shah, N. B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2606.27687 · Cited by 4
“This episode is an illustration of a highly pervasive problem of p-hacking —tuning analytic choices until a hypothesis test reaches statistical significance—an age-old problem in science [Head et al., 2015, Bruns and Ioannidis, 2016, Simmons et al., 2013].”
Ackley, S. F., Andrews, R. M., Seaman, C., Flanders, M. D., Chen, R., Wang, J., Lopes, G., Sims, K. D., Buto, P. T., Ferguson, E. L., et al. (2025) · American Journal of Epidemiology · doi:10.1093/aje/kwaf184 · Cited by 2
“The Elephant’s Tail”: Nepal’s Transition to Fractious Semi-Democracy
Pinckney, J. C. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190097301.003.0005 · Cited by 2
Using a penalized likelihood to detect mortality deceleration
Patrício, S. C., & Missov, T. I. (2023) · PLoS ONE · doi:10.1371/journal.pone.0294428 · Cited by 2
“Using the latter has been widely discussed and rethought in the Statistics community (Berk et al., 2010; Head et al., 2015; Vidgen and Yasseri, 2016; Bruns and Ioannidis, 2016), especially in relation to the arbitrary choice of the α-level (most often 0.”
Heijungs, R. (2024) · Springer eBooks · doi:10.1007/978-3-031-49317-1_5 · Cited by 2
Murphy, S. L., & Steel, R. P. (2021) · Motivation and Emotion · doi:10.1007/s11031-021-09919-w · Cited by 2
“P-hacking is the practice of engaging in one or more behaviors (e.g., including recruiting beyond their planned sample-size, including or excluding covariates post-analysis, etc.) with the aim of revealing statistically significant estimates (Bruns & Ioannidis, 2016).”
BackgroundApproximate reasoning and the ethnomathematics of cooking
Mani, A. (2023) · Prometeica - Revista de Filosofía y Ciencias · doi:10.34024/prometeica.2023.27.15299 · Cited by 2
Bruns, S. B., KKnig, J., & Stern, D. I. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3167667 · Cited by 2
Self-citationIdentification of and correction for publication biasPreprint
Andrews, I., & Kasy, M. (2017) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1711.10527 · Cited by 2
“Bruns and Ioannidis, 2016; Bruns, 2017), for instance, our corrections provide median unbiased estimates for the sum of the parameter of interest and the omitted variables bias. See Section IV.E below. 2Clemens (2017) terms such studies “reproductions,” to distinguish them from “verifications” (cf.”
van Aert, R. C. M., & van Assen, M. A. L. M. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ft3tu · Cited by 2
The Challenges at Work: Testing the Civil Resistance Transitions Data
Pinckney, J. C. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190097301.003.0003 · Cited by 1
DA CONDUTA ÉTICA À CIÊNCIA RESPONSÁVEL NA PESQUISA EM ADMINISTRAÇÃO
Costa, M. M., Sousa, M. D. M., Limongi, R., Torres, M. M., & Noll, P. R. E. S. (2025) · Revista de Administração de Empresas · doi:10.1590/s0034-759020250610x · Cited by 1
How did empirical economic research improve over the last decades: Recent trends and prospects
Brodeur, A., Bruns, S. B., Herwartz, H., & Islam, C.-G. (2026) · European Economic Review · doi:10.1016/j.euroecorev.2026.105464 · Cited by 1
Self-citationIoannidis, J. P. A. (2020) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2020.05.004 · Cited by 1
Self-citationErlenwein, J., Emons, M. I., Petzke, F. W., Quintel, M., STABOULIDOU, I., & Przemeck, M. (2020) · Der Anaesthesist · doi:10.1007/s00101-020-00806-6 · Cited by 1
Introduction: When the Revolution Doesn’t Deliver
Pinckney, J. C. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190097301.003.0001 · Cited by 1
Responsible Integration of Behavioral Science in Computer Science Research and Development
Niedbala, E. M., Ferguson-Walter, K. J., & Lafon, D. (2022) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2022.278 · Cited by 1
Multiversal Methods in Observational Studies: The Case of COVID-19
Tomaselli, V., Cantone, G. G., & Miracula, V. (2022) · Springer proceedings in mathematics & statistics · doi:10.1007/978-3-031-16609-9_22 · Cited by 2
The inconsistency of p-curve: Testing its reliability using the power pose and HPA debates
Montoya, R. M., Kershaw, C., & Jurgens, C. T. (2024) · PLoS ONE · doi:10.1371/journal.pone.0305193 · Cited by 1
“Most p -curvers tend to use the rule "include the first p -value reported" (e.g., [26–29]), but other p -curvers have used the p -value associated with the largest sample [30] or selected a p -value at random [31], as discussed in [32].”
MethodSchneck, A. (2019) · Elektronische Hochschulschriften der LMU München (Ludwig-Maximilians-Universität München) · doi:10.5282/edoc.24321 · Cited by 1
Essays on the economics of energy in Vietnam
Nguyen, T. (2021) · ANU Open Research (Australian National University) · doi:10.25911/7g5z-f062 · Cited by 1
The songs of my people: appraisal differences of popular music as a function of ideologyPreprint
Myers, C., & Wallisch, P. (2020) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/rhbyq · Cited by 1
Three essays on corporate financial misconduct and market reactions
de Batz, L. (2021) · theses.fr (ABES) · doi:10.70675/188ef2a1zfc8bz4d42zbd81z21028e1bd295 · Cited by 1
A Bayesian Nonparametric Test of Significance-Chasing Biases
Karabatsos, G. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1269
“The purpose of this simulation study is to evaluate the claim that the BNP meta-regression model can: (1) support essentially the entire space of smooth distributions of the dependent variable on the [0,1] sample space; (2) allow the dependent variable distribution to change flexibly as a function of the covariates; a…”
Antibody-based bead arrays for high-throughput protein profiling in human plasma and serum
Drobin, K. (2018) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Research Integrity in Public Health
Gorman, D. M. (2018) · Oxford University Press eBooks · doi:10.1093/obo/9780199756797-0189
Therapeutic vaccination for the treatment of metastatic breast cancer
Gross, B., Norian, L. A., Bishop, G. A., Ballas, Z. K., Legge, K. L., Lubaroff, D. M., & Salem, A. K. (2018) · doi:10.17077/etd.gxfjbqz5
Reproducerbarhet av p-värden: en simuleringsstudie
Bark, M., Hammargren, L., Larsson, C., & Nilsén, W. (2019) · Gothenburg University Publications Electronic Archive (Gothenburg University)
Mobilization and Moderation in Brazil
Pinckney, J. C. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190097301.003.0007
Introduction to Case Study Chapters
Pinckney, J. C. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190097301.003.0004
The Challenges of Civil Resistance Transitions
Pinckney, J. C. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190097301.003.0002
Civil Resistance and Democratization
Pinckney, J. C. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190097301.003.0008
“Power Is Sweet”: Elite Semi-Democracy in Zambia
Pinckney, J. C. (2020) · Oxford University Press eBooks · doi:10.1093/oso/9780190097301.003.0006
Park, S. (2020) · Korean Journal of Sport Science · doi:10.24985/kjss.2020.31.2.216
“이러한 현상의 원인은 매우 다양하게 존재할 수 있으 며, 반복모의실험의 결과를 절대적인 기준인양 무조건 수 용하여 본 연구의 결과와 비교 및 판단할 수는 없다 (Bruns & Ioannidis, 2016).”
Kahkoska, A. R. (2019) · Carolina Digital Repository (University of North Carolina at Chapel Hill) · doi:10.17615/pmkd-k264
Damage Control upon Learning That One’s Study Failed to Replicate
Bausell, R. B. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197536537.003.0009
Key Principles in Ethical Data Analysis and Handling Conflicts of Interest
Schwartz, S. J. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780190095918.003.0004
Gray Matter Analysis of MRI Images: Introduction to Current Research Practice
Hamada, H. T., Matsuyoshi, D., & Kanai, R. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-819641-0.00163-8
Significance Chasing in Hand Surgery Literature
Sankaran, A. (2022) · The Journal of Hand Surgery (Asian-Pacific Volume) · doi:10.1142/s2424835522500643
Quantinar: a blockchain p2p ecosystem for honest scientific researchPreprint
Bag, R. C., Spilak, B., Winkel, J., & Härdle, W. K. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.11525
Metadata
- Authors
- Bruns, S. B., & Ioannidis, J. P. A.
- Affiliations
- University of Kassel (DE)
- Stanford University (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-02-17
- Volume
- 11
- Issue
- 2
- Pages
- e0149144
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC4757561
- OpenAlex
- W2275632435
- Cited by
- 210
- References
- 44
- Citations by year
- 2026: 8 · 2025: 15 · 2024: 13 · 2023: 15 · 2022: 19 · 2021: 24 · 2020: 37 · 2019: 20 · 2018: 25 · 2017: 23 · 2016: 11
- FWCI
- 24.57
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Document Server@UHasselt (UHasselt) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- p-curve, p-hacking, omitted variable bias, confounding, observational studies, null effect, malaria prevalence, economic growth, p-value calibration, significance threshold
- MeSH terms
- Humans, Malaria, Research, Statistics as Topic, Vibration, Prevalence, Sample Size, Observational Studies as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.