P-curve: A key to the file-drawer.
The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Because scientists tend to report only studies (publication bias) or analyses (p-hacking) that "work," readers must ask, "Are these effects true, or do they merely reflect selective reporting?" We introduce p-curve as a way to answer this question. P-curve is the distribution of statistically significant p values for a set of studies (ps < .05). Because only true effects are expected to generate right-skewed p-curves-containing more low (.01s) than high (.04s) significant p values--only right-skewed p--curves are diagnostic of evidential value. By telling us whether we can rule out selective reporting as the sole explanation for a set of findings, p-curve offers a solution to the age-old inferential problems caused by file-drawers of failed studies and analyses.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Incorrect p-values could affect the outcome of tests that analyze the distribution of p-values, such as the p-curve (Simonsohn, Nelson, & Simmons, 2014) and p-uniform (Van Assen, Van Aert, & Wicherts, 2014).”
From The prevalence of statistical reporting errors in psychology (1985–2013) (2016) · cites this paper as Simonsohn, Nelson, & Simmons, 2014
In the citing paper
“Even if the first REM episode occurs about 70 minutes after falling asleep (33), some subjects may present a REM EEG and occulomotor pattern a way farster.The REM sleep can actually occur pretty rapidly in some individuals according to the MD (sleep specialist) who co-supervised this study.Furthermore, the MSLT has specialy been built for this puporse (see32)”
From Is there a Publication Bias in Behavioural Intranasal Oxytocin Research on Humans? Opening the File Drawer of One Laboratory (2016) · cites this paper as [33]
In the citing paper
“After excluding studies which assessed maltreatment as part of broader measures of victimization (k=3) (25, 27, 29) or ACEs (k=5) (30, 34, 39, 44, 49), or focused on institutional neglect (k=3) (15, 45, 46), the meta-analytic effect size was also similar to the original estimate (Cohen’s d=0.34, 95% CI=0.26-0.42).”
From Childhood Maltreatment and Mental Health Problems: A Systematic Review and Meta-Analysis of Quasi-Experimental Studies (2023) · cites this paper as [25]
In the citing paper
“Trim‐and‐fill procedures do suffer from some well‐known limitations that could result in the underestimation or overestimation of publication bias (Rothstein, 2008; Simonsohn, Nelson, & Simmons, 2014).”
From Hot spots policing of small geographic areas effects on crime (2019) · cites this paper as Simonsohn, Nelson, & Simmons, 2014
In the citing paper
“Applying selection modeling approaches like p-uniform or 3PSM to the simple effects may therefore substantially overestimate the true effect size.”
From Do Salient Social Norms Moderate Mortality Salience Effects? A (Challenging) Meta-Analysis of Terror Management Studies (2023) · cites this paper as Simonsohn et al., 2014
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
(1963) · Medical Entomology and Zoology · Cited by 15,085
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Self-citationTesting Statistical Hypotheses
(2021) · Wiley Series in Probability and Statistics · doi:10.1002/9781119243830.ch12 · Cited by 5,106
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“1 Trying multiple analyses to obtain statistical significance has received many names, including: bias (Ioannidis, 2005), significance chasing (Ioannidis & Trikalinos, 2007), data snooping (White, 2003), fiddling (Bross, 1971), publication bias in situ (Phillips, 2004) and specification searching (Gerber & Malhotra, 2…”
Cited by
Items 801–900 of 1,005
The help that hinders? A meta‐analysis of reactions to affirmative action
Greig, S. M., Coundouris, S. P., Fletcher, G. L., Henry, J. D., & von Hippel, C. (2023) · European Journal of Social Psychology · doi:10.1002/ejsp.2991 · Cited by 14
Ratner, K., Burrow, A. L., & Thoemmes, F. J. (2016) · Royal Society Open Science · doi:10.1098/rsos.160431 · Cited by 11
Krueger, J. I., & Heck, P. R. (2018) · Collabra Psychology · doi:10.1525/collabra.108 · Cited by 12
“The probability distribution of p should be studied for different alternative hypotheses, a strategy encouraged by recent developments in p-curve analysis and related methods (Simonsohn et al., 2014).”
BackgroundMethodWhat is behind the variation in mate quality dependent sex ratio adjustment? - A meta-analysis
Szász, E., Garamszegi, L., & Rosivall, B. (2018) · Oikos · doi:10.1111/oik.05157 · Cited by 9
Boudesseul, J., Gildersleeve, K. A., Haselton, M. G., & Bègue, L. (2019) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2019.08.016 · Cited by 11
Realizing the promises of replication studies in education
Morrison, K. (2019) · Educational Research and Evaluation · doi:10.1080/13803611.2020.1838300 · Cited by 15
Collaboration and Open Science Initiatives in Primate Research
ManyPrimates, Altschul, D., Bohn, M., Canteloup, C., Ebel, S., Hanus, D., Hernandez-Aguilar, R. A., Joly, M., Keupp, S., Petkov, C. I., et al. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108955836.023 · Cited by 9
Antonelli, M., Donelli, D., & Firenzuoli, F. (2020) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2020.102457 · Cited by 12
“The p-curve method was used to test if the sets of included studies were, on average, powered enough to detect a true effect of studied intervention, and to correct for the potentially inflated estimates that arise from the publication of results intentionally modified to be significant (“p-hacking”).(33),(34) All the…”
Demographics, Career Concerns or Social Comparison: Who Games SSRN Download Counts?Preprint
Edelman, B. G., & Larkin, I. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1346397 · Cited by 19
Video Games and Attitude Change: A Meta-analysisPreprint
Kolek, L., Ropovik, I., Šisler, V., van Oostendorp, H., & Brom, C. (2022) · doi:10.31234/osf.io/8y7jn · Cited by 11
Lakens, D. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/dtvs7 · Cited by 17
Jernslett, M., Kilmer, R. P., Avraam, D., & Anastassiou‐Hadjicharalambous, X. (2025) · Clinical Psychology Review · doi:10.1016/j.cpr.2025.102617 · Cited by 13
A comprehensive meta-analysis reveals the key variables and scope of seed defense priming
Talavera‐Mateo, L., Garcia, A., & Santamaria, M. E. (2023) · Frontiers in Plant Science · doi:10.3389/fpls.2023.1208449 · Cited by 11
Ocampo, E. H., Nuñez, J. D., Ribeiro, P. D., García, M. P., Bas, C. C., & Luppi, T. (2024) · Marine Pollution Bulletin · doi:10.1016/j.marpolbul.2024.116293 · Cited by 10
Burns, E. J. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02459-4 · Cited by 13
“This is an important antidote to the replication crisis psychology has faced in recent years, as it can provide support that any studied effect is real (Simonsohn et al., 2014).”
BackgroundMethodInfluentialSpurious precision in meta-analysis of observational research
Iršová, Z., Bom, P. R. D., Havránek, T., & Rachinger, H. J. (2025) · Nature Communications · doi:10.1038/s41467-025-63261-0 · Cited by 26
“The two selection models, based on random-effects speci fi cations, are also used often 39 – 45 and represent the latest incarnations of models in the tradition of Hedges 10 – 13 and their simpli fi cations 46 – 51 .”
Petrowsky, H. M., Boecker, L., Escher, Y. A., Frech, M.-L., Friese, M., Galinsky, A. D., Gunia, B., Lee, A. J., Schaerer, M., Schweinsberg, M., et al. (2025) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2025.104448 · Cited by 15
“We also report RoBMA for a Bayesian perspective on publication bias (Barto ˇ s et al., 2022) and p -curve analyses to investigate the evidential basis for effects and potential p -hacking (Simonsohn et al., 2014).”
InfluentialScherr, S., & Zhou, J. (2019) · Communication Methods and Measures · doi:10.1080/19312458.2019.1677882 · Cited by 11
Statistics for HCI: Making Sense of Quantitative Data
Dix, A. J. (2020) · Synthesis lectures on human-centered informatics · doi:10.2200/s00974ed1v01y201912hci044 · Cited by 11
Home Telemonitoring of Patients With Type 2 Diabetes: A Meta-Analysis and Systematic Review
Zhu, X., Williams, M. S., Finuf, K. D., Patel, V. H., Sinvani, L., Wolf‐Klein, G. P., Marziliano, A. M., Nouryan, C. N., Makaryus, A. N., Zeltser, R., et al. (2022) · Diabetes Spectrum · doi:10.2337/ds21-0023 · Cited by 13
Do we really measure what we think we are measuring?
Gordillo, D., da Cruz, J. N., Moreno, D., Garobbio, S., & Herzog, M. H. (2023) · iScience · doi:10.1016/j.isci.2023.106017 · Cited by 15
Lehmann, R., & Vogt, B. (2023) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2023.349 · Cited by 10
Gangestad, S. W. (2015) · Emotion Review · doi:10.1177/1754073915580400 · Cited by 14
“Simonsohn et al. (2014) laid out a method for detecting p-hacking—the p-curve.”
MethodGronau, Q. F., Duizer, M., Bakker, M., & Wagenmakers, E. (2017) · Journal of Experimental Psychology General · doi:10.1037/xge0000324 · Cited by 15
“That is, this is an undifferentiated set of p values which has not been selected in accordance with the guidelines proposed by Simonsohn et al. (2014a).”
BackgroundMethodInfluentialThe Impact of P -hacking on “Redefine Statistical Significance”
Crane, H. (2018) · Basic and Applied Social Psychology · doi:10.1080/01973533.2018.1474111 · Cited by 11
“Empirical studies (e.g., Head et al., 2015; Masicampo & Lalande, 2012; Simonsohn et al., 2014) find that unsound p values tend to cluster disproportionately close to the significance cutoff (i.e., tend to lie just below .05).”
BackgroundResultOn the Apparently Inappropriate Use of Multiple Hypothesis Testing in Earthquake Prediction Studies
Kato, M. (2019) · Seismological Research Letters · doi:10.1785/0220180378 · Cited by 10
Niederstrasser, N. G., & Cook, S. (2020) · Journal of Pain · doi:10.1016/j.jpain.2020.07.005 · Cited by 14
Practice what you preach: Credibility-enhancing displays and the growth of open science
Kraft‐Todd, G., & Rand, D. G. (2021) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2020.10.009 · Cited by 14
Use of Technology-Based Tools in Ensuring Quality of Publishable Journal Articles
Magulod, G. C., Capulso, L. B., Tabiolo, C. D. L., Luza, M. N., & Ramada, M. G. C. (2020) · International Journal of Learning Teaching and Educational Research · doi:10.26803/ijlter.19.11.9 · Cited by 22
“…community and the society at large (Wager & Kleinert, 2010), but what is lamenting is that many studies are never published and termed as the file-drawer problem (Dalton et al., 2012; Franco et al., 2014; Iwachiw, Button & Atlas, 2019; Lane et al., 2016; Simonsohn et al., 2014; Song et al., 2010).”
BackgroundBurns, E. J., & Bukach, C. M. (2022) · Cortex · doi:10.1016/j.cortex.2022.06.008 · Cited by 10
Significance bias: an empirical evaluation of the oral health literature
Kagereki, E., Gakonyo, J., & Simila, H. O. (2016) · BMC Oral Health · doi:10.1186/s12903-016-0208-x · Cited by 11
“One such method is data-dredging (also termed as snooping, fishing, significance-chasing or double-dipping) [19].”
BackgroundMethodInfluentialPublication bias in a recent meta‐analysis on breastfeeding and IQ
Ritchie, S. J. (2016) · Acta Paediatrica · doi:10.1111/apa.13539 · Cited by 10
“Indeed, a p-curve analysis (4) indicated that the data set shows evidential value (binomial test p = .”
BackgroundFamily ties: Exploring the influence of family legacy on self and identity
Baldwin, M. W., Molina, L. E., & Naemi, P. (2018) · Self and Identity · doi:10.1080/15298868.2018.1526820 · Cited by 10
West, S. J., Hyatt, C. S., Miller, J. D., & Chester, D. S. (2020) · Aggressive Behavior · doi:10.1002/ab.21937 · Cited by 13
We should focus on the biases that matter: A reply to commentaries
Francis, G. (2013) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2013.06.001 · Cited by 10
Internal Meta-Analysis Makes False-Positives Easier To Produce and Harder To CorrectPreprint
Vosgerau, J., Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3271372 · Cited by 12
Self-citationInaccuracy in the Scientific Record and Open Postpublication Critique
Brewin, C. R. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916221141357 · Cited by 14
“Furthermore, serious concerns have been raised about the practice (“p-hacking”) of making the decision about which part to publish after scrutinizing the data and reporting only that part of a data set that yields significant results (Simonsohn et al., 2014).”
BackgroundEvaluating the Evidence for Enclothed Cognition: Z-Curve and Meta-Analyses
Horton, C. B., Adam, H., & Galinsky, A. D. (2023) · Personality and Social Psychology Bulletin · doi:10.1177/01461672231182478 · Cited by 14
“Moreover, methods like p and z-curves were introduced around that time, specifically to diagnose and respond to replication concerns (Brunner & Schimmack, 2020; Simonsohn et al., 2014).”
Older Americans are more vulnerable to prior exposure effects in news evaluation
Lyons, B. A. (2023) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-118 · Cited by 17
“The primary models do not include other covariates because inclusion of background controls is not necessary for experimental designs due to benefits of random assignment, and in fact, flexible inclusion of covariates in an analysis can lead to Type I error inflation (e.g., Simmons et al., 2011; Simonsohn et al., 2014…”
BackgroundUsing DNA to Predict Education: a Meta-analytic Review
Wilding, K., Wright, M., & von Stumm, S. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09928-4 · Cited by 15
“Third, we conducted p -curve analyses with histograms of the p -values associated with the studies’ estimates (Simonsohn et al., 2014a, b), generating p -curves for our estimates using an application (http:// www.p-curve. com/ app4/; see Supplementary Materials section 5 for details).”
Stop Fooling Yourself! (Diagnosing and Treating Confirmation Bias)
Born, R. T. (2024) · eNeuro · doi:10.1523/eneuro.0415-24.2024 · Cited by 18
“” (Good, 1972), and this sort of “ p -hacking ” (Simonsohn et al., 2014) is best combatted by not con fl ating exploratory (i.e., “ torturing the data ” ) and con fi rmatory (i.e., hypothesis testing) analyses.”
BackgroundCognitive Reserve? Cognitive Capacity!
Paap, K. R. (2024) · Brain Sciences · doi:10.3390/brainsci14121265 · Cited by 9
Talebi, A., Mukherjee, S., Gera, N., Kaur, K., & Das, G. (2025) · Journal of Product Innovation Management · doi:10.1111/jpim.12774 · Cited by 18
Bürkle, J. J., Schmidt, S., & Fendel, J. C. (2025) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2025.102977 · Cited by 13
On the Poor Statistical Properties of the P -Curve Meta-Analytic Procedure
Morey, R. D., & Davis‐Stober, C. P. (2025) · Journal of the American Statistical Association · doi:10.1080/01621459.2025.2544397 · Cited by 10
“Simonsohn, Nelson, and Simmons (2014a) and Simonsohn, Simmons, and Nelson (2015) refer to three tests: a “test of evidential value/right skew 2 ”, a “test of lack of evidential value”, and a “test of left skew”.”
InfluentialSingle paper meta‐analysis is unavoidable
McShane, B. B., & Böckenholt, U. (2025) · Journal of Consumer Psychology · doi:10.1002/jcpy.1462 · Cited by 12
Ten simple rules for designing and conducting undergraduate replication projects
Moreau, D., & Wiebels, K. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010957 · Cited by 14
“Via the role it plays in addressing and correcting errors or biases in research, doing replication work also provides a great opportunity to highlight the human side of the scientific enterprise, and particularly how scientists may make mistakes or be influenced by their own biases, which can lead to flawed or biased…”
BackgroundKim, H., Kim, J. H., Kim, J.-H., Kim, J. Y., Cortese, S., Smith, L., Koyanagi, A., Raduà, J., Fusar‐Poli, P., Carvalho, A. F., et al. (2023) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796023000574 · Cited by 12
“Publication bias was evaluated using Egger’s test, p -curve analysis and visual inspection of the funnel plots (Egger et al. , 1997; Simonsohn et al. , 2014a, 2014b).”
MethodKeener, S. K., Kepes, S., & Torka, A. (2023) · Acta Psychologica · doi:10.1016/j.actpsy.2023.104005 · Cited by 14
Kulinna, P. H., Wahl-Alexander, Z., Nam, K., & Kinder, C. J. (2024) · Kinesiology Review · doi:10.1123/kr.2024-0009 · Cited by 12
Transparency in Cognitive Training Meta-analyses: A Meta-review
Sandoval‐Lentisco, A., López‐Nicolás, R., Tortajada, M., López-López, J. A., & Sánchez‐Meca, J. (2024) · Neuropsychology Review · doi:10.1007/s11065-024-09638-2 · Cited by 10
Misstatements, misperceptions, and mistakes in controlling for covariates in observational research
Yu, X. D., Zoh, R. S., Fluharty, D. A., Mestre, L. M., Valdez, D., Tekwe, C. D., Vorland, C. J., Jamshidi‐Naeini, Y., Chiou, S. H., Lartey, S. T., et al. (2024) · eLife · doi:10.7554/elife.82268 · Cited by 11
“Conventionally, this is termed ‘p-hacking’ ( Simonsohn et al., 2014 ), ‘investigator degrees of freedom’ ( Simmons et al., 2011 ), ‘taking the garden of forking paths’ ( Gelman and Loken, 2013 ), and so on.”
BackgroundMoving beyond unwise replication practices: The case of romantic motivation.
Sundie, J. M., Beal, D. J., Neuberg, S. L., & Kenrick, D. T. (2019) · Journal of Experimental Psychology General · doi:10.1037/xge0000527 · Cited by 10
p-value Problems? An Examination of Evidential Value in Criminology
Wooditch, A., Fisher, R., Wu, X., & Johnson, N. J. (2020) · Journal of Quantitative Criminology · doi:10.1007/s10940-020-09459-5 · Cited by 19
Practical and Ethical Reasons for Pursuing a More Open Science
Lupia, A. (2020) · PS Political Science & Politics · doi:10.1017/s1049096520000979 · Cited by 9
Vogel, D., & Xu, C. (2021) · Journal of Behavioral Public Administration · doi:10.30636/jbpa.42.239 · Cited by 11
“Simonsohn et al. (2014) give a more detailed introduction to the p-curve method and the rationale behind the distribution of p values.”
BackgroundMethodInfluentialDemidenko, M. I., Kelly, D. P., Hardi, F. A., Ip, K. I., Lee, S., Becker, H. C., Hong, S. H., Thijssen, S., Luciana, M. M., & Keating, D. P. (2022) · Neuroimage Reports · doi:10.1016/j.ynirp.2022.100133 · Cited by 9
“05) is traditionally used to evaluate whether a finding or set of findings is published or promoted versus ending in the file drawer (Simonsohn et al., 2014).”
BackgroundAn advanced method to streamline p-hacking
Sarstedt, M., & Adler, S. J. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.113942 · Cited by 10
Neoh, M. J. Y., Carollo, A., Lee, A., & Esposito, G. (2023) · Royal Society Open Science · doi:10.1098/rsos.230677 · Cited by 17
“Simonsohn et al. [43,75] proposed the use of the p -curve — the distribution of p -values that are statistically significant for a set of studies, where they argued that right skewed p -curves are generated only by true effects.”
BackgroundWenzel, M., Rowland, Z., Zahn, D., Kubiak, T., & Carlson, E. (2019) · European Journal of Personality · doi:10.1002/per.2208 · Cited by 9
Kossmeier, M., Vilsmeier, J. K., Dittrich, R., Fritz, T., Kolmanz, C., Plessen, C. Y., Slowik, A., Tran, U. S., & Voracek, M. (2019) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000384 · Cited by 10
DeRamus, T. P., Silva, R. F., Iraji, A., Damaraju, E., Belger, A., Ford, J. M., McEwen, S. C., Mathalon, D. H., Mueller, B. A., Pearlson, G. D., et al. (2020) · NMR in Biomedicine · doi:10.1002/nbm.4294 · Cited by 7
Karamitros, G., Johnson, J., Gergoudis, F. R., Giannas, E., Torres-Guzman, R. A., Lamaris, G. A., & Lineaweaver, W. C. (2026) · Annals of Plastic Surgery · doi:10.1097/sap.0000000000004738 · Cited by 11
Sun, Y., Shen, L., Pan, Z., & Qian, S. (2025) · Communication Research · doi:10.1177/00936502241308599 · Cited by 10
“…we report the median power, together with the proportion of studies with power levels of 33% or below (i.e., “severely underpowered,” Simonsohn, 2015; Simonsohn et al., 2014), 80% or above (Cohen, 1988; the “bare minimum” level, Giner-Sorolla et al., 2024), and 90% or above (required for…”
Vertical and horizontal space-valence associations: A meta-analysis
Pohl, J., & Miklashevsky, A. A. (2025) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2025.106054 · Cited by 10
Bruns, H., Fillon, A. A., Maniadis, Z., & Paunov, Y. (2025) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2025.102350 · Cited by 14
Skubera, M., Korbmacher, M., Evans, T. R., Azevedo, F., & Pennington, C. R. (2025) · Royal Society Open Science · doi:10.1098/rsos.241726 · Cited by 18
“Specifically, P-curve [79] is a statistical tool that can be utilized to explore the evidential value of research findings or detect selective reporting from a set of quantitative findings; Stat Check [80,81] can detect statistical errors in articles by reproducing the calculations outlined in an…”
Is the ANS linked to mathematics performance?
Inglis, M., Batchelor, S., Gilmore, C. K., & Watson, D. G. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16002120 · Cited by 11
The Paradox of Personalization: Does Task Prediction Require Individualized Models?
Mitsui, M. R., Liu, J., & Shah, C. S. (2018) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3176349.3176887 · Cited by 11
“We omitted a more rigorous test for the validity of p-values [13] beyond the scope of this work, but we will later discuss how it can robustly discover statistically significant differences.”
MethodEmpirical Research in Affective Computing: An Analysis of Research Practices and Recommendations
Wessler, J., Schneeberger, T., Hilpert, B., Alles, A., & Gebhard, P. (2021) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii52823.2021.9597418 · Cited by 17
Reis, D., & Friese, M. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_5 · Cited by 14
Increasing the Power of Two-Sample T-tests in Health Psychology Using a Compositional Data Approach
Lehmann, R., & Vogt, B. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-43075-6_29 · Cited by 8
Smyth, R. E., & Ansari, D. (2019) · Developmental Science · doi:10.1111/desc.12897 · Cited by 11
Sakaluk, J. K. (2020) · Archives of Sexual Behavior · doi:10.1007/s10508-020-01795-8 · Cited by 8
Vrantsidis, D. M., Wuest, V., & Wiebe, S. A. (2022) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-022-00387-3 · Cited by 8
The Sustainability Argument for Open Science
Govaart, G., Hofmann, S., & Medawar, E. (2022) · Collabra Psychology · doi:10.1525/collabra.35903 · Cited by 10
Interpreting Effectiveness Evidence in Pain: Short Tour of Contemporary Issues
O'Connell, N. E., Moseley, G. L., McAuley, J. H., Wand, B. M., & Herbert, R. (2015) · Physical Therapy · doi:10.2522/ptj.20140480 · Cited by 10
Holbert, R. L., Hardy, B. W., Park, E., Robinson, N. W., Jung, H., Zeng, C., Drouin, E., & Sweeney, K. (2018) · Annals of the International Communication Association · doi:10.1080/23808985.2018.1459198 · Cited by 8
“The underlying principle of p-curve analyses is that more frequent occurrences of stronger findings as indicated by stricter alpha levels (i.e. more .001s than .04s) should breed greater confidence in a set of findings (See Simonsohn et al., 2014a).”
BackgroundThe reliability of an environmental epidemiology meta-analysis, a case study
Young, S. S., Acharjee, M. K., & Das, K. P. (2018) · Regulatory Toxicology and Pharmacology · doi:10.1016/j.yrtph.2018.12.013 · Cited by 9
“The positioning of p-values in the distribution can be used to evaluate potential manipulation of the analysis process, Simonsohn et al. (2014); they worked with a limited the range of p-values, those less than or equal to 0.”
MethodSegerstrom, S. C. (2019) · International Journal of Behavioral Medicine · doi:10.1007/s12529-019-09811-5 · Cited by 8
Nordahl‐Hansen, A., Donolato, E., Lervåg, A., Norbury, C., & Melby‐Lervåg, M. (2019) · Campbell Systematic Reviews · doi:10.1002/cl2.1062 · Cited by 9
Does Social Exclusion Improve Detection of Real and Fake Smiles? A Replication Study
Schindler, S., & Trede, M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.626087 · Cited by 9
The Mental Timeline During the Processing of Linguistic Information
Eikmeier, V., Alex-Ruf, S., Maienborn, C., Schröter, H., & Ulrich, R. (2016) · Human cognitive processing · doi:10.1075/hcp.52.06eik · Cited by 12
No evidence for a bilingual executive function advantage in the ABCD study.Preprint
Dick, A. S. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/gjh95 · Cited by 11
Montoya, A. K., Charlton, A., Krefeld-Schwalb, A., Price, J., & Hilgard, J. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ck2r5 · Cited by 9
Hopeful Parenting: A Systematic Literature Review on Hope among Parents
Hoang, N. T., Yakes, K., Moran, E. V., Musherure, I., Turahirwa, E., Prindle, A. B., Reagan, M., Vandezande, J., & Thomas, K. J. (2024) · International Journal of Applied Positive Psychology · doi:10.1007/s41042-024-00181-2 · Cited by 13
“A set of findings has evidential value when the half p -curve ( p .025) is significantly right-skewed at p .05 or when both the half p -curve and full p -curve were significantly right-skewed at p .1 (Simonsohn et al., 2014 ).”
p-Hacking: Its Costs and When It Is Warranted
Erasmus, A. (2024) · Erkenntnis · doi:10.1007/s10670-024-00834-3 · Cited by 11
“To reiterate, Simonsohn et al. stress that p-hacking allows researchers to obtain spurious “significant relationships between truly unrelated variables” (2014: 534), while the ASA claims that p-hacking should be avoided because leads to an “excess of statistically significant results in the…”
InfluentialTreatment of gaming disorder: A systematic review and meta-analysis
Harpas, I., Stevens, M., Radünz, M., Williamson, P., Hamamura, T., Svendsen, O., & King, D. L. (2025) · Psychiatry Research · doi:10.1016/j.psychres.2025.116783 · Cited by 14
Asakawa-Haas, K. D., Spiegel, D., Bossert, L., Garić, A., Schwartz, K., Voracek, M., & Tran, U. S. (2026) · Communications Psychology · doi:10.1038/s44271-026-00414-x · Cited by 10
Bucher, L., Burgard, T., Tran, U. S., Prinz, G. M., Bošnjak, M., & Voracek, M. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231197611 · Cited by 7
“18. p curve (Simonsohn et al., 2014a, 2014b). the data structure of a newly submitted data set that potentially cause dysfunctionality if filled inconsistently (Gasparini, 2022).”
BackgroundMethodDoes thinking about God increase acceptance of artificial intelligence in decision-making?
Moore, D. A., Schroeder, J., Bailey, E. R., Gershon, R., Moore, J. E., & Simmons, J. P. (2024) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2402315121 · Cited by 7
Self-citationA meta-analysis on the relationship between the use of electronic media and psychological well-being
Liu, D., Baumeister, R. F., & Yang, C. (2024) · Emerging Trends in Drugs Addictions and Health · doi:10.1016/j.etdah.2024.100162 · Cited by 18
Does it actually feel right? A replication attempt of the rounded price effect
Harms, C., Genau, H. A., Meschede, C., & Beauducel, A. (2018) · Royal Society Open Science · doi:10.1098/rsos.171127 · Cited by 10
“[21] introduced a meta-analytic approach aimed to identify studies that have either been selectively reported based on the significance of the statistical tests or been ‘p-hacked’ [17] to reach statistically significant results.”
Ex-ante commitments to “give if you win” exceed donations after a win
Kellner, C., Reinstein, D. A., & Riener, G. (2018) · Journal of Public Economics · doi:10.1016/j.jpubeco.2018.10.009 · Cited by 12
“To provide strong evidence that our results are robust and not driven by "p-hacking" (Simonsohn et al., 2014), in appendix Table D.”
BackgroundP -curve accurately rejects evidence for homeopathic ultramolecular dilutions
Reisman, S., Balboul, M., & Jones, T. (2019) · PeerJ · doi:10.7717/peerj.6318 · Cited by 7
De-Biasing Strategic Communication
Gesche, T. (2017) · Games and Economic Behavior · doi:10.1016/j.geb.2021.09.001 · Cited by 7
P -CURVING AS A SAFEGUARD AGAINST P -HACKING IN SLA RESEARCH: A CASE STUDY
Lindstromberg, S. (2021) · Studies in Second Language Acquisition · doi:10.1017/s0272263121000516 · Cited by 8
“Various sets of guidelines have been proposed for maximizing the integrity of p -curve analyses (e.g., BITSS, 2017; Head et al., 2017; Simonsohn et al., 2014b, p. 1151).”
BackgroundMethodInfluentialLong, J. A. (2021) · Annals of the International Communication Association · doi:10.1080/23808985.2021.1979421 · Cited by 11
Maag, J. W., & Losinski, M. L. (2015) · Advances in Social Sciences Research Journal · doi:10.14738/assrj.24.1044 · Cited by 12
Metadata
- Authors
- Simonsohn, U., Nelson, L. D., & Simmons, J. P.
- Affiliations
- University of Pennsylvania (US)
- Venue
- Journal of Experimental Psychology: General
- Published
- 2014-04
- Volume
- 143
- Issue
- 2
- Pages
- 534-547
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- OpenAlex
- W3124690569
- Cited by
- 1,500
- References
- 49
- Citations by year
- 2026: 75 · 2025: 96 · 2024: 110 · 2023: 121 · 2022: 146 · 2021: 157 · 2020: 158 · 2019: 154 · 2018: 143 · 2017: 113 · 2016: 103 · 2015: 80 · 2014: 35
- FWCI
- 82.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental Psychology General (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- p-curve, publication bias, selective reporting, p-hacking, file drawer problem, statistical significance, evidentiary value
- MeSH terms
- Data Interpretation, Statistical, Humans, Psychology, Experimental, Statistics as Topic, Reproducibility of Results, Models, Statistical, Publication Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.