The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index; none of the 1 sources its claims cite is checked for support yet.
The ASA Statement on p -Values: Context, Process, and Purpose
Open accessAbstract
Emeritus of Mathematics and Statistics at
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
24 Own interpretation · 2 No basis given · 1 No full text of the sources
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The widespread use of”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Statistical significance is not equivalent to scientific, human, or economic significance.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, a p-value near 0.05 taken by itself offers only weak evidence against the null hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By itself, a p-value does not provide a good measure of evidence regarding a model or hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similarly, identical estimated effects will have different p-values if the precision of the estimates differs.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A p-value provides one approach to summarizing the incompatibility between a particular set of data and a proposed model for the data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Conducting multiple analyses of the data and reporting only those with certain p-values (typically those passing a significance threshold) renders the reported p-values essentially uninterpretable.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Whenever a researcher chooses what to present based on statistical results, valid interpretation of those results is severely compromised if the reader is not informed of the choice and its basis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The smaller the p-value, the greater the statistical incompatibility of the data with the null hypothesis, if the underlying assumptions used to calculate the p-value hold.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Valid scientific conclusions based on p-values and related statistics cannot be drawn without at least knowing how many and which analyses were conducted, and how those analyses (including p-values) were selected for reporting.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 10
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This has led to some scientific journals discouraging the use of p-values, and some scientists and statisticians recommending their abandonment, with some arguments essentially unchanged since p-values were first introduced.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The statistical community has been deeply concerned about issues of reproducibility and replicability of scientific conclusions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the p-value can be a useful statistical measure, it is commonly misused and misinterpreted.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A conclusion does not immediately become”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All these measures and approaches rely on further assumptions, but they may more directly address the size of an effect (and its associated uncertainty) or whether the hypothesis is correct.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The validity of scientific conclusions, including their reproducibility, depends on more than the statistical methods themselves.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is a statement about data in relation to a specified hypothetical explanation, and is not a statement about the explanation itself.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Researchers should recognize that a p-value without context or other evidence provides limited information.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Likewise, a relatively large p-value does not imply evidence in favor of the null hypothesis; many other hypotheses may be equally or more consistent with the observed data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This incompatibility can be interpreted as casting doubt on or providing evidence against the null hypothesis or the underlying assumptions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Appropriately chosen techniques, properly conducted analyses and correct interpretation of statistical results also play a key role in ensuring that conclusions are sound and that uncertainty surrounding them is represented properly.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Misunderstanding or misuse of statistical inference is only one cause of the”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
What the sources say
- Not checked — no full text of the sourcecites Peng 2015 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Smaller p-values do not necessarily imply the presence of larger or more important effects, and larger p-values do not imply a lack of importance or even lack of effect.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In view of the prevalent misuses of and misconceptions concerning p-values, some statisticians prefer to supplement or even replace p-values with other approaches.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
There is widespread consensus in the statistical community on the principles articulated in the ASA statement.
“according to widespread consensus in the statistical community”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While the large scale of the Tabula Muris Senis dataset provides substantial power to predict subtle changes in LR interactions, the biological complexity, dependencies among communication pairs, and multiple testing burden require that these p-values be interpreted within a broader biological and statistical context [33].”
From Quantitative profiling of lifespan-dependent cell-cell communication potential reveals dynamic ligand-receptor network shifts across mouse tissues (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These types of incorrect descriptions contribute to confirmation bias, overinterpretation of results, and reporting correlation as implied causation (Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This is especially true of relatively large-sample-size studies (as most learning analytics studies are), which are likely to obtain statistically significant findings in relatively small variations in measures such as GPA (Field 2017; Salkind 2016 Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
In the citing paper
“In 2016, the American Statistical Association released a statement on statistical significance and the P value with six principles underlying the proper use and interpretation of this statistical tool (77).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [77]
In the citing paper
“Although we also present p values for exploratory analyses, we refrain from labeling any of them as statistically significant, following best-practice recommendations for statistical analysis [43].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [43]
In the citing paper
“Contrary to IJE author recommendations and recent guidance from the American Statistics Society, 16 Gao et al. largely base their conclusions on findings with a P -value equivalent to < 0.05 after multiple testing.”
From Commentary: Two-sample Mendelian randomization: opportunities and challenges (2016) · cites this paper as [16]
In the citing paper
“Following guidance,50 we focused on 95% CIs, rather than statistical significance. For example, unlike conventional interpretations, we did not outright interpret an effect estimate “non‐significant” if the lower or upper bound of the 95% CI was slightly above/below the null value; we interpreted them as “suggestive” of an effect.”
From Third‐wave cognitive behaviour therapies for weight management: A systematic review and network meta‐analysis (2020) · cites this paper as [50]
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,745
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946
Smithson, M. J. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Research works printed but not linked: 5
- Leek, J. (2014), “On the Scalability of Statistical Procedures: Why the p-Value Bashers Just Don't Get It,” Simply Statistics Blog, Available at http://simplystatistics.org/2014/02/14/on-the-scalability-of-statistical-procedures-why-the-p-value-bashers-just-dont-get-it/.
- Gelman A. and Loken E. (2014) “The Statistical Crisis in Science [online] ” American Scientist 102. Available at http://www.americanscientist.org/issues/feature/2014/6/the-statistical-crisis-in-science · DOI · Paper page
- Greenland, S., and Poole, C. (2011), “Problems in Common Interpretations of Statistics in Scientific Articles, Expert Reports, and Testimony,” Jurimetrics, 51, 113–129.
- 10.1214/13-AOS1123 · DOI
- Lavine, M. (1999), “What is Bayesian Statistics and Why Everything Else is Wrong,” UMAP Journal, 20, 2.
Cited by
Sorted by citations
Items 4,901–5,000 of 6,272
It would be desirable to reduce the p value considered significant?
Saladich, I. G. (2018) · Endocrinología Diabetes y Nutrición (English ed ) · doi:10.1016/j.endien.2018.11.002
Reminiscence from Half a Century of Anti-Pneumocystis Drug Discovery and Development
Hughes, W. (2018) · OBM Genetics · doi:10.21926/obm.genet.1804052
Quantifying the Reversibility of Protocol Format
Xu, Z., You, L., & Zheng, H. (2018) · IEEE International Conference on Mobile Ad-Hoc and Sensor Systems (MASS) · doi:10.1109/mass.2018.00079
Using Bayesian Multilevel Models to Control for Multiplicity among Means
Zweifel, M. J. (2018) · Lincoln (University of Nebraska)
I3: A Non-Parametric Alternative to the Journal Impact Factor.Preprint
Loet Leydesdorff, A., Bornmann, L., & Adams, J. R. (2018) · arXiv (Cornell University)
Farges, O., & Cauchy, F. (2018) · Annals of Surgery · doi:10.1097/sla.0000000000002994
“This point is indeed crucial, as the P value is so frequently misused and misinterpreted that the American Statistical Association has recently published a statement on P values and statistical significance.(3)”
BackgroundIn Search of Organization Laws: A New Way of Doing Science? (The Uprising of Systemic Attitude)
Giuliani, A. (2018) · Contemporary systems thinking · doi:10.1007/978-3-030-00725-6_3
Fietz, A. V., & Grüner, S. (2017) · Journal of Consumer Protection and Food Safety
Gestational Diabetes and Childhood Obesity—Reply
Lowe, W. L., Scholtens, D. M., & Metzger, B. E. (2019) · JAMA · doi:10.1001/jama.2018.19754
Cáceres, A., & González, J. R. (2019) · BMC Genomics · doi:10.1186/s12864-018-5340-3
A Re-Interpretation of 'Significant' Empirical Financial ResearchPreprint
Kellner, R., & Roesch, D. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3272291
Time Is Precious—Quo Vadis, Creativity?
Velázquez, J. L. P. (2019) · Springer eBooks · doi:10.1007/978-3-030-12326-0_2
Discussion of ‘Prior-based Bayesian Information Criterion (PBIC)’
Liu, S., & Sun, D. (2019) · Statistical Theory and Related Fields · doi:10.1080/24754269.2019.1611142
The Inextricable Link Between Culture and Statistics
Nolan, S. A., & Simon, A. F. (2019) · Wiley eBooks · doi:10.1002/9781119519348.ch5
JAMA Otolaryngology–Head & Neck Surgery—The Year in Review, 2018
Piccirillo, J. F. (2019) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2019.0389
Fiala, M. A. (2019) · Cancer · doi:10.1002/cncr.32082
“and are a major contributor to the current reproducibility crisis in the scientific community.(12) Their statement intentionally omitted problems concerning low sample”
BackgroundGuidelines for Experimental Algorithmics in Network AnalysisPreprint
Angriman, E., van der Grinten, A., von Looz, M., Meyerhenke, H., Nöllenburg, M., Predari, M., & Tzovas, C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.04690
Bagheri, E. (2019) · doi:10.32657/10220/48049
“P-value is the probability that a statistical summary of the data, would be equal to or more extreme than its observed value [147].”
BackgroundSimple Statistical Tests and P Values
Goldsmith, C. H., Duku, E., Thoma, A., & Murphy, J. (2019) · Springer eBooks · doi:10.1007/978-3-030-05120-4_27
Abd-Elsayed, A. A. (2019) · Pain · doi:10.1007/978-3-319-99124-5_16
Response to Technical Comment on Rickles, Heppen, Allensworth, Sorensen, and Walters (2018)
Rickles, J. H., Heppen, J. B., Allensworth, E. M., et al. (2019) · Educational Researcher · doi:10.3102/0013189x19848731
Probabilistic Adaptation and Voluntary Attention
Griffin, S. F. (2019) · UWSpace (University of Waterloo)
Brain networks construction using Bayes FDR and average power function
Quatto, P., Margaritella, N., Costantini, I., et al. (2019) · Statistical Methods in Medical Research · doi:10.1177/0962280219844288
Opioid Seizures by Law Enforcement in Relation to Emergency Room Visits
Turley, T., Mobley, E. L., & Hunter, A. (2019) · Online Journal of Public Health Informatics · doi:10.5210/ojphi.v11i1.9928
“05 which indicates none of the results are markedly different given the null hypothesis of R=0 is true [6].”
BackgroundI can see clearly now: reinterpreting statistical significancePreprint
Dushoff, J. G., Kain, M. P., & Bolker, B. M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.06387
“ontext Although species richness is usually strongly influenced by landscape context, we were unable to find a statistically clear relationship in this study Inferring weak effects from large p-values (Wasserstein and Lazar, 2016) ... differencesbetweentreatment and control groups were nonsignificant, with P values of at…”
BackgroundInfluentialExploration, inference and prediction in neuroscience and biomedicinePreprint
Bzdok, D., & Ioannidis, J. P. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.10310 · Cited by 1
“The framework however is sometimes ill-suited and frequently misunderstood [17-19].”
BackgroundHasan, S. A. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2912610
A default prior for regression coefficientsPreprint
van Zwet, E. W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.08449
Viewing “p” through the lens of the philosophy of medicine
Asato, S., & Giordano, J. (2019) · Philosophy Ethics and Humanities in Medicine · doi:10.1186/s13010-019-0077-4
Loet Leydesdorff, A., Bornmann, L., & Adams, J. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.03448
Objective Bayesian Comparison of Order-Constrained Models in Contingency TablesPreprint
Paroli, R., & Consonni, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1810.09750
Comparing Techniques for Aggregating Interrelated Replications in Software EngineeringPreprint
Santos, A., & Juristo, N. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.06809
“Thus, some authors suggest replacing p-values by effects sizes and their corresponding 95% CIs instead [46][10][32], as they serve also to quantify the statistical significance of results (if the 95% CI does not cross 0, then the effect size is statistically significant), and they can be used either to quantify the pr…”
BackgroundMethodYuzurihara, H., Mano, S., & Tagoshi, H. (2020) · Journal of Physics Conference Series · doi:10.1088/1742-6596/1468/1/012222
“iversity of Tokyo, National Research Foundation (NRF) and Computing Infrastructure Project of KISTI-GSDC in Korea. A. Appendix : Derivation and meaning of pconv As in various scientific research fields [24], there might be some confusion in use of p-values in the gravitational wave community. In the recent American stat…”
Backgroundbayes4psy—An Open Source R Package for Bayesian Statistics in Psychology
Demšar, J., Repovš, G., & Štrumbelj, E. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00947 · Cited by 5
“Many manuscripts published today repeat the same mistakes even though prominent statisticians prepared extensive guidelines about what to do and mainly what not to do (Hubbard 2015; Wasserstein and Lazar 2016; Wasserstein et al. 2019; Ziliak 2019).”
BackgroundThe bilingual advantage: Cognitive effects of bilingualism in healthy older Norwegians
Cameron, S. (2018) · NORA - Norwegian Open Research Archives
Basic antidepressant research: a brief assay on how to justify your alpha
de Oliveira, C. L. (2019) · Bionatura · doi:10.21931/rb/cs/2019.02.01.3
Uncertainty in the MAN Data Calibration & Trend EstimatesPreprint
Briggs, W. M., & Hanekamp, J. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1907.10173
“icians and scientists are calling to retire statistical signicance as a concept, e.g. [1]. The American Statistical Association issued a statement warning about excesses due to reliance on p-values; [20]. Others call for a lowering of the usual threshold from 0.05 to 0.005, e.g. [3, 4]. These authors say that (emphasi…”
BackgroundInfluentialConstructing Algorithms for Forecasting High (Low) Project Management Performance
Awe, O. A., Woodside, A. G., Nerur, S., et al. (2019) · Springer eBooks · doi:10.1007/978-3-030-26818-3_2
Jehi, L. E., & Kattan, M. W. (2019) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2019.106442
Thilakarathna, S. H. (2019) · The Atrium (University of Guelph)
Evidence in Neurosurgery: Perspectives
Shimanskaya, V. E., Martens, J., Boogaarts, J. H. D., Westert, G. P., Rovers, M. M., & Bartels, R. (2019) · Springer eBooks · doi:10.1007/978-3-030-16323-5_22
Bartels, R., Westert, G. P., & Rovers, M. M. (2019) · Springer eBooks · doi:10.1007/978-3-030-16323-5_1
Introduction to Meta-Science in HRD
Turner, J. R. (2019) · Advances in Developing Human Resources · doi:10.1177/1523422319870788
“…problems, the social sciences have also experienced a growth in big data and machine learning, involving more complex data sets that require advanced complex analysis techniques, furthering the growing concerns regarding “conclusions drawn from research data” (Wasserstein & Lazar, 2016, p. 131).”
BackgroundMethodBaker, R. M., & Hirudayaraj, M. (2019) · Advances in Developing Human Resources · doi:10.1177/1523422319870565 · Cited by 1
“Statistical significance does not measure the size of the effect or the importance of a result, nor does it provide a good measure of evidence for a model or hypothesis (Wasserstein & Lazar, 2016).”
BackgroundMethodThe Search for the Light Top Squark
Köhler, N. M. (2019) · Springer theses · doi:10.1007/978-3-030-25988-4_11
Wycoff, N., Balaprakash, P., & Xia, F. (2019) · International Conference on Neuromorphic Systems (ICONS) · doi:10.1145/3354265.3354274
“ceable loss 1A common criticism of KS tests (and general point-null hypothesis testing) is that for large sample sizes, even the smallest discrepancy will cause the test to reject the null hypothesis [24]. It is likely that we could consistently get results indicating that the two predictive distributions are differen…”
ResultStudy of Dark Matter Models in Astrophysics and Particle Physics
John, I. (2019) · Lund University Publications Student Papers (Lund University)
Lin, E. (2019) · Bariatric Surgical Practice and Patient Care · doi:10.1089/bari.2019.29017.el
Jahandideh, S. (2019) · Griffith Research Online · doi:10.25904/1912/1318
Neppelenbroek, K. H., Honório, H. M., & Garlet, G. P. (2019) · Journal of Applied Oral Science · doi:10.1590/1678-7757-2019-ed001
Risk and Decision Making: Modeling and Statistics in Medicine – Fundamental Aspects
Borovcnik, M. (2019) · Springer eBooks · doi:10.1007/978-3-319-70658-0_62-1
Re: adjuvant radiation in early oral cancers with isolated perineural invasion
Shetty, S. S., Kudpaje, A., Rao, V. U. S., & Jayaraj, R. (2019) · British Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.bjoms.2019.09.015
Journal of Traumatic Stress P Value Guidelines
Hyland, P., Shevlin, M. E., & Kerig, P. K. (2019) · Journal of Traumatic Stress · doi:10.1002/jts.22460
Quantitative analysis of tumor heterogeneity based on magnetic resonance images
Trajkovska, E. (2019) · NORA - Norwegian Open Research Archives
IDEALEM: Statistical Similarity Based Data ReductionPreprint
Lee, D., Sim, A., Choi, J., et al. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.06980
“The larger this standardized distance is, the smaller the output of the KS test is, which is called the p-value [45].”
BackgroundKukush, A. G., & Mandel, I. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.07556
“in fact, they represent a small fraction of all works. This bias strongly contributes into the roots of the actively discussed now “reproducibility crisis” [12] and “statistical significance crisis” [13, 14]. A lot of work for investigating different conditions in a sense of the table 1 lies ahead, in our opinion. In…”
A quick guide to competitive forecast verification testing
Gilleland, E. (2019)
Kerscher, M., & Weller, J. (2019) · SciPost Physics Lecture Notes · doi:10.21468/scipost.report.847
Kerscher, M., & Weller, J. (2019) · SciPost Physics Lecture Notes · doi:10.21468/scipost.report.820
van Laar, E. (2019) · doi:10.3990/1.9789036548670 · Cited by 1
Research Reproducibility and p-value Threshold
Xie, X. J. (2019) · Biomedical Journal of Scientific & Technical Research · doi:10.26717/bjstr.2019.22.003805
“005 has been proposed to decrease the rate of false positives [2].”
BackgroundFrom the Editors’ Desk: HSR Updates Instructions for Authors
Romano, P. S., & Bindman, A. B. (2019) · Health Services Research · doi:10.1111/1475-6773.13232
Englert, B. (2019) · doi:10.1364/cqo.2019.w2a.1
Laccourre, O., & Maisonneuve, H. (2019) · Annales françaises d Oto-rhino-laryngologie et de Pathologie Cervico-faciale · doi:10.1016/j.aforl.2019.06.004
Multiple testing approaches for hypotheses in integrative genomics
Rudra, P., Cruz-Cortés, E., Zhang, X., & Ghosh, D. (2019) · Wiley Interdisciplinary Reviews Computational Statistics · doi:10.1002/wics.1493
“For a more apt discussion, we refer the reader to (Wasserstein & Lazar, 2016) and (Wasserstein, Schirm, & Lazar, 2019) for advice on how to interpret and use p values in a principled manner.”
MethodImage Cryptography using Complex Quadratic Map
Gunawan, T. S., Al-Ash, H. S., Arymurthy, A. M., et al. (2019) · International Workshop on Big Data and Information Security (IWBIS) · doi:10.1109/iwbis.2019.8935855
“The p − value or also known as the probability of observing sample statistic as extreme as the test statistics [21].”
BackgroundImproved Reporting in Abstracts When Uncertainty Is Inevitable
Halabi, S., & Day, S. J. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.17543
Bunting, W. C. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3199804
Detecting treatment effects in clinical trials without a control group
Baas, S. P. R. (2019)
Fuhrer, M. (2016) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-132513
Frommlet, F., & Schimek, M. G. (2020) · Computational Statistics · doi:10.1007/s00180-019-00945-4
Gannon, M. P., & Desmond, C. (2019) · Journal of Physiotherapy & Physical Rehabilitation
Firmin, M. W. (2020) · Journal of Human Behavior in the Social Environment · doi:10.1080/10911359.2019.1681342
“Contemporary psychology, unfortunately, contains a climate where empirical evidence of positive-results-bias exists as well as cherry-picking what becomes reported in peer-reviewed journals, partly through misuse of the P-value (Wasserstein & Lazar, 2016).”
BackgroundIncreasing Chlorophyll a Amid Stable Nutrient Concentrations in Rhode Island Lakes and ReservoirsPreprint
Hollister, J. W., Kellogg, D. Q., Kreakie, B. J., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.02.11.944280
Commentary: Too much ado about P value
Benedetto, U., & Dimagli, A. (2020) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2020.02.027
Helske, J., Helske, S., Cooper, M. D., Ynnerman, A., & Besançon, L. (2020) · arXiv (Cornell University)
Zheng, L., Li, J., & Yu, P. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.02.27.968909
Ziborova, V., Kataļņikova, S., Zagulova, D., & Prokofjeva, N. (2020) · SOCIETY INTEGRATION EDUCATION Proceedings of the International Scientific Conference · doi:10.17770/sie2020vol2.4978
Demystify Lindley's Paradox by Interpreting P-value as Posterior ProbabilityPreprint
Yin, G., & Shi, H. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2002.10883
Schmiedebach, M., Litzke, V., & Wegner, C. (2019) · Progress in Science Education (PriSE) · doi:10.25321/prise.2019.923
“As recommended by [45] and [46], confidence intervals are reported instead.”
BackgroundThe Mysterious, Magical Oseltamivir
Radecki, R. P., McNaughton, C. D., & Spiegel, R. J. (2020) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2020.02.009
Sharp and Practical Performance Bounds for MCMC and Multiple Testing
Rabinovich, M. (2019) · eScholarship (California Digital Library)
Decision-making in English Clinical Commissioning Groups: A Mixed Methods Study
Sibanda, M. (2019) · Sheffield Hallam University · doi:10.7190/shu-thesis-00277
The Myth of “The Myth of Objectivity”
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.009
Commentary: Are we confident in abandoning P values, or is this just the interval?
Gupta, V., & Kidane, B. (2020) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2020.03.131
Bayesian confidence intervals with more power to estimate the minimum effect and determine the sign
Zhao, H. (2020) · Communication in Statistics- Theory and Methods · doi:10.1080/03610926.2020.1752725
“Wasserstein and Lazar (2016) said: “Statistical significance is not equivalent to scientific, human, or economic significance.””
BackgroundHo, A. M. ‐., Norman, P. A., Wan, S., et al. (2020) · Canadian Journal of Emergency Medicine · doi:10.1017/cem.2020.35
Quantitative Decision Making in Pharmaceutical Development via Confidence DistributionsPreprint
Johnson, G. (2020) · arXiv (Cornell University)
Quantitative (Technical) Wine Assessment
Jackson, R. S. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-801813-2.00005-7
Moving pharmacy beyond “ P < .05”
Jiroutek, M. R., Al-Achi, A. J., Carter, C. A., et al. (2020) · JACCP JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY · doi:10.1002/jac5.1227
Harraz, . M., & Abol‐Enein, H. (2020) · International Urology and Nephrology · doi:10.1007/s11255-020-02477-z
Berenbaum, F., Blanco, F. J., Guermazi, A., et al. (2020) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2020-217629
Liu, J., & Gao, J. (2019) · International Conference on Vision, Image and Signal Processing (ICVISP) · doi:10.1145/3387168.3387208
Kelter, R., & Stern, J. M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03334
“In general, among the proposed solutions to the observed problems with NHST and p-values is a trend for the increased use of Bayesian data analysis (Wasserstein & Lazar, 2016; Wasserstein, Schirm, & Lazar, 2019).”
MethodEthical Representation of Data
Pierson, C. (2019) · Springer eBooks · doi:10.1007/978-3-319-23514-1_312-1
The welfare state and individual attitudes towards immigration
Rask, H. (2017) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
The Classical Model and Its Consequences
Westfall, P. H., & Arias, A. L. (2020) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003025764-3
Brown, D. W. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108551045.006
Metadata
- Authors
- Wasserstein, R. L., & Lazar, N. A.
- Affiliations
- American Statistical Association, 732 North Washington Street, Alexandria, VA 22314-1943
- American Statistical Association (US)
- ORCID
- Lazar, Nicole A.
- Venue
- The American Statistician
- Publisher
- Informa UK Limited
- Published
- 2016-04-02
- Volume
- 70
- Issue
- 2
- Pages
- 129-133
- ISSN
- 0003-1305 (ISSN-L)
- 1537-2731
- OpenAlex
- W2293040502
- Semantic Scholar
- 81a65f23474ffceb2481836328608102950da979
- Cited by
- 6,306
- References
- 45
- Citations by year
- 2026: 625 · 2025: 629 · 2024: 575 · 2023: 543 · 2022: 642 · 2021: 676 · 2020: 678 · 2019: 666 · 2018: 596 · 2017: 438 · 2016: 226
- FWCI
- 649.74
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The American Statistician (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- p-values, statistical evidence, p-value interpretation, statistical inference, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
