The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index; none of the 1 sources its claims cite is checked for support yet.
The ASA Statement on p -Values: Context, Process, and Purpose
Open accessAbstract
Emeritus of Mathematics and Statistics at
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
24 Own interpretation · 2 No basis given · 1 No full text of the sources
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The widespread use of”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Statistical significance is not equivalent to scientific, human, or economic significance.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, a p-value near 0.05 taken by itself offers only weak evidence against the null hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By itself, a p-value does not provide a good measure of evidence regarding a model or hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similarly, identical estimated effects will have different p-values if the precision of the estimates differs.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A p-value provides one approach to summarizing the incompatibility between a particular set of data and a proposed model for the data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Conducting multiple analyses of the data and reporting only those with certain p-values (typically those passing a significance threshold) renders the reported p-values essentially uninterpretable.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Whenever a researcher chooses what to present based on statistical results, valid interpretation of those results is severely compromised if the reader is not informed of the choice and its basis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The smaller the p-value, the greater the statistical incompatibility of the data with the null hypothesis, if the underlying assumptions used to calculate the p-value hold.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Valid scientific conclusions based on p-values and related statistics cannot be drawn without at least knowing how many and which analyses were conducted, and how those analyses (including p-values) were selected for reporting.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 10
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This has led to some scientific journals discouraging the use of p-values, and some scientists and statisticians recommending their abandonment, with some arguments essentially unchanged since p-values were first introduced.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The statistical community has been deeply concerned about issues of reproducibility and replicability of scientific conclusions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the p-value can be a useful statistical measure, it is commonly misused and misinterpreted.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A conclusion does not immediately become”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All these measures and approaches rely on further assumptions, but they may more directly address the size of an effect (and its associated uncertainty) or whether the hypothesis is correct.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The validity of scientific conclusions, including their reproducibility, depends on more than the statistical methods themselves.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is a statement about data in relation to a specified hypothetical explanation, and is not a statement about the explanation itself.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Researchers should recognize that a p-value without context or other evidence provides limited information.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Likewise, a relatively large p-value does not imply evidence in favor of the null hypothesis; many other hypotheses may be equally or more consistent with the observed data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This incompatibility can be interpreted as casting doubt on or providing evidence against the null hypothesis or the underlying assumptions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Appropriately chosen techniques, properly conducted analyses and correct interpretation of statistical results also play a key role in ensuring that conclusions are sound and that uncertainty surrounding them is represented properly.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Misunderstanding or misuse of statistical inference is only one cause of the”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
What the sources say
- Not checked — no full text of the sourcecites Peng 2015 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Smaller p-values do not necessarily imply the presence of larger or more important effects, and larger p-values do not imply a lack of importance or even lack of effect.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In view of the prevalent misuses of and misconceptions concerning p-values, some statisticians prefer to supplement or even replace p-values with other approaches.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
There is widespread consensus in the statistical community on the principles articulated in the ASA statement.
“according to widespread consensus in the statistical community”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While the large scale of the Tabula Muris Senis dataset provides substantial power to predict subtle changes in LR interactions, the biological complexity, dependencies among communication pairs, and multiple testing burden require that these p-values be interpreted within a broader biological and statistical context [33].”
From Quantitative profiling of lifespan-dependent cell-cell communication potential reveals dynamic ligand-receptor network shifts across mouse tissues (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These types of incorrect descriptions contribute to confirmation bias, overinterpretation of results, and reporting correlation as implied causation (Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This is especially true of relatively large-sample-size studies (as most learning analytics studies are), which are likely to obtain statistically significant findings in relatively small variations in measures such as GPA (Field 2017; Salkind 2016 Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
In the citing paper
“In 2016, the American Statistical Association released a statement on statistical significance and the P value with six principles underlying the proper use and interpretation of this statistical tool (77).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [77]
In the citing paper
“Although we also present p values for exploratory analyses, we refrain from labeling any of them as statistically significant, following best-practice recommendations for statistical analysis [43].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [43]
In the citing paper
“Contrary to IJE author recommendations and recent guidance from the American Statistics Society, 16 Gao et al. largely base their conclusions on findings with a P -value equivalent to < 0.05 after multiple testing.”
From Commentary: Two-sample Mendelian randomization: opportunities and challenges (2016) · cites this paper as [16]
In the citing paper
“Following guidance,50 we focused on 95% CIs, rather than statistical significance. For example, unlike conventional interpretations, we did not outright interpret an effect estimate “non‐significant” if the lower or upper bound of the 95% CI was slightly above/below the null value; we interpreted them as “suggestive” of an effect.”
From Third‐wave cognitive behaviour therapies for weight management: A systematic review and network meta‐analysis (2020) · cites this paper as [50]
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,745
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946
Smithson, M. J. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Research works printed but not linked: 5
- Leek, J. (2014), “On the Scalability of Statistical Procedures: Why the p-Value Bashers Just Don't Get It,” Simply Statistics Blog, Available at http://simplystatistics.org/2014/02/14/on-the-scalability-of-statistical-procedures-why-the-p-value-bashers-just-dont-get-it/.
- Gelman A. and Loken E. (2014) “The Statistical Crisis in Science [online] ” American Scientist 102. Available at http://www.americanscientist.org/issues/feature/2014/6/the-statistical-crisis-in-science · DOI · Paper page
- Greenland, S., and Poole, C. (2011), “Problems in Common Interpretations of Statistics in Scientific Articles, Expert Reports, and Testimony,” Jurimetrics, 51, 113–129.
- 10.1214/13-AOS1123 · DOI
- Lavine, M. (1999), “What is Bayesian Statistics and Why Everything Else is Wrong,” UMAP Journal, 20, 2.
Cited by
Sorted by citations
Items 5,601–5,700 of 6,272
Escarce, J. J., Rünger, D., Campbell, J. M., & Huckfeldt, P. J. (2025) · Health Services Research · doi:10.1111/1475-6773.14646
“…the criterion for statistical significance, but following recommendations from the American Statistical Association and leading econometricians, we report confidence intervals to communicate the uncertainty of point estimates and exact P values to communicate the strength of the evidence [13, 14].”
van Ginkel, C., Groenewoud, J. M. M., Hoogeboom, T. J., et al. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-092757
“The GETSBI study allows for a comparison between the outcomes of a traditional RCT and the N- of-1 trial methodology, providing a comprehensive evaluation of this methodology’s first use in clinical urologic research.”
Hohmann, M. H., Barnett, A. G., King, N. A., & Connell, S. D. (2025) · Scientometrics · doi:10.1007/s11192-025-05353-8
“Given the very large data set, any statistical tests will almost certainly reject the null hypothesis of no change over time (Wasserstein & Lazar, 2016).”
Can nectary structure in Laeliinae promote or constrain nectar secretion?
Stpiczyńska, M., Pansarin, E. R., Davies, K. L., et al. (2025) · BMC Plant Biology · doi:10.1186/s12870-025-06810-5
“We chose this approach because P -values can be heavily influenced by sample size (i.e. low P -values for small sample sizes, and high P -values for large sample sizes), leading to the misinterpretation of ecologically important results by regarding them to be statistically insignificant [41].”
REMOVED: Ivermectin and COVID-19
Butler, C., Hobbs, R. F., Little, P. S., Richards, D. B., Saville, B. R., & Yu, L. (2025) · Journal of Infection · doi:10.1016/j.jinf.2025.106530
RetractedCerqueira, H. F., Santana, S. D. M., & Cerqueira, C. A. (2025) · Jornal Brasileiro de Psiquiatria · doi:10.1590/0047-2085-2025-0002 · Cited by 2
Bichon, B., Alfama, G., Gaillard, A.-L., Tostivint, H., & Pézeron, G. (2025) · Comparative Biochemistry and Physiology Part A Molecular & Integrative Physiology · doi:10.1016/j.cbpa.2025.111893
BAYAS: simplifying access to Bayesian analysis for biologists
Waterkamp, C., & Hoffmann, D. E. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf276
“Unfortunately, NHSTP is prone to misinterpretation and can lead to apparent replication failures (Wasserstein and Lazar 2016, Amrhein et al. 2019), especially in settings typical for biology with small (costly) samples, small effect sizes, and noisy data (Ioannidis 2005).”
Williams, K. V., Rosner, M., Shantz, C. F., Taylor, E., Satin, A. J., Kush, M., Miller, J. L., & Baschat, A. (2025) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.18248
“To reduce the risk of drawing incorrect conclusions, we consistently included the same set of core variables when comparing sociodemographic factors and reported all test results transparently [25].”
Modeling Soft Skills Development During School-to-Work Programme: A Structural Equation Approach
Graziosi, G., Poliandri, D., & Epifani, G. (2025) · Springer eBooks · doi:10.1007/978-3-031-95995-0_59
Brophy, J. M. (2025) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2025.06.008
Navigating the Replication Crisis in Science: Striving for Solutions
Lovrić, M. (2025) · Springer eBooks · doi:10.1007/978-3-662-69359-9_409
Kulinskaya, E., Morgenthaler, S., & Staudte, R. G. (2025) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-662-69359-9_562
Bayesian Statistics in Pharmaceutical Research
Carlin, B. P., Boulanger, B., & Lesaffre, E. M. E. H. (2025) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-662-69359-9_60
P-Value Chronicles, The: Unmasking Fourteen Widespread Misconceptions
Chamberlain, R. R., Ross, M. W., Long, C. C., & Lovrić, M. (2025) · Springer eBooks · doi:10.1007/978-3-662-69359-9_705
Statistics: Controversies in Practice
Notz, W. I. (2025) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-662-69359-9_630
Rhudy, L. M. (2025) · Journal of Neuroscience Nursing · doi:10.1097/jnn.0000000000000841
Hanley‐Cook, G., Frongillo, E. A., Sattamini, I. F., Ingenbleek, L., Coates, J., & Holmes, B. (2025) · medRxiv · doi:10.1101/2025.06.20.25329980
Halls, D., Leppänen, J., Williams, S., & Tchanturia, K. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1583417
Maintaining an Effective Lab Notebook and Data Integrity
Murphy, A. J., & Kaifi, J. (2025) · Success in academic surgery · doi:10.1007/978-3-031-83034-1_5
Online versus cognitive control: A dividing line between physical action and motor imagery.
Martel, M., & Glover, S. (2025) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0001356
Simple Statistical Tests and P Values
Goldsmith, C. H., Duku, E., Thoma, A., Murphy, J., & Dunn, E. (2025) · Springer eBooks · doi:10.1007/978-3-031-87083-5_27
Soil Data Structure, Properties, and Visualization
Pawlik, Ł. (2025) · Springer textbooks in earth sciences, geography and environment · doi:10.1007/978-3-031-89673-6_3
أرنوط, ب. إ. أ. (2025) · مجلة الإرشاد النفسی · doi:10.21608/cpc.2025.433652
Sharifan, A. (2025) · Journal of Critical Care · doi:10.1016/j.jcrc.2025.155162
Ulloa, J., Velasco, A. A., Kosheleva, O. M., et al. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-97228-7_8
“For example, in many papers, events with probability less than 5% were considered to be impossible – which led to so many irreproducible results that the American Statistical Association (ASA) had to issue a special statement about it [19].”
Reply to: On meta-analytic models and the effect of hydroxychloroquine use in COVID-19
Schmitt, A. M., Axfors, C., Moher, D., et al. (2025) · Nature Communications · doi:10.1038/s41467-025-60479-w
“” 13 .”
REACT to NHST: Sensible conclusions for meaningful hypotheses
Izbicki, R., Cabezas, L. M. C., Colugnati, F. A. B., Lassance, R. F. L., de Souza, A. A. L., & Stern, R. B. (2025) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.21.2.p043 · Cited by 1
“One of the primary challenges of NHST is the diffi-culty in distinguishing between statistical significance and practical significance (Wasserstein & Lazar, 2016).”
Simplifying Academic Knowledge: Why and HowPreprint
Wood, M. (2025) · Qeios · doi:10.32388/rhtt8d.3
Closing a Chapter: A Farewell from the Editor of Statistics in Biopharmaceutical Research
Hamasaki, T. (2025) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2025.2509468
“When I became Editor, the ASA had recently published its “Statement on Statistical Significance and P-Values” (Wasserstein and Lazar 2016), sparking widespread debate across the scientific community.”
Komaroff, E. (2025) · Qeios · doi:10.32388/ps72pk.3
Lewis, K. P., Loughlin, K. G., & Clarke, K. D. (2025) · River Research and Applications · doi:10.1002/rra.70019
Stang, A., Schäfer, H., Idrissi-Yaghir, A., Friedrich, C. M., & Fox, M. P. (2025) · Global Epidemiology · doi:10.1016/j.gloepi.2025.100213 · Cited by 1
“A call from the American Statistical Society and a follow-up editorial by Wasserstein et al. to move into a post p < 0.05 era [12,13] has sparked new interest in change, and a lengthy debate has begun on whether to move away from NHST entirely or to simply change the alpha used within the procedure…”
InfluentialQuantitative models of discounting
Franck, C. T. (2025) · Elsevier eBooks · doi:10.1016/b978-0-323-95745-8.00004-3
Designing for Flow: How Baffle Geometry Shapes Wood Accumulation in Fishways
Błotnicki, J. (2025) · Civil And Environmental Engineering Reports · doi:10.59440/ceer/207954
Schub, R. J. (2025) · doi:10.1093/9780197809334.003.0001
When Certainty Promotes War and Peace
Schub, R. J. (2025) · doi:10.1093/9780197809334.003.0007
Schub, R. J. (2025) · doi:10.1093/9780197809334.002.0004
Schub, R. J. (2025) · doi:10.1093/9780197809334.005.0001
Schub, R. J. (2025) · doi:10.1093/9780197809334.003.0005
Schub, R. J. (2025) · doi:10.1093/9780197809334.001.0001
Schub, R. J. (2025) · doi:10.1093/9780197809334.003.0003
Schub, R. J. (2025) · doi:10.1093/9780197809334.003.0004
Schub, R. J. (2025) · doi:10.1093/9780197809334.003.0008
What You Know Depends on Where You Sit
Schub, R. J. (2025) · doi:10.1093/9780197809334.003.0006
An Informational Theory of Bureaucracies and Conflict
Schub, R. J. (2025) · doi:10.1093/9780197809334.003.0002
Sharma, S. P., Bhatia, A., & Guleria, M. (2025) · Asian Spine Journal · doi:10.31616/asj.2025.0361.r1
OTSUKA, Y., & IWASAKI, Y. (2025) · Cities · doi:10.1016/j.cities.2025.106342 · Cited by 1
Jing, Y., Bailey, G. A., Cheung, S. Y., Griffiths, L. J., & Scourfield, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5388652
Montaletti, G. (2025) · Emerald Group Publishing Limited eBooks · doi:10.1108/s2045-794420250000008008
Production Process Decision-Making Scheme Based on Genetic Algorithm
Chen, S., Li, D., & Wu, Y. (2025) · doi:10.1109/isbdas64762.2025.11116799
Choudhary, A., Choudhary, A., Garg, R. D., et al. (2025) · Innovative Infrastructure Solutions · doi:10.1007/s41062-025-02219-z
“Numerous studies justify this practice [5, 30, 39 – 41] which suggested that drawing conclusions based on the “statistical significance” (i.e., p-value 0.05) data are [11, 43, 44].”
InfluentialStatistical Significance versus Clinical Significance
Madhukumar, R., Mankari, S., & Malekar, R. (2022) · Journal of ophthalmology clinics and research. · doi:10.4103/jocr.jocr_1_25
Why isn’t science better? Look at career incentives
Smaldino, P. E. (2016) · doi:10.64628/aai.wgmrhm6y4
Nakashima, K., Inoue, Y., Iwasaki, T., Fukushige, H., & Ishii, A. (2025) · Journal of Nursing Management · doi:10.1155/jonm/5540600
“Since a p -value, or statistical sig-nifcance, does not measure the size of an efect or the importance of a result [30], we used Clif’s delta to quantify the efect size for group combinations with signifcant diferences.”
Zhao, S. S., Woolf, B. A. R., Rogne, T., & Gill, D. (2025) · Rheumatology Advances in Practice · doi:10.1093/rap/rkaf100
“While the analysis did not reach nominal significance after FDR correction, the American Statistics Association has argued against the interpretation of P -values based on a dichotomous threshold [32].”
la Gala‐Velásquez, B. D., Hurtado‐Palomino, A., Arredondo-Salas, Á. Y., et al. (2025) · Journal of Small Business & Entrepreneurship · doi:10.1080/08276331.2025.2552543
“The test results (F (3,291) ¼ 12.61, p ¼ 0.000) led to the rejection of the null hypothesis (Wasserstein and Lazar 2016), suggesting the existence of a non-linear relationship, thus supporting H1.”
InfluentialFekete, I. (2025) · Springer eBooks · doi:10.1007/978-3-032-02595-1_1
Moody, E. J., Holst, B., Sturges, H. A., Dahl, E., Crume, T., Kaczaniuk, J., Durkin, M. S., Hightshoe, K., Nadler, C. B., Pazol, K., et al. (2025) · Research in Autism · doi:10.1016/j.reia.2025.202705
González, L. V., López, J. P., Orjuela, M. P., et al. (2025) · British Journal of Oral and Maxillofacial Surgery · doi:10.1016/j.bjoms.2025.08.010
EHLAN, K. B., Richardson, Y., Lare, Y., et al. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5467951
Significance testing: Limitations and alternatives
Gorney, K., & Trout, N. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00031-9
Weidman, A. (2025) · Emergency Medicine Journal · doi:10.1136/emermed-2025-215306
Reluctant ratifiers: The crime of aggression at the International Criminal Court
Chiozza, G., & Grieco, J. M. (2025) · International Interactions · doi:10.1080/03050629.2025.2556327
“…results from these tests indicate that we have robust evidence congruent with our expectation that states with a track record of the use force are reluctant to ratify the Kampala Amendments, we are also cognizant of the problems associated with null hypothesis tests (Wasserstein and Lazar 2016).”
Black-Box Bug Amplification for Multithreaded Software
Weiss, Y., Amram, G., Elyasaf, A., Margalit, O., Farchi, E., & Weiss, G. (2025) · Mathematics · doi:10.3390/math13182921
“These results indicate only marginal evidence of superiority, rather than a substantial widening of performance [14].”
Association Between Sexual Orientation and the Impact, Diagnosis, and Treatment of Endometriosis
O’Donnell, S. E., & Abarbanell, L. (2025) · LGBT Health · doi:10.1177/23258292251374717
“30,31 Rather, these results should be interpreted as highlighting emerging possible differences that need to be further tested using a priori hypotheses and appropriate sampling strategies.”
Exploring disparities in open source contribution experiences through the diversity lens of race
Dandamudi, R., Rodríguez-Pérez, G., Nagappan, M., Alegria, S. N., Ventura, F., & Coronel, F. (2026) · Journal of Systems and Software · doi:10.1016/j.jss.2026.113030
den Brok, E. J., Svensson, C. H., Dimitropoulou, N. M., Broeng‐Mikkelgaard, S., Olsen, M. T., Rahman, L. A., Papathanail, I., Wiede, A., Peters, J., Mertens, P. R., et al. (2025) · Diabetic Medicine · doi:10.1111/dme.70140
Humann‐Guilleminot, S., Bailly, A., Monceau, K., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.09.17.676817
Collins, K. S., Bellin, M. H., Osteen, P. J., Bledsoe, S. E., Freeman, P. C., Burton, A., & Seen, H. (2025) · Journal of Child & Adolescent Trauma · doi:10.1007/s40653-025-00759-1
Lolong, D. B., Irianto, J., Kusrini, I., Tarigan, I. U., Letelay, A. M., Tobing, K., Herawati, M. H., Pracoyo, N. E., Isfandari, S., Raflizar, et al. (2025) · Asian Pacific Journal of Tropical Medicine · doi:10.4103/apjtm.apjtm_80_25
Reichenberg, M., Berhanu, G., & Fridlund, L. (2025) · British Educational Research Journal · doi:10.1002/berj.70037
Milanetto, A. C., Armellin, C., Gasparini, D., et al. (2025) · Cancers · doi:10.3390/cancers17193205
“These reporting choices align with guidance from the ASA and subsequent commentaries that recommend moving beyond strict “statistical significance” dichotomies [28].”
Science between evidence and illusion
Lederer, W. (2024) · The Evidence · doi:10.61505/evidence.2024.2.3.95
Comparative Assessment of Egg Quality Across Farming Systems and Stages of Laying Cycle
Stavropoulos, I.-E., Basdagianni, Z., Manessis, G., et al. (2025) · Applied Sciences · doi:10.3390/app151910693
Spatial pattern analysis: From the perspective of spatial autocorrelation
Luo, Q., Lu, B., & Wu, H. (2025) · Elsevier eBooks · doi:10.1016/b978-0-443-26629-4.00110-6
Mitchell, P. D., Blanco, J., Chomicki, M., et al. (2025) · Journal of Pediatric Orthopaedics · doi:10.1097/bpo.0000000000003123
Usami, S. (2025) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2025.2562475
“…on null-hypothesis significance testing has been criticized, as rejecting the null hypothesis alone does not offer meaningful insights because, strictly speaking, the null hypothesis is almost never true in practice (e.g., Cohen, 1994; Sedlmeier, 2009; Usami, 2020; Wasserstein & Lazar, 2016).”
Piscitelli, S., Ponti, G., Civitani, M. M., & Spiga, D. (2025) · Astronomy and Astrophysics · doi:10.1051/0004-6361/202555325
“The test returns a p-value p ≈ 1 (Wasserstein & Lazar 2016) for all pairs of images, supporting the assumption that straylight patterns remain stable over time.”
Robbennolt, D., Beliveau, A., & Bhat, C. R. (2025) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2025.104696
Rammon, J., Tolliver, E. A., Storandt, R., Sosnoff, C., Wang, L.-Q., Drobeniuc, J., Pfeiffer, C. M., Schleicher, R., Powers, C., Mineva, E. M., et al. (2025) · Biopreservation and Biobanking · doi:10.1177/19475535251382352
Gridded oceanographic data-based tridacnine oxygen isotope thermometers: advantages and problems
Oda, H., Tanaka, S., Takayanagi, H., et al. (2025) · Progress in Earth and Planetary Science · doi:10.1186/s40645-025-00769-5
“As Wasserstein and Lazar (2016) argued, the p -value itself does not indicate the magnitude of the effect or the importance of the results.”
Dzhambov, A. M., Lercher, P., Spilski, J., Rüdisser, J., Browning, M. H. E. M., & Markevych, I. (2025) · International Journal of Hygiene and Environmental Health · doi:10.1016/j.ijheh.2025.114683
What’s changing? Maternal behaviour and egg sac chemistry in the wolf spider Pardosa paludicola
Suprunowicz, U., Kostro‐Ambroziak, A., Stocki, M., et al. (2025) · The European Zoological Journal · doi:10.1080/24750263.2025.2562906
“Following this approach, we focussed on evaluating the effect sizes and biological importance of the observed patterns, rather than solely relying on the statistical significance of the results (Wasserstein & Lazar 2016).”
Neutrality Boundary Fragility: A Geometric Framework for Statistical StabilityPreprint
Heston, T. F. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5636470
Decision Rules in Frequentist and Bayesian Hypothesis Testing: P-Value and Bayes Factor
Nicolao, G. D., Fordellone, M., Schiattarella, P., et al. (2025) · Epidemiology Biostatistics and Public Health · doi:10.54103/2282-0930/29432
Response to Schneeweiss et al, “Recognizing and avoiding pitfalls and bias in database research”
Meisenheimer, J. L., Dellavalle, R. P., Solomon, J. A., et al. (2025) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2025.10.083
Xia, J., Ni, Y., Su, Y., & Li, B. (2025) · International Journal of Educational Management · doi:10.1108/ijem-01-2024-0009 · Cited by 3
Analysis of the Block Size Effects on the Extreme Wave Data Independence
Jeong, T.-S., & Cho, H.-Y. (2025) · 한국해안·해양공학회논문집 · doi:10.9765/kscoe.2025.37.5.219
Longaretti, Y., Cheron, G. A., & Zarka, D. (2025) · The Journal of Psychology · doi:10.1080/00223980.2025.2575309
Jiang, J., & Xiang-ming, Z. (2025) · PLoS ONE · doi:10.1371/journal.pone.0334186 · Cited by 1
“While p -values indicate statistical significance, they do not assess the magnitude or practical significance of an effect [79,80].”
The pursuitworthiness of experiments in neurolinguistics
Dolcini, N., Jap, B. A. J., Kun, C. W., & Politzer‐Ahles, S. (2025) · European Journal for Philosophy of Science · doi:10.1007/s13194-025-00691-z · Cited by 1
“Cumming (2014) and Wasserstein and Lazar (2016) argue that point estimates accompanied by confidence intervals provide more informative evidence than dichotomous significance testing.”
Bastos, A. F., Oliveira, L., Pereira, M. G., Mendlowicz, M. V., Berger, W., Cardoso, A. R., Volchan, E., & Erthal, F. S. (2025) · Journal of Child & Adolescent Trauma · doi:10.1007/s40653-025-00788-w
Some misinterpretations of Inferential statistics in dental public health literature
Alshihayb, T. S., Alnasser, L. A., Al-Soneidar, W. A., & Mansournia, M. A. (2025) · BMC Oral Health · doi:10.1186/s12903-025-06962-8
“Despite the American Statistical Association’s call for reporting CIs in research in 2016 [9], the authors found that seven years later, the authors of studies published in the five DPH journals still reported p-values considerably more than confidence intervals.”
InfluentialA specifically designed handkerchief for skin‐to‐skin care: A randomized controlled trial in Spain
Vidal, M. B., Gálvez‐Barrón, C., Pérez‐López, C., et al. (2025) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.70635
(2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64802-799-420251029
Long-term Associations of COVID-19 Severity with Cognition and Mental Health in an Indian CohortPreprint
Biswas, A., Pamnani, V., Srivastava, P., & Sreekumar, V. (2025) · medRxiv · doi:10.1101/2025.11.17.25340384
Lajeunesse, M., & Dougherty, C. A. (2025) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2025.07.029
"No Difference or Missed Difference?" Revisiting Functional Gains in Low Back Pain.
Lei, Z.-H. (2025) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2025.07.028
Metadata
- Authors
- Wasserstein, R. L., & Lazar, N. A.
- Affiliations
- American Statistical Association, 732 North Washington Street, Alexandria, VA 22314-1943
- American Statistical Association (US)
- ORCID
- Lazar, Nicole A.
- Venue
- The American Statistician
- Publisher
- Informa UK Limited
- Published
- 2016-04-02
- Volume
- 70
- Issue
- 2
- Pages
- 129-133
- ISSN
- 0003-1305 (ISSN-L)
- 1537-2731
- OpenAlex
- W2293040502
- Semantic Scholar
- 81a65f23474ffceb2481836328608102950da979
- Cited by
- 6,306
- References
- 45
- Citations by year
- 2026: 625 · 2025: 629 · 2024: 575 · 2023: 543 · 2022: 642 · 2021: 676 · 2020: 678 · 2019: 666 · 2018: 596 · 2017: 438 · 2016: 226
- FWCI
- 649.74
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The American Statistician (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- p-values, statistical evidence, p-value interpretation, statistical inference, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
