The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index; none of the 1 sources its claims cite is checked for support yet.
The ASA Statement on p -Values: Context, Process, and Purpose
Open accessAbstract
Emeritus of Mathematics and Statistics at
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
24 Own interpretation · 2 No basis given · 1 No full text of the sources
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The widespread use of”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Statistical significance is not equivalent to scientific, human, or economic significance.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, a p-value near 0.05 taken by itself offers only weak evidence against the null hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By itself, a p-value does not provide a good measure of evidence regarding a model or hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similarly, identical estimated effects will have different p-values if the precision of the estimates differs.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A p-value provides one approach to summarizing the incompatibility between a particular set of data and a proposed model for the data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Conducting multiple analyses of the data and reporting only those with certain p-values (typically those passing a significance threshold) renders the reported p-values essentially uninterpretable.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Whenever a researcher chooses what to present based on statistical results, valid interpretation of those results is severely compromised if the reader is not informed of the choice and its basis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The smaller the p-value, the greater the statistical incompatibility of the data with the null hypothesis, if the underlying assumptions used to calculate the p-value hold.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Valid scientific conclusions based on p-values and related statistics cannot be drawn without at least knowing how many and which analyses were conducted, and how those analyses (including p-values) were selected for reporting.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 10
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This has led to some scientific journals discouraging the use of p-values, and some scientists and statisticians recommending their abandonment, with some arguments essentially unchanged since p-values were first introduced.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The statistical community has been deeply concerned about issues of reproducibility and replicability of scientific conclusions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the p-value can be a useful statistical measure, it is commonly misused and misinterpreted.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A conclusion does not immediately become”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All these measures and approaches rely on further assumptions, but they may more directly address the size of an effect (and its associated uncertainty) or whether the hypothesis is correct.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The validity of scientific conclusions, including their reproducibility, depends on more than the statistical methods themselves.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is a statement about data in relation to a specified hypothetical explanation, and is not a statement about the explanation itself.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Researchers should recognize that a p-value without context or other evidence provides limited information.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Likewise, a relatively large p-value does not imply evidence in favor of the null hypothesis; many other hypotheses may be equally or more consistent with the observed data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This incompatibility can be interpreted as casting doubt on or providing evidence against the null hypothesis or the underlying assumptions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Appropriately chosen techniques, properly conducted analyses and correct interpretation of statistical results also play a key role in ensuring that conclusions are sound and that uncertainty surrounding them is represented properly.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Misunderstanding or misuse of statistical inference is only one cause of the”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
What the sources say
- Not checked — no full text of the sourcecites Peng 2015 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Smaller p-values do not necessarily imply the presence of larger or more important effects, and larger p-values do not imply a lack of importance or even lack of effect.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In view of the prevalent misuses of and misconceptions concerning p-values, some statisticians prefer to supplement or even replace p-values with other approaches.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
There is widespread consensus in the statistical community on the principles articulated in the ASA statement.
“according to widespread consensus in the statistical community”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While the large scale of the Tabula Muris Senis dataset provides substantial power to predict subtle changes in LR interactions, the biological complexity, dependencies among communication pairs, and multiple testing burden require that these p-values be interpreted within a broader biological and statistical context [33].”
From Quantitative profiling of lifespan-dependent cell-cell communication potential reveals dynamic ligand-receptor network shifts across mouse tissues (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These types of incorrect descriptions contribute to confirmation bias, overinterpretation of results, and reporting correlation as implied causation (Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This is especially true of relatively large-sample-size studies (as most learning analytics studies are), which are likely to obtain statistically significant findings in relatively small variations in measures such as GPA (Field 2017; Salkind 2016 Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
In the citing paper
“In 2016, the American Statistical Association released a statement on statistical significance and the P value with six principles underlying the proper use and interpretation of this statistical tool (77).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [77]
In the citing paper
“Although we also present p values for exploratory analyses, we refrain from labeling any of them as statistically significant, following best-practice recommendations for statistical analysis [43].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [43]
In the citing paper
“Contrary to IJE author recommendations and recent guidance from the American Statistics Society, 16 Gao et al. largely base their conclusions on findings with a P -value equivalent to < 0.05 after multiple testing.”
From Commentary: Two-sample Mendelian randomization: opportunities and challenges (2016) · cites this paper as [16]
In the citing paper
“Following guidance,50 we focused on 95% CIs, rather than statistical significance. For example, unlike conventional interpretations, we did not outright interpret an effect estimate “non‐significant” if the lower or upper bound of the 95% CI was slightly above/below the null value; we interpreted them as “suggestive” of an effect.”
From Third‐wave cognitive behaviour therapies for weight management: A systematic review and network meta‐analysis (2020) · cites this paper as [50]
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,745
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946
Smithson, M. J. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Research works printed but not linked: 5
- Leek, J. (2014), “On the Scalability of Statistical Procedures: Why the p-Value Bashers Just Don't Get It,” Simply Statistics Blog, Available at http://simplystatistics.org/2014/02/14/on-the-scalability-of-statistical-procedures-why-the-p-value-bashers-just-dont-get-it/.
- Gelman A. and Loken E. (2014) “The Statistical Crisis in Science [online] ” American Scientist 102. Available at http://www.americanscientist.org/issues/feature/2014/6/the-statistical-crisis-in-science · DOI · Paper page
- Greenland, S., and Poole, C. (2011), “Problems in Common Interpretations of Statistics in Scientific Articles, Expert Reports, and Testimony,” Jurimetrics, 51, 113–129.
- 10.1214/13-AOS1123 · DOI
- Lavine, M. (1999), “What is Bayesian Statistics and Why Everything Else is Wrong,” UMAP Journal, 20, 2.
Cited by
Sorted by citations
Items 4,701–4,800 of 6,272
The Bayesian New Statistics (Public)Preprint
Kruschke, J. K., & Liddell, T. M. (2017) · doi:10.31234/osf.io/wntsa · Cited by 1
Fertility and social interaction - a simulation approach
Pink, S. (2017) · MADOC (University of Mannheim) · Cited by 1
Towards Predictive Medicine — On Remote Monitoring, Privacy and Scientific Bias
Aranki, D. (2017) · UC Berkeley · Cited by 1
Tmava, A. M. (2017) · University of North Texas Digital Library (University of North Texas) · doi:10.12794/metadc1062881 · Cited by 1
Teaching Our Students about Evidence
Klawitter, M. (2017) · Journal of Public Affairs Education · doi:10.1080/15236803.2017.12002267 · Cited by 1
Generation of Automatic and Realistic Artificial ProfilesPreprint
Paradise, A., Cohen, D., Shabtai, A., et al. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1807.00125 · Cited by 1
Machine Learning Macroeconometrics: A PrimerPreprint
Korobilis, D. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3246473 · Cited by 1
“In contrast, a p-value is not the probability that the null hypothesis is true, which many times has lead to their misinterpretation in scientific and academic studies; see the American Statistical Association’s statement on p-values in Wasserstein and Lazar (2016).”
Critical Evaluation of Data Requires Rigorous but Broadly Based Statistical Inference
Cox, N. J., & Below, J. E. (2018) · Circulation Research · doi:10.1161/circresaha.118.312530 · Cited by 1
“Still, others propose approaches such as decision-theoretical modeling and improved use of false discovery rates.(1) Importantly, Mark et al(12) remind us that the “clinical or scientific importance of study results is a judgment integrating multiple elements, including effect size (expected and observed), precision o…”
Brownstein, N. C. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1809.04721 · Cited by 4
“Additionally, p-values can be considered just one piece of evidence to be evaluated with other factors, such as study design quality and effect size (Spurlock 2017, Wasserstein & Lazar 2016).”
BackgroundEvaluating model estimation processes for diagnostic classification modelsPreprint
Thompson, W. J. (2020) · doi:10.31237/osf.io/vke5u · Cited by 1
Liao, J., Midya, V., & Berg, A. S. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.03153 · Cited by 1
“The limitation of the frequentist hypothesis testing is well documented (Wasserstein et al., 2016).”
BackgroundKorologou‐Linden, R., O’Keeffe, L. M., Howe, L. D., Smith, G. D., Jones, H. J., Anderson, E. L., & Stergiakouli, E. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/580548 · Cited by 1
Wycoff, N., Balaprakash, P., & Xia, F. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.12904 · Cited by 1
“ceable loss 1A common criticism of KS tests (and general point-null hypothesis testing) is that for large sample sizes, even the smallest discrepancy will cause the test to reject the null hypothesis [24]. It is likely that we could consistently get results indicating that the two predictive distributions are differen…”
ResultSignificance Testing in Accounting Research: A Critical Evaluation Based on EvidencePreprint
Kim, J. H., Ji, P. I., & Ahmed, K. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3032438 · Cited by 1
Statistical comparison of classifiers through Bayesian hierarchical modellingPreprint
Corani, G., Benavoli, A., Demšar, J., et al. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1609.08905 · Cited by 1
“Null hypotheses can virtually always be rejected by increasing the sample size (Wasserstein & Lazar, 2016), since the p-value depends both on the actual difference between the two classifiers and number of collected observations.”
BackgroundBootstrap Cross-Validation Improves Model Selection in Pharmacometrics
Cavenaugh, J. S. (2020) · Figshare · doi:10.6084/m9.figshare.13194899 · Cited by 1
Commentary: Confidence intervals are only one piece of the puzzle
Zurakowski, D., & Staffa, S. J. (2020) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2020.02.029 · Cited by 1
Analysis of Variance and hypothesis testing
McIntosh, M. S. (2018) · ASSA, CSSA and SSSA · doi:10.2134/appliedstatistics.2016.0009.c2 · Cited by 1
A fast Monte Carlo test for preferential samplingPreprint
Watson, J. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.01319 · Cited by 1
An investigation of polyamide 6 and 12 synthesis in an oscillatory baffled reactor
Laska, R. D. F. (2019) · Cited by 1
Kelter, R. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1906.07524 · Cited by 1
“The misuse and drawbacks of pvalues in medical research have been detailed in a variety of papers, including an official ASA statement in 2016 [32].”
BackgroundBinkley, D. (2020) · Trees Forests and People · doi:10.1016/j.tfp.2020.100010 · Cited by 1
Examining instructor and instructional effects on students' statistics attitudes
Xu, C. (2019) · Cited by 1
24-hour Holter findings in infants with in utero exposure to Zika virus: a cross-sectional study.Preprint
Orofino, D. H. G., Passos, S. R. L., Pone, S. M., et al. (2019) · Research Square · doi:10.21203/rs.2.14894/v1 · Cited by 1
Kliesch, M., Giroud, N., & Meyer, M. E. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.10.03.324640 · Cited by 1
Invited commentary: On influence and significance in quality improvement/process improvement studies
Heilbrun, M. E. (2020) · Abdominal Radiology · doi:10.1007/s00261-020-02778-y · Cited by 1
Batley, P. N., Boedeker, P., & Onwuegbuzie, A. J. (2020) · International Journal of Multiple Research Approaches · doi:10.29034/ijmra.v12n1editorial2 · Cited by 2
Field Testing Anti-Speeding MessagesPreprint
Glendon, A. I., & Lewis, I. M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4188628 · Cited by 1
Causality from the Point of View of StatisticsPreprint
Ferreira, J. A. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1908.07301 · Cited by 1
Theilacker, C., Jódar, L., & Gessner, B. D. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2020.12.015 · Cited by 1
Altman, M. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3126147 · Cited by 1
The Dozen Things Experimental Economists Should Do (More Of)Preprint
Czibor, E., Jimenez‐Gomez, D., & List, J. A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3313734 · Cited by 2
Towards More Effective and Transferable Transition Experiments – Learning Through StratificationPreprint
Engler, J., Zimmermann, H., Lang, D. J., et al. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3145112 · Cited by 1
Greenland, S. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05569 · Cited by 1
“Shafer offers a betting perspective on statistical testing which may be useful for foundational debates, given that disputes over such testing continue to be intense (e.g., see the special issues of TAS introduced by Wasserstein and Lazar 2016 and Wasserstein et al. 2019).”
BackgroundMeta-Analysis in Finance Research: Opportunities, Challenges, and Contemporary ApplicationsPreprint
Geyer‐Klingeberg, J., Hang, M., & Rathgeber, A. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3469150 · Cited by 1
Rassen, J. A., Murk, W. K., & Schneeweiß, S. (2021) · Diabetes Obesity and Metabolism · doi:10.1111/dom.14404 · Cited by 1
“05 is explicitly discouraged.(6) Rather, we are reassured by the consistent demonstration of the expected increased risk of our two tracer outcomes, cholelithiasis and B12 deficiency anaemia across analyses A1 to A5.”
BackgroundIsaac, N. (2020) · Unisa Institutional Repository (University of South Africa) · Cited by 1
Statistical Assessment of Replicability via Bayesian Model CriticismPreprint
Zhao, Y., & Wen, X. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2105.03993 · Cited by 1
“Additionally, our use and subsequent interpretations of p -values in the context of replicability assessment strictly follow the ASA’s statement on p -values [46].”
MethodEstudios de Replicación, Pre-registros y Ciencia Abierta en PsicologíaPreprint
García‐Garzón, E., Lecuona, O. Z., & Carbajal, G. V. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/u3a6r · Cited by 2
Replication of Quasi-Experimental Population Studies: Motivation and GuidancePreprint
Cready, W. M. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3803428 · Cited by 1
Suzuki, A. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2108.05100 · Cited by 1
Grüner, S. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3351911 · Cited by 1
Ten simple rules for good research practicePreprint
Schwab, S., Janiaud, P., Dayan, M., Amrhein, V., Panczak, R., Palagi, P. M., Hemkens, L. G., Ramon, M., Rothen, N., Senn, S. J., et al. (2021) · doi:10.31219/osf.io/am5ck · Cited by 1
Statistical Inferential Testing
Webster, R. (2021) · Encyclopedia of earth sciences series/Encyclopedia of earth sciences · doi:10.1007/978-3-030-26050-7_459-1 · Cited by 1
The Digital Experiment Reporting Protocol (DERP)Preprint
Weinmann, M., Schneider, C., & Valacich, J. S. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3985991 · Cited by 1
Teaching open science analytics in the age of financial technologyPreprint
Quinn, B. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4019430 · Cited by 1
The Theory of Quantitative TradingPreprint
Berdondini, A. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3994764 · Cited by 1
“We use very similar approaches, where the strategy being evaluated is compared with an equivalent random strategy, in the financial field to analyse the results generated by a trading strategy [7], [8].”
MethodClearer Analysis, Interpretation, and Communication in Organizational Research: A Bayesian GuidePreprint
Courey, K. A., Oswald, F. L., & Culpepper, S. (2022) · doi:10.31219/osf.io/z9xd6 · Cited by 1
Juvenile Graphical Perception: A Comparison between Children and AdultsPreprint
Panavas, L., Worth, A. E., Crnovrsanin, T., et al. (2022) · doi:10.31219/osf.io/r3dy2 · Cited by 1
Cotton, J., Swanson, J. M., Sonuga-Barke, E. J. S., & KRAEMER, H. C. (2022) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2022.03.062 · Cited by 1
Forecast Intervals for Infectious Disease ModelsPreprint
Picard, R., & Osthus, D. (2022) · medRxiv · doi:10.1101/2022.04.29.22274494 · Cited by 1
“That is, scientists were misled for years to believe apparent data-based p-values provided much greater certainty than was warranted, a problem that had long been recognized by the American Statistical Association (Wasserstein and Lazar, 2016) and statistics community in general.”
BackgroundNissen, J. M., Dusen, B. V., & Kukday, S. (2022) · bioRxiv · doi:10.1101/2022.05.05.490808 · Cited by 2
“…use of p-values in research has been problematic enough for the American Statistical Association to put out an initial statement on its use in 2016 (Wasserstein & Lazar, 2016) and a second one in 2019 (Wasserstein et al., 2019) that was accompanied by 43 publications offering alternative solutions.”
MethodCahusac, P. (2020) · doi:10.1002/9781119549833.app3 · Cited by 1
Tackling False Positives in Finance: A Statistical Toolbox with ApplicationsPreprint
Kim, J. H. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3217003 · Cited by 1
(2016) · Journal of the American Veterinary Medical Association · doi:10.2460/javma.250.1.39 · Cited by 1
Latent Semantic Analysis Applied to Authorship Questions in Textual AnalysisPreprint
Marshall, C. Z., & Buchanan, E. M. (2017) · doi:10.31219/osf.io/zpsd7 · Cited by 1
“Our work reinforces the329 reliability of findings in traditionally less statistically driven research areas, such as religious330 studies and linguistics and fits in line with recent movements in statistical thinking331 (Wasserstein & Lazar 2016).”
Bayesian statistics improves biological interpretability of metabolomics data from human cohortsPreprint
Brydges, C. R., Che, X., Lipkin, W. I., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.05.17.492312 · Cited by 1
Accounting Research's 'Flat Earth' ProblemPreprint
Cready, W. M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4115822 · Cited by 1
Mündt, T., Heinemann, F., Müller, J., et al. (2022) · Research Square · doi:10.21203/rs.3.rs-1900113/v1 · Cited by 1
Webster, R. (2022) · Elsevier eBooks · doi:10.1016/b978-0-12-822974-3.00002-1 · Cited by 1
Imbens, G. W. (2022) · Journal of the American Statistical Association · doi:10.1080/01621459.2022.2102501 · Cited by 1
“In such cases the common focus on p-values and statistical significance is inappropriate, as discussed in the ASA statement in Wasserstein and Lazar (2016).”
BackgroundCognitive status and rehabilitation outcomes of patients in acute rehabilitation post Covid-19Preprint
Vahtra, M., Fahey, K., Malina, A. C., Dreyer, S. D., Roth, E. J., Grafman, J. H., Jayabalan, P. S., & Cohen‐Zimerman, S. (2022) · medRxiv · doi:10.1101/2022.09.10.22279806 · Cited by 1
Haitani, T. (2022) · doi:10.31234/osf.io/ab2tv · Cited by 1
Letter to the Editor: What is the value of statistical testing of observational data?
de Souza, A. F., de Souza, A. A., & Zoppa, A. L. D. V. D. (2022) · Veterinary Surgery · doi:10.1111/vsu.13904 · Cited by 1
Pick, J. L., Kasper, C., Allegue, H., et al. (2022) · doi:10.32942/x27g6w · Cited by 1
Fornacon-Wood, I., Mistry, H. B., Price, G. J., Finn, C. F., & O’Connor, J. P. B. (2022) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2022.08.048 · Cited by 1
Ків, А. Ю., Semerikov, S. O., Соловйов, В. М., & Стрюк, А. М. (2022) · doi:10.31812/123456789/6983 · Cited by 1
Sun, J., & Xie, Y. (2023) · Journal of Clinical Oncology · doi:10.1200/jco.23.00332 · Cited by 1
Review of: "Strategic Citations in Patents: Analysis Using Machine Learning"
Zanella, G. (2023) · doi:10.32388/3eh8ks · Cited by 1
Adamowicz, M. A., Gortat, T., Czortek, P., et al. (2023) · Research Square · doi:10.21203/rs.3.rs-3087033/v1 · Cited by 1
Halperin, J. L., & Rothman, K. J. (2023) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2023.08.037 · Cited by 1
(2023) · Gifted Child Quarterly · doi:10.1177/00169862231199745 · Cited by 1
“In recent years, the “ASA Statement on Statistical Significance and p -Values” (Wasserstein & Lazar, 2016) and others have warned against dichotomizing results into significant and not significant using p -values as the sole marker of association.”
MethodObsessive-compulsive severity, gender, and religiosity as predictors of personality trait scores
Muller, G. N., Zaboski, B., Joyce-Beaulieu, D., Bailey, B., McCarty, R. J., Olsen, B., & McNamara, J. P. H. (2023) · Bulletin of the Menninger Clinic · doi:10.1521/bumc.2023.87.4.317 · Cited by 1
Abandon Statistical Significance: A Gentle Introduction to S-values and S-intervalsPreprint
Rovetta, A. (2024) · doi:10.31219/osf.io/ywhu9 · Cited by 1
Rovetta, A., & Mansournia, M. A. (2024) · doi:10.31219/osf.io/ur5at · Cited by 1
Phytoplankton Biomass in Northern Lakes Reveals a Complex Response to Global ChangesPreprint
Paltsev, A., Bergström, A., Vuorio, K. M., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4747926 · Cited by 1
Bove, F. (2024) · Research Square · doi:10.21203/rs.3.rs-4171975/v1 · Cited by 1
Xia, J. (2024) · Educational Administration Quarterly · doi:10.1177/0013161x241242599 · Cited by 2
Danka, M. N., Steptoe, A., & Iob, E. (2025) · Psychoneuroendocrinology · doi:10.1101/2024.04.14.24305797 · Cited by 1
“We followed guidelines aiming to improve statistical inference [50, 51].”
Evolutionary paleoecology of European rhinocerotids across the Oligocene-Miocene transitionPreprint
Hullot, M., Martin, C., Blondel, C., et al. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.04.17.589495 · Cited by 1
“Following the recent statement of the American Statistical Association (ASA) on p-values [70], we favored giving exact values and we tried to be critical regarding the classical thresholds of “statistical significativity”.”
MethodKomaroff, E. (2024) · Qeios · doi:10.32388/ps72pk · Cited by 1
Simonson, M. A. (2024) · doi:10.31274/td-20240617-139 · Cited by 1
Komaroff, E. (2024) · Qeios · doi:10.32388/ps72pk.2 · Cited by 1
Nadeau, K. C., Kashtan, Y. S., Nicholson, M., Finnegan, C. J., Ouyang, Z., Garg, A., Lebel, E. D., Rowland, S. T., Michanowicz, D. R., & Jackson, R. B. (2024) · Global Epidemiology · doi:10.1016/j.gloepi.2024.100172 · Cited by 1
“…cutoff that Cox uses is arbitrary, is largely a function of study size, and ignores potentially more important factors such as how large the association is (effect size), how well-crafted the study or studies are, and what degree of uncertainty is appropriate for the association in question [29].”
Statistics in biology: a survey of the three major multidisciplinary journalsPreprint
Mazoit, J. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.02.04.636422 · Cited by 1
Ackley, S. F., Andrews, R. M., Seaman, C., Flanders, M. D., Chen, R., Wang, J., Lopes, G., Sims, K. D., Buto, P. T., Ferguson, E. L., et al. (2025) · medRxiv · doi:10.1101/2025.02.13.25322235 · Cited by 1
The application of the reverse fragility index to randomized controlled trials in hand surgery
Ahdoot, R., Pottepalem, B., Benítez, T. M., Wang, C.-W., & Chung, K. C. (2025) · Journal of Hand Surgery (European Volume) · doi:10.1177/17531934251327880 · Cited by 1
“The commonly accepted threshold is a p -value of 0.05 (Freiman et al., 1978; Wasserstein and Lazar, 2016), indicating that the probability of an observed difference occurring by random chance is less than 5%, attributing the difference to the intervention (Thoma et al., 2004; Walsh et al., 2014).”
InfluentialA global P-Process map to avoid P-value abusePreprint
Xu, J., Wei, S., Tao, J., Sun, C., Chen, H., Duan, L., Shang, Z., Lyu, W., Lyu, H., Zhang, M., et al. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.04.06.646254 · Cited by 1
Rieger, D. J. (2024) · Carleton University's Institutional Repository (MacOdrum Library, Carleton University) · doi:10.22215/etd/2024-16459 · Cited by 1
Humann‐Guilleminot, S., Bretagnolle, V., & Gaba, S. (2025) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2025.05.21.654858 · Cited by 1
Heckler, A. F., Henderson, R. J., Kuo, E., Nissen, J., Stelzer, T. J., & Wilcox, B. R. (2025) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.21.020001 · Cited by 1
The Intervention Fragility Quotient: An Improved Metric for Assessing Robustness in Clinical TrialsPreprint
Heston, T. F. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5425334 · Cited by 1
JECH : Methodological recommendations
Katikireddi, S. V., & Pearce, A. (2025) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2025-225647 · Cited by 1
Habasque, P. (2020) · theses.fr (ABES) · doi:10.70675/e32575b6zb191z44bfz970fzdf1e7fa764fc · Cited by 1
Diter, K. (2019) · theses.fr (ABES) · doi:10.70675/1cbf94ffzffa6z4c5bz8f07z0df6979937fc · Cited by 1
Wei, B., Troendle, E. P., Simpson, D. A., & Stitt, A. W. (2026) · PLoS ONE · doi:10.1371/journal.pone.0345045
“…the Tabula Muris Senis dataset provides substantial power to predict subtle changes in LR interactions, the biological complexity, dependencies among communication pairs, and multiple testing burden require that these p-values be interpreted within a broader biological and statistical context [33].”
Zhan, X., & Liu, X. (2026) · Educational Administration Quarterly · doi:10.1177/0013161x261418738
“We report effect sizes and their 95% con fi dence intervals, exact p-values and the coef fi cient of determination (R 2 ) to provide non-dichotomous information (Cumming, 2014; Wasserstein & Lazar, 2016; Wasserstein et al., 2019).”
Características de usuários de crack quanto à situação de moradia no Nordeste brasileiro, 2011-2013
dos Santos, R. R., Hacker, M. A., da Mota, J. C., & Bastos, F. I. (2022) · Ciência & Saúde Coletiva · doi:10.1590/1413-81232022276.16522021
Metadata
- Authors
- Wasserstein, R. L., & Lazar, N. A.
- Affiliations
- American Statistical Association, 732 North Washington Street, Alexandria, VA 22314-1943
- American Statistical Association (US)
- ORCID
- Lazar, Nicole A.
- Venue
- The American Statistician
- Publisher
- Informa UK Limited
- Published
- 2016-04-02
- Volume
- 70
- Issue
- 2
- Pages
- 129-133
- ISSN
- 0003-1305 (ISSN-L)
- 1537-2731
- OpenAlex
- W2293040502
- Semantic Scholar
- 81a65f23474ffceb2481836328608102950da979
- Cited by
- 6,306
- References
- 45
- Citations by year
- 2026: 625 · 2025: 629 · 2024: 575 · 2023: 543 · 2022: 642 · 2021: 676 · 2020: 678 · 2019: 666 · 2018: 596 · 2017: 438 · 2016: 226
- FWCI
- 649.74
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The American Statistician (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- p-values, statistical evidence, p-value interpretation, statistical inference, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
