The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index; none of the 1 sources its claims cite is checked for support yet.
The ASA Statement on p -Values: Context, Process, and Purpose
Open accessAbstract
Emeritus of Mathematics and Statistics at
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
24 Own interpretation · 2 No basis given · 1 No full text of the sources
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The widespread use of”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Statistical significance is not equivalent to scientific, human, or economic significance.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, a p-value near 0.05 taken by itself offers only weak evidence against the null hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By itself, a p-value does not provide a good measure of evidence regarding a model or hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similarly, identical estimated effects will have different p-values if the precision of the estimates differs.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A p-value provides one approach to summarizing the incompatibility between a particular set of data and a proposed model for the data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Conducting multiple analyses of the data and reporting only those with certain p-values (typically those passing a significance threshold) renders the reported p-values essentially uninterpretable.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Whenever a researcher chooses what to present based on statistical results, valid interpretation of those results is severely compromised if the reader is not informed of the choice and its basis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The smaller the p-value, the greater the statistical incompatibility of the data with the null hypothesis, if the underlying assumptions used to calculate the p-value hold.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Valid scientific conclusions based on p-values and related statistics cannot be drawn without at least knowing how many and which analyses were conducted, and how those analyses (including p-values) were selected for reporting.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plainstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 10
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This has led to some scientific journals discouraging the use of p-values, and some scientists and statisticians recommending their abandonment, with some arguments essentially unchanged since p-values were first introduced.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The statistical community has been deeply concerned about issues of reproducibility and replicability of scientific conclusions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the p-value can be a useful statistical measure, it is commonly misused and misinterpreted.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A conclusion does not immediately become”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All these measures and approaches rely on further assumptions, but they may more directly address the size of an effect (and its associated uncertainty) or whether the hypothesis is correct.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The validity of scientific conclusions, including their reproducibility, depends on more than the statistical methods themselves.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is a statement about data in relation to a specified hypothetical explanation, and is not a statement about the explanation itself.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Researchers should recognize that a p-value without context or other evidence provides limited information.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Likewise, a relatively large p-value does not imply evidence in favor of the null hypothesis; many other hypotheses may be equally or more consistent with the observed data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This incompatibility can be interpreted as casting doubt on or providing evidence against the null hypothesis or the underlying assumptions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Appropriately chosen techniques, properly conducted analyses and correct interpretation of statistical results also play a key role in ensuring that conclusions are sound and that uncertainty surrounding them is represented properly.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Misunderstanding or misuse of statistical inference is only one cause of the”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
What the sources say
- Not checked — no full text of the sourcecites Peng 2015 source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Smaller p-values do not necessarily imply the presence of larger or more important effects, and larger p-values do not imply a lack of importance or even lack of effect.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In view of the prevalent misuses of and misconceptions concerning p-values, some statisticians prefer to supplement or even replace p-values with other approaches.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
There is widespread consensus in the statistical community on the principles articulated in the ASA statement.
“according to widespread consensus in the statistical community”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While the large scale of the Tabula Muris Senis dataset provides substantial power to predict subtle changes in LR interactions, the biological complexity, dependencies among communication pairs, and multiple testing burden require that these p-values be interpreted within a broader biological and statistical context [33].”
From Quantitative profiling of lifespan-dependent cell-cell communication potential reveals dynamic ligand-receptor network shifts across mouse tissues (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These types of incorrect descriptions contribute to confirmation bias, overinterpretation of results, and reporting correlation as implied causation (Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This is especially true of relatively large-sample-size studies (as most learning analytics studies are), which are likely to obtain statistically significant findings in relatively small variations in measures such as GPA (Field 2017; Salkind 2016 Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
In the citing paper
“In 2016, the American Statistical Association released a statement on statistical significance and the P value with six principles underlying the proper use and interpretation of this statistical tool (77).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [77]
In the citing paper
“Although we also present p values for exploratory analyses, we refrain from labeling any of them as statistically significant, following best-practice recommendations for statistical analysis [43].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [43]
In the citing paper
“Contrary to IJE author recommendations and recent guidance from the American Statistics Society, 16 Gao et al. largely base their conclusions on findings with a P -value equivalent to < 0.05 after multiple testing.”
From Commentary: Two-sample Mendelian randomization: opportunities and challenges (2016) · cites this paper as [16]
In the citing paper
“Following guidance,50 we focused on 95% CIs, rather than statistical significance. For example, unlike conventional interpretations, we did not outright interpret an effect estimate “non‐significant” if the lower or upper bound of the 95% CI was slightly above/below the null value; we interpreted them as “suggestive” of an effect.”
From Third‐wave cognitive behaviour therapies for weight management: A systematic review and network meta‐analysis (2020) · cites this paper as [50]
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,745
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946
Smithson, M. J. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Research works printed but not linked: 5
- Leek, J. (2014), “On the Scalability of Statistical Procedures: Why the p-Value Bashers Just Don't Get It,” Simply Statistics Blog, Available at http://simplystatistics.org/2014/02/14/on-the-scalability-of-statistical-procedures-why-the-p-value-bashers-just-dont-get-it/.
- Gelman A. and Loken E. (2014) “The Statistical Crisis in Science [online] ” American Scientist 102. Available at http://www.americanscientist.org/issues/feature/2014/6/the-statistical-crisis-in-science · DOI · Paper page
- Greenland, S., and Poole, C. (2011), “Problems in Common Interpretations of Statistics in Scientific Articles, Expert Reports, and Testimony,” Jurimetrics, 51, 113–129.
- 10.1214/13-AOS1123 · DOI
- Lavine, M. (1999), “What is Bayesian Statistics and Why Everything Else is Wrong,” UMAP Journal, 20, 2.
Cited by
Sorted by citations
Items 5,001–5,100 of 6,272
El bayesianismo: de lo casuístico a lo histórico
Virla, M. Q. (2020) · Sapientiae · doi:10.37293/sapientiae61.11
“…las publicadas por la Administración de Alimentos y Medicamentos (Food and Drug Administration) en el año 2010, y cuyos antecedentes se remontan a 1997 (Campbell, 2017), y por la Asociación Estadística Americana (American Statistical Association, ASA), en el año 2016 (Wasserstein & Lazar, 2016).”
Backgroundde Souza, R. G., Sales, J. E. D. S., Lacerda, R. D., Gurgel, A. D. C., de Souza, M. F., da Silva, L. S. C., de Farias, A. S. S., de Azevedo, C. A., de Araújo, M. A., de Lima, M. A. F., et al. (2020) · doi:10.22533/at.ed.36720250614
Frequentism-as-modelPreprint
Hennig, C. (2020) · arXiv (Cornell University)
Visualizing large medical image datasets using the 3D scale-invariant feature transform (SIFT)
Rokooie, M. (2020) · Espace ÉTS (ETS)
Júnior, C. A. M. (2019) · Arquivos de Ciências do Esporte
Frequentist approach to data analysis and interpretation in forensic anthropology
Sifakis, M., Kalochristianakis, M. N., García-Donas, J. G., et al. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-815764-0.00003-4
Robust Phase Estimation of Gaussian States in the Presence of Outlier Quantum States
Mototake, Y., & Suzuki, J. (2020) · Applied Sciences · doi:10.3390/app10165475
Lightowler, H. J., Schweitzer, L., Theis, S., et al. (2020) · Nutrients · doi:10.3390/nu12082339
Reviewing Quantitative Studies: Meta-analysis and Narrative Approaches
Purssell, E., & McCrae, N. (2020) · Springer eBooks · doi:10.1007/978-3-030-49672-2_7
Response to the letter by Knapp and Hayat
Cron, S. G. (2020) · Research in Nursing & Health · doi:10.1002/nur.22061
Contexts, communicating and climbing out of comfort zones
MacGillivray, H. (2020) · Teaching Statistics · doi:10.1111/test.12236
Rowe, S. M. (2020) · University of Minnesota Digital Conservancy (University of Minnesota)
Is predation a driver of polydomy in ants
Sammy, J. M. (2019) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
Literary Dialect, Race, and Empire
Brown, D. W. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108551045.002
Characteristics of institutions with Learning Assistant programs: An equity investigation
McQuade, A., Nissen, J., & Jariwala, M. (2020) · Physics Education Research Conference (PERC) · doi:10.1119/perc.2020.pr.mcquade
Yuan, X., Deng, F., Wang, Y., et al. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.09.18.303701
Instructional Design for Non-specialist Beginners to Learn Chinese Semantic Radicals
Tian, T., Lonsdale, M. D. S., & Cheung, V. (2020) · Proceedings of DRS · doi:10.21606/drs.2020.363
“1 The p-value is the probability value in statistical hypothesis testing (Wasserstein & Lazar, 2016).”
MethodSamarei, R., & Mabarian, S. (2020) · Annales françaises d Oto-rhino-laryngologie et de Pathologie Cervico-faciale · doi:10.1016/j.aforl.2020.05.007 · Cited by 3
Reductio ad absurdum in critical care trials
Zampieri, F. G. (2020) · Journal of Critical Care · doi:10.1016/j.jcrc.2020.10.001
A Farewell to Arms, to Staff, to You, and to the Journal of Clinical Psychopharmacology
Shader, R. I. (2020) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0000000000001298
Ortiz, A. C. E. (2017) · Cirujano General · doi:10.35366/77025
Raittio, E. J., & Raittio, L. (2020) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.13499
How to Control the Error Rates of Binary ClassifiersPreprint
Simić, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.11039
“Another shortcoming is that p -values are usually misinterpreted [4, 7, 13, 15, 27, 33, 44, 45], so special care must be given to interpret them correctly.”
BackgroundБеспалов, В. Г., Belyaev, А. М., Baranenko, D. A., et al. (2017) · Voprosy Onkologii · doi:10.37469/0507-3758-2017-63-2-329-335
Finding the Gray Area in Scientific Research: Moving Beyond the Dichotomy of P < or > .05
Batra, P. (2020) · The Journal of Indian Orthodontic Society · doi:10.1177/0301574220966305
Kun, Y. A. N., Ke, W. A. N., & Shimokawa, T. (2020) · Transactions of Japan Society of Kansei Engineering · doi:10.5057/jjske.tjske-d-20-00020
Social Justice Development and Practice in School Leaders in Nepal
Higgins, J. B. (2019) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
Scheuer, K. S., Hanlon, B. M., Dresel, J. W., Nolan, E. D., Davis, J. C., & Loewe, L. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/099192
UV bright red-sequence galaxies: a comparative study between UV upturn and UV weak systems Maria
Dantas, M. L. L. (2020) · doi:10.11606/t.14.2020.tde-14122020-155924
“However, given the difficulties in interpreting these values and the controversies involved in the use of p-value (see, for instance, Lin, Lucas, & Shmueli, 2013; Nuzzo, 2014; Halsey et al., 2015; Wasserstein & Lazar, 2016), the discussion around these results is not developed throughout the text.”
BackgroundIssues and pitfalls in the use of p-values
Counotte, M. J., Flammer, S. A., & Hartnack, S. (2020) · Veterinary Anaesthesia and Analgesia · doi:10.1016/j.vaa.2020.10.007
Mota, M. A. E., Corrêa, J. O. D. A., Ferreira, R. E., et al. (2020) · HU Revista · doi:10.34019/1982-8047.2020.v46.28887
NLPStatTest: A Toolkit for Comparing NLP System PerformancePreprint
Zhu, H., Mak, D., Gioannini, J., & Xia, F. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.13231
“The American Statistical Association emphasizes that ‘‘a p-value, or statistical significance, does not measure the size of an effect or the importance of a result” (Wasserstein and Lazar, 2016).”
BackgroundBayesian decision theory for clinical trials: Utility and sample size determination
Sakamaki, K., Kanekiyo, M., Ohwada, S., et al. (2020) · Japanese Journal of Biometrics · doi:10.5691/jjb.41.55
Reflections on the 1962 Paper “The Statistician in Medicine” by Sir Austin Bradford Hill
Lin, X. (2020) · Statistics in Medicine · doi:10.1002/sim.8834
Inferential Frameworks for Clinical Trials
Long, J. P., & Lee, J. J. (2020) · Springer eBooks · doi:10.1007/978-3-319-52677-5_271-1
WHEN AND WHERE P-VALUE IS REQUIRED: MISNOMERS IN CLINICALAND STATISTICAL SIGNIFICANCE
Oberoi, S. S., & Atri, M. (2021) · INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH · doi:10.36106/ijsr/9300808
Austin, A. E., Naumann, R. B., Figgatt, M. C., & Aiello, A. E. (2021) · Substance Use & Misuse · doi:10.1080/10826084.2020.1868521
“The American Statistical Association, 70(2), 129–133.”
MethodFalsification, Pseudoscience, Induction
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.005
Estimating Rationality in Economics: A History of Statistical Methods in Experimental EconomicsPreprint
Jullien, D., & Vallois, N. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3116220
Park, J.-W., Lee, J., & Shin, K. (2020) · Korean Journal of Industrial and Organizational Psychology
Assessing Gender Disparity in Job Satisfaction: A Bayesian Approach
Adruce, S. A. Z., Stephen, D., & Jonathan, V. (2021) · International Journal of Academic Research in Business and Social Sciences · doi:10.6007/ijarbss/v11-i14/8526
“American Statistical Association warned against the unwarranted use of p-value because it can lead to the distortion of the scientific process (Wasserstein & Lazar, 2016).”
BackgroundComputational Tools for Network Analysis
Dijkstra, H. A., Hernández-García, E., Masoller, C., & Barreiro, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781316275757.006
Balgoma, D., Kullenberg, F., Calitz, C., Kopsida, M., Heindryckx, F., Lennernäs, H., & Hedeland, M. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.02.16.431377
Sato, T. S. (2021) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2020.1811149
The Clinical Utility of Psychometric Tests
Anunciação, L., Arruda, M. A., & Landeira-Fernández, J. (2021) · Advances in early childhood and K-12 education · doi:10.4018/978-1-7998-7630-4.ch016
Predicting Stroke Risk in Patients with Atrial Fibrillation Using Machine LearningPreprint
Jung, S., Lee, E.-J., Lee, M., Bae, S., Kim, Y.-Y., Lee, D., Song, M., & Yoo, S. (2021) · Research Square · doi:10.21203/rs.3.rs-209356/v1
MacDougall, M. (2021) · Research Online (University of Wollongong) · doi:10.14453/jutlp.v18i2.8
Laccourreye, O., Fakhry, N., Franco‐Vidal, V., Jankowski, R., Karkas, A. A., Leboulanger, N., Makeieff, M., Malard, O., Michel, J., Righini, C. A., et al. (2021) · Annales françaises d Oto-rhino-laryngologie et de Pathologie Cervico-faciale · doi:10.1016/j.aforl.2020.05.013
Interpretación teórica del p valor
Barrios, I., & Marecos, C. (2018) · Medicina Clínica y Social · doi:10.52379/mcs.v2i1.41
Toward a More Nuanced Interpretation of Statistical Significance in Biomedical Research
Bajpai, R. C., & Chaturvedi, H. K. (2021) · Asian Journal of Oncology · doi:10.1055/s-0041-1727066
Non-random errors and their importance in testing of hypotheses
Szreder, M. (2021) · Wiadomości Statystyczne The Polish Statistician · doi:10.5604/01.3001.0014.7984
David, I., & Barrios, F. A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.04.438425
“Echoing recommendations from the statistical community, we did not set arbitrary “significance” thresholds, but rather regard these values as lying on a continuous evidence scale (Wasserstein and Lazar, 2016; Amrhein and Greenland, 2018; Wasserstein et al, 2019).”
BackgroundEthical Principles and Laws Governing Clinical Research
Karcz, M. (2021) · Springer eBooks · doi:10.1007/978-3-030-68570-6_28
Reproducibilidad y replicabilidad en la investigación en ciencias naturales: ¿Hay una crisis?
Gorla, D. E. (2021) · Ecología Austral · doi:10.25260/ea.21.31.1.0.1060
“…discusiones que la Asociación de Estadística de los Estados Unidos emitió una declaración acerca de los P-valores en un editorial (Wasserstein and Lazar 2016), y más recientemente, The American Statistician publicó un número especial titulado "Moving to a World Beyond P<0.05", incluyendo 45…”
BackgroundInfluentialRichardson, C. J., Smith, T. I., & Walter, P. J. (2021) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.17.020127
Volatility Persistence as a New Channel for Global Impact on Local VolatilityPreprint
Chen, S., & Wang, J. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3584863
Methodology minute: A statistical test primer for infection prevention and control
Wiemken, T. L., Niemotka, S. L., & Prener, C. G. (2021) · American Journal of Infection Control · doi:10.1016/j.ajic.2021.04.003
Chai, C. P. (2021) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/rssa.12658
Feature Tables: Chinese Dialogue
Brown, D. W. (2018) · doi:10.1017/9781108551045.016
Past, Present and Future With p-Values, Confidence Intervals and Effect Sizes
Reito, A. R. (2021) · The Journal of Foot & Ankle Surgery · doi:10.1053/j.jfas.2020.04.017
Beyond Probabilism and Performance
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.002 · Cited by 1
Sharpley, C. F., Sarmukadam, K., Bitsika, V., McMillan, M., & Agnew, L. L. (2021) · Journal of Developmental and Physical Disabilities · doi:10.1007/s10882-021-09799-5
“Further, although results may be statistically significant (at whatever p value is used) they may not necessarily be meaningful (Wasserstein & Lazar, 2016).”
BackgroundHaughton, J. (2021) · Significance · doi:10.1111/1740-9713.01530
The 'Big N' Audit Quality KerfufflePreprint
Cready, W. M. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3511585
Comparing Distributions with the Probability of Agreement
Dadbin, M. (2021) · UWSpace (University of Waterloo)
The A merican Statistical Association
Wasserstein, R. (2018) · Wiley StatsRef: Statistics Reference Online · doi:10.1002/9781118445112.stat08060
Self-citationGalvagno, S. M., Cloepin, J., Hannas, J., et al. (2021) · BMC Emergency Medicine · doi:10.1186/s12873-021-00503-6
“005 was considered statistically significant [7].”
Åvitsland, A. (2020) · University of Stavanger eBooks · doi:10.31265/usps.68
Cytokine inhibitors in COVID-19: looking back to move forward
Szakmány, T., & Duric, N. (2021) · Minerva Anestesiologica · doi:10.23736/s0375-9393.21.15837-7
7. Data Management in Radiation Therapy
Inoue, H., & Takei, Y. (2021) · Japanese Journal of Radiological Technology · doi:10.6009/jjrt.2021_jsrt_77.6.604
Comparative evaluation of virtualization technologies in the cloud
Johansson, M., & Olsson, L. (2017) · KTH Publication Database DiVA (KTH Royal Institute of Technology)
Espinosa-Brito, J., & Hennig, C. M. (2025) · Statistical Methods & Applications · doi:10.1007/s10260-025-00816-x
“A major issue with them is that researchers often focus on significance only and neglect effect sizes (Wasserstein and Lazar (2016); Stahel (2021)), which CRs enforce to take into account.”
Albalawi, M., Babtain, F. A., Baeesa, S. S., et al. (2021) · Neurosciences · doi:10.17712/nsj.2021.3.20200182
Attention and motor learning in an aiming task
Yamada, M. (2020) · NC Digital Online Collection of Knowledge and Scholarship (The University of North Carolina at Greensboro)
Vinh, L. N. H., & Dinh, V. H. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-77094-5_23
A Proposed Hybrid Effect Size Plus $p$-Value Criterion: A Replication of Goodman et al. (2019)Preprint
Dreher, R. T., Hoffmann, L., Kramer-Sunderbrink, A., et al. (2021) · arXiv (Cornell University)
Selected poster presentations from the American Association of Applied Linguistics conference 2021
Shibata, N. (2021) · Language Teaching · doi:10.1017/s0261444821000306
“The reliability of the p-value is currently considered problematic to estimate the probability and alternative statistic benchmarks are required (Wasserstein & Lazar, 2016).”
BackgroundAusência de assimetria vertical na orientação encoberta da atenção visual
Galindo, D. P. A., Date, B. L., & Rodrigues, F. V. (2021) · Research Society and Development · doi:10.33448/rsd-v10i10.18522
Lacko, D., & Prošek, . (2021) · TESTFÓRUM · doi:10.5817/tf2021-14-13648
Doing Business in Serbia: Key Corporate Stakeholders
Milić, T. (2021) · Management Journal of Sustainable Business and Management Solutions in Emerging Economies · doi:10.7595/management.fon.2021.0019
“In the study, results with p<0.1 were declared significant (Kim, 2020; Kim & Choi, 2019; Wasserstein & Lazar, 2016; Mudge, Baker, Edge & Houlahan, 2012).”
ResultInfluentialContribution of working memory to gesture production in toddlers
Güneş‐Acar, N., Ercan, İ., Küntay, A. C., & Aksu-Koç, A. (2021) · Cognitive Development · doi:10.1016/j.cogdev.2021.101113 · Cited by 1
The Necessity of Preserving the Research System in Emergency Eras
Shamabadi, A., & Akhondzadeh, S. (2021) · Archives of Iranian Medicine · doi:10.34172/aim.2021.82
Statistical concepts for research in emergency medical services
Newgard, C. D., & Lewis, R. J. (2021) · Emergency medical services · doi:10.1002/9781119756279.ch121
Meeker, T. J., Schmid, A., Keaser, M. L., Khan, S. A., Gullapalli, R. P., Dorsey, S. G., Greenspan, J. D., & Seminowicz, D. A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.08.31.458440
“It should be noted the guidelines ‘significance’ of p-values, are arbitrary and participant to test assumptions, sample size, context, and practical effect interpretation(Fisher, 1948; Wasserstein and Lazar, 2016).”
Backgroundp-Hacking as a Questionable Research Practice in Industrial and Organizational Psychology
Cocoș, B. (2021) · doi:10.47040/sd/sdpsych.v12i1.119
“Often, this incompatibility is attributed to the concept of chance or luck, despite the fact that Wasserstein and Lazar (2016) argue against such an operational definition of the p-value.”
BackgroundProbabilistic approximation to change and no change in multispectral remote sensing
Gutiérrez-Vélez, V. H., Rodriguez-Escobar, J., Lara, W., et al. (2021) · International Journal of Remote Sensing · doi:10.1080/01431161.2021.1958391
“This situation is acknowledged by the formal policy statement by the American Statistical Association (ASA-Wasserstein and Lazar 2016) where they clarify principles for the proper use and interpretation of the p-value.”
BackgroundComments From the Editor: How Big Are Your P Values?
Silvey, B. A. (2021) · Update Applications of Research in Music Education · doi:10.1177/87551233211043843
“Due to the distorted nature of this easy and lazy categorization that places research findings into those that matter and those that do not, it should come as no surprise that statisticians disagree on the importance and use of p values (Wasserstein & Lazar, 2016).”
BackgroundMayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.004
Using Mathematical Statistics Ethically in Research in The Social Sciences and Humanities
Hanes, P., Gibson, W., & Hanesová, D. (2018) · Communications - Scientific letters of the University of Zilina · doi:10.26552/com.c.2018.1a.80-88
“For example, are references to multivariate regression, Cronbach’s alpha and The ASA’s p-value statement of 2016 includes the following principles [26]: 1.”
MethodDecision Making in Drug Development via Inference on PowerPreprint
Johnson, G. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2005.04721
“This resonates with the American Statistical Association (ASA) statement on statistical significance and the p-value (Wasserstein et al. 2016).”
Maîtriser les statistiques descriptives utilisées en otorhinolaryngologie
Laccourreye, O., Jankowski, R., & Lisan, Q. (2021) · Annales françaises d Oto-rhino-laryngologie et de Pathologie Cervico-faciale · doi:10.1016/j.aforl.2020.09.006
Understanding Statistical Evidence
Setchell, J. M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108368513.006
Dijkstra, H. A., Hernández-García, E., Masoller, C., & Barreiro, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781316275757.009
The Spillovers from US Monetary Policy to Asian Economies
Tran, O. T. K., Tran, N. T. T., & Vu, U. B. T. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-77094-5_41
Claesdotter‐Knutsson, E., Delfin, C., Laporte, N., & Wallinius, M. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2021.114235
“Second, the fully Bayesian approach allowed us to make genuine probabilistic statements, and also alleviates some of the concerns with a traditional frequentist approach, such as reliance on arbitrary cut-offs for p-values (Wasserstein and Lazar, 2016).”
Background
Metadata
- Authors
- Wasserstein, R. L., & Lazar, N. A.
- Affiliations
- American Statistical Association, 732 North Washington Street, Alexandria, VA 22314-1943
- American Statistical Association (US)
- ORCID
- Lazar, Nicole A.
- Venue
- The American Statistician
- Publisher
- Informa UK Limited
- Published
- 2016-04-02
- Volume
- 70
- Issue
- 2
- Pages
- 129-133
- ISSN
- 0003-1305 (ISSN-L)
- 1537-2731
- OpenAlex
- W2293040502
- Semantic Scholar
- 81a65f23474ffceb2481836328608102950da979
- Cited by
- 6,306
- References
- 45
- Citations by year
- 2026: 625 · 2025: 629 · 2024: 575 · 2023: 543 · 2022: 642 · 2021: 676 · 2020: 678 · 2019: 666 · 2018: 596 · 2017: 438 · 2016: 226
- FWCI
- 649.74
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The American Statistician (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- p-values, statistical evidence, p-value interpretation, statistical inference, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
