The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index; none of the 1 sources its claims cite is checked for support yet.
The ASA Statement on p -Values: Context, Process, and Purpose
Open accessAbstract
Emeritus of Mathematics and Statistics at
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
24 Own interpretation · 2 No basis given · 1 No full text of the sources
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The widespread use of”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Statistical significance is not equivalent to scientific, human, or economic significance.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, a p-value near 0.05 taken by itself offers only weak evidence against the null hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By itself, a p-value does not provide a good measure of evidence regarding a model or hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similarly, identical estimated effects will have different p-values if the precision of the estimates differs.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A p-value provides one approach to summarizing the incompatibility between a particular set of data and a proposed model for the data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Conducting multiple analyses of the data and reporting only those with certain p-values (typically those passing a significance threshold) renders the reported p-values essentially uninterpretable.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Whenever a researcher chooses what to present based on statistical results, valid interpretation of those results is severely compromised if the reader is not informed of the choice and its basis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The smaller the p-value, the greater the statistical incompatibility of the data with the null hypothesis, if the underlying assumptions used to calculate the p-value hold.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Valid scientific conclusions based on p-values and related statistics cannot be drawn without at least knowing how many and which analyses were conducted, and how those analyses (including p-values) were selected for reporting.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 10
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This has led to some scientific journals discouraging the use of p-values, and some scientists and statisticians recommending their abandonment, with some arguments essentially unchanged since p-values were first introduced.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The statistical community has been deeply concerned about issues of reproducibility and replicability of scientific conclusions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the p-value can be a useful statistical measure, it is commonly misused and misinterpreted.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A conclusion does not immediately become”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All these measures and approaches rely on further assumptions, but they may more directly address the size of an effect (and its associated uncertainty) or whether the hypothesis is correct.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The validity of scientific conclusions, including their reproducibility, depends on more than the statistical methods themselves.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is a statement about data in relation to a specified hypothetical explanation, and is not a statement about the explanation itself.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Researchers should recognize that a p-value without context or other evidence provides limited information.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Likewise, a relatively large p-value does not imply evidence in favor of the null hypothesis; many other hypotheses may be equally or more consistent with the observed data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This incompatibility can be interpreted as casting doubt on or providing evidence against the null hypothesis or the underlying assumptions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Appropriately chosen techniques, properly conducted analyses and correct interpretation of statistical results also play a key role in ensuring that conclusions are sound and that uncertainty surrounding them is represented properly.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Misunderstanding or misuse of statistical inference is only one cause of the”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
What the sources say
- Not checked — no full text of the sourcecites Peng 2015 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Smaller p-values do not necessarily imply the presence of larger or more important effects, and larger p-values do not imply a lack of importance or even lack of effect.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In view of the prevalent misuses of and misconceptions concerning p-values, some statisticians prefer to supplement or even replace p-values with other approaches.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
There is widespread consensus in the statistical community on the principles articulated in the ASA statement.
“according to widespread consensus in the statistical community”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While the large scale of the Tabula Muris Senis dataset provides substantial power to predict subtle changes in LR interactions, the biological complexity, dependencies among communication pairs, and multiple testing burden require that these p-values be interpreted within a broader biological and statistical context [33].”
From Quantitative profiling of lifespan-dependent cell-cell communication potential reveals dynamic ligand-receptor network shifts across mouse tissues (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These types of incorrect descriptions contribute to confirmation bias, overinterpretation of results, and reporting correlation as implied causation (Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This is especially true of relatively large-sample-size studies (as most learning analytics studies are), which are likely to obtain statistically significant findings in relatively small variations in measures such as GPA (Field 2017; Salkind 2016 Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
In the citing paper
“In 2016, the American Statistical Association released a statement on statistical significance and the P value with six principles underlying the proper use and interpretation of this statistical tool (77).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [77]
In the citing paper
“Although we also present p values for exploratory analyses, we refrain from labeling any of them as statistically significant, following best-practice recommendations for statistical analysis [43].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [43]
In the citing paper
“Contrary to IJE author recommendations and recent guidance from the American Statistics Society, 16 Gao et al. largely base their conclusions on findings with a P -value equivalent to < 0.05 after multiple testing.”
From Commentary: Two-sample Mendelian randomization: opportunities and challenges (2016) · cites this paper as [16]
In the citing paper
“Following guidance,50 we focused on 95% CIs, rather than statistical significance. For example, unlike conventional interpretations, we did not outright interpret an effect estimate “non‐significant” if the lower or upper bound of the 95% CI was slightly above/below the null value; we interpreted them as “suggestive” of an effect.”
From Third‐wave cognitive behaviour therapies for weight management: A systematic review and network meta‐analysis (2020) · cites this paper as [50]
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,745
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946
Smithson, M. J. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Research works printed but not linked: 5
- Leek, J. (2014), “On the Scalability of Statistical Procedures: Why the p-Value Bashers Just Don't Get It,” Simply Statistics Blog, Available at http://simplystatistics.org/2014/02/14/on-the-scalability-of-statistical-procedures-why-the-p-value-bashers-just-dont-get-it/.
- Gelman A. and Loken E. (2014) “The Statistical Crisis in Science [online] ” American Scientist 102. Available at http://www.americanscientist.org/issues/feature/2014/6/the-statistical-crisis-in-science · DOI · Paper page
- Greenland, S., and Poole, C. (2011), “Problems in Common Interpretations of Statistics in Scientific Articles, Expert Reports, and Testimony,” Jurimetrics, 51, 113–129.
- 10.1214/13-AOS1123 · DOI
- Lavine, M. (1999), “What is Bayesian Statistics and Why Everything Else is Wrong,” UMAP Journal, 20, 2.
Cited by
Sorted by citations
Items 5,201–5,300 of 6,272
Tropical Grasslands-Forrajes Tropicales Vol.7 No.1 [January 2019]
Journal, T. (2019) · Tropical Grasslands - Forrajes Tropicales · doi:10.17138/tgft(7)1-55
The Core ACT-R-Based Model of Retrieval Processes
Vasishth, S., & Engelmann, F. (2021) · Cambridge University Press eBooks · doi:10.1017/9781316459560.008
Bergmann, T. J. (2018) · Musiktherapeutische Umschau · doi:10.13109/muum.2018.39.2.188
Legg, E. W., Farrar, B. G., Lazić, A., Thiele, M., Kampis, D., Mani, N., Sesar, K., Klapwijk, E. T., Schlingloff, L., Reindl, E., et al. (2021) · doi:10.31234/osf.io/mxac9
Shaw, L., Diao, Y., Martin-Noble, G. C., Yan, H., Hayoz, P., Weitz, R. T., Kälblein, D., Toney, M. F., & Bao, Z. (2020) · MRS Bulletin · doi:10.1557/mrs.2020.306
Reanalysis and Underspecification in Sentence Comprehension: Modelling Eye Movements
Vasishth, S., & Engelmann, F. (2021) · Cambridge University Press eBooks · doi:10.1017/9781316459560.011
Goel, A., Tigges, S., & Murphy, A. J. (2014) · Radiopaedia.org · doi:10.53347/rid-31425
Remedies That Science Uses to Compensate for How Humans Tend to Make Errors
Zimring, J. C. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108569149.010
Tourish, D. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108616669.012
Probability, Bayes, P‐values, Tests of Hypotheses and Confidence Intervals
Senn, S. J. (2021) · Wiley eBooks · doi:10.1002/9781119238614.ch4 · Cited by 1
Economic History as Humanomics
McCLOSKEY, D. N. (2019) · Springer eBooks · doi:10.1007/978-3-030-00181-0_47
If Knowledge Were Simpler We Would All Be WiserPreprint
Wood, M. C. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3911835
Hess, J. R. (2016) · Transfusion · doi:10.1111/trf.13772
Understanding significance and p-values
Bangdiwala, S. I. (2016) · Nepal Journal of Epidemiology · doi:10.3126/nje.v1i1.14732
Dijkstra, H. A., Hernández-García, E., Masoller, C., & Barreiro, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781316275757.011
Shemyakin, A. E., & Kniazev, A. (2017) · doi:10.1002/9781118959046.ch7
(2021) · Significance · doi:10.1111/1740-9713.01536
Analysis of NSIDC Dataset Downloads and MetadataPreprint
Kolesnikova, Y., Lathrop, A., Norlander, B., et al. (2017) · doi:10.31219/osf.io/5mh9n
González‐Marrón, A., Real, J., Forné, C., et al. (2019) · Medicina Clínica (English Edition) · doi:10.1016/j.medcle.2018.06.021
4 Hand andwrist arthroplasty Outcome Measurement in Hand and Wrist Arthroplasty
(2021) · Haug Verlag in Georg Thieme Verlag KG eBooks · doi:10.1055/b-0041-182688
Re: The effect of vaccination against human papillomavirus on fecundability
McInerney, K. A., Hatch, E. E., Wesselink, A. K., et al. (2018) · Paediatric and Perinatal Epidemiology · doi:10.1111/ppe.12436
Dunn, J. C., & Kalish, M. L. (2018) · Computational approaches to cognition and perception · doi:10.1007/978-3-319-73129-2_8
Observation Oriented Modelling revised from a Statistical Point of ViewPreprint
Sauer, S., & Luebke, K. (2016) · doi:10.31234/osf.io/7eh5d
Kimura, H. (2017) · Revista de Administração Contemporânea · doi:10.1590/1982-7849rac2017170131
Warne, R. T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108894319.011
Islam, M. A., & Al-Shiha, A. A. M. (2018) · Springer eBooks · doi:10.1007/978-981-10-8627-4_8
Lepitzki, D. A. W. (2019) · The Canadian Field-Naturalist · doi:10.22621/cfn.v133i1.2773
Barticevic, N. A., Poblete, F., Bradshaw, L., & Bendtsen, M. (2022) · BMC Research Notes · doi:10.1186/s13104-022-06071-7
“In fact, inference cannot rely only on a statistical model, as recently cautioned by the American Psychology Association [11].”
Empowering Research on Epilepsy Surgery OutcomesPreprint
Dickey, A. S., Krafty, R. T., & Pedersen, N. P. (2022) · medRxiv · doi:10.1101/2022.05.11.22274965
Increasing information gain in animal research by improving statistical model accuracyPreprint
Waterkamp, C., von Kortzfleisch, V. T., Neu, C., et al. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.06.03.494726
The Reproducibility Crisis and Autism Spectrum Research
Bennett, M., & Goodall, E. (2022) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-80382-463-520221011
Wong, B. W. L., Hemelstrand, S., & Inoue, T. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/rf5et
Decision letter for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2022) · Publons reviews and discussion · doi:10.1177/25152459221095827/v2/decision1
Decision letter for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2022) · Publons reviews and discussion · doi:10.1177/25152459221095827/v3/decision1
Author response for "That's a Lot to Process! Pitfalls of Popular Path Models"
Rohrer, J. M., Hünermund, P., Arslan, R. C., & Elson, M. (2022) · Publons reviews and discussion · doi:10.1177/25152459221095827/v2/response1
Author response for "That's a Lot to Process! Pitfalls of Popular Path Models"
Rohrer, J. M., Hünermund, P., Arslan, R. C., & Elson, M. (2022) · Publons reviews and discussion · doi:10.1177/25152459221095827/v3/response1
Talking About Statistical Significance in Numeracy
Grawe, N. D., & Karaali, G. (2022) · Numeracy · doi:10.5038/1936-4660.15.2.1424
Worst Case Resistance TestingPreprint
France, S. L., Adams, F., & Landers, V. M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4132196
“6 n-Curve for EXP and SAT: α = 0.05 JCR, 2021; Harvey, 2017; Schwab et al., 2011; Wasserstein & Lazar, 2016), there has been a move towards requiring preregistration of experiments (Simmons et al., 2021), i.e., the process of researchers stating the experimental procedure and expected results and…”
InfluentialSnelder, T. H., Fraser, C., & WHITEHEAD, A. L. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4160474
Schaffer, M. E. (2022) · Studies in systems, decision and control · doi:10.1007/978-3-030-98689-6_9
Understanding Complex Systems and How It Impacts Quality in Surgery
Tügertimur, B., & Ramshaw, B. (2022) · Springer eBooks · doi:10.1007/978-3-030-94610-4_4
Jarmakowska-Kostrzanowska, L. (2021) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.7889
Decision letter for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2021) · Publons reviews and discussion · doi:10.1177/25152459221095827/v1/decision1
Review for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2021) · Publons reviews and discussion · doi:10.1177/25152459221095827/v1/review3
Review for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2021) · Publons reviews and discussion · doi:10.1177/25152459221095827/v1/review2
Review for "That's a Lot to Process! Pitfalls of Popular Path Models"
(2021) · Publons reviews and discussion · doi:10.1177/25152459221095827/v1/review1
Expansion of job demands-resources model by applying the circumplex model of affect
Park, J.-W., Lee, J., & Shin, K. (2020) · Korean Journal of Industrial and Organizational Psychology · doi:10.24230/kjiop.v33i4.501-543 · Cited by 1
Lysne, V., Olsén, T., & Kværner, A. S. (2020) · Norsk tidsskrift for ernæring · doi:10.18261/ntfe.18.3.7
Assessing the Robustness of SARS-CoV-2 Vaccine Efficacy Trials: Systematic Review and Meta-AnalysisPreprint
Hoang, T. N. A., Quach, H., Hoang, N. V., Tran, T. V., Thái, P. Q., & VOGT, F. M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4161714
Nonlinear Forecasting of Exchange Rate Volatility Using Google Search
Khiewngamdee, C., Hongsakulvasu, N., & Liammukda, A. (2022) · Studies in systems, decision and control · doi:10.1007/978-3-030-97273-8_47
Poufinas, T., Chen, J. M., Agiropoulos, C., et al. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4185168
The scientific method and p ‐values: response to Mayo (2022)
Ionides, E. L., & Ritov, Y. (2022) · Conservation Biology · doi:10.1111/cobi.13984
“Consequently, it may be ineffective at communicating with those swing voters who have sympathies with some of the insinuations in the Wasserstein and Lazar (2016) editorial.”
BackgroundInfluentialControversies Regarding Null Hypothesis Significance Testing
O’Connor, B. P., & Khattar, N. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_7
Mohajeri, K., Mesgari, M., & Lee, A. S. (2022) · Journal of Information Technology · doi:10.1177/02683962221087449
“However, MR and the ASA statement (Wasserstein and Lazar, 2016) neither define nor describe what they mean by “magnitude of an effect” and “the size of an effect.””
LalehMehrad, L. (2021) · Journal of Foreign Languages Cultures and Civilizations · doi:10.15640/jflcc.v9n2a1
Home-bias in online fundraising: an analysis of international reward-based crowdfunding
Filatov, G. (2021) · Sheffield Hallam University · doi:10.7190/shu-thesis-00442
Impact of Shorter Trial Periods in Medical Litigation
Kitamura, M., & Arai, K. (2022) · Asian Journal of Law and Economics · doi:10.1515/ajle-2022-0056
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.013
Rejection Fallacies: Who’s Exaggerating What?
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.010
More Auditing: Objectivity and Model Checking
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.012
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.018
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.006
Sato, H., Wakida, M., Kubota, R., et al. (2022) · Aging Clinical and Experimental Research · doi:10.1007/s40520-022-02241-6
“A p-value itself does not measure the size of an effect or the importance of a result [26].”
BackgroundError Probing Tools versus Logics of Evidence
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.003
Trials and Tribulations of Teaching Null Hypothesis Significance Testing in the Health Sciences
Sedgwick, P. M. (2022) · CHANCE · doi:10.1080/09332480.2022.2123159
Using EHR Data to Identify Patient Frailty and Risk for ICU Transfer
Lekan, D. A., McCoy, T. P., Jenkins, M., Mohanty, S. D., & Manda, P. (2022) · Western Journal of Nursing Research · doi:10.1177/01939459221123162
“A two-sided p-value .05 was considered statistically significant and is reported with effect size (AHR) and precision (95% CI) (Wasserstein & Lazar, 2016).”
MethodA Statistics-Related Approach to the Legislative Apportionment Problem…and also, a Second One
Swenson, D. (2022) · College Mathematics Journal · doi:10.1080/07468342.2022.2118994
Relevance, Redundancy, and Regularization: Penalized Regression and the Quest for the ℓ₀ Quasi-NormPreprint
Chen, J. M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4188299
Bayesian Multilevel Modeling for the Intersections of Race and GenderPreprint
Much, M. (2022) · SSRN Electronic Journal · doi:10.33774/apsa-2022-rxv5f
Needed in Empirical Social Science: NumbersPreprint
Edlin, A. S., & Love, M. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4195779
“(Wasserstein and Lazar, 2016).”
An Online Application for Exploratory and Explanatory Data Analysis
Collett, P. (2022) · doi:10.37546/jaltpcp2021-26 · Cited by 1
Olhar sobre a Pós-Graduação: Ansiedade e Autoeficácia nos Cursos Stricto Sensu de Ciências Contábeis
Coelho, W. E., Nascimento, E. M., da Cunha, J. V. A., & Cornacchione, E. B. (2022) · Revista de Educação e Pesquisa em Contabilidade (REPeC) · doi:10.17524/repec.v16i2.2536
Darracq, M. A., & Wu, F. C. W. (2022) · Western Journal of Emergency Medicine · doi:10.5811/westjem.2022.8.58423
Frequentist and Bayesian Hypothesis Testing: An Intuitive Guide for Urologists and Clinicians
Gaona, J. L., Sánchez, D., González, C., Gonzalez, F. A., Rueda, A., & Ortiz, S. (2022) · Revista Urología Colombiana / Colombian Urology Journal · doi:10.1055/s-0042-1756171
Feature Tables: Indian Dialogue
Brown, D. W. (2018) · doi:10.1017/9781108551045.015
Brown, D. W. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108551045.003
Brown, D. W. (2018) · doi:10.1017/9781108551045.013
Brown, D. W. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108551045.018
Auditing: Biasing Selection Effects and Randomization
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.011
Brown, D. W. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108551045.001
Brown, D. W. (2018) · doi:10.1017/9781108551045.011
Capability and Severity: Deeper Concepts
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.008
Feature Tables: African Diasporic Dialogue
Brown, D. W. (2018) · doi:10.1017/9781108551045.014
Brown, D. W. (2018) · doi:10.1017/9781108551045.009
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.007
Brown, D. W. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108551045.007
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.001
An Overview of the Data and the Digital Toolkit
Brown, D. W. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108551045.004
Warton, D. I. (2021) · Methods in statistical ecology · doi:10.1007/978-3-030-88443-7_1
Brown, D. W. (2018) · doi:10.1017/9781108551045.012
Case #1: African Diasporic Dialogue
Brown, D. W. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108551045.005
Deconstructing the N-P versus Fisher Debates
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.015
(2018) · Cambridge University Press eBooks · doi:10.1017/9781108551045.017
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.019
The Enduring Power of Mimicry and the Politics of Measurement
Brown, D. W. (2018) · Cambridge University Press eBooks · doi:10.1017/9781108551045.008
Metadata
- Authors
- Wasserstein, R. L., & Lazar, N. A.
- Affiliations
- American Statistical Association, 732 North Washington Street, Alexandria, VA 22314-1943
- American Statistical Association (US)
- ORCID
- Lazar, Nicole A.
- Venue
- The American Statistician
- Publisher
- Informa UK Limited
- Published
- 2016-04-02
- Volume
- 70
- Issue
- 2
- Pages
- 129-133
- ISSN
- 0003-1305 (ISSN-L)
- 1537-2731
- OpenAlex
- W2293040502
- Semantic Scholar
- 81a65f23474ffceb2481836328608102950da979
- Cited by
- 6,306
- References
- 45
- Citations by year
- 2026: 625 · 2025: 629 · 2024: 575 · 2023: 543 · 2022: 642 · 2021: 676 · 2020: 678 · 2019: 666 · 2018: 596 · 2017: 438 · 2016: 226
- FWCI
- 649.74
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The American Statistician (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- p-values, statistical evidence, p-value interpretation, statistical inference, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
