The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index; none of the 1 sources its claims cite is checked for support yet.
The ASA Statement on p -Values: Context, Process, and Purpose
Open accessAbstract
Emeritus of Mathematics and Statistics at
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
24 Own interpretation · 2 No basis given · 1 No full text of the sources
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The widespread use of”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Statistical significance is not equivalent to scientific, human, or economic significance.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, a p-value near 0.05 taken by itself offers only weak evidence against the null hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By itself, a p-value does not provide a good measure of evidence regarding a model or hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similarly, identical estimated effects will have different p-values if the precision of the estimates differs.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A p-value provides one approach to summarizing the incompatibility between a particular set of data and a proposed model for the data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Conducting multiple analyses of the data and reporting only those with certain p-values (typically those passing a significance threshold) renders the reported p-values essentially uninterpretable.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Whenever a researcher chooses what to present based on statistical results, valid interpretation of those results is severely compromised if the reader is not informed of the choice and its basis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The smaller the p-value, the greater the statistical incompatibility of the data with the null hypothesis, if the underlying assumptions used to calculate the p-value hold.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Valid scientific conclusions based on p-values and related statistics cannot be drawn without at least knowing how many and which analyses were conducted, and how those analyses (including p-values) were selected for reporting.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 10
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This has led to some scientific journals discouraging the use of p-values, and some scientists and statisticians recommending their abandonment, with some arguments essentially unchanged since p-values were first introduced.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The statistical community has been deeply concerned about issues of reproducibility and replicability of scientific conclusions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the p-value can be a useful statistical measure, it is commonly misused and misinterpreted.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A conclusion does not immediately become”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All these measures and approaches rely on further assumptions, but they may more directly address the size of an effect (and its associated uncertainty) or whether the hypothesis is correct.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The validity of scientific conclusions, including their reproducibility, depends on more than the statistical methods themselves.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is a statement about data in relation to a specified hypothetical explanation, and is not a statement about the explanation itself.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Researchers should recognize that a p-value without context or other evidence provides limited information.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Likewise, a relatively large p-value does not imply evidence in favor of the null hypothesis; many other hypotheses may be equally or more consistent with the observed data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This incompatibility can be interpreted as casting doubt on or providing evidence against the null hypothesis or the underlying assumptions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Appropriately chosen techniques, properly conducted analyses and correct interpretation of statistical results also play a key role in ensuring that conclusions are sound and that uncertainty surrounding them is represented properly.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Misunderstanding or misuse of statistical inference is only one cause of the”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
What the sources say
- Not checked — no full text of the sourcecites Peng 2015 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Smaller p-values do not necessarily imply the presence of larger or more important effects, and larger p-values do not imply a lack of importance or even lack of effect.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In view of the prevalent misuses of and misconceptions concerning p-values, some statisticians prefer to supplement or even replace p-values with other approaches.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
There is widespread consensus in the statistical community on the principles articulated in the ASA statement.
“according to widespread consensus in the statistical community”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While the large scale of the Tabula Muris Senis dataset provides substantial power to predict subtle changes in LR interactions, the biological complexity, dependencies among communication pairs, and multiple testing burden require that these p-values be interpreted within a broader biological and statistical context [33].”
From Quantitative profiling of lifespan-dependent cell-cell communication potential reveals dynamic ligand-receptor network shifts across mouse tissues (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These types of incorrect descriptions contribute to confirmation bias, overinterpretation of results, and reporting correlation as implied causation (Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This is especially true of relatively large-sample-size studies (as most learning analytics studies are), which are likely to obtain statistically significant findings in relatively small variations in measures such as GPA (Field 2017; Salkind 2016 Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
In the citing paper
“In 2016, the American Statistical Association released a statement on statistical significance and the P value with six principles underlying the proper use and interpretation of this statistical tool (77).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [77]
In the citing paper
“Although we also present p values for exploratory analyses, we refrain from labeling any of them as statistically significant, following best-practice recommendations for statistical analysis [43].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [43]
In the citing paper
“Contrary to IJE author recommendations and recent guidance from the American Statistics Society, 16 Gao et al. largely base their conclusions on findings with a P -value equivalent to < 0.05 after multiple testing.”
From Commentary: Two-sample Mendelian randomization: opportunities and challenges (2016) · cites this paper as [16]
In the citing paper
“Following guidance,50 we focused on 95% CIs, rather than statistical significance. For example, unlike conventional interpretations, we did not outright interpret an effect estimate “non‐significant” if the lower or upper bound of the 95% CI was slightly above/below the null value; we interpreted them as “suggestive” of an effect.”
From Third‐wave cognitive behaviour therapies for weight management: A systematic review and network meta‐analysis (2020) · cites this paper as [50]
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,745
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946
Smithson, M. J. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Research works printed but not linked: 5
- Leek, J. (2014), “On the Scalability of Statistical Procedures: Why the p-Value Bashers Just Don't Get It,” Simply Statistics Blog, Available at http://simplystatistics.org/2014/02/14/on-the-scalability-of-statistical-procedures-why-the-p-value-bashers-just-dont-get-it/.
- Gelman A. and Loken E. (2014) “The Statistical Crisis in Science [online] ” American Scientist 102. Available at http://www.americanscientist.org/issues/feature/2014/6/the-statistical-crisis-in-science · DOI · Paper page
- Greenland, S., and Poole, C. (2011), “Problems in Common Interpretations of Statistics in Scientific Articles, Expert Reports, and Testimony,” Jurimetrics, 51, 113–129.
- 10.1214/13-AOS1123 · DOI
- Lavine, M. (1999), “What is Bayesian Statistics and Why Everything Else is Wrong,” UMAP Journal, 20, 2.
Cited by
Sorted by citations
Items 501–600 of 6,272
What Science Is and How It Really Works
Zimring, J. C. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108569149 · Cited by 58
Balachandren, N., Davies, M. C., Hall, J., Stephenson, J., David, A. L., Barrett, G., O’Neill, H. C., Ploubidis, G. B., Yasmin, E., & Mavrelos, D. (2022) · Human Reproduction · doi:10.1093/humrep/deac062 · Cited by 56
“All three studies recruited women attending early pregnancy and antenatal clinic appointments.”
Sufficient trial size to inform clinical practice
Manski, C. F., & Tetenov, A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1612174113 · Cited by 56
“1 and the recent statement by the American Statistical Association (2).”
Avian trait-mediated vulnerability to road traffic collisions
Santos, S., Mira, A. P. P., Salgueiro, P. A., Costa, P., Medinas, D., & Beja, P. R. (2016) · Biological Conservation · doi:10.1016/j.biocon.2016.06.004 · Cited by 59
Risk of malignancy in ankylosing spondylitis: a systematic review and meta-analysis
Deng, C., Li, W., Fei, Y., et al. (2016) · Scientific Reports · doi:10.1038/srep32063 · Cited by 56
Klockmann, S., Reiner, E., Cain, N., & Fischer, M. J. (2017) · Journal of Agricultural and Food Chemistry · doi:10.1021/acs.jafc.6b05007 · Cited by 56
Duncan, R. J., McClelland, M. M., & Acock, A. C. (2017) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2017.01.004 · Cited by 68
Hoekstra, R., Monden, R., van Ravenzwaaij, D., & Wagenmakers, E. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195474 · Cited by 55
“This important caveat was recently underscored in a report from the American Statistical Association : “a relatively large p -value does not imply evidence in favor of the null hypothesis” [11], p. 132.”
Hart, R. J., Frederiksen, H. W., Doherty, D. A., Keelan, J. A., Skakkebæk, N. E., Minaee, N. S., McLachlan, R. I., Newnham, J. P., Dickinson, J. E., Pennell, C. E., et al. (2018) · Frontiers in Endocrinology · doi:10.3389/fendo.2018.00288 · Cited by 57
Murray, E. J., Caniglia, E. C., Swanson, S. A., Hernández–Dı́az, S., & Hernán, M. Á. (2018) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2018.06.009 · Cited by 58
“Although we did not ask patients or investigators about p-values, current statistical best practices discourage such reliance on p-values.(25) These findings are supported by literature on patient-clinician communication and statistical literacy.”
BackgroundAn a priori solution to the replication crisis
Trafimow, D. (2018) · Philosophical Psychology · doi:10.1080/09515089.2018.1490707 · Cited by 56
“The American Statistical Association came out with a recent statement admitting that p-values do not justify conclusions about hypotheses (Wasserstein & Lazar, 2016).”
BackgroundNonprobability Sampling and Causal Analysis
Köhler, U., Kreuter, F., & Stuart, E. A. (2018) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-030718-104951 · Cited by 64
“…Mill 1843, Neyman et al. 1935, Rubin 1974, and Pearl 2009 for important milestones of the potential outcome framework; also see King et al. 1994, Winship & Morgan 1999, Angrist & Pischke 2009, and Rubin 2001 for explanations and examples addressed to specific disciplines, and Dawid 2015 for…”
Leisman, D. E. (2019) · Critical Care Medicine · doi:10.1097/ccm.0000000000003567 · Cited by 56
On the Impact of Programming Languages on Code Quality
Berger, E. D., Hollenbeck, C., Maj, P., Vitek, O., & Vitek, J. (2019) · ACM Transactions on Programming Languages and Systems · doi:10.1145/3340571 · Cited by 61
“oefficients. This is quite narrow, in that the p-values are largely driven by the number of observations in the dataset [7]. Small p-values do not necessarily imply practically important associations [2, 21]. In contrast, practical significancecan be assessed by examining model-based prediction intervals [10], which p…”
BackgroundTo test or to estimate? P ‐values versus effect sizes
Dunkler, D., Haller, M. C., Oberbauer, R. W., & Heinze, G. (2019) · Transplant International · doi:10.1111/tri.13535 · Cited by 58
Cognitive Efficacy of Pharmacologic Treatments in Multiple Sclerosis: A Systematic Review
Chen, M. H., Goverover, Y., Genova, H. M., & DeLuca, J. (2020) · CNS Drugs · doi:10.1007/s40263-020-00734-4 · Cited by 58
Infosonics: Accessible Infographics for People who are Blind using Sonification and Voice
Holloway, L. M., Goncu, C., Ilsar, A., Butler, M., & Marriott, K. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517465 · Cited by 57
“We present p-values in our statistical analysis but, as advocated by the American Statistical Association [67] and others [56], we do not use this as evidence for signifcance.”
MethodThree common misuses of P values
Kim, J., & Bang, H. (2016) · Dental Hypotheses · doi:10.4103/2155-8213.190481 · Cited by 61
Cristea, I. A., & Ioannidis, J. P. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197440 · Cited by 56
Peer tutoring in mathematics in primary education: a systematic review
Alegre, F., Miravet, L. M., Maroto, A., & Valentín, G. L. (2018) · Educational Review · doi:10.1080/00131911.2018.1474176 · Cited by 69
“The excess of statistically significant results in the published literature (Wasserstein and Lazar 2016) must also be considered.”
BackgroundMulti-Modal Analgesic Strategy for Trauma: A Pragmatic Randomized Clinical Trial
Harvin, J. A., Albarado, R. P., Truong, V. T. T., Green, C., Tyson, J. E., Pedroza, C., Wade, C. E., Kao, L. S., Hudson, J. A., Taub, E. A., et al. (2021) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2020.12.014 · Cited by 55
Oldfield, E. E., Bradford, M. A., Augarten, A. J., Cooley, E. T., Radatz, A. M., Radatz, T., & Ruark, M. D. (2021) · Soil Science Society of America Journal · doi:10.1002/saj2.20349 · Cited by 55
Farland, L. V., Correia, K. F. B., Wise, L. A., Williams, P. L., Ginsburg, E. S., & Missmer, S. A. (2016) · Human Reproduction · doi:10.1093/humrep/dew192 · Cited by 59
“…2014; Rothman, 2014; Schmidt and Rothman, 2014; Greenland et al., 2016), but recently P-values gained national attention after the American Statistical Association (ASA) released a statement on statistical significance and the use of P-values for data interpretation (Wasserstein and Lazar, 2016).”
BackgroundLee, V. R., Fischback, L., & Cain, R. (2019) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2019.101789 · Cited by 59
Thomas, C. E., Gastin, P. B., Abbott, G., & Main, L. C. (2020) · European Journal of Sport Science · doi:10.1080/17461391.2020.1775894 · Cited by 60
“No specific threshold for statistical significance was used within the current study as this approach of drawing conclusions has been heavily criticized in the research literature (Wasserstein & Lazar, 2016).”
MethodLipocalin-2 is an anorexigenic signal in primates
Πετροπούλου, Π.-Ι., Mosialou, I., Shikhel, S., Hao, L., Panitsas, K., Bisikirska, B. C., Luo, N., Bahna, F. A., Kim, J., Carberry, P., et al. (2020) · eLife · doi:10.7554/elife.58949 · Cited by 61
Howey, R. A. J., Shin, S., Relton, C. L., Smith, G. D., & Cordell, H. J. (2020) · PLoS Genetics · doi:10.1371/journal.pgen.1008198 · Cited by 57
“Although we concur with the opinion [54] that, in real data analysis, use of absolute p -value thresholds should be avoided, we do not in fact propose that any particular threshold should be considered as “correct”; here we instead use the thresholds as heuristics and examine the performance of the…”
BackgroundMethodResultUluğ, Ö. M., & Tropp, L. R. (2020) · Journal of Applied Social Psychology · doi:10.1111/jasp.12731 · Cited by 54
“…= 1.29) than participants in the control condition (M = 2.02, SD = 1.17); however, this mean difference was not statistically significant according to conventional levels for testing statistical significance, t(256) = -1.89, p = .060 (see, e.g., Gelman & Hal Stern, 2006; Wasserstein & Lazar, 2016).”
BackgroundInfluentialPermutation tests are robust and powerful at 0.5% and 5% significance levels
Noguchi, K., Konietschke, F., Marmolejo‐Ramos, F., & Pauly, M. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01595-5 · Cited by 59
How to embrace variation and accept uncertainty in linguistic and psycholinguistic data analysis
Vasishth, S., & Gelman, A. (2021) · Linguistics · doi:10.1515/ling-2019-0051 · Cited by 76
Stoner, L. R., Gibbs, B. B., Meyer, M. L., Fryer, S. M., Credeur, D. P., Paterson, C. A., Stone, K. J., Hanson, E. D., Kowalsky, R. J., Horiuchi, M., et al. (2021) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2021.716938 · Cited by 60
Incisional Wound Irrigation for the Prevention of Surgical Site Infection
Groenen, H., Bontekoning, N., Jalalzadeh, H., Buis, D. R., Dreissen, Y. E. M., Goosen, J. H. M., Graveland, H., Griekspoor, M., IJpma, F. F. A., van der Laan, M. J., et al. (2024) · JAMA Surgery · doi:10.1001/jamasurg.2024.0775 · Cited by 57
HindSight: Encouraging Exploration through Direct Encoding of Personal Interaction History
Feng, M., Deng, C., Peck, E. M., & Harrison, L. (2016) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2016.2599058 · Cited by 52
“In response to concerns about the limitations of null hypothesis significance testing [7, 35], we model our analyses on recent visualization research that seeks to move beyond these limitations [6], primarily focusing on confidence intervals and effect sizes.”
MethodNhu, T. T., Schaubroeck, T., Henriksson, P. J. G., et al. (2016) · Environmental Pollution · doi:10.1016/j.envpol.2016.10.006 · Cited by 54
“We also advocate for the proper interpretation of p-values and their limitations (Wasserstein and Lazar, 2016).”
BackgroundMeador, J., Yeh, A., & Gallagher, E. (2018) · Environmental Pollution · doi:10.1016/j.envpol.2018.02.007 · Cited by 47
“We consider the p-values from the posthoc tests to be an important indicator of the relationship between observed data and the null hypothesis of no treatment effect (Hurlbert and Lombardi, 2009; Wasserstein and Lazar, 2016).”
MethodAssessing Statistical Results: Magnitude, Precision, and Model Uncertainty
Anderson, A. A. (2019) · The American Statistician · doi:10.1080/00031305.2018.1537889 · Cited by 54
“The American Statistical Association statement on p-values (Wasserstein and Lazar 2016), calls for moving beyond “bright line rules” when evaluating empirical results.”
BackgroundNonparametric multiple comparisons
Noguchi, K., Abel, R. S., Marmolejo‐Ramos, F., & Konietschke, F. (2019) · Behavior Research Methods · doi:10.3758/s13428-019-01247-9 · Cited by 58
Environment and health: Risk perception and its determinants among Italian university students
Carducci, A., Fiore, M., Azara, A., Bonaccorsi, G., Bortoletto, M., Caggiano, G., Calamusa, A., Donno, A. D., Giglio, O. D., Dettori, M., et al. (2019) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2019.07.201 · Cited by 54
“to give importance to information that have not and, vice versa, to neglect important data (Rothman et al., 2008; Wasserstein and Lazar, 2016).”
BackgroundNaclerio, R. M., Baroody, F. M., Bachert, C., Bleier, B. S., Borish, L., Brittain, E., Chupp, G. L., Fisher, A., Fokkens, W. J., Gevaert, P., et al. (2020) · The Journal of Allergy and Clinical Immunology In Practice · doi:10.1016/j.jaip.2020.02.023 · Cited by 53
Simning, A., & Simons, K. V. (2017) · International Psychogeriatrics · doi:10.1017/s1041610216001733 · Cited by 47
“Our systematic review ultimately shows that the evidence base for treating depression in nursing facility residents who are cognitively intact or with only mild impairment has significant limitations: (1) there was a notable lack of high-quality, large-scale RCTs, (2) participant characteristics varied widely with man…”
BackgroundKatz, D., Bateman, B. T., Kjaer, K., Turner, D. P., Spence, N. Z., Habib, A. S., George, R. B., Toledano, R. D., Grant, G., Madden, H. E., et al. (2021) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000005592 · Cited by 52
Amrhein, V., & Greenland, S. (2022) · Journal of Information Technology · doi:10.1177/02683962221105904 · Cited by 51
Serrone, G. D., & Moretti, L. (2023) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2023.136564 · Cited by 56
Yang, S., Martin, R. M., Oken, E., Hameza, M., Doniger, G. M., Amit, S., Patel, R., Thompson, J., Rifas‐Shiman, S. L., Vilchuck, K., et al. (2018) · PLoS Medicine · doi:10.1371/journal.pmed.1002554 · Cited by 53
Bello, N. M., & Renter, D. G. (2018) · Journal of Dairy Science · doi:10.3168/jds.2017-13978 · Cited by 65
Dose of Early Therapeutic Mobility: Does Frequency or Intensity Matter?
Winkelman, C., Sattar, A., Momotaz, H., Johnson, K. D., Morris, P. E., Rowbottom, J. R., Thornton, J. D., Feeney, S., & Levine, A. D. (2018) · Biological Research For Nursing · doi:10.1177/1099800418780492 · Cited by 60
Problematic Internet Use, Social Needs, and Social Support Among Youth
Prievara, D. K., Piko, B. F., & Łuszczyńska, A. (2018) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-018-9973-x · Cited by 57
Evolution in statistics: P values, statistical significance, kayaks, and walking trees
Curran‐Everett, D. (2020) · AJP Advances in Physiology Education · doi:10.1152/advan.00054.2020 · Cited by 53
Gestational and childhood exposure to phthalates and child behavior
Li, N., Papandonatos, G. D., Calafat, A. M., Yolton, K. A., Lanphear, B. P., Chen, A., & Braun, J. M. (2020) · Environment International · doi:10.1016/j.envint.2020.106036 · Cited by 54
Stable Isotope Composition of River Waters across the World
Nan, Y., Tian, F., Hu, H., Wang, L., & Zhao, S. (2019) · Water · doi:10.3390/w11091760 · Cited by 54
Feinkohl, I., Janke, J., Slooter, A. J. C., Winterer, G., Spies, C., & Pischon, T. (2023) · British Journal of Anaesthesia · doi:10.1016/j.bja.2023.04.031 · Cited by 55
“43 The absence of an association of POD with POCD was unexpected 44 and may indicate measurement problems, though incidences of POD (19.5”
BackgroundInfluentialBenkendorf, D. J., Schwartz, S. D., Cutler, D. R., & Hawkins, C. P. (2023) · Ecological Modelling · doi:10.1016/j.ecolmodel.2023.110414 · Cited by 61
Statistical comparison of classifiers through Bayesian hierarchical modelling
Giorgio Corani, A., Benavoli, A., Demšar, J., et al. (2017) · Machine Learning · doi:10.1007/s10994-017-5641-9 · Cited by 54
“Null hypotheses can virtually always be rejected by increasing the sample size (Wasserstein & Lazar, 2016), since the p-value depends both on the actual difference between the two classifiers and number of collected observations.”
BackgroundNull hypothesis significance testing and Type I error: The domain problem
Trafimow, D., & Earp, B. (2017) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2017.01.002 · Cited by 57
Kulikowski, K., & Sedlak, P. (2017) · Current Psychology · doi:10.1007/s12144-017-9768-4 · Cited by 76
“…suggests: BScientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold^ (Wasserstein and Lazar 2016, p.131), and, in view of this, this study provides a set of analysis which allows us to suggest that there is no evidence…”
BackgroundThe Academic Adaptation of Immigrant Students with Interrupted Schooling
Potochnick, S. (2018) · American Educational Research Journal · doi:10.3102/0002831218761026 · Cited by 61
“For all of these analyses, I report p-values at the .10 level because the relatively smaller sample of students with interrupted schooling (~140) may limit power and increase the probability of a Type II error, that is, failing to detect an effect that is present (Wasserstein & Lazar, 2016).”
Multi-objective bayesian optimization for analog/RF circuit synthesis
Lyu, W., Yang, F., Yan, C., et al. (2018) · Proceedings - ACM IEEE Design Automation Conference · doi:10.1145/3195970.3196078 · Cited by 52
Fan Therapy for the Treatment of Dyspnea in Adults: A Systematic Review
Yu, Q., Wu, Y., de Moraes, A. R., Xue, Y., Geng, Y., Dibaj, S. S., Liu, D., Naberhuis, J., & Bruera, E. D. (2019) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2019.04.011 · Cited by 52
A Frequentist Alternative to Significance Testing, p-Values, and Confidence Intervals
Trafimow, D. (2019) · Econometrics · doi:10.3390/econometrics7020026 · Cited by 55
“The American Statistical Association (Wasserstein and Lazar 2016) admits that p-values provide a poor justification for drawing conclusions about hypotheses.”
BackgroundMartin, J. S., Koski, S. E., Bugnyar, T., Jaeggi, A. V., & Massen, J. J. M. (2021) · Animal Behaviour · doi:10.1016/j.anbehav.2020.12.016 · Cited by 53
Wu, Y., Qie, R., Cheng, M., Zeng, Y., Huang, S., Guo, C., Zhou, Q., Li, Q., Tian, G., Han, M., et al. (2021) · Environmental Pollution · doi:10.1016/j.envpol.2021.117152 · Cited by 50
Zaaqoq, A. M., Barnett, A. G., Griffee, M., MacLaren, G., Jacobs, J. P., Heinsar, S., Suen, J. Y., Bassi, G. L., Fraser, J. F., Dalton, H. J., et al. (2021) · Critical Care Medicine · doi:10.1097/ccm.0000000000005296 · Cited by 52
Landscape drivers of pests and pathogens abundance in arable crops
Delaune, T., Ouattara, M. S., Ballot, R., Sausse, C., Félix, I., Maupas, F., Chen, M., Morison, M., Makowski, D., & Barbu, C. (2021) · Ecography · doi:10.1111/ecog.05433 · Cited by 46
Ren, W., Sun, C., Lu, N.-N., et al. (2016) · Journal of Applied Clinical Medical Physics · doi:10.1120/jacmp.v17i6.6464 · Cited by 51
“05 was thought statistically significant.(27)”
The clinical application of suicide risk assessment: A theory‐driven approach
Mitchell, S. M., Brown, S. L., Roush, J. F., Bolaños, A. D., Littlefield, A. K., Marshall, A. J., Jahn, D. R., Morgan, R. D., & Cukrowicz, K. C. (2017) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2086 · Cited by 52
Shochet, L. R., Kerr, P. G., & Polkinghorne, K. R. (2017) · Kidney International · doi:10.1016/j.kint.2017.05.011 · Cited by 50
On the independence of statistical randomness tests included in the NIST test suite
Sulak, F., Uğuz, M., KOÇAK, O., et al. (2017) · TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES · doi:10.3906/elk-1605-212 · Cited by 51
“A P-value is the probability under a specified statistical model that a statistical summary of the data would be equal to or more extreme than its observed value [1].”
BackgroundZieffler, A., Garfield, J., & Fry, E. B. (2017) · Springer international handbooks of education · doi:10.1007/978-3-319-66195-7_2 · Cited by 51
COHAN, S. L., Moses, H., Calkwood, J., et al. (2018) · Multiple Sclerosis and Related Disorders · doi:10.1016/j.msard.2018.02.028 · Cited by 51
Late Transitions and Bereaved Family Member Perceptions of Quality of End‐of‐Life Care
Makaroun, L. K., Teno, J. M., Freedman, V. A., Kasper, J. D., Gozalo, P. L., & Mor, V. (2018) · Journal of the American Geriatrics Society · doi:10.1111/jgs.15455 · Cited by 52
Low, S. K., Smolkowski, K., Cook, C. R., & Desfosses, D. A. (2018) · Developmental Psychology · doi:10.1037/dev0000621 · Cited by 64
Nazari, G., Bobos, P., MacDermid, J. C., & Birmingham, T. B. (2019) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2019.01.017 · Cited by 51
A Proposed Hybrid Effect Size Plus p -Value Criterion: Empirical Evidence Supporting its Use
Goodman, W. M., Spruill, S. E., & Komaroff, E. (2019) · The American Statistician · doi:10.1080/00031305.2018.1564697 · Cited by 56
“Shortly following the release of this policy statement, the publishers of The American Statistician, Taylor & Francis Group, made available a supplement of statements from 23 well-respected statisticians from around the world (Wasserstein and Lazar 2016b).”
BackgroundMethodInfluentialCullen, T., Thomas, G., Wadley, A. J., & Myers, T. (2019) · Journal of Sports Sciences · doi:10.1080/02640414.2019.1662539 · Cited by 52
“…that are more intuitively interpretable than those from traditional (NHST) and avoids recent concerns about the misinterpretation of p-values (Wasserstein & Lazar, 2016) and the appropriateness of using statistical significance as a scientific decisionmaking tool (Amrhein, Greenland, &…”
BackgroundThe voice of COVID-19: Acoustic correlates of infection in sustained vowels
Bartl-Pokorny, K. D., Pokorny, F. B., Batliner, A., Amiriparian, S., Semertzidou, A., Eyben, F., Kramer, E., Schmidt, F., Schönweiler, R., Wehler, M., et al. (2021) · The Journal of the Acoustical Society of America · doi:10.1121/10.0005194 · Cited by 55
“As null-hypothesis testing with p -values as decisive criterion has been repeatedly criticised (see the statement by the American Statistical Association [ 20 ], we here report p -values as additional descriptive measures and do not employ them for accepting or rejecting a null-hypothesis.”
The Impact of Health Information Exchanges on Emergency Department Length of Stay
Ayer, T., Ayvaci, M., Karaca, Z., & Vlachy, J. (2017) · Production and Operations Management · doi:10.1111/poms.12953 · Cited by 51
“…with this approach, we draw on the most recent recommendations by the American Statistical Society: (i) capture the uncertainty in the estimates via standard errors and (ii) highlight practical signifi-cance of the effects by providing easily-interpretable percentages (Wasserstein and Lazar 2016).”
Validation of stock assessment methods: is it me or my model talking?
Kell, L. T., Sharma, R., Kitakado, T., Winker, H., Mosqueira, I., Cardinale, M., & Fu, D. (2021) · ICES Journal of Marine Science · doi:10.1093/icesjms/fsab104 · Cited by 55
Zhu, J., Guo, M., Yang, T., Lai, X., Tang, T., Chen, J., Li, L., & Li, T. (2020) · Frontiers in Pediatrics · doi:10.3389/fped.2020.00469 · Cited by 50
New Insights Into the Alleged Kidney Donor Profile Index Labeling Effect on Kidney Utilization
Stewart, D. E., Garcia, V. C., Aeder, M. I., & Klassen, D. K. (2017) · American Journal of Transplantation · doi:10.1111/ajt.14379 · Cited by 52
“Appropriate interpretation of statistical evidence should not rely heavily on arbitrary pvalue thresholds (18,19).”
BackgroundGefen, D., Endicott, J. E., Fresneda, J. E., Miller, J., & Larsen, K. R. T. (2017) · Communications of the Association for Information Systems · doi:10.17705/1cais.04121 · Cited by 51
“Likewise, researchers should not blindly apply rules of thumb (as the American Statistical Association also demands in the case of p-values (Wasserstein & Lazar, 2016)).”
MethodMultiple Perspectives on Inference for Two Simple Statistical Scenarios
van Dongen, N. N. N., van Doorn, J. B., Gronau, Q. F., van Ravenzwaaij, D., Hoekstra, R., Haucke, M. N., Lakens, D., Hennig, C. M., Morey, R. D., Homer, S., et al. (2019) · The American Statistician · doi:10.1080/00031305.2019.1565553 · Cited by 49
“Even today, the paradigmatic debates show no sign of stalling, neither in the published literature (e.g., Benjamin et al. 2018; McShane et al. in press; Wasserstein and Lazar 2016) nor on social media.”
BackgroundPutting the P -Value in its Place
Krueger, J. I., & Heck, P. R. (2019) · The American Statistician · doi:10.1080/00031305.2018.1470033 · Cited by 51
“The conventional criterion for declaring significance is p < 0.05, and much has been made of the presumed rigidity of its application (Greenland 2017; Wasserstein and Lazar 2016).”
BackgroundInfluentialChang, K., Cooper, O. R., Gaudel, A., Petropavlovskikh, I. V., & Thouret, V. (2020) · Atmospheric chemistry and physics · doi:10.5194/acp-20-9915-2020 · Cited by 49
Sand, A., Hagberg, E., & Lohmander, A. (2022) · Journal of Speech Language and Hearing Research · doi:10.1044/2021_jslhr-21-00367 · Cited by 51
Statistical significance versus clinical relevance
van Rijn, M. H. C., Bech, A. P., Bouyer, J., & van den Brand, J. A. J. G. (2016) · Nephrology Dialysis Transplantation · doi:10.1093/ndt/gfw385 · Cited by 49
“Last March, the American Statistical Association (ASA) posted a statement on the correct use of P-values [1].”
BackgroundInfluentialPerneger, T., & Combescure, C. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.04.003 · Cited by 51
A validation of 11 body-condition indices in a giant snake species that exhibits positive allometry
Falk, B. G., Snow, R. W., & Reed, R. N. (2017) · PLoS ONE · doi:10.1371/journal.pone.0180791 · Cited by 49
Mao, G., Wu, P., Zhang, Z., Zhang, Z., Liao, W., Li, Y., & Kang, Y. Q. (2017) · Cellular Physiology and Biochemistry · doi:10.1159/000484579 · Cited by 49
Nash, P. T., McInnes, I. B., Mease, P. J., Thom, H. H. Z., Hünger, M., Karabis, A., Gandhi, K. K., Mpofu, S., & Jugl, S. M. (2018) · Rheumatology and Therapy · doi:10.1007/s40744-018-0106-6 · Cited by 49
Coupé, C. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.00513 · Cited by 48
“First, large digital datasets such as WALS (Dryer and Haspelmath, 2013), ASJP (Wichmann et al., 2016), Lapsyd (Maddieson et al., 2013), or D-Place (Kirby et al., 2016) are freely and readily available for computational analysis.”
MethodGlazebrook, M. A., Blundell, C. M., O’Dowd, D., et al. (2018) · Foot & Ankle International · doi:10.1177/1071100718815469 · Cited by 49
Bell, J. A., Hamer, M., Richmond, R. C., Timpson, N. J., Carslake, D., & Smith, G. D. (2018) · PLoS Medicine · doi:10.1371/journal.pmed.1002649 · Cited by 50
“precision and interpret P values as continuous indicators of evidence strength [33,34].”
BackgroundReporting errors and biases in published empirical findings: Evidence from innovation research
Bruns, S. B., Asanov, I., Bode, R., Dunger, M., Funk, C., Hassan, S. M., Hauschildt, J., Heinisch, D. P., Kempa, K., König, J., et al. (2019) · Research Policy · doi:10.1016/j.respol.2019.05.005 · Cited by 50
The trouble with the curve: Reevaluating the Gulf of Mexico sea-level curve
Joy, S. (2019) · Quaternary International · doi:10.1016/j.quaint.2019.07.023 · Cited by 49
Miano, T. A., Flesch, J. D., Feng, R., Forker, C. M., Brown, M., Oyster, M. L., Kalman, L., Rushefski, M., Cantu, E., Porteus, M. K., et al. (2019) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1629 · Cited by 48
Brophy, J. M. (2020) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2020.1647 · Cited by 49
Newcomer, M., Bouskill, N., Wainwright, H. M., Maavara, T., Arora, B., Siirila‐Woodburn, E. R., Dwivedi, D., Williams, K. H., Steefel, C. I., & Hubbard, S. S. (2021) · Global Biogeochemical Cycles · doi:10.1029/2020gb006777 · Cited by 50
“To provide a robust approach to interpretation of trends (Renwick et al., 2018; Wasserstein & Lazar, 2016), statistical significance of trend tests and persistence of trends were obtained from three metrics: (1) the significance p-value for the linear slope (β) at the p < 0.05 value, (2) the…”
MethodInfluentialCharacterization of delay propagation in the air traffic network
Li, Q., & Jing, R. (2021) · Journal of Air Transport Management · doi:10.1016/j.jairtraman.2021.102075 · Cited by 55
Inter-Rebel Alliances in the Shadow of Foreign Sponsors
Popović, M. (2017) · International Interactions · doi:10.1080/03050629.2017.1414812 · Cited by 50
Lewnard, J. A., Fries, L. F., Cho, I., Chen, J., & Laxminarayan, R. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2112410119 · Cited by 49
“Relevant considerations for the interpretation of statistical testing and effect size measurement in the context of secondary data analyses have been described elsewhere (53, 54).”
Method
Metadata
- Authors
- Wasserstein, R. L., & Lazar, N. A.
- Affiliations
- American Statistical Association, 732 North Washington Street, Alexandria, VA 22314-1943
- American Statistical Association (US)
- ORCID
- Lazar, Nicole A.
- Venue
- The American Statistician
- Publisher
- Informa UK Limited
- Published
- 2016-04-02
- Volume
- 70
- Issue
- 2
- Pages
- 129-133
- ISSN
- 0003-1305 (ISSN-L)
- 1537-2731
- OpenAlex
- W2293040502
- Semantic Scholar
- 81a65f23474ffceb2481836328608102950da979
- Cited by
- 6,306
- References
- 45
- Citations by year
- 2026: 625 · 2025: 629 · 2024: 575 · 2023: 543 · 2022: 642 · 2021: 676 · 2020: 678 · 2019: 666 · 2018: 596 · 2017: 438 · 2016: 226
- FWCI
- 649.74
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The American Statistician (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- p-values, statistical evidence, p-value interpretation, statistical inference, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
