The DOI matches its Crossref record; 50 of the 50 references it cites were found in a registry or an index; none of the 1 sources its claims cite is checked for support yet.
The ASA Statement on p -Values: Context, Process, and Purpose
Open accessAbstract
Emeritus of Mathematics and Statistics at
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
24 Own interpretation · 2 No basis given · 1 No full text of the sources
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The widespread use of”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Statistical significance is not equivalent to scientific, human, or economic significance.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“For example, a p-value near 0.05 taken by itself offers only weak evidence against the null hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“By itself, a p-value does not provide a good measure of evidence regarding a model or hypothesis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Similarly, identical estimated effects will have different p-values if the precision of the estimates differs.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A p-value provides one approach to summarizing the incompatibility between a particular set of data and a proposed model for the data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Conducting multiple analyses of the data and reporting only those with certain p-values (typically those passing a significance threshold) renders the reported p-values essentially uninterpretable.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: unclear — It is unclear why the paper says it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Whenever a researcher chooses what to present based on statistical results, valid interpretation of those results is severely compromised if the reader is not informed of the choice and its basis.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
boosteddirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The smaller the p-value, the greater the statistical incompatibility of the data with the null hypothesis, if the underlying assumptions used to calculate the p-value hold.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Valid scientific conclusions based on p-values and related statistics cannot be drawn without at least knowing how many and which analyses were conducted, and how those analyses (including p-values) were selected for reporting.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plainconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Probably not a substantial claim. 10
- It may state two separate claims as one. 10
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“This has led to some scientific journals discouraging the use of p-values, and some scientists and statisticians recommending their abandonment, with some arguments essentially unchanged since p-values were first introduced.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
The paper states this without a source or data behind it here, so there is nothing to check it against. The quote shows it is in the paper.
In the paper
“The statistical community has been deeply concerned about issues of reproducibility and replicability of scientific conclusions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“While the p-value can be a useful statistical measure, it is commonly misused and misinterpreted.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“A conclusion does not immediately become”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“All these measures and approaches rely on further assumptions, but they may more directly address the size of an effect (and its associated uncertainty) or whether the hypothesis is correct.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
hedgedconditional- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The validity of scientific conclusions, including their reproducibility, depends on more than the statistical methods themselves.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. The paper may give no reason why it holds.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“It is a statement about data in relation to a specified hypothetical explanation, and is not a statement about the explanation itself.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Researchers should recognize that a p-value without context or other evidence provides limited information.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Likewise, a relatively large p-value does not imply evidence in favor of the null hypothesis; many other hypotheses may be equally or more consistent with the observed data.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This incompatibility can be interpreted as casting doubt on or providing evidence against the null hypothesis or the underlying assumptions.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. P-values can indicate how incompatible the data are with a specified statistical model.
plaincorrelational- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Appropriately chosen techniques, properly conducted analyses and correct interpretation of statistical results also play a key role in ensuring that conclusions are sound and that uncertainty surrounding them is represented properly.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 1. Introduction
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: fails — It may be too vague to check against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: fails — The paper may give no reason why it holds.
Probably not a substantial claim. It may be too vague to check against evidence. The paper’s conclusions may not depend on it. The paper may give no reason why it holds. It may state two separate claims as one.
In the paper
“Misunderstanding or misuse of statistical inference is only one cause of the”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > Abstract
What the sources say
- Not checked — no full text of the sourcecites Peng 2015 source
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Smaller p-values do not necessarily imply the presence of larger or more important effects, and larger p-values do not imply a lack of importance or even lack of effect.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 3. Scientific conclusions and business or policy decisions should not be based only on whether a p-value passes a specific threshold.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 2. P-values do not measure the probability that the studied hypothesis is true, or the probability that the data were produced by random chance alone.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
It may state two separate claims as one.
A conclusion the paper draws from its own results — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In view of the prevalent misuses of and misconceptions concerning p-values, some statisticians prefer to supplement or even replace p-values with other approaches.”
§ The ASA's Statement on p-Values: Context, Process, and Purpose In > 4. Other Approaches
plaindirect- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: fails — The paper’s conclusions may not depend on it.
- Based: passes — The paper gives a reason why it holds.
Probably not a substantial claim. The paper’s conclusions may not depend on it.
The paper relies on this without support.
There is widespread consensus in the statistical community on the principles articulated in the ASA statement.
“according to widespread consensus in the statistical community”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While the large scale of the Tabula Muris Senis dataset provides substantial power to predict subtle changes in LR interactions, the biological complexity, dependencies among communication pairs, and multiple testing burden require that these p-values be interpreted within a broader biological and statistical context [33].”
From Quantitative profiling of lifespan-dependent cell-cell communication potential reveals dynamic ligand-receptor network shifts across mouse tissues (2026) · cites this paper as [33]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“These types of incorrect descriptions contribute to confirmation bias, overinterpretation of results, and reporting correlation as implied causation (Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“This is especially true of relatively large-sample-size studies (as most learning analytics studies are), which are likely to obtain statistically significant findings in relatively small variations in measures such as GPA (Field 2017; Salkind 2016 Wasserstein and Lazar 2016).”
From Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies (2019) · cites this paper as Wasserstein and Lazar 2016
In the citing paper
“In 2016, the American Statistical Association released a statement on statistical significance and the P value with six principles underlying the proper use and interpretation of this statistical tool (77).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [77]
In the citing paper
“Although we also present p values for exploratory analyses, we refrain from labeling any of them as statistically significant, following best-practice recommendations for statistical analysis [43].”
From Comparing quality of reporting between preprints and peer-reviewed articles in the biomedical literature (2020) · cites this paper as [43]
In the citing paper
“Contrary to IJE author recommendations and recent guidance from the American Statistics Society, 16 Gao et al. largely base their conclusions on findings with a P -value equivalent to < 0.05 after multiple testing.”
From Commentary: Two-sample Mendelian randomization: opportunities and challenges (2016) · cites this paper as [16]
In the citing paper
“Following guidance,50 we focused on 95% CIs, rather than statistical significance. For example, unlike conventional interpretations, we did not outright interpret an effect estimate “non‐significant” if the lower or upper bound of the 95% CI was slightly above/below the null value; we interpreted them as “suggestive” of an effect.”
From Third‐wave cognitive behaviour therapies for weight management: A systematic review and network meta‐analysis (2020) · cites this paper as [50]
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
(1947) · The American Statistician · doi:10.1080/00031305.1947.10501534 · Cited by 3,745
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
Statistics notes: Absence of evidence is not evidence of absence
Altman, D. G., & Bland, J. M. (1995) · BMJ · doi:10.1136/bmj.311.7003.485 · Cited by 1,946
Smithson, M. J. (2000) · SAGE Publications Ltd eBooks · doi:10.4135/9781446218525 · Cited by 1,871
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Scientific method: Statistical errors
Nuzzo, R. (2014) · Nature · doi:10.1038/506150a · Cited by 1,536
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Sterne, J. A. C. (2001) · BMJ · doi:10.1136/bmj.322.7280.226 · Cited by 1,466
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Research works printed but not linked: 5
- Leek, J. (2014), “On the Scalability of Statistical Procedures: Why the p-Value Bashers Just Don't Get It,” Simply Statistics Blog, Available at http://simplystatistics.org/2014/02/14/on-the-scalability-of-statistical-procedures-why-the-p-value-bashers-just-dont-get-it/.
- Gelman A. and Loken E. (2014) “The Statistical Crisis in Science [online] ” American Scientist 102. Available at http://www.americanscientist.org/issues/feature/2014/6/the-statistical-crisis-in-science · DOI · Paper page
- Greenland, S., and Poole, C. (2011), “Problems in Common Interpretations of Statistics in Scientific Articles, Expert Reports, and Testimony,” Jurimetrics, 51, 113–129.
- 10.1214/13-AOS1123 · DOI
- Lavine, M. (1999), “What is Bayesian Statistics and Why Everything Else is Wrong,” UMAP Journal, 20, 2.
Cited by
Sorted by citations
Items 601–700 of 6,272
Application of Bayesian methods to accelerate rare disease drug development: scopes and hurdles
Kidwell, K., Roychoudhury, S., Wendelberger, B. A., Scott, J., Moroz, T., Yin, S., Majumder, M., Zhong, J., Huml, R. A., & Miller, V. (2022) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-022-02342-5 · Cited by 48
“Challenges of frequentist analysis include difficulty comprehending the proper meaning of the p-value and confidence intervals, inability to estimate the probability of clinical benefit, and no straightforward mechanism for combining external information with internal trial data [25, 26].”
BackgroundBell, J. A., Richardson, T. G., Wang, Q., Sanderson, E. C. M., Palmer, T., Walker, V. M., O’Keeffe, L. M., Timpson, N. J., Cichońska, A., Julkunen, H., et al. (2022) · The Lancet Regional Health - Europe · doi:10.1016/j.lanepe.2022.100457 · Cited by 47
Mapping Landslide Susceptibility Over Large Regions With Limited Data
Woodard, J., Mirus, B. B., Crawford, M. M., Or, D., Leshchinsky, B. A., Allstadt, K. E., & Wood, N. (2023) · Journal of Geophysical Research Earth Surface · doi:10.1029/2022jf006810 · Cited by 50
“These benefits help to prevent model users from making unjustified conclusions about the data compared to traditional frequentist models (Wasserstein & Lazar, 2016).”
BackgroundReplication initiatives will not salvage the trustworthiness of psychology
Coyne, J. C. (2016) · BMC Psychology · doi:10.1186/s40359-016-0134-3 · Cited by 46
“Andrew Gelman [32] has provided a valuable elaboration of the American Statistical Association statement on p-values [33] with: “Valid p-values cannot be drawn without knowing, not just what was done with the existing data, but what the choices in data coding, exclusion, and analysis would have been, had the data been…”
BackgroundDegerud, E., Ariansen, I., Ystrøm, E., Graff‐Iversen, S., Høiseth, G., Mørland, J. G., Smith, G. D., & Næss, Ø. (2018) · PLoS Medicine · doi:10.1371/journal.pmed.1002476 · Cited by 48
“We did not impose a p-value cutoff to define statistical significance [33] nor apply survey weights.”
MethodDardiotis, E., Siokas, V., Sokratous, M., et al. (2018) · Environment International · doi:10.1016/j.envint.2018.04.008 · Cited by 48
Kell, H. J. (2019) · ETS Research Report Series · doi:10.1002/ets2.12241 · Cited by 63
“Due to long-standing concerns about statistical significance and its (mis)interpretation (Wasserstein & Lazar, 2016), all effect sizes were summarized, regardless of their significance.”
BackgroundModongo, C., Wang, Q., Dima, M., et al. (2019) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000002126 · Cited by 48
Li, J. J., & Tong, X. (2020) · Patterns · doi:10.1016/j.patter.2020.100115 · Cited by 57
“ity and meanwhile common misuses of hypothesis testing, there are recent in-depth and extensive discussions on the proper use and interpretation of p-values in and outside of the statistics community [14, 13]. In multiple testing, the choice of value is determined by an overall objective on all tests together, and two…”
MethodA biosocial return to race? A cautionary view for the postgenomic era
Meloni, M., Moll, T., Issaka, A., & Kuzawa, C. W. (2022) · American Journal of Human Biology · doi:10.1002/ajhb.23742 · Cited by 49
Selective Inference: The Silent Killer of Replicability
Benjamini, Y. (2020) · Harvard Data Science Review · doi:10.1162/99608f92.fc62b261 · Cited by 54
“The board of the American Statistical Association (ASA) caved in to this pressure and started a yearlong discussion about the misinterpretation and misuses of the p-value, rather than the replicability problem in general (Wasserstein & Lazar, 2016).”
Simulation of non-stationary stochastic ground motions based on recent Italian earthquakes
Sabetta, F., Pugliese, A., Fiorentino, G., et al. (2021) · Bulletin of Earthquake Engineering · doi:10.1007/s10518-021-01077-1 · Cited by 47
“In addition to the standard error (SE), the p-value (Wasserstein and Lazar 2016) of the fixed coefficients is also included.”
BackgroundFactorial Designs, Model Selection, and (Incorrect) Inference in Randomized Experiments
Muralidharan, K., Romero, M., & Wüthrich, K. (2020) · The Review of Economics and Statistics · doi:10.1162/rest_a_01317 · Cited by 102
Ma, J. K. (2021) · International Journal of Comparative Sociology · doi:10.1177/00207152211023540 · Cited by 47
“Researchers increasingly advocate using p -values with caution since they are commonly misinterpreted and misused (e.g. Greenland et al., 2016; Wasserstein and Lazar, 2016).”
BackgroundMethodLaccourreye, O., Lisan, Q., Vincent, C., Righini, C. A., Leboulanger, N., Franco‐Vidal, V., Radulesco, T., Rumeau, C., Schmerber, S., Simon, F., et al. (2022) · European Annals of Otorhinolaryngology Head and Neck Diseases · doi:10.1016/j.anorl.2022.05.001 · Cited by 47
Ten simple rules for good research practice
Schwab, S., Janiaud, P., Dayan, M., Amrhein, V., Panczak, R., Palagi, P. M., Hemkens, L. G., Ramon, M., Rothen, N., Senn, S. J., et al. (2022) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010139 · Cited by 53
“It would help if more researchers were familiar with correct interpretations and possible misinterpretations of statistical tests, p-values, confidence intervals, and statistical power [59,60].”
BackgroundExternal Validity: The Next Step for Systematic Reviews?
Avellar, S., Thomas, J., Kleinman, R., Sama-Miller, E., Woodruff, S. E., Coughlin, R. L., & Westbrook, T. R. (2016) · Evaluation Review · doi:10.1177/0193841x16665199 · Cited by 45
“A recent statement by the American Statistical Association cautions against relying solely on a single significance threshold of p ¼ .05 and urges researchers to provide a variety of numerical and graphical summaries of data (Wasserstein & Lazar, 2016).”
BackgroundGroup cognitive behavioral therapy for children and adolescents with ADHD
Coelho, L. F., Barbosa, D. L. F., Rizzutti, S., Bueno, O. F. A., & Miranda, M. C. (2017) · Psicologia Reflexão e Crítica · doi:10.1186/s41155-017-0063-y · Cited by 50
“Through the treatment effect paradigm, 33 regressions were assessed using STATA version 14.1 (one for each outcome individually), with the level of significance of 0.0015 corrected to avoid false positives as suggested by Wasserstein and Lazar (2016).”
MethodInfluentialUsing meta-analysis for evidence synthesis: The case of incomplete neutralization in German
Nicenboim, B., Roettger, T. B., & Vasishth, S. (2018) · Journal of Phonetics · doi:10.1016/j.wocn.2018.06.001 · Cited by 45
Parsons, T., Geist, E. L., Console, R., et al. (2018) · Journal of Geophysical Research Solid Earth · doi:10.1029/2018jb016539 · Cited by 47
“The standard for rejection of a null hypothesis is a p value less than 0.05, although caution is urged about absolute thresholds (e.g., Wasserstein & Lazar, 2016).”
BackgroundInfluentialMukhopadhyay, U. K., Oturkar, C. C., Adams, C., Wickramasekera, N. T., Bansal, S., Medisetty, R., Miller, A., Swetzig, W. M., Silwal‐Pandit, L., Børresen‐Dale, A., et al. (2019) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djz051 · Cited by 47
False confidence, non-additive beliefs, and valid statistical inference
Martin, R. (2019) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2019.06.005 · Cited by 54
Gilroy, S. P., & Kaplan, B. A. (2019) · Perspectives on Behavior Science · doi:10.1007/s40614-019-00202-5 · Cited by 49
“The capability of revisiting these findings speaks to the analytical replicability of published studies (Klein et al., 2018; Wasserstein & Lazar, 2016).”
BackgroundResultBloomfield, R. J., Rennekamp, K. M., & Steenhoven, B. A. (2018) · Journal of Accounting Research · doi:10.1111/1475-679x.12208 · Cited by 48
Grünwald, P., de Heide, R., & Koolen, W. M. (2020) · Information Theory and Applications Workshop (ITA) · doi:10.1109/ita50056.2020.9244948 · Cited by 50
“p -values and standard null hypothesis testing have come under intense scrutiny in recent years (Wasserstein et al., 2016; Benjamin et al., 2018). e -variables and safe tests offer several advantages.”
BackgroundSanchis‐Segura, C., Aguirre, N., Cruz-Gómez, Á. J., Félix, S., & Forn, C. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119343 · Cited by 48
Chiappa, V., Interlenghi, M., Salvatore, C., et al. (2021) · Gynecologic Oncology · doi:10.1016/j.ygyno.2021.04.004 · Cited by 46
Zhang, Q., Zhang, L., She, D., Wang, S., Wang, G., & Zeng, S. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2021.105180 · Cited by 45
Cready, W. M., He, J., Lin, W., Shao, C., Wang, D., & Zhang, Y. (2022) · Behavioral Research in Accounting · doi:10.2308/bria-2020-033 · Cited by 40
Toward an improved understanding of causation in the ecological sciences
Addicott, E. T., Fenichel, E. P., Bradford, M. A., Pinsky, M. L., & Wood, S. A. (2022) · Frontiers in Ecology and the Environment · doi:10.1002/fee.2530 · Cited by 45
Timoshevskiy, V. A., Herdy, J. R., Keinath, M. C., & Smith, J. J. (2016) · PLoS Genetics · doi:10.1371/journal.pgen.1006103 · Cited by 48
Gros, J. (2017) · Genèses · doi:10.3917/gen.108.0129 · Cited by 46
Results Blind Science Publishing
Locascio, J. J. (2017) · Basic and Applied Social Psychology · doi:10.1080/01973533.2017.1336093 · Cited by 45
“The American Statistical Association recently even felt it necessary to publish a policy statement critical of widespread misuse of the NHST and p values (Wasserstein & Lazar, 2016).”
BackgroundBeyond ‘significance’: principles and practice of the Analysis of Credibility
Matthews, R. (2018) · Royal Society Open Science · doi:10.1098/rsos.171047 · Cited by 47
Reconnecting p -Value and Posterior Probability Under One- and Two-Sided Tests
Shi, H., & Yin, G. (2020) · The American Statistician · doi:10.1080/00031305.2020.1717621 · Cited by 53
“To clarify ambiguities surrounding p-value, the American Statistical Association (Wasserstein and Lazar 2016) issued statements on p-value and, in particular, the second point states that “P-values do not measure the probability that the studied hypothesis is true, or the probability that the data…”
BackgroundBeyond Traditional Probabilistic Methods in Econometrics
Nguyen, H. T., Trung, N. Đ., & Thạch, N. N. (2018) · Studies in computational intelligence · doi:10.1007/978-3-030-04200-4_1 · Cited by 48
Elevated autoimmunity in residents living near abandoned uranium mine sites on the Navajo Nation
Erdei, E., Shuey, C., Pacheco, B., Cajero, M., Lewis, J. L., & Rubin, R. L. (2019) · Journal of Autoimmunity · doi:10.1016/j.jaut.2019.01.006 · Cited by 46
“While the hypothesis of this project, that specific autoantibodies known to be induced by xenobiotics would be markers for exposure to environmental toxicants, satisfied a fundamental statistical requirement for a meaningful finding [35], many variables as well as their interactions were included as potential autoanti…”
BackgroundTreatment Choice With Trial Data: Statistical Decision Theory Should Supplant Hypothesis Testing
Manski, C. F. (2019) · The American Statistician · doi:10.1080/00031305.2018.1513377 · Cited by 46
“See, for example, Ioannidis (2005) and Wasserstein and Lazar (2016).”
BackgroundMethodThe p-value Function and Statistical Inference
Fraser, D. (2019) · American Statistician · doi:10.1080/00031305.2018.1556735 · Cited by 46
Why is Getting Rid of P -Values So Hard? Musings on Science and Statistics
Goodman, S. N. (2019) · The American Statistician · doi:10.1080/00031305.2018.1558111 · Cited by 53
“Twenty four of the 31 people who contributed to the ASA P value statement development wrote commentaries (Wasserstein and Lazar 2016).”
BackgroundThe Registered Reports Revolution Lessons in Cultural Reform
Chambers, C. (2019) · Significance · doi:10.1111/j.1740-9713.2019.01299.x · Cited by 43
Griffiths, P., & Needleman, J. (2019) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2019.07.001 · Cited by 46
Effect of self-assembling peptide P11-4 on orthodontic treatment-induced carious lesions
Welk, A., Ratzmann, A., Reich, M., Krey, K., & Schwahn, C. (2020) · Scientific Reports · doi:10.1038/s41598-020-63633-0 · Cited by 47
Ow, N., & Mayo, N. E. (2020) · Quality of Life Research · doi:10.1007/s11136-020-02519-0 · Cited by 49
“To be compatible with guidelines from the American Statistical Association, this paper will avoid presenting p-values or refer to findings as “statistically significant” [43].”
MethodSvantesson, E., Senorski, E. H., Webster, K. E., et al. (2020) · Orthopaedic Journal of Sports Medicine · doi:10.1177/2325967120934751 · Cited by 46
“However, a post hoc power calculation to test the validity of the study results can be an acceptable method under certain conditions, for instance, in the case of a retrospective study, but caution must be given to the high risk of overestimating power.(38,116) CONCLUSION.”
MethodHospital Consultation From Outpatient Clinicians for Medically Complex Children
Mosquera, R. A., Avritscher, E. B. C., Pedroza, C., Bell, C., Samuels, C. L., Harris, T. S., Eapen, J. C., Yadav, A., Poe, M., Parlar-Chun, R. L., et al. (2020) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2020.5026 · Cited by 46
The conspiracy of Covid-19 and 5G: Spatial analysis fallacies in the age of data democratization
Flaherty, E. T., Sturm, T., & Farries, E. (2021) · Social Science & Medicine · doi:10.1016/j.socscimed.2021.114546 · Cited by 52
“…on the interpretation of quantitative data, such as the correspondence between statistical and substantive significance (Ziliak and McCloskey, 2008; Wasserstein and Lazar, 2016), or the robustness of existing research findings to replication or re-specification (Aarts et al., 2015; Wilson and…”
BackgroundRejecting or accepting parameter values in Bayesian estimationPreprint
Kruschke, J. K. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/s5vdy · Cited by 50
Essential statistical principles of clinical trials of pain treatments
Dworkin, R. H., Evans, S. R., Mbowe, O. B., & McDermott, M. (2020) · PAIN Reports · doi:10.1097/pr9.0000000000000863 · Cited by 52
“Valuable discussions of important issues and challenges involving P values and their interpretation can be found in recent proposals and responses.(1,11,210,211)”
BackgroundA critical appraisal of studies on endometrial thickness and embryo transfer outcome
Mathyk, B. A., Schwartz, A., DeCherney, A. H., & Ata, B. (2023) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2023.103259 · Cited by 51
Responding to Reviewers and Editors About Statistical Significance Testing
Savitz, D. A., Wise, L. A., Bond, J. C., Hatch, E. E., Ncube, C. N., Wesselink, A. K., Willis, M. D., Yland, J. J., & Rothman, K. J. (2024) · Annals of Internal Medicine · doi:10.7326/m23-2430 · Cited by 45
“The statistics community (5) and medical journal editors (6) have long recognized this problem and have begun to more forcefully emphasize quantitative interpretation of results rather than assignment into discrete bins.”
BackgroundSurgery for Primary Hyperparathyroidism
Kuo, E. J., Al-Alusi, M. A., Du, L., et al. (2017) · Annals of Surgery · doi:10.1097/sla.0000000000002474 · Cited by 45
“Statistical Analysis Standardized differences were used to estimate discrepancies in baseline demographic and clinical variables between patients who received PTx and those who did not, in accordance with the American Statistical Association’s Statement on Statistical Significance and P values.(11,12) Standardized dif…”
MethodValues in environmental research: Citizens’ views of scientists who acknowledge values
Elliott, K. C., McCright, A. M., Allen, S., & Dietz, T. M. (2017) · PLoS ONE · doi:10.1371/journal.pone.0186049 · Cited by 52
Fay, M. P., Brittain, E., Shih, J. H., Follmann, D. A., & Gabriel, E. E. (2018) · Statistics in Medicine · doi:10.1002/sim.7799 · Cited by 43
“ψL ≡ sup y fF0ðyÞ− F1ðyÞg≤ ψ≤ 1− sup y fF1ðyÞ− F0ðyÞg≡ψU : (6)”
Freak‐Poli, R., Licher, S., Ryan, J. L., Ikram, M. A., & Tiemeier, H. W. (2018) · Gerontology · doi:10.1159/000490560 · Cited by 44
Wilkinson, T. J., Watson, E. L., Xenophontos, S., Gould, D. W., & Smith, A. C. (2018) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000001080 · Cited by 46
Glycemic load, dietary fiber, and added sugar and fecundability in 2 preconception cohorts
Willis, S. K., Wise, L. A., Wesselink, A. K., Rothman, K. J., Mikkelsen, E. M., Tucker, K. L., Trolle, E., & Hatch, E. E. (2019) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqz312 · Cited by 50
Craig, R., Cox, A., Tourish, D., & Thorpe, A. (2020) · Research Policy · doi:10.1016/j.respol.2020.103930 · Cited by 53
On the applicability of ANOVA models for CATA data
Meyners, M., & Hasted, A. M. (2021) · Food Quality and Preference · doi:10.1016/j.foodqual.2021.104219 · Cited by 47
Parisien, R. L., Constant, M., Saltzman, B. M., Popkin, C. A., Ahmad, C. S., Li, X., & Trofa, D. P. (2021) · Cartilage · doi:10.1177/19476035211012458 · Cited by 44
Editorial: Threshold P Values in Orthopaedic Research—We Know the Problem. What is the Solution?
Leopold, S. S., & Porcher, R. (2018) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000000413 · Cited by 45
Solmi, M., Correll, C. U., Carvalho, A. F., & Ioannidis, J. P. A. (2018) · Epidemiology and Psychiatric Sciences · doi:10.1017/s204579601800032x · Cited by 44
Cullen, B., Eichel, K., Lindahl, J. R., Rahrig, H., Kini, N., Flahive, J., & Britton, W. B. (2021) · PLOS ONE · doi:10.1371/journal.pone.0244838 · Cited by 43
Gibson, R. S., Rahmannia, S., Diana, A., Leong, C. S.-F., Haszard, J. J., Hampel, D., Reid, M., Erhardt, J. G., Suryanto, A. H., Sofiah, W. N., et al. (2020) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/nqaa200 · Cited by 44
“Emphasis on estimation over statistical testing has been used in this analysis, with limited reliance on P values for inference, as recommended (32).”
MethodWeather Factors Associated with Extremely Large Fires and Fire Growth Days
Potter, B. E., & McEvoy, D. J. (2021) · Earth Interactions · doi:10.1175/ei-d-21-0008.1 · Cited by 44
Significance Testing in Accounting Research: A Critical Evaluation Based on Evidence
Kim, J. H., Ahmed, K., & Ji, P. I. (2018) · Abacus · doi:10.1111/abac.12141 · Cited by 38
Wang, N. C., Li, J. Z., ADELSTEIN, E. C., Althouse, A. D., Sharbaugh, M. S., Jain, S. K., Mendenhall, G. S., Shalaby, A. A., Voigt, A., & Saba, S. (2018) · Pacing and Clinical Electrophysiology · doi:10.1111/pace.13264 · Cited by 45
“95 Aldosterone antagonist 22 (18) 10 (17) 12 (19) 0.”
Consequences of relying on statistical significance: Some illustrations
CALSTER, B. V., Steyerberg, E. W., Collins, P. G. S., & Smits, T. (2018) · European Journal of Clinical Investigation · doi:10.1111/eci.12912 · Cited by 47
“Recently, the American Statistical Association (ASA) has fuelled the discussion by releasing a statement including six principles on how to deal with P-values (Table 1).(12) The key question is the extent to which the criticisms reach applied researchers and journal reviewers, and if so, the extent to which technical…”
BackgroundMorris, R. O., Emmonds, S., Jones, B. L., Myers, T., Clarke, N. D., Lake, J. P., Ellis, M., Singleton, D., Roe, G. A. B., & Till, K. (2018) · Science and Medicine in Football · doi:10.1080/24733938.2018.1454599 · Cited by 50
Bayesian inference for algorithm ranking analysis
Calvo, B., Ceberio, J., & Lozano, J. A. (2018) · Genetic and Evolutionary Computation Conference Companion (GECCO Companion) · doi:10.1145/3205651.3205658 · Cited by 50
“A recent example of this concern is the statement about p-values published by the American Statistical Association (ASA) [8].”
BackgroundWang, Z., Wang, Y., & Redmiles, D. (2018) · IEEE/ACM International Conference on Software Engineering: Software Engineering in Society (ICSE-SEIS) · doi:10.1145/3183428.3183437 · Cited by 43
“We follow the American Statistical Association’s principles to interpret the statistical results [65].”
MethodRose, S., & McGuire, T. G. (2019) · The American Statistician · doi:10.1080/00031305.2018.1518269 · Cited by 47
Vakhitova, Z., & Alston‐Knox, C. (2018) · PLoS ONE · doi:10.1371/journal.pone.0205076 · Cited by 44
Ren, Z., Niu, D., Ma, P., Wang, Y., Fu, H., & Elser, J. J. (2019) · Ecology · doi:10.1002/ecy.2755 · Cited by 42
Vallejo‐Bernal, S. M., Urrea, V., Bedoya-Soto, J. M., Posada, D., Olarte, A., Cárdenas‐Posso, Y., Ruiz‐Murcia, F., Martínez, M. T. L., Petersen, W. A., Huffman, G. J., et al. (2020) · International Journal of Climatology · doi:10.1002/joc.6640 · Cited by 44
Moving Beyond p < 0.05 in Ecotoxicology: A Guide for Practitioners
Erickson, R. A., & Rattner, B. A. (2020) · Environmental Toxicology and Chemistry · doi:10.1002/etc.4800 · Cited by 45
“When using NHST, several important items need to be considered and reported (Wasserstein and Lazar 2016).”
BackgroundMethodInfluentialStatistical Inference and the Replication Crisis
Colling, L. J., & Szűcs, D. (2019) · PhilPapers (PhilPapers Foundation) · doi:10.17863/cam.35452 · Cited by 41
Math anxiety affects females’ vocational interests
Levy, H. E., Fares, L., & Rubinsten, O. (2021) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2021.105214 · Cited by 60
Nutrition: ethical issues and challenges
Rucker, R. B., & Rucker, M. R. (2016) · Nutrition Research · doi:10.1016/j.nutres.2016.10.006 · Cited by 44
“In this regard, the advice and statements adopted from the American Statistical Society [53] and Nuzzo [54] on statistical significance and P values are seminal (Table 2), That is, values for probability are mostly useful in making an inference for a null hypothesis and not for working backward to make a causal statem…”
MethodEthics and Good Practice in Computational Paralinguistics
Batliner, A., Hantke, S., & Schuller, B. (2022) · IEEE Transactions on Affective Computing · doi:10.1109/taffc.2020.3021015 · Cited by 30
“Twenty years ago, the American Psychological Association (APA) recommended to report effect sizes [165], and eventually, the American Statistical Association (ASA) published a statement on p-values [166] summarising all these problems – and of course, different assessments, concluding: “Good statistical practice, as a…”
BackgroundDetecting privacy requirements from User Stories with NLP transfer learning models
Casillo, F., Deufemia, V., & Gravino, C. (2022) · Information and Software Technology · doi:10.1016/j.infsof.2022.106853 · Cited by 60
“Furthermore, it was verified that the predictions obtained using the different models came from the same population in order to assess whether the differences observed by applying the chosen evaluation criterion (i.e., Accuracy and F1-score) were legitimate or due to coincidence [50].”
MethodPacyga, D. C., Haggerty, D. K., Nicol, M., Henning, M., Calafat, A. M., Braun, J. M., Schantz, S. L., & Strakovsky, R. S. (2022) · Environment International · doi:10.1016/j.envint.2022.107150 · Cited by 43
Mayo, D. G., & Hand, D. J. (2022) · Synthese · doi:10.1007/s11229-022-03692-0 · Cited by 48
Fink, D. S., Stohl, M., Mannes, Z. L., Shmulewitz, D., Wall, M. M., Gutkind, S., Olfson, M., Gradus, J. L., Keyhani, S., Maynard, C. C., et al. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08899-y · Cited by 47
Aftab, R., Dodhia, V. H., Jeanes, C., & Wade, R. G. (2023) · Scientific Reports · doi:10.1038/s41598-022-26658-1 · Cited by 48
Integrative genomic analyses in adipocytes implicate DNA methylation in human obesity and diabetes
McAllan, L., Baranas̆ić, D., Villicaña, S., Brown, S., Zhang, W., Lehne, B. C., Adamo, M., Jenkinson, A. D., Elkalaawy, M., Mohammadi, B., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-38439-z · Cited by 48
Misconceptions, Misuses, and Misinterpretations of P Values and Significance Testing
Gagnier, J. J., & Morgenstern, H. (2017) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.16.01314 · Cited by 50
“The ASA statement discussed 6 principles: (1) “P-values can indicate how incompatible the data are with a specified statistical model.”
BackgroundAdvances in p-Value Based Multiple Test Procedures
Tamhane, A. C., & Gou, J. (2017) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543406.2017.1378666 · Cited by 43
“Despite many concerns about the p-values (see, e.g., Wasserstein and Lazar (2016)), these MTPs remain popular for several reasons listed below.”
BackgroundTutorial: Small-N Power Analysis
Kyonka, E. G. E. (2018) · Perspectives on Behavior Science · doi:10.1007/s40614-018-0167-4 · Cited by 52
“Within those approaches, tests of statistical significance can be used in combination with other analyses to answer certain research questions (Haig, 2017; Wasserstein & Lazar, 2016).”
BackgroundMethodThe “Reproducibility Crisis:” Might the Methods Used Frequently in Behavior-Analysis Research Help?
Branch, M. N. (2018) · Perspectives on Behavior Science · doi:10.1007/s40614-018-0158-5 · Cited by 44
“…repeatable – is so pervasive that the American Statistical Association (ASA) felt compelled to assemble a committee of eminent statisticians to report on the problem, and an outcome was publication, by the ASA, of a first-ever position statement (Wasserstein & Lazar, 2016) on any statistical issue.”
BackgroundPereira, P. F., & Ramos, N. (2018) · Building and Environment · doi:10.1016/j.buildenv.2018.10.053 · Cited by 43
Hudson, P., Pham, T. D. M., & Bubeck, P. (2019) · Climate and Development · doi:10.1080/17565529.2019.1579698 · Cited by 43
“…present a qualitative comparison of estimated values, since focusing on p-values is not always sufficient for understanding results (Altman & Krzywinski, 2017; Wasserstein & Lazar, 2016).2 Thus, both a qualitative and quantitative analysis is required in order to provide future research focuses.”
ResultTreating Hypertension in Children With n-of-1 Trials
Samuel, J. P., Tyson, J. E., Green, C., Bell, C., Pedroza, C., Molony, D., & Samuels, J. (2019) · PEDIATRICS · doi:10.1542/peds.2018-1818 · Cited by 43
“(%) Headache 2 (6) 4 (13) 7 (22) Polyuria 0 8 (25) 1 (3) Fatigue 2 (6) 4 (13) 3 (9) Nausea 2 (6) 2 (6) 3 (9) Dizziness 3 (10) 0 2 (6) Dry throat or cough 2 (6) 0 2 (6) Abdominal pain 0 1 (3) 2 (6) Bitter taste 1 (3) 1 (3) 1 (3) Decreased appetite 0 2 (6) 0 Mood instability 0 2 (6) 0 Rash 1 (3) 0 1 (3) Leg pain 1 (3) 1…”
BackgroundPractical Evaluation of VMAF Perceptual Video Quality for WebRTC Applications
García, B., López-Fernández, L., Gortázar, F., & Gallego, M. (2019) · Electronics · doi:10.3390/electronics8080854 · Cited by 44
Ending Reliance on Statistical Significance Will Improve Environmental Inference and Communication
Smith, E. P. (2019) · Estuaries and Coasts · doi:10.1007/s12237-019-00679-y · Cited by 43
Anderson, S. F. (2019) · Psychological Methods · doi:10.1037/met0000248 · Cited by 44
“Despite methodologists “sounding the alarm about these matters for de-cades” (Wasserstein & Lazar, 2016, p. 130), the misinterpretation persists in psychology almost as much as the p value itself (Stern, 2016).”
Unveiling Elite Developers’ Activities in Open Source Projects
Wang, Z., Feng, Y., Wang, Y., Jones, J. A., & Redmiles, D. (2020) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3387111 · Cited by 48
Ekhtiari, S., Gazendam, A., Nucci, N. W., Kruse, C. C., & Bhandari, M. (2020) · The Journal of Arthroplasty · doi:10.1016/j.arth.2020.12.015 · Cited by 44
Developments in data science solutions for carnivore tooth pit classification
Courtenay, L. A., Herranz‐Rodrigo, D., González‐Aguilera, D., & Yravedra, J. (2021) · Scientific Reports · doi:10.1038/s41598-021-89518-4 · Cited by 44
Valente, F., Henriques, J. M. O., Paredes, S., Rocha, T., Carvalho, P., & Morais, J. (2021) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2021.102113 · Cited by 43
Metadata
- Authors
- Wasserstein, R. L., & Lazar, N. A.
- Affiliations
- American Statistical Association, 732 North Washington Street, Alexandria, VA 22314-1943
- American Statistical Association (US)
- ORCID
- Lazar, Nicole A.
- Venue
- The American Statistician
- Publisher
- Informa UK Limited
- Published
- 2016-04-02
- Volume
- 70
- Issue
- 2
- Pages
- 129-133
- ISSN
- 0003-1305 (ISSN-L)
- 1537-2731
- OpenAlex
- W2293040502
- Semantic Scholar
- 81a65f23474ffceb2481836328608102950da979
- Cited by
- 6,306
- References
- 45
- Citations by year
- 2026: 625 · 2025: 629 · 2024: 575 · 2023: 543 · 2022: 642 · 2021: 676 · 2020: 678 · 2019: 666 · 2018: 596 · 2017: 438 · 2016: 226
- FWCI
- 649.74
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- The American Statistician (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Physical Sciences › Mathematics › Statistics and Probability › Probability and Statistical Research
- Keywords
- p-values, statistical evidence, p-value interpretation, statistical inference, hypothesis testing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-09-28, under version 3 of the claim definition (prompt extract-v3).
A second model labelled each claim on 2026-09-28 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
