Bayesian estimation supersedes the t-test
The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Abstract
Bayesian estimation for 2 groups provides complete distributions of credible values for the effect size, group means and their difference, standard deviations and their difference, and the normality of the data. The method handles outliers. The decision rule can accept the null value (unlike traditional t tests) when certainty in the estimate is high (unlike Bayesian model comparison using Bayes factors). The method also yields precise estimates of statistical power for various research goals. The software and programs are free and run on Macintosh, Windows, and Linux platforms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Bayesian hypothesis testing is therefore conceptually akin to performing a frequentist t-test 40 .”
From Crowdsourcing punishment: Individuals reference group preferences to inform their own punitive decisions (2019) · cites this paper as [40]
In the citing paper
“The Bayesian framework was chosen specifically for its ability to represent parameter uncertainty directly through posterior distributions, offering interpretable estimates without relying on sampling distributions from null hypotheses, as required in frequentist approaches [79, 80, 81].”
From Interpersonal Synchronization of Autonomic Physiology via Mere Visual Contact (2026) · cites this paper as [81]
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395 · cited 2×
“1 is conventionally deemed to be small (Cohen, 1988), a ROPE on effect size might extend from 0.”
BackgroundInfluentialJeffreys, H., Moran, P. A. P., & Chatfield, C. (1922) · Nature · doi:10.1093/oso/9780198503682.001.0001 · Cited by 7,878
Distribution Theory for Glass's Estimator of Effect Size and Related Estimators
Hedges, L. V. (1981) · Journal of Educational Statistics · doi:10.2307/1164588 · Cited by 5,695
Effect size estimates: Current use, calculations, and interpretation.
Fritz, C. O., Morris, P. E., & Richler, J. J. (2012) · Journal of Experimental Psychology: General · doi:10.1037/a0024338 · Cited by 5,199
JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720
THE GENERALIZATION OF ‘STUDENT'S’ PROBLEM WHEN SEVERAL DIFFERENT POPULATION VARLANCES ARE INVOLVED
WELCH, B. L. (1947) · Biometrika · doi:10.1093/biomet/34.1-2.28 · Cited by 4,135
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688 · cited 8×
“Wetzels et al. (2009) showed that their approach closely mimicked the analytical results of Rouder et al. (2009) when the model was restricted to have equal variances in the two groups.”
MethodResultInfluentialHandbook of Markov Chain Monte Carlo
Brooks, S., Gelman, A., Jones, G., & Meng, X.-L. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905 · Cited by 2,993
AN ESSAY TOWARDS SOLVING A PROBLEM IN THE DOCTRINE OF CHANCES
BAYES (1958) · Biometrika · doi:10.1093/biomet/45.3-4.296 · Cited by 2,911
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490 · cited 2×
“These results, and the results of all t tests reported in this article, use the Welch (1947) modification to degrees of freedom for producing the p value and confidence interval, to accommodate unequal variances.”
MethodThe Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
The Importance of the Normality Assumption in Large Public Health Data Sets
Lumley, T., Diehr, P., Emerson, S., & Chen, L. (2002) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.23.100901.140546 · Cited by 1,803
Bayesian Data Analysis, 2nd edn
Brix, A. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2004.00347_4.x · Cited by 1,767
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
(2014) · Thammasat University Digital Collections · Cited by 1,732
Self-citationPrior distributions for variance parameters in hierarchical modelsPreprint
Gelman, A. (2004) · RePEc: Research Papers in Economics · Cited by 1,632
Student (1908) · Biometrika · doi:10.1093/biomet/6.1.1 · Cited by 1,363
Bayesianly Justifiable and Relevant Frequency Calculations for the Applied Statistician
Rubin, D. B. (1984) · The Annals of Statistics · doi:10.1214/aos/1176346785 · Cited by 1,343
NON-NORMALITY AND TESTS ON VARIANCES
BOX, G. E. P. (1953) · Biometrika · doi:10.1093/biomet/40.3-4.318 · Cited by 1,302 · cited 1×
“While the t test for difference of means tends to be fairly robust against violations of normality (e.g., Lumley, Diehr, Emerson, & Chen, 2002, and references cited therein), the F test for difference of variances can be strongly affected by violations of normality (e.g., Box, 1953; Pearson, 1931).”
BackgroundWhy We (Usually) Don't Have to Worry About Multiple Comparisons
Gelman, A., Hill, J., & Yajima, M. (2012) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2011.618213 · Cited by 1,274 · cited 1×
“Further details regarding so-called “hierarchical Bayesian ANOVA” are provided by Gelman (2005, 2006), Gelman, Hill, and Yajima (2011), and Kruschke (2010b, 2010a, 2011b).”
BackgroundJEFFREYS, H. (1922) · Nature · doi:10.1038/109132a0 · Cited by 1,217
Robust Statistical Modeling Using the t Distribution
Lange, K. L., Little, R. J. A., & Taylor, J. M. G. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478852 · Cited by 1,039 · cited 1×
“In Bayesian estimation, we reallocate belief toward the parameter values that are consistent with the data, and away from parameter values that are inconsistent with the data.”
MethodBayesian Modeling Using WinBUGS
Ntzoufras, I. (2009) · Wiley eBooks · doi:10.1002/9780470434567 · Cited by 1,001
Designing Experiments and Analyzing Data: A Model Comparison Perspective, Third Edition
Maxwell, S. E., & Delaney, H. D. (1999) · Medical Entomology and Zoology · Cited by 975
Theory-Testing in Psychology and Physics: A Methodological Paradox
Meehl, P. E. (1967) · Philosophy of Science · doi:10.1086/288135 · Cited by 962 · cited 2×
“The p value indicates the rarity of tobs relative to the space of all possible t values that might have been observed from the intended sampling process if the null hypothesis were true.”
BackgroundStatistical Evidence in Experimental Psychology: An Empirical Comparison Using 855 t Tests
Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., & Wagenmakers, E.-J. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406923 · Cited by 945
Bayesian Versus Orthodox Statistics: Which Side Are You On?
Dienes, Z. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406920 · Cited by 938 · cited 3×
“Dienes (2008, 2011) provided another analytical solution, with a corresponding online calculator.”
BackgroundMethodBayesian Methods for Data Analysis
Carlin, B. P., & Louis, T. A. (2008) · Chapman & Hall/CRC eBooks · doi:10.1201/b14884 · Cited by 917
Analysis of variance—why it is more important than ever
Gelman, A. (2005) · The Annals of Statistics · doi:10.1214/009053604000001048 · Cited by 861 · cited 1×
“Further details regarding so-called “hierarchical Bayesian ANOVA” are provided by Gelman (2005, 2006), Gelman, Hill, and Yajima (2011), and Kruschke (2010b, 2010a, 2011b).”
BackgroundPhilosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2011.02037.x · Cited by 825 · cited 1×
“Confidence intervals (CIs) carry no distributional information, and therefore render power to be virtually unknowable because of its uncertainty.”
BackgroundStatistical Methods for Eliciting Probability Distributions
Garthwaite, P. H., Kadane, J. B., & O'Hagan, A. (2005) · Journal of the American Statistical Association · doi:10.1198/016214505000000105 · Cited by 801
Bayesian Analysis for the Social Sciences
Jackman, S. (2009) · Wiley Series in Probability and Statistics · doi:10.1002/9780470686621 · Cited by 756 · cited 2×
“It turns out that in most typical applications, clumpiness can be adequately smoothed simply by running a long chain without thinning, and the long chain produces reliable estimates of the posterior distribution (e.g., Link & Eaton, 2012; Jackman, 2009, p. 263).”
BackgroundResultBerry, D. A. (2006) · Nature Reviews Drug Discovery · doi:10.1038/nrd1927 · Cited by 726 · cited 2×
“Gelman, A. (2006).”
Bayesian approaches to randomized trials
Spiegelhalter, D. J., Freedman, L. S., & Parmar, M. K. B. (1994) · Journal of the Royal Statistical Society. Series A (Statistics in Society) · doi:10.2307/2983527 · Cited by 720
Philosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2010) · Cited by 709
Using significance tests to evaluate equivalence between two experimental groups.
Rogers, J. L., Howard, K. I., & Vessey, J. T. (1993) · Psychological Bulletin · doi:10.1037//0033-2909.113.3.553 · Cited by 566
Doing Bayesian Data Analysis: A Tutorial with R and BUGS
Barry, J. (2011) · Europe’s Journal of Psychology · doi:10.5964/ejop.v7i4.163 · Cited by 563 · cited 15×
“Then I will turn to general foundational issues that undermine the usefulness of NHST in any application.”
BackgroundMethodInfluentialBayesian Assessment of Null Values Via Parameter Estimation and Model Comparison
Kruschke, J. K. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406925 · Cited by 468 · cited 6×
“pdf Kruschke, J. K. (2010a). Bayesian data analysis. Wiley Interdisciplinary Reviews: Cognitive Science, 1, 658–676. doi:10.1002/wcs.72 Kruschke, J. K. (2010b). What to believe: Bayesian methods for data analysis. Trends in Cognitive Sciences, 14, 293–300. doi:10.1016/ j.tics.2010.05.001 Kruschke, J. K. (2011a). Bayes…”
BackgroundMethodInfluentialSelf-citationPosterior odds ratios for selected regression hypotheses
Zellner, A., & Siow, A. (1980) · Trabajos de Estadistica Y de Investigacion Operativa · doi:10.1007/bf02888369 · Cited by 463 · cited 1×
“These assumptions for the prior distributions follow precedents of Jeffreys (1961) and Zellner and Siow (1980), and the approach is therefore called the JZS prior by Rouder et al. (2009).”
MethodThe Assessment of Prior Distributions in Bayesian Analysis
Winkler, R. L. (1967) · Journal of the American Statistical Association · doi:10.1080/01621459.1967.10500894 · Cited by 430 · cited 2×
“The method advocated here, in which the informant generates hypothetical data from which a parameter distribution is derived, is analogous to the equivalent prior sample (EPS) method proposed by Winkler (1967) for eliciting the prior in estimating the bias of a coin.”
MethodResultStatistical Power Analysis in Wildlife Research
Steidl, R. J., Hayes, J. P., & Schauber, E. (1997) · The Journal of Wildlife Management · doi:10.2307/3802582 · Cited by 420 · cited 1×
“Unfortunately, this typically results in a huge range on the power estimate, rendering it virtually useless, as many authors have pointed out (e.g., Gerard et al., 1998; Miller, 2009; Nakagawa & Foster, 2004; O’Keefe, 2007; Steidl et al., 1997; Sun et al., 2011; Thomas, 1997).”
BackgroundUnderstanding Psychology as a Science: An Introduction to Scientific and Statistical Inference
Dienes, Z. P. (2008) · Cited by 418
Statistical analysis and the illusion of objectivity
(1988) · Infectious Diseases Newsletter · doi:10.1016/0278-2316(88)90057-6 · Cited by 408 · cited 2×
“The scheme is exactly analogous to sampling schemes for estimating the bias in a coin, as explained for example by Berger and Berry (1988). To estimate the bias in a coin one could sample until reaching a threshold number of flips and count the number of heads, or one could sample until attaining a threshold number of…”
MethodThomas, L. (1997) · Conservation Biology · doi:10.1046/j.1523-1739.1997.96102.x · Cited by 403 · cited 5×
“analysis provides useful information, but retrospective power analysis (that uses only the data from a single experiment) provides no additional information that is not already implicit in the p value (e.g., Gerard, Smith, & Weerakkody, 1998; Hoenig & Heisey, 2001; Nakagawa & Foster, 2004; O’Keefe, 2007; Steidl, Hayes…”
BackgroundResultInfluentialLink, W. A., & Eaton, M. J. (2012) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2011.00131.x · Cited by 351 · cited 1×
“It turns out that in most typical applications, clumpiness can be adequately smoothed simply by running a long chain without thinning, and the long chain produces reliable estimates of the posterior distribution (e.g., Link & Eaton, 2012; Jackman, 2009, p. 263).”
BackgroundWhat to believe: Bayesian methods for data analysis
Kruschke, J. K. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.05.001 · Cited by 342 · cited 4×
“This specification of an uncertain prior implies that the prior has minimal influence on the estimates of the parameters, and even a modest amount of data will overwhelm the prior assumptions when we are doing Bayesian parameter estimation.”
BackgroundMethodInfluentialSelf-citationSymmetrical Confidence Intervals for Bioequivalence Trials
Westlake, W. J. (1976) · Biometrics · doi:10.2307/2529259 · Cited by 336 · cited 1×
“This approach goes by the name of equivalence testing in NHST (e.g., Rogers, Howard, & Vessey, 1993; Westlake, 1976, 1981).”
MethodA Skew Extension of the T-Distribution, with Applications
Jones, M. C., & Faddy, M. J. (2003) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00378 · Cited by 326 · cited 2×
“There is a large literature on the use of the t distribution to describe outliers (e.g., Damgaard, 2007; Jones & Faddy, 2003; Lange, Little, & Taylor, 1989; Meyer & Yu, 2000; Tsionas, 2002; Zhang, Lai, Lu, & Tong, in press).”
BackgroundMethodKruschke, J. K. (2010) · WIREs Cognitive Science · doi:10.1002/wcs.72 · Cited by 317
Self-citationSample size determination: a review
Adcock, C. J. (1997) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1111/1467-9884.00082 · Cited by 275 · cited 1×
“The issue has been explored in technical detail in various domains (e.g., Adcock, 1997; De Santis, 2004, 2007; Joseph, Wolfson, & du Berger, 1995a, 1995b; Wang & Gelfand, 2002; Weiss, 1997).”
BackgroundTHE ANALYSIS OF VARIANCE IN CASES OF NON-NORMAL VARIATION
PEARSON, E. S. (1931) · Biometrika · doi:10.1093/biomet/23.1-2.114 · Cited by 263 · cited 2×
“, Lumley, Diehr, Emerson, & Chen, 2002, and references cited therein), the F test for difference of variances can be strongly affected by violations of normality (e.g., Box, 1953; Pearson, 1931).”
BackgroundBeyond the confidence interval.
Poole, C. (1987) · American Journal of Public Health · doi:10.2105/ajph.77.2.195 · Cited by 253 · cited 1×
“As an example of imposing distributional information on a confidence interval, consider a plot of the p value (for a particular sampling intention) as a function of the parameter value (e.g., Poole, 1987; Sullivan & Foster, 1990).”
MethodThe Weighted Likelihood Ratio, Sharp Hypotheses about Chances, the Order of a Markov Chain
Dickey, J. M., & Lientz, B. P. (1970) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177697203 · Cited by 251 · cited 1×
“Instead of deriving the BF analytically, Wetzels et al. (2009) used MCMC methods to obtain a posterior distribution on the parameters in the alternative model, and then adapted the Savage-Dickey (SD) method to approximate the Bayes factor (Dickey & Lientz, 1970).”
MethodO'Keefe, D. J. (2007) · Communication Methods and Measures · doi:10.1080/19312450701641375 · Cited by 245 · cited 3×
“In the context of NHST, many authors have pointed out that prospective power analysis provides useful information, but retrospective power analysis (that uses only the data from a single experiment) provides no additional information that is not already implicit in the p value (e.g., Gerard, Smith, & Weerakkody, 1998;…”
BackgroundEdwards, J. R., & Berry, J. W. (2010) · Organizational Research Methods · doi:10.1177/1094428110380467 · Cited by 226 · cited 1×
“Independently of its use as a decision tool for Bayesian analysis, the use of a ROPE has also been suggested as a way to increase the predictive precision of theories (J. R. Edwards & Berry, 2010).”
MethodBUGS for a Bayesian analysis of stochastic volatility models
Meyer, R., & Yu, J. (2000) · The Econometrics Journal · doi:10.1111/1368-423x.00046 · Cited by 219 · cited 1×
“There is a large literature on the use of the t distribution to describe outliers (e.g., Damgaard, 2007; Jones & Faddy, 2003; Lange, Little, & Taylor, 1989; Meyer & Yu, 2000; Tsionas, 2002; Zhang, Lai, Lu, & Tong, in press).”
BackgroundGelfand, A. E., & Wang, F. (2002) · Statistical Science · doi:10.1214/ss/1030550861 · Cited by 214 · cited 1×
“The issue has been explored in technical detail in various domains (e.g., Adcock, 1997; De Santis, 2004, 2007; Joseph, Wolfson, & du Berger, 1995a, 1995b; Wang & Gelfand, 2002; Weiss, 1997).”
BackgroundThe Use of the Concept of a Future Observation in Goodness-Of-Fit Problems
Guttman, I. (1967) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1967.tb00676.x · Cited by 206
A hierarchical model for estimating response time distributions
Rouder, J. N., Lu, J., Speckman, P., Sun, D., & Jiang, Y. (2005) · Psychonomic Bulletin & Review · doi:10.3758/bf03257252 · Cited by 194
Doyle, A. C. (2010) · Cited by 176
Sample Size Calculations for Binomial Proportions via Highest Posterior Density Intervals
Joseph, L., Wolfson, D. B., & du Berger, R. (1995) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348439 · Cited by 171
SCHWEDER, T., & HJORT, N. L. (2002) · Scandinavian Journal of Statistics · doi:10.1111/1467-9469.00285 · Cited by 167 · cited 2×
“More sophisticated forms of the approach construct actual probability distributions over the parameter space, such that different areas under the distribution correspond to confidence levels (e.g., Schweder & Hjort, 2002; Singh, Xie, & Strawderman, 2007).”
BackgroundMethodPrior sensitivity in theory testing: An apologia for the Bayes factor
Vanpaemel, W. (2010) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2010.07.003 · Cited by 164
Limits of Retrospective Power Analysis
Gerard, P. D., Smith, D. R., & Weerakkody, G. (1998) · The Journal of Wildlife Management · doi:10.2307/3802357 · Cited by 163
Bayes factors: Prior sensitivity and model generalizability
Liu, C. C., & Aitkin, M. (2008) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2008.03.002 · Cited by 163 · cited 2×
“There are typically a variety of alternative-hypothesis priors, and the relative preference for the null hypothesis can change dramatically depending on the choice of alternative-hypothesis prior (e.g., Dienes, 2008; Kruschke, 2011a; Liu & Aitkin, 2008; Vanpaemel, 2010).”
Backgrounddu Prel, J.-B., Röhrig, B., Hommel, G., & Blettner, M. (2010) · Deutsches Ärzteblatt international · doi:10.3238/arztebl.2010.0343 · Cited by 161
The case against retrospective statistical power analyses with an introduction to power analysis
Nakagawa, S., & Foster, T. M. (2004) · acta ethologica · doi:10.1007/s10211-004-0095-z · Cited by 159 · cited 2×
“Unfortunately, this typically results in a huge range on the power estimate, rendering it virtually useless, as many authors have pointed out (e.g., Gerard et al., 1998; Miller, 2009; Nakagawa & Foster, 2004; O’Keefe, 2007; Steidl et al., 1997; Sun et al., 2011; Thomas, 1997).”
BackgroundWetzels, R., Raaijmakers, J. G. W., Jakab, E., & Wagenmakers, E.-J. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.4.752 · Cited by 143
Implementing MCMC: Estimating with Confidence
Flegal, J. M., & Jones, G. L. (2011) · Chapman & Hall/CRC eBooks · doi:10.1201/b10905-8 · Cited by 140
Effects of failure stress upon skilled performance.
Lazarus, R. S., & Eriksen, C. W. (1952) · Journal of Experimental Psychology · doi:10.1037/h0056614 · Cited by 128
Harlow, L. L., Mulaik, S. A., & Steiger, J. H. (2016) · doi:10.4324/9781315629049-29 · Cited by 121
Confidence distribution (CD) -- distribution estimator of a parameter
Singh, K., Xie, M., & Strawderman, W. E. (2007) · Institute of Mathematical Statistics eBooks · doi:10.1214/074921707000000102 · Cited by 110
Bayesian sample size calculations for hypothesis testing
Weiss, R. (1997) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.1111/1467-9884.00075 · Cited by 107 · cited 1×
“The issue has been explored in technical detail in various domains (e.g., Adcock, 1997; De Santis, 2004, 2007; Joseph, Wolfson, & du Berger, 1995a, 1995b; Wang & Gelfand, 2002; Weiss, 1997).”
BackgroundUsing Historical Data for Bayesian Sample Size Determination
Santis, F. D. (2006) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2006.00438.x · Cited by 105
What is the probability of replicating a statistically significant effect?
Miller, J. O. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.4.617 · Cited by 100
Stopping Rules for Clinical Trials Incorporating Clinical Opinion
Freedman, L. S., Lowe, D., & Macaskill, P. (1984) · Biometrics · doi:10.2307/2530902 · Cited by 94 · cited 1×
“The use of a ROPE is described further by Kruschke (2011a, 2011b), and in additional settings by Carlin and Louis (2009), Freedman, Lowe, and Macaskill (1984), Hobbs and Carlin (2008), and Spiegelhalter, Freedman, and Parmar (1994).”
MethodBayesian computation: a statistical revolution
Brooks, S. P. (2003) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2003.1263 · Cited by 90 · cited 4×
“(Brooks, 2003, p. 2694)” The present article has shown, to the contrary, that Bayesian estimation always provides much richer information than the NHST t test, and sometimes comes to different decisions.”
BackgroundMethodResultInfluentialConfidence Intervals: Better Answers to Better Questions
Cumming, G., & Fidler, F. (2009) · Zeitschrift für Psychologie / Journal of Psychology · doi:10.1027/0044-3409.217.1.15 · Cited by 83 · cited 1×
“…take the sampling distribution of the difference of sample means from the null hypothesis, denoted p(ȳ1−ȳ2|µ1−µ2 = 0), and re-center it on the observed difference of sample means, and then superimpose that distribution on the parameter axis, µ1 − µ2 (Cumming, 2007; Cumming & Fidler, 2009).”
BackgroundPractical Bayesian Design and Analysis for Drug and Device Clinical Trials
Hobbs, B. P., & Carlin, B. P. (2007) · Journal of Biopharmaceutical Statistics · doi:10.1080/10543400701668266 · Cited by 79
Fixed-Sample-Size Analysis of Sequential Observations
Anscombe, F. J. (1954) · Biometrics · doi:10.2307/3001665 · Cited by 78 · cited 1×
“This is known as “sampling to reach a foregone conclusion” (e.g., Anscombe, 1954).”
BackgroundKruschke, J. K. (2012) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2012.02063.x · Cited by 74
Self-citationInference by Eye: Pictures of Confidence Intervals and Thinking About Levels of Confidence
Cumming, G. (2007) · Teaching Statistics · doi:10.1111/j.1467-9639.2007.00267.x · Cited by 62
Statistical evidence and sample size determination for Bayesian hypothesis testing
Santis, F. D. (2003) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(03)00198-8 · Cited by 56
Introduction to Special Section on Bayesian Data Analysis
Kruschke, J. K. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406926 · Cited by 54 · cited 13×
“Nevertheless, the BF can be highly sensitive to the choice of alternative-hypothesis prior distribution (e.g., Dienes, 2008, 2011; Kruschke, 2011a; Liu & Aitkin, 2008; Vanpaemel, 2010), even to such as extent that the BF can change from substantially favoring the null hypothesis to substantially…”
BackgroundMethodInfluentialSelf-citationBayesian Inference and Application of Robust Growth Curve Models Using Student's t Distribution
Zhang, Z. J., Lai, K., Lu, Z. L., & Tong, X. (2013) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2013.742382 · Cited by 53
Use of the Confidence Interval function
Sullivan, K. M., & Foster, D. A. (1990) · Epidemiology · doi:10.1097/00001648-199001000-00009 · Cited by 51 · cited 1×
“As an example of imposing distributional information on a confidence interval, consider a plot of the p value (for a particular sampling intention) as a function of the parameter value (e.g., Poole, 1987; Sullivan & Foster, 1990).”
Some comments on Bayesian sample size determination
Joseph, L., Wolfson, D., & du Berger, R. (1995) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2348442 · Cited by 37
Rethinking Observed Power: Concept, Practice, and Implications
Sun, S., Pan, W., & Wang, L. L. (2011) · Methodology · doi:10.1027/1614-2241/a000025 · Cited by 32 · cited 1×
“Unfortunately, this typically results in a huge range on the power estimate, rendering it virtually useless, as many authors have pointed out (e.g., Gerard et al., 1998; Miller, 2009; Nakagawa & Foster, 2004; O’Keefe, 2007; Steidl et al., 1997; Sun et al., 2011; Thomas, 1997).”
BackgroundPhilosophy and the Practice of Bayesian Statistics in the Social Sciences
Gelman, A., & Shalizi, C. R. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195392753.013.0011 · Cited by 30 · cited 1×
“This type of assessment is called a posterior predictive check (Kruschke, 2012; Gelman, Carlin, Stern, & Rubin, 2004; Gelman & Shalizi, 2012a, 2012b; Guttman, 1967; Rubin, 1984).”
Technical note: how to use Winbugs to draw inferences in animal models.
Damgaard, L. H. (2007) · Journal of Animal Science · doi:10.2527/jas.2006-543 · Cited by 25 · cited 1×
“There is a large literature on the use of the t distribution to describe outliers (e.g., Damgaard, 2007; Jones & Faddy, 2003; Lange, Little, & Taylor, 1989; Meyer & Yu, 2000; Tsionas, 2002; Zhang, Lai, Lu, & Tong, in press).”
BackgroundBayesian Inference in the Noncentral Student-tModel
Tsionas, E. G. (2002) · Journal of Computational and Graphical Statistics · doi:10.1198/106186002317375695 · Cited by 17 · cited 2×
“There is a large literature on the use of the t distribution to describe outliers (e.g., Damgaard, 2007; Jones & Faddy, 2003; Lange, Little, & Taylor, 1989; Meyer & Yu, 2000; Tsionas, 2002; Zhang, Lai, Lu, & Tong, in press).”
BackgroundMethodA Tutorial on Simulation of Queueing Models
Sadiku, M. N. O., & Tofighi, M. R. (1999) · International Journal of Electrical Engineering Education · doi:10.7227/ijeee.36.2.2 · Cited by 15
Cited by
Using Bayes to get the most out of non-significant results
Dienes, Z. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00781 · Cited by 1,998
“Update the prior to obtain the posterior distribution (see e.g., Kruschke, 2013b, or tools on the website for Dienes, 2008: http://www.lifesci.sussex.ac.uk/home/Zoltan_Dienes/inference/bayes_normalposte rior.swf).”
BackgroundMethodInfluentialLakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Extensive impact of non-antibiotic drugs on human gut bacteria
Maier, L., Pruteanu, M., Kuhn, M., Zeller, G., Telzerow, A., Anderson, E. E., Brochado, A. R., Fernandez, K. C., Dose, H., Mori, H., et al. (2018) · Nature · doi:10.1038/nature25979 · Cited by 1,905
“We fitted heavy-tailed distributions (scaled Student’s t-distribution 50) to the wells containing reference compounds for each replicate and, separately, to each individual plate.”
Bayesian statistics and modelling
van de Schoot, R., Depaoli, S., King, R., Kramer, B., Märtens, K., Tadesse, M. G., Vannucci, M., Gelman, A., Veen, D., Willemsen, J., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-020-00001-2 · Cited by 1,176
Kruschke, J. K., & Liddell, T. M. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1221-4 · Cited by 1,288
“Other introductory resources include a companion article in this issue (Kruschke & Liddell, 2015), Chapter 2 of Kruschke (2015, available free online), and other articles (e.g., Kruschke, 2013; Kruschke, Aguinis, & Joo, 2012).”
Self-citation
Metadata
- Authors
- Kruschke, J. K.
- Affiliations
- Indiana University Bloomington (US)
- Corresponding author
- Kruschke, John K.
- ORCID
- Kruschke, John K.
- Venue
- Journal of Experimental Psychology: General
- Published
- 2013
- Volume
- 142
- Issue
- 2
- Pages
- 573-603
- ISSN
- 0096-3445 (ISSN-L)
- 1939-2222
- OpenAlex
- W2064604759
- Cited by
- 1,530
- References
- 91
- Citations by year
- 2026: 52 · 2025: 88 · 2024: 111 · 2023: 127 · 2022: 139 · 2021: 217 · 2020: 178 · 2019: 135 · 2018: 130 · 2017: 119 · 2016: 87 · 2015: 76 · 2014: 54 · 2013: 16
- FWCI
- 44.55
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Experimental Psychology General (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Distribution Estimation and Applications
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- Bayesian estimation, two-group comparison, effect size, credible intervals, group means, standard deviation, normality, outliers, statistical power, Bayes factor
- MeSH terms
- Bayes Theorem, Software, Confidence Intervals
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.