The DOI matches its Crossref record; 51 of the 51 references it cites were found in a registry or an index.
Rejecting or Accepting Parameter Values in Bayesian Estimation
Open accessAbstract
This article explains a decision rule that uses Bayesian posterior distributions as the basis for accepting or rejecting null values of parameters. This decision rule focuses on the range of plausible values indicated by the highest density interval of the posterior distribution and the relation between this range and a region of practical equivalence (ROPE) around the null value. The article also discusses considerations for setting the limits of a ROPE and emphasizes that analogous considerations apply to setting the decision thresholds for p values and Bayes factors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“There is no uniquely correct ROPE; however, by convention, the ROPE range is often set at half the size of Cohen’s definition of small effect size (i.e. 0.2 [306];) resulting in ROPE values of ±0.1 and ±0.05 for standardized mean differences (e.g. Cohen’s d = group 1 mean – group 2 mean/pooled standard deviation) and standardized regression coefficients (i.e. sβ = coefficient from a regression on”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,421
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
The ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306 · cited 1×
“Discrete decisions should be avoided if possible, because such decisions encourage people to ignore the magnitude of the parameter value and its uncertainty (e.g., Cumming, 2014; Kruschke & Liddell, 2018b; Wasserstein & Lazar, 2016, and many references cited therein).”
BackgroundJAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720
The Confrontation between General Relativity and Experiment
Will, C. M. (2014) · Living Reviews in Relativity · doi:10.12942/lrr-2014-4 · Cited by 3,996
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200
Bayes, T. (1763) · Philosophical Transactions of the Royal Society of London · doi:10.1098/rstl.1763.0053 · Cited by 3,023
AN ESSAY TOWARDS SOLVING A PROBLEM IN THE DOCTRINE OF CHANCES
BAYES (1958) · Biometrika · doi:10.1093/biomet/45.3-4.296 · Cited by 2,939
Redefine statistical significance
Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., et al. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0189-z · Cited by 2,772
Research works printed but not linked: 5
- Jeffreys H., 1961, Theory of probability
- Lakens D., 2017, t, 8, 355
- Lesaffre E., 2008, Bulletin of the NYU Hospital for Joint Diseases, 66, 150
- Little T. A., 2015, BioPharm International, 28, 45
- Westlake W. J., 1981, Biometrics, 37, 591
Cited by
Sorted by citations
Items 101–200 of 742
Muehlensiepen, F., Petit, P., Knitza, J., Welcker, M., & Vuillerme, N. (2022) · Journal of Medical Internet Research · doi:10.2196/40304 · Cited by 22
“This variable selection was based on the region of practical equivalence (ROPE) percentage (ROPE% ≤ 5) [16] and a subsequent selection based first on the variance inflation factor (VIF) [17].”
Albers, N., Neerincx, M. A., & Brinkman, W. (2022) · PLoS ONE · doi:10.1371/journal.pone.0277295 · Cited by 25
Escudero, P., Smit, E. A., & Angwin, A. J. (2022) · Language Learning · doi:10.1111/lang.12550 · Cited by 22
Weijs, M. L., Daum, M. M., & Lenggenhager, B. (2023) · Psychophysiology · doi:10.1111/psyp.14386 · Cited by 22
Stunnenberg, M., van Huizen, S. C., Swart, A., Lodder, W. J., Boxman, I. L. A., & Rutjes, S. A. (2023) · Microorganisms · doi:10.3390/microorganisms11102451 · Cited by 22
“The HEV-3c inoculates reached a concentration of 6.0 log 10 viral particles/mL, while the HEV-3e inoculates reached a concentration of 4.3 log 10 viral particles/mL and 6.1 log 10 viral particles/mL, depending on the stock that was used (Table S1).”
MethodInfluentialHealthy women show more experimentally induced central sensitization compared with men
Guekos, A., Saxer, J., Gallegos, D. S., & Schweinhardt, P. (2024) · Pain · doi:10.1097/j.pain.0000000000003144 · Cited by 22
“55 For the extent of sensitized skin, the ROPE was set to 6 0.5 cm 2 .”
BackgroundInfluentialWittekind, C. E., Bierbrodt, J., Lüdecke, D., Feist, A., Hand, I., & Moritz, S. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2018.12.075 · Cited by 22
Designing and evaluating an online course to support transition to university mathematics
Kinnear, G., Wood, A. K., & Gratwick, R. (2021) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2021.1962554 · Cited by 24
“(Kruschke, 2018, p271) The Bayesian approach takes a prior distribution of probabilities and updates this in light of the data to produce a posterior distribution of probabilities: the results therefore depend on the choice of priors.”
BackgroundYoshimura, H., Hirata, S., & Kinoshita, K. (2021) · Ecology and Evolution · doi:10.1002/ece3.7885 · Cited by 23
“We used the HDI + ROPE (region of practical equivalence) decision rule as the basis for accepting or rejecting null values of fixed effects (Kruschke, 2018; Makowski et al., 2019).”
BackgroundMethodInfluentialIntra- and inter-brain synchrony oscillations underlying social adjustment
Vicente, U., Ara, A., & Marco‐Pallarés, J. (2023) · Scientific Reports · doi:10.1038/s41598-023-38292-6 · Cited by 26
Organic Matter Is a Mixture of Terrestrial, Autochthonous, and Wastewater Effluent in an Urban River
Kelso, J. E., & Baker, M. A. (2020) · Frontiers in Environmental Science · doi:10.3389/fenvs.2019.00202 · Cited by 21
“Estimated values within the HDI have higher probability density than values outside the HDI and the total probability of values within the 95% HDI is 95% (Kruschke, 2018).”
BackgroundRognli, E. W., Zahl‐Olsen, R., Rekdal, S. S., Hoffart, A., & Bertelsen, T. B. (2022) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.13662 · Cited by 21
“When using older estimators of the ESS, 10,000 for the overall sample size has been recommended for reliable use of the 95% interval (Kruschke, 2018).”
MethodVerschooren, S., Pourtois, G., & Egner, T. (2020) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/xhp0000758 · Cited by 20
Seagren, E. G., Schoenbohm, L. M., Owen, L. A., Figueiredo, P. M., Hammer, S. J., Rimando, J., Wang, Y., & Bohon, W. (2020) · Earth and Planetary Science Letters · doi:10.1016/j.epsl.2020.116555 · Cited by 20
Campos, F. D. S., Borszcz, F. K., Flores, L. J. F., Barazetti, L. K., Teixeira, A. S., Nunes, R. F. H., & Guglielmo, L. G. A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.636153 · Cited by 20
“Additionally, Bayesian inferences are more intuitive by posterior probability distributions of parameters (Kruschke, 2018).”
BackgroundMethodInfluentialSampleSizePlanner: A Tool to Estimate and Justify Sample Size for Two-Group Studies
Kovács, M., van Ravenzwaaij, D., Hoekstra, R., & Aczél, B. (2022) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459211054059 · Cited by 20
“For further reading, see Kruschke (2018) and Kruschke (2011).”
BackgroundMethodKoerich, A. C. C., Borszcz, F. K., Mello, A. T., de Lucas, R. D., & Hansen, F. (2022) · Critical Reviews in Food Science and Nutrition · doi:10.1080/10408398.2022.2090894 · Cited by 24
“We used the region of practical equivalence (ROPE) method to infer the results (Kruschke 2018).”
MethodWulff, J. N., & Taylor, L. (2023) · Strategic Organization · doi:10.1177/14761270231214429 · Cited by 22
“Sample-size-dependent extensions exist (Held and Ott, 2016, 2018), but are valid only for a narrow set of models.”
Meier, Y., & Krämer, N. C. (2024) · Behaviour and Information Technology · doi:10.1080/0144929x.2024.2349183 · Cited by 20
“A 95% HDI contains the 95% most probable values of the estimated parameter (Kruschke 2018).”
InfluentialA Bayesian perspective on severity: risky predictions and specific hypotheses
van Dongen, N. N. N., Sprenger, J., & Wagenmakers, E. (2022) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02069-1 · Cited by 23
“Our approach is susceptible to any objection that may be raised against Bayesian statistics as a whole (e.g., Moy ´ e, 2008; Senn, 2011; Mayo, 2010; 2018).”
BackgroundPowering Nutrition Research: Practical Strategies for Sample Size in Multiple Regression
Seabrook, J. A. (2025) · Nutrients · doi:10.3390/nu17162668 · Cited by 38
Morando, A., Victor, T., & Dozza, M. (2019) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2019.2900436 · Cited by 19
“3) Group Comparison: Comparing groups by basing the estimate of a null effect solely on whether the null value is contained in the HPD is discouraged (for a discussion see [24]).”
BackgroundMethodResultInfluentialModelling generalisation gradients as augmented Gaussian functions
Lee, J. C., Mills, L., Hayes, B. K., & Livesey, E. J. (2020) · Quarterly Journal of Experimental Psychology · doi:10.1177/1747021820949470 · Cited by 22
Homeostatic response to sleep restriction in adolescents
Skoručak, J., Weber, N., Carskadon, M. A., Reynolds, C. M., Coussens, S. W., Achermann, P., & Short, M. A. (2021) · SLEEP · doi:10.1093/sleep/zsab106 · Cited by 21
Betacoronavirus-specific alternate splicing
Karlebach, G., Aronow, B. J., Baylin, S. B., Butler, D., Foox, J., Levy, S. A., Meydan, C., Mozsary, C., Saravia-Butler, A., Taylor, D. M., et al. (2022) · Genomics · doi:10.1016/j.ygeno.2022.110270 · Cited by 20
Wirtz, M. A., & Pfenninger, S. E. (2023) · Studies in Second Language Acquisition · doi:10.1017/s0272263123000177 · Cited by 19
“0.08 around a point null value of 0 (in accordance with the suggestions in Kruschke, 2018).”
BackgroundInfluentialBrennan, M. C., Albrecht, M. A., Brown, J. A., Leslie, G. D., & Ntoumanis, N. (2021) · Canadian Journal of Diabetes · doi:10.1016/j.jcjd.2021.01.001 · Cited by 23
Responders and non‐responders to aerobic exercise training: beyond the evaluation of
Maturana, F. M., Soares, R. N., Murias, J. M., Schellhorn, P., Erz, G., Burgstahler, C., Widmann, M., Munz, B., Thiel, A., & Niess, A. M. (2021) · Physiological Reports · doi:10.14814/phy2.14951 · Cited by 19
“Based on this percentage, there are different levels of significance, which we then apply to responders’ classification (see Figure 2 for an overview and (Kruschke, 2018) for an introduction to the topic).”
BackgroundMethodInfluentialSmit, E. A., Milne, A. J., & Escudero, P. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.801263 · Cited by 18
“We consider evidence ratios of >10 to be strong evidence and above >30 to be very strong evidence [see Jeffreys (1998), as cited by Kruschke (2018)].”
BackgroundSuárez‐García, A., Hernández, M. Á., Arce, E., & Ribas, J. R. (2024) · Applied Sciences · doi:10.3390/app14104189 · Cited by 26
Hoang, T. T. T., Ichinose, K., Morimoto, S., Furukawa, K., Le, L. H. T., & Kawakami, A. (2022) · Clinical Immunology · doi:10.1016/j.clim.2022.108980 · Cited by 17
Piccioni, F., Casenave, C., Baragatti, M. C., Cloez, B., & Vinçon‐Leite, B. (2022) · Ecological Informatics · doi:10.1016/j.ecoinf.2022.101764 · Cited by 18
Noroozi, O., & Wever, B. D. (2023) · Social interaction in learning and development · doi:10.1007/978-3-031-29411-2 · Cited by 23
Mental fatigue and technical performance in elite rugby league
Mariano, Y., Martin, K., & Mara, J. K. (2023) · Journal of Sports Sciences · doi:10.1080/02640414.2023.2228138 · Cited by 18
“2 times the standard deviation of the response variable (equivalent to a small effect size (Cohen, 1988; Kruschke, 2018) when modelling the NASA TLX subscales and mental fatigue pre to post game.”
BackgroundMethodInfluentialUnderstanding community assembly rules in managed floodplain food webs
Corline, N. J., Peek, R. A., Montgomery, J., Katz, J. V. E., & Jeffres, C. A. (2021) · Ecosphere · doi:10.1002/ecs2.3330 · Cited by 18
“In Bayesian inference, an effect is not present when a distribution simply differs from zero; thus, to assess the effect strength of each variable, we used a test of practical equivalence which combines HDI (highest density interval) and ROPE (a region of practical equivalence; Kruschke 2018).”
MethodSerial reproduction of narratives preserves emotional appraisals
Breithaupt, F. A., Li, B., & Kruschke, J. K. (2022) · Cognition & Emotion · doi:10.1080/02699931.2022.2031906 · Cited by 17
“For more information about ordered probit models see Kruschke (2015: chapter 23), Liddell and Kruschke (2018), and complete details at https://osf.io/nbuxg/.”
MethodSelf-citationKelter, R. (2022) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12267 · Cited by 21
Evidence against the “anomalous-is-bad” stereotype in Hadza hunter gatherers
Workman, C. I., Smith, K. M., Apicella, C. L., & Chatterjee, A. K. (2022) · Scientific Reports · doi:10.1038/s41598-022-12440-w · Cited by 20
“18 following guidelines for a “small” effect for standardized coefficients in logistic regression.(54,56) We conducted the analyses in R (4.”
MethoddockerHDDM: A user-friendly environment for Bayesian Hierarchical Drift-Diffusion ModelingPreprint
Pan, W., Geng, H., Zhang, L., Fengler, A., Frank, M. J., Zhang, R., & Chuan-Peng, H. (2022) · doi:10.31234/osf.io/6uzga · Cited by 20
Ackermans, K., Rusman, E., Nadolski, R. J., Specht, M. M., & Brand‐Gruwel, S. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12525 · Cited by 17
“To accept our hypotheses, the HDI of the TR or VERS condition must lie outside the ROPE limits set by the TPE [ − 0.52, 0.52], as illustrated in Table 5 and Figure 8.”
BackgroundMethodInfluentialUnconscious Visual Working Memory: A critical review and Bayesian meta-analysis
Gambarota, F., Tsuchiya, N., Pastore, M., Polito, N. D., & Sessa, P. (2022) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2022.104618 · Cited by 19
Claesdotter‐Knutsson, E., André, F., Fridh, M., Delfin, C., Håkansson, A., & Lindström, M. (2022) · JMIR Pediatrics and Parenting · doi:10.2196/35207 · Cited by 17
“Finally, since there is no notion of “statistical significance” in the Bayesian framework, we used the region of practical equivalence in conjunction with the 95% HDI as a decision boundary [26] in order to establish whether an estimated difference between those with and without problem gambling was of practical clini…”
MethodInvestor Intuition Promotes Gender Equality in Access to Reward-Based Crowdfunding
Fellnhofer, K., & Deng, Y. (2023) · Entrepreneurship Theory and Practice · doi:10.1177/10422587231192150 · Cited by 17
“For all three studies, Figure 6 illustrates investors’ mean willingness to invest via a point, possible parameter values of all variables under investigation, predictive band intervals of the HDI alongside the data via its posterior predictions (levels 95%, gray curves), and the conventional region of practical equiva…”
MethodInfluentialZurlinden, T. J., Dzierlenga, M. W., Kapraun, D. F., Ring, C., Bernstein, A. S., Schlosser, P. M., & Morozov, V. (2025) · Toxicology and Applied Pharmacology · doi:10.1016/j.taap.2025.117336 · Cited by 17
de Leeuw, S., Azrout, R., Rekker, R., & van Spanje, J. (2020) · Journal of Communication · doi:10.1093/joc/jqaa029 · Cited by 17
“Notes: The gray area surrounding the y-axis depicts the area of negligible change, as suggested by Kruschke (2018).”
Using p-values for the comparison of classifiers: pitfalls and alternatives
Berrar, D. (2022) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-022-00828-1 · Cited by 22
“Rejecting or accepting parameter values is straightforward in a Bayesian framework (Kruschke 2010, 2013, 2015, 2018).”
BackgroundMethodEscudero, P., Smit, E., & Mulak, K. E. (2022) · Brain Science · doi:10.3390/brainsci12121618 · Cited by 17
“To test our hypotheses, we only consider ERs above 30 (or of 1/30 or beyond) which qualify as “very strong evidence” and ERs of 10–30 (or of 1/10–1/30) which qualify as “strong” evidence (see [57] as cited by [58]).”
BackgroundIdentifying healthy individuals with Alzheimer’s disease neuroimaging phenotypes in the UK Biobank
Azevedo, T., Bethlehem, R. A. I., Whiteside, D. J., Swaddiwudhipong, N., Rowe, J. B., Lió, P., Rittman, T., Initiative, T. A. D. N., Silbert, L. C., Lind, B., et al. (2023) · Communications Medicine · doi:10.1038/s43856-023-00313-w · Cited by 17
“The 95% distribution of the Bayesian posterior is termed the critical interval (CI); if the mean lies outside the ROPE there is some evidence to accept a hypothesis between groups, and where the CI lies outside the ROPE there is strong evidence for accepting a hypothesis 58 .”
InfluentialWirtz, M. A., Pfenninger, S. E., Kaiser, I., & Ender, A. (2024) · Modern Language Journal · doi:10.1111/modl.12918 · Cited by 16
Not All Claims are Created Equal: Choosing the Right Statistical Approach to Assess Hypotheses
Azer, E. S., Khashabi, D., Sabharwal, A., & Roth, D. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.506 · Cited by 18
“For a discussion on setting ROPE see Kruschke (2018).”
BackgroundPalmer, J., Duffy, S., Meares, S., Pye, J. E., Calamante, F., Cespedes, M. I., Hickie, I., & Naismith, S. (2021) · Sleep · doi:10.1093/sleep/zsab007 · Cited by 16
Axon initial segment geometry in relation to motoneuron excitability
Rotterman, T. M., Carrasco, D. I., Housley, S. N., Nardelli, P., Powers, R. K., & Cope, T. C. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259918 · Cited by 16
How to Choose between Different Bayesian Posterior Indices for Hypothesis Testing in Practice
Kelter, R. (2021) · Multivariate Behavioral Research · doi:10.1080/00273171.2021.1967716 · Cited by 19
“To test hypotheses via the ROPE and a Bayesian interval estimate, the highest posterior density (HPD) interval, Kruschke (2018) proposed the following decision rule: • Reject the null value θ0 specified by H0 : θ = θ0, if the 95% HPD falls entirely outside the ROPE.”
BackgroundMethodInfluentialMaking the Unfamiliar Familiar: The Effect of Exposure on Ratings of Unfamiliar Musical Chords
Smit, E. A., Milne, A. J., Dean, R. T., & Weidemann, G. (2020) · Musicae Scientiae · doi:10.1177/1029864920948575 · Cited by 16
“In order to qualify the evidence for our hypotheses, we calculated evidence ratios employing the guidelines by Jeffreys (1998) as cited by Kruschke (2018).”
MethodTsirgiotis, J. M., Young, R. L., & Weber, N. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05286-0 · Cited by 15
Kelter, R. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01613-6 · Cited by 17
“…approaches like Bayesian equivalence testing based on the region of practical equivalence (ROPE) (Kruschke, 2013, 2015; Kruschke and Liddell, 2018b; Kruschke, 2018; Westlake, 1976; Kirkwood and Westlake, 1981; Kelter, 2020a; Liao et al., 2020) which are based on an analogy to frequentist…”
BackgroundMethodInfluentialRognli, E. W., Aalberg, M., & Czajkowski, N. O. (2020) · Clinical Child Psychology and Psychiatry · doi:10.1177/1359104520969761 · Cited by 15
“In contrast with classical null-hypothesis testing, Bayesian analysis allows for valid probability statements about the parameter falling within some range (Kruschke, 2018).”
InfluentialbayestestR: Understand and Describe Bayesian Models and Posterior Distributions
Makowski, D., Lüdecke, D., Ben‐Shachar, M. S., Patil, I., Wilson, M. K., & Wiernik, B. M. (2019) · doi:10.32614/cran.package.bayestestr · Cited by 15
Pull Request Governance in Open Source Communities
Alami, A., Pardo, R., Cohn, M. L., & Wasowski, A. (2022) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2021.3128356 · Cited by 19
Buckstein, R. J., Chodirker, L., Yee, K. W. L., Geddes, M. N., Leitch, H. A., Christou, G., Banerji, V., Leber, B. F., Khalaf, D., St‐Hilaire, È., et al. (2023) · Leukemia & lymphoma/Leukemia and lymphoma · doi:10.1080/10428194.2022.2156793 · Cited by 14
Wirtz, M. A., & Pfenninger, S. E. (2023) · Applied Linguistics · doi:10.1093/applin/amad055 · Cited by 15
Touzalin, F., PETIT, E. J., Cam, E., Stagier, C., Teeling, E. C., & Puechmaille, S. J. (2023) · Peer Community Journal · doi:10.24072/pcjournal.348 · Cited by 14
“For each scenario, we also estimated a Region Of Practical Equivalence (ROPE, Kruschke, 2018) the distributions represented by the EMD metric.”
MethodSocialness effects in lexical–semantic processing.
Diveica, V., Muraki, E. J., Binney, R. J., & Pexman, P. M. (2024) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0001328 · Cited by 18
Quesada, R. C., & Demiris, Y. (2024) · ACM Transactions on Human-Robot Interaction · doi:10.1145/3660649 · Cited by 14
“The default ROPE range suggested by [48] is − 0.1 to 0.1 for a standardised parameter.”
BackgroundInfluentialCoventry, B. S., & Bartlett, E. L. (2024) · eNeuro · doi:10.1523/eneuro.0484-23.2024 · Cited by 16
“…(ROPEs) may be included in the posterior distribution that explicitly de fi ne a range of values that are effectively equivalent to a null value, with parameters considered signi fi cant if 95% of the posterior distribution (95% HDI) does not contain 0 or any values in the ROPE (Kruschke, 2018).”
Scientific self-correction: the Bayesian way
Romero, F., & Sprenger, J. (2020) · Synthese · doi:10.1007/s11229-020-02697-x · Cited by 16
“…on fat-tailed Cauchy priors in statistical packages), bias in favor of the null hypothesis, and potential mismatch between inference with Bayes factors and estimation based on the posterior distribution (e.g., Sprenger 2013; Kruschke 2018; Lakens et al. 2018a; Mayo 2018; Ten-deiro and Kiers 2019).”
BackgroundChoi, W., To, C. Y., & Cheng, R. (2023) · Applied Psycholinguistics · doi:10.1017/s0142716423000358 · Cited by 13
“, unpitched musicians and nonmusicians are expected to perform similarly), where appropriate, we would supplement any null hypothesis significance testing with Bayesian hypothesis testing (Kruschke, 2018).”
MethodCausal roles of prefrontal and temporo-parietal theta oscillations for inequity aversion
Christian, P., Kapetaniou, G. E., & Soutschek, A. (2023) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsad061 · Cited by 14
“Re-computing this GLMM revealed that, contrary to the original GLMM results, the effect of tACS theta-sham on inequity aversion no longer passed the statistical threshold, tACS theta-sham ×Inequity absolute : HDI mean = −0,89, HDI 95% = [−1.95, 0.08].”
InfluentialAccurate digital quantification of tau pathology in progressive supranuclear palsy
Pansuwan, T., Quaegebeur, A., Kaalund, S. S., Hidari, E., Briggs, M., Rowe, J. B., & Rittman, T. (2023) · Acta Neuropathologica Communications · doi:10.1186/s40478-023-01674-y · Cited by 13
“…of the balanced random forest were tuned using a random-search with the following parameter space: n_features_to_select = [28, 30, 34, 36, 38, 40, 42, 44, 46, 48, 50, 52, 54] (number of features to select) , n_estimators = [100, 200, 300, 400, 500, 600, 700, 800, 900, 1000] (number…”
MethodInfluentialEquilibrium Mechanical Properties of the Nonhuman Primate Cervix
Fang, S., Shi, L. T., Vink, J., Feltovich, H. M., Hall, T. J., & Myers, K. M. (2024) · Journal of Biomechanical Engineering · doi:10.1115/1.4064558 · Cited by 13
Replication of null results: Absence of evidence or evidence of absence?
Pawel, S., Heyard, R., Micheloud, C., & Held, L. (2024) · eLife · doi:10.7554/elife.92311.3 · Cited by 13
Timbre Preferences in the Context of Mixing Music
Dobrowohl, F. A., Milne, A. J., & Dean, R. T. (2019) · Applied Sciences · doi:10.3390/app9081695 · Cited by 13
“An Evidence Ratio of 3–10 indicates “substantial” evidence for the reported observation; Evidence Ratios of 10+ indicate strong evidence for the observation [27].”
BackgroundFire-mediated germination syndromes in Leucadendron (Proteaceae) and their functional correlates
Newton, R. J., Mackenzie, B. D. E., Lamont, B. B., Barreiro, P. G., Cowling, R. M., & He, T. (2021) · Oecologia · doi:10.1007/s00442-021-04947-2 · Cited by 13
“Adapting the HDI + ROPE (Region of Practical Equivalence) decision rule (Kruschke 2018), treatment effects with 95% HDIs completely contained within the interval [-10%–10”
MethodMemory precision for salient distractors decreases with learned suppression
Won, B.-Y., Venkatesh, A., Witkowski, P. P., Banh, T., & Geng, J. J. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01968-z · Cited by 13
“Figure 8 shows the distribution and marks the Highest Density Interval (HDI) for each group, which describes the 95%most credible values for the parameter (Kruschke, 2018).”
BackgroundMuehlensiepen, F., Petit, P., Knitza, J., Welcker, M., & Vuillerme, N. (2023) · Journal of Medical Internet Research · doi:10.2196/40912 · Cited by 13
“This variable selection was based on the region of practical equivalence (ROPE) percentage (ROPE% ≤ 5) [18-20], and a subsequent selection was based first on the variance inflation factor (VIF) [21].”
Murphy, C. M., Weller, D. L., & Strawn, L. K. (2023) · Applied and Environmental Microbiology · doi:10.1128/aem.01529-22 · Cited by 13
“5% indicate a nonnegligible effect and values of,1% indicate a substantial effect, and Kruschke (73) states that values of,5% indicate a nonnegligible effect.”
BackgroundInfluentialMediation analysis of conspiratorial thinking and anti-expert sentiments on vaccine willingness.
Blackburn, A. M., Han, H., Gelpí, R., Stöckli, S., Jeftić, A., Ch’ng, B., Koszałkowska, K., Lacko, D., Milfont, T. L., Lee, Y., et al. (2023) · Health Psychology · doi:10.1037/hea0001268 · Cited by 13
Ware, A. L., McLarnon, M. J. W., Lapointe, A. P., Brooks, B. L., Bacevice, A. M., Bangert, B. A., Beauchamp, M. H., Bigler, E. D., Björnson, B., Cohen, D. M., et al. (2023) · PEDIATRICS · doi:10.1542/peds.2022-060515 · Cited by 15
Kurdi, B., Melnikoff, D. E., Hannay, J. W., Korkmaz, A., Lee, K. M., Ritchie, E. G., Surdel, N., Vuletich, H. A., Xin, Y., Payne, B. K., et al. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02291-2 · Cited by 14
“Specifically, it is not statistically warranted to conclude that the null hypothesis is true (i.e., that the two versions of the AMP do not differ from each other) from a nonsignificant statistical test (Dienes, 2014; Kruschke, 2018).”
BackgroundAckermans, K., Rusman, E., Nadolski, R. J., Specht, M. M., & Brand‐Gruwel, S. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.07.011 · Cited by 13
Kinnear, G. (2021) · International Journal of Research in Undergraduate Mathematics Education · doi:10.1007/s40753-020-00121-w · Cited by 16
“Every parameter in the model has an exact credible interval” (Liddell and Kruschke 2018, p339); this enables us to look at the strength of evidence for differences between different groups of students, without needing to worry about corrections for multiple comparisons.”
BackgroundInfluentialBates, A., Laven, R. A., O’Brien, R., Liggett, S., & Griffin, F. (2020) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2020.105199 · Cited by 12
Wirth, M., Voß, A., & Rothermund, K. (2023) · The Journals of Gerontology Series B · doi:10.1093/geronb/gbad033 · Cited by 13
Ferrali, R., Grossman, G., & Larreguy, H. (2023) · Science Advances · doi:10.1126/sciadv.adf1222 · Cited by 14
Zloteanu, M., & Vuorre, M. (2024) · Journal of Nonverbal Behavior · doi:10.1007/s10919-024-00456-x · Cited by 15
“Decisions about negligible effects can made on the basis of the 95% CI falling entirely within the ROPE, known as the HDI + ROPE decision rule (Kruschke, 2018), or by using the entire posterior density, known as the ROPE(100”
The political (a)symmetry of metacognitive insight into detecting misinformation.
Geers, M., Fischer, H., Lewandowsky, S., & Herzog, S. M. (2024) · Journal of Experimental Psychology General · doi:10.1037/xge0001600 · Cited by 11
Predicting Thoracic Aortic Dissection in a Diverse Biobank Using a Polygenic Risk Score
DePaolo, J. S., Zamirpour, S., Abramowitz, S. A., Biagetti, G. M., Judy, R., Beeche, C., Duda, J., Gee, J. C., Witschey, W. R. T., Chirinos, J. A., et al. (2025) · JACC Advances · doi:10.1016/j.jacadv.2025.101743 · Cited by 14
bayest: An R Package for Effect-Size Targeted Bayesian Two-Sample t-Tests
Kelter, R. (2020) · Journal of Open Research Software · doi:10.5334/jors.290 · Cited by 12
Gerhardsson, A., Porada, D. K., Lundström, J. N., Axelsson, J., & Schwarz, J. (2020) · Journal of Sleep Research · doi:10.1111/jsr.13236 · Cited by 12
“A region of practical equivalence (ROPE) was used as proxy for the null hypothesis, with limits set to reflect half of a small effect size (Kruschke, 2018).”
Lewis, R. J., Bueno, G. L., & Fiore, A. D. (2022) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2022.851880 · Cited by 12
“Finally, we used an HDI + ROPE approach (Kruschke, 2015, 2018; Kruschke and Liddell, 2018) to evaluate which of our variables of interest might be considered important predictors in all of our models.”
BackgroundMethodKelter, R. (2020) · BMC Research Notes · doi:10.1186/s13104-020-05291-z · Cited by 11
Absolute ethanol intake predicts ethanol preference inDrosophila
Park, S. J., & Ja, W. W. (2020) · Journal of Experimental Biology · doi:10.1242/jeb.224121 · Cited by 12
“testing: reject H 0 if the 95% high density interval (HDI) falls completely outside the ROPE; accept H 0 “for practical purposes” if the HDI falls fully inside the ROPE; remain “undecided” otherwise (Kruschke, 2018). When there was more than an anecdotal evidence for the existence of an association (BF < 1/3 or >…”
MethodThe Role of Sleep in the Relationship Between ADHD Symptoms and Stop Signal Task Performance
Wolff, B., Sciberras, E., He, J. L., Youssef, G. J., Anderson, V. A., & Silk, T. J. (2020) · Journal of Attention Disorders · doi:10.1177/1087054720943290 · Cited by 13
“Corrections were not made for multiple comparisons, as Bayesian analyses do not correct for other tests conducted and do not use sampling distributions; the posterior distribution is a fixed entity based on the data at hand (Kruschke, 2018).”
BackgroundMethodEquivalence Testing and the Second Generation P-Value
Lakens, D., & Delacre, M. (2020) · Meta-Psychology · doi:10.15626/mp.2018.933 · Cited by 12
Samara, I., Roth, T. S., & Kret, M. E. (2021) · Archives of Sexual Behavior · doi:10.1007/s10508-021-02017-5 · Cited by 12
“Effects were interpreted using the OR 95% highest density intervals (HDI), which summarize 95% of the posterior parameter distribution (Kruschke, 2018).”
MethodEarly-Stage Alzheimer's Disease Affects Fast But Not Slow Adaptive Processes in Motor Learning
Sutter, K., Wijdenes, L. O., van Beers, R. J., Claassen, J. A. H. R., Kessels, R. P. C., & Medendorp, W. P. (2024) · eNeuro · doi:10.1523/eneuro.0108-24.2024 · Cited by 11
“We tested the ROPE for each parameter separately using the following formula (Kruschke, 2018): in which s 21 and s 22 are the variances of the posterior distributions of the two groups.”
MethodAl‐Essa, L. A., Ebrahim, E. A., & Mergiaw, Y. A. (2024) · Frontiers in Energy Research · doi:10.3389/fenrg.2024.1416126 · Cited by 11
Consonant lengthening marks the beginning of words across a diverse sample of languages
Blum, F., Paschen, L., Forkel, R., Fuchs, S. I., & Seifart, F. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01988-4 · Cited by 11
“In the complete absence of an effect, the posterior distribution would be fully within the ROPE 37 .”
InfluentialAn In-Class Demonstration of Bayesian Inference
van Doorn, J. B., Matzke, D., & Wagenmakers, E. (2019) · Psychology Learning & Teaching · doi:10.1177/1475725719848574 · Cited by 11
Hormonal Contraception and Sexuality: Causal Effects, Unobserved Selection, or Reverse Causality?
Botzet, L. J., Gerlach, T. M., Driebe, J. C., Penke, L., & Arslan, R. C. (2021) · Collabra Psychology · doi:10.1525/collabra.29039 · Cited by 11
Metadata
- Authors
- Kruschke, J. K.
- Affiliations
- Indiana University Bloomington (US)
- Corresponding author
- Kruschke, John K.
- ORCID
- Kruschke, John K.
- Venue
- Advances in Methods and Practices in Psychological Science
- Publisher
- SAGE Publications
- Published
- 2018-05-08
- Volume
- 1
- Issue
- 2
- Pages
- 270-280
- ISSN
- 2515-2459 (ISSN-L)
- 2515-2467
- OpenAlex
- W2801776818
- Cited by
- 734
- References
- 51
- Citations by year
- 2026: 99 · 2025: 128 · 2024: 128 · 2023: 98 · 2022: 85 · 2021: 93 · 2020: 67 · 2019: 25 · 2018: 10
- FWCI
- 41.08
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Advances in Methods and Practices in Psychological Science (publishedVersion)
- IUScholarWorks Open (Indiana University) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- U.S. Food and Drug Administration
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Distribution Estimation and Applications
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- Bayesian hypothesis testing, null hypothesis rejection, highest density interval, region of practical equivalence, posterior distribution, decision threshold, p-values, Bayes factor, parameter values
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review