Small Sample Inference for Fixed Effects from Restricted Maximum Likelihood
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Restricted maximum likelihood (REML) is now well established as a method for estimating the parameters of the general Gaussian linear model with a structured covariance matrix, in particular for mixed linear models. Conventionally, estimates of precision and inference for fixed effects are based on their asymptotic distribution, which is known to be inadequate for some small-sample problems. In this paper, we present a scaled Wald statistic, together with an F approximation to its sampling distribution, that is shown to perform well in a range of small sample settings. The statistic uses an adjusted estimator of the covariance matrix that has reduced small sample bias. This approach has the advantage that it reproduces both the statistics and F distributions in those settings where the latter is exact, namely for Hotelling T2 type statistics and for analysis of variance F-ratios. The performance of the modified statistics is assessed through simulation studies of four different REML analyses and the methods are illustrated using three examples.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Accurate model parameter estimations were ensured by use of the residual maximum likelihood approach with the Kenward and Roger, 1997 approximation of degrees of freedom.”
From Longitudinal association between social media use and psychological distress among adolescents (2020) · cites this paper as Kenward and Roger, 1997
In the citing paper
“Not only does the data in the motivating example have different flowering days for each genotype (see for example Fig. 2), but the proposed methodology also accounts for the different strata in the Wald test by approximating the denominator degrees of freedom (Kenward and Roger, 1997).”
From Incorporating environmental covariates to explore genotype × environment × management (G × E × M) interactions: A one-stage predictive model (2023) · cites this paper as Kenward and Roger, 1997
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923
Recovery of inter-block information when block sizes are unequal
PATTERSON, H. D., & THOMPSON, R. (1971) · Biometrika · doi:10.1093/biomet/58.3.545 · Cited by 4,058
Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems
Harville, D. A. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10480998 · Cited by 2,667 · cited 1×
“Restricted (or residual) maximum likelihood (REML) has become well established for the estimation of the parameters of Z (Patterson and Thompson, 1971; Harville, 1977; Thompson, 1980; Robinson, 1991) and the corresponding estimator of 3, 3 say, has a generalized least squares form that uses the REML estimate of Z.”
BackgroundThat BLUP is a Good Thing: The Estimation of Random Effects
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011926 · Cited by 1,686
Gilmour, A. R., Thompson, R., & Cullis, B. R. (1995) · Biometrics · doi:10.2307/2533274 · Cited by 915
15 Design and Analysis of Cross-Over Trials
Kenward, M. G., & Jones, B. (2007) · Handbook of Statistics · doi:10.1016/s0169-7161(07)27015-4 · Cited by 871
Self-citationPrinciples of Multivariate Analysis
Ling, R. F. (1990) · Technometrics · doi:10.1080/00401706.1990.10484645 · Cited by 812
Satterthwaite, F. E. (1941) · Psychometrika · doi:10.1007/bf02288586 · Cited by 809
Approximations for Standard Errors of Estimators of Fixed and Random Effects in Mixed Linear Models
Kackar, R. N., & Harville, D. A. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477102 · Cited by 445
Cited by
Items 301–400 of 1,051
Natural host‐plant quality affects immune defence of an insect herbivore
Klemola, N., Klemola, T., Rantala, M. J., & Ruuhola, T. (2007) · Entomologia Experimentalis et Applicata · doi:10.1111/j.1570-7458.2007.00533.x · Cited by 107
“We used the method by Kenward & Roger (1997) in computing the denominator degrees of freedom for the tests of fixed effects.”
MethodMeta-Analysis of Treatment for Child Sexual Behavior Problems: Practice Elements and Outcomes
Amand, A. S., Bard, D., & Silovsky, J. F. (2008) · Child Maltreatment · doi:10.1177/1077559508315353 · Cited by 137
“The Student t distribution with Satterthwaite-adjusted degrees of freedom was used for interval calculations to adjust for known underestimation of restricted maximum likelihood standard errors when meta-analyzing a small number of studies (Kenward & Roger, 1997; Manor & Zucker, 2004, among others).”
MethodSampasa-Kanyinga, H., Standage, M., Tremblay, M. S., Katzmarzyk, P. T., Hu, G., Kuriyan, R., Maher, C., Maia, J., Olds, T., Sarmiento, O. L., et al. (2017) · Public Health · doi:10.1016/j.puhe.2017.07.010 · Cited by 106
How predictable are reptile responses to wildfire?
Lindenmayer, D. B., Wood, J. T., MacGregor, C. I., Michael, D., Cunningham, R. B., Crane, M. J., Montague‐Drake, R., Brown, D., Muntz, R., & Driscoll, D. A. (2008) · Oikos · doi:10.1111/j.0030-1299.2008.16683.x · Cited by 121
Kuusim�ki, L., Peltonen, Y., Mutanen, P., Peltonen, K., & Savela, K. (2004) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-003-0477-y · Cited by 109
Carbon input to soil from oilseed and pulse crops on the Canadian prairies
Gan, Y., Campbell, C. A., Janzen, H. H., Lemke, R. L., Basnyat, P., & McDonald, C. L. (2009) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2009.04.014 · Cited by 106
Pandey, A. K., Kamarajan, C., Tang, Y., Chorlian, D. B., Roopesh, B. N., Manz, N., Stimus, A., Rangaswamy, M., & Porjesz, B. (2012) · Biological Psychology · doi:10.1016/j.biopsycho.2011.10.009 · Cited by 105
Using cluster bootstrapping to analyze nested data with a few clusters
Huang, F. L. (2018) · Educational and Psychological Measurement · doi:10.1177/0013164416678980 · Cited by 107
“In addition, a Kenward–Roger (Kenward & Roger, 1997) correction using the pbkrtest package (Halekoh & Højsgaard, 2014) in R was used to adjust standard errors which has shown to result in less-biased standard errors when analyzing data with a low number of clusters (B. A. Bell et al., 2014; McNeish & Stapleton, 2016).”
MethodAnesthetic Techniques for Fetal Surgery
Ngamprasertwong, P., Michelfelder, E. C., Arbabi, S., Choi, Y. S., Statile, C. J., Ding, L., Boat, A. C., Eghtesady, P., Holland, K. D., & Sadhasivam, S. (2013) · Anesthesiology · doi:10.1097/aln.0b013e318283c954 · Cited by 105
Thalamic Shape Abnormalities in Individuals with Schizophrenia and Their Nonpsychotic Siblings
Harms, M. P., Wang, L., Mamah, D., Barch, D. M., Thompson, P. A., & Csernansky, J. G. (2007) · The Journal of Neuroscience · doi:10.1523/jneurosci.2571-07.2007 · Cited by 105
“In all mixed model analyses, the covariance structure was “unstructured,” the two different sibling pairs were allowed to be heterogeneous in their covariance estimates, and the degrees of freedom calculations used the method of Kenward and Roger (1997).”
MethodWatkins, P. J., Kearney, G. A., Rose, G., Allen, D., Ball, A. J., Pethick, D. W., & Warner, R. D. (2012) · Meat Science · doi:10.1016/j.meatsci.2012.08.011 · Cited by 107
“Themost parsimonious model for each variate was chosen using Wald tests and approximate F statistics (Kenward & Roger, 1997).”
MethodTwo-year trends in psychosocial functioning after adolescent Roux-en-Y gastric bypass
Zeller, M. H., Reiter‐Purtill, J., Ratcliff, M. B., Inge, T. H., & Noll, J. G. (2011) · Surgery for Obesity and Related Diseases · doi:10.1016/j.soard.2011.01.034 · Cited by 112
Spagnolo, P. A., Ramchandani, V. A., Schwandt, M. L., Kwako, L. E., George, D. T., Mayo, L. M., Hillard, C. J., & Heilig, M. (2016) · Alcoholism: Clinical and Experimental Research · doi:10.1111/acer.13210 · Cited by 104
“The Kenward-Roger correction (Kenward and Roger, 1997) was used in all models, as the use of this correction is highly recommended in repeated measures models with more complex covariance structures, especially when there is an unbalanced design (Littell, 2006).”
MethodDavidson, M., Saoud, J., Staner, C., Noel, N., Luthringer, E., Werner, S., Reilly, J., Schaffhauser, J.-Y., Rabinowitz, J., Weiser, M., et al. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.17010122 · Cited by 100
“The Kenward-Roger approximation (33) was used to estimate denominator degrees of freedom.”
Piepho, H., & Edmondson, R. N. (2018) · Journal of Agronomy and Crop Science · doi:10.1111/jac.12267 · Cited by 117
Kause, A., Tobin, D., Houlihan, D. F., Martín, S., Mäntysaari, E. A., Ritola, O., & Ruohonen, K. (2006) · Journal of Animal Science · doi:10.2527/2006.844807x · Cited by 104
“The method of Kenward and Roger (1997) was used to calculate the correct degrees of freedom and F-tests for the fixed effects.”
MethodMelchinger, A. E., Piepho, H., Utz, H. F., Muminović, J., Wegenast, T., Törjék, O., Altmann, T., & Kusterer, B. (2007) · Genetics · doi:10.1534/genetics.107.080564 · Cited by 120
“The lack-of-fit of each model was tested with a x2-test statistic, which corresponds approximately to a Wald F-test in the context of a mixed linear model, with denominator degrees of freedom approximated by the method of Kenward and Roger (1997).”
MethodEmslie, G. J., Prakash, A., Zhang, Q., Pangallo, B. A., Bangs, M. E., & March, J. S. (2014) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2013.0096 · Cited by 106
“A Kenward–Roger correction (Kenward and Roger 1997) was used to estimate denominator degrees of freedom.”
MethodBerinstein, N. L., Karkada, M., Oza, A. M., Odunsi, K. O., Villella, J., Nemunaitis, J. J., Morse, M. A., Pejovic, T. B., Bentley, J., Buyse, M. E., et al. (2015) · OncoImmunology · doi:10.1080/2162402x.2015.1026529 · Cited by 103
“Differences in the IFNg response between the stimulated and unstimulated cells at Day 21, 42, and 73 were compared between the cohorts by using suitable F-tests with degrees of freedom approximated by the Kenward–Roger method.(36) The resulting p values were adjusted for multiplecomparisons by using a closed testing p…”
MethodWatson, D., Anderson, M. J., Kendrick, G. A., Nardi, K., & Harvey, E. S. (2009) · Marine Ecology Progress Series · doi:10.3354/meps08009 · Cited by 103
“Tests of fixed effects were done using Type III sums of squares and approximate F-tests, with corrections to Satterthwaite’s (1941) approximations to the degrees of freedom as provided by Kenward & Roger (1997) and bias-correction for small samples as provided by Kackar & Harville (1984).”
MethodLuby, J. L., Belden, A. C., Jackson, J. J., Lessov-Schlaggar, C. N., Harms, M. P., Tillman, R., Botteron, K., Whalen, D., & Barch, D. M. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2356 · Cited by 103
Bouchet, S., Servin, B., Bertin, P., Madur, D., Combes, V., Dumas, F., Brunel, D., Laborde, J., Charcosset, A., & Nicolas, S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0071377 · Cited by 118
Automated mixed ANOVA modeling of sensory and consumer data
Kuznetsova, A., Christensen, R. H. B., Bavay, C., & Brockhoff, P. B. (2014) · Food Quality and Preference · doi:10.1016/j.foodqual.2014.08.004 · Cited by 119
Toews, M. D., Subramanyam, B., & Rowan, J. M. (2003) · Journal of Economic Entomology · doi:10.1093/jee/96.6.1967 · Cited by 103
London, C. A., Bernabé, L. F., Barnard, S., Kisseberth, W. C., Borgatti, A., Henson, M., Wilson-Robles, H. M., Jensen, K., Ito, D., Modiano, J. F., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0087585 · Cited by 104
Mixed Models for Assessing Correlation in the Presence of Replication
Hamlett, A., RYAN, L. M., Serrano-Trespalacios, P., & Wolfinger, R. D. (2003) · Journal of the Air & Waste Management Association · doi:10.1080/10473289.2003.10466174 · Cited by 102
Ngetich, F. K., Diels, J., Shisanya, C. A., Mugwe, J. N., Mucheru-Muna, M. W., & Mugendi, D. N. (2014) · CATENA · doi:10.1016/j.catena.2014.05.026 · Cited by 104
Long-term biochar and soil organic carbon stability – Evidence from field experiments in Germany
Groß, A., Bromm, T., Polifka, S., Fischer, D., & Glaser, B. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.176340 · Cited by 119
Farrell, A. D., Henry, D. B., Mays, S., & Schoeny, M. E. (2011) · Child Development · doi:10.1111/j.1467-8624.2010.01546.x · Cited by 113
Microemboli Composed of Cholesterol Crystals Disrupt the Blood-Brain Barrier and Reduce Cognition
Rapp, J. H., Pan, X. M., Neumann, M., Hong, M., Hollenbeck, K., & Liu, J. (2008) · Stroke · doi:10.1161/strokeaha.107.496737 · Cited by 101
Lower subjective social status exaggerates interleukin-6 responses to a laboratory stressor
Derry, H. M., Fagundes, C. P., Andridge, R., Glaser, R., Malarkey, W. B., & Kiecolt-Glaser, J. K. (2013) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2013.06.026 · Cited by 98
“The Kenward—Roger method was used to correct the degrees of freedom in the models and control Type I error (Kenward and Roger, 1997).”
MethodSoil moisture mediates alpine life form and community productivity responses to warming
Winkler, D. E., Chapin, K. J., & Kueppers, L. M. (2016) · Ecology · doi:10.1890/15-1197.1 · Cited by 111
Denervation drives mitochondrial dysfunction in skeletal muscle of octogenarians
Spendiff, S., Vuda, M., Gouspillou, G., Aare, S., Perez, A., Morais, J. A., Jagoe, R. T., Filion, M., Glicksman, R., Kapchinsky, S., et al. (2016) · The Journal of Physiology · doi:10.1113/jp272487 · Cited by 100
Stability of hand force production. I. Hand level control variables and multifinger synergies
Reschechtko, S., & Latash, M. L. (2017) · Journal of Neurophysiology · doi:10.1152/jn.00485.2017 · Cited by 105
“F-test degrees of freedom were computed using the Kenward-Roger method (Kenward and Roger 1997).”
MethodMuir, C. D., Hangarter, R. P., Moyle, L. C., & Davis, P. A. (2013) · Plant Cell & Environment · doi:10.1111/pce.12245 · Cited by 115
“Firstly, we used F-tests, calculating the residual degrees of freedom using the Kenward–Roger approximation (Kenward & Roger 1997) as implemented in the R package pbrktest version 0.3-1 (Halekoh & Højsgaard 2012).”
MethodInfluentialSchjønning, P., Lamandé, M., Berisso, F. E., Simojoki, A., Alakukku, L., & Andreasen, R. R. (2013) · Soil Science Society of America Journal · doi:10.2136/sssaj2013.06.0224 · Cited by 99
Effect of Camelina sativa expeller cake on performance and meat quality of broilers
Ryhänen, E., Perttilä, S., Tupasela, T., Valaja, J., Eriksson, C., & Larkka, K. (2007) · Journal of the Science of Food and Agriculture · doi:10.1002/jsfa.2864 · Cited by 99
The Analysis of Combined Experiments
Dixon, P. M., Moore, K. J., & van Santen, E. (2018) · ASSA, CSSA and SSSA · doi:10.2134/appliedstatistics.2016.0004.c8 · Cited by 100
An Open Trial of a Metacognitive Executive Function Training for Young Children With ADHD
Tamm, L., Nakonezny, P. A., & Hughes, C. W. (2014) · Journal of Attention Disorders · doi:10.1177/1087054712445782 · Cited by 98
Avoiding bias in mixed model inference for fixed effects
Gurka, M. J., Edwards, L. J., & Muller, K. E. (2011) · Statistics in Medicine · doi:10.1002/sim.4293 · Cited by 98
“We employed restricted maximum likelihood (REML) estimation with the Kenward–Roger approach [26] for all five cases.”
MethodPiepho, H., Laidig, F., Drobek, T., & Meyer, U. (2014) · Theoretical and Applied Genetics · doi:10.1007/s00122-014-2275-1 · Cited by 95
Coyle, D. R., Coleman, M. D., & Aubrey, D. P. (2008) · Canadian Journal of Forest Research · doi:10.1139/x07-231 · Cited by 110
The appetite‐suppressant effect of nicotine is enhanced by caffeine*
Jessen, A., Buemann, B., Toubro, S., Skovgaard, I. M., & Astrup, A. (2005) · Diabetes, Obesity and Metabolism · doi:10.1111/j.1463-1326.2004.00389.x · Cited by 98
Maulfair, D. D., Fustini, M., & Heinrichs, A. J. (2011) · Journal of Dairy Science · doi:10.3168/jds.2010-3718 · Cited by 124
Regression Analysis of Country Effects Using Multilevel Data: A Cautionary TalePreprint
Bryan, M. L., & Jenkins, S. P. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2322088 · Cited by 153
Martin, K. L., & Kirkman, L. K. (2009) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2009.01659.x · Cited by 107
Alfano, C. M., Peng, J., Andridge, R. R., Lindgren, M. E., Povoski, S. P., Lipari, A. M., Agnese, D. M., Farrar, W. B., Yee, L. D., Carson, W. E., et al. (2017) · Journal of Clinical Oncology · doi:10.1200/jco.2016.67.1883 · Cited by 95
Emotion Regulation in Everyday Life: The Role of Goals and Situational Factors
Wilms, R., Lanwehr, R., & Kastenmüller, A. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00877 · Cited by 135
Changes in taxonomic and phylogenetic diversity in the Anthropocene
Li, D., Olden, J. D., Lockwood, J. L., Record, S., McKinney, M. L., & Baiser, B. (2020) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2020.0777 · Cited by 106
“The 95% confidence interval (CI) of the intercept was assessed by computing scaled Wald statistics, which were treated as following an approximate F distribution [53].”
Quaegebeur, A., Segura, I., Schmieder, R., Verdegem, D., Decimo, I., Bifari, F., Dresselaers, T., Eelen, G., Ghosh, D., Davidson, S. M., et al. (2016) · Cell Metabolism · doi:10.1016/j.cmet.2015.12.007 · Cited by 95
Analysing repeated measurements data: a practical comparison of methods
Omar, R. Z., Wright, E. M., Turner, R. M., & Thompson, S. G. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990715)18:13<1587::aid-sim141>3.0.co;2-z · Cited by 95
Longitudinal patterns of physical activity in children aged 8 to 12 years: the LOOK study
Telford, R. M., Telford, R. D., Cunningham, R. B., Cochrane, T., Davey, R., & Waddington, G. (2013) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-10-81 · Cited by 95
“Statistical significance of effects are assessed by calculating adjusted Wald statistics [24].”
MethodBrown, A. W., Li, P., Brown, M. M. B., Kaiser, K. A., Keith, S. W., Oakes, J. M., & Allison, D. B. (2015) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.114.105072 · Cited by 104
Gundlach, C., Moratti, S., Forschack, N., & Müller, M. M. (2020) · Cerebral Cortex · doi:10.1093/cercor/bhz335 · Cited by 105
Mamalakis, M., Swift, A. J., Vorselaars, B., Ray, S., Weeks, S., Ding, W., Clayton, R. H., Mackenzie, L. S., & Banerjee, A. (2021) · Computerized Medical Imaging and Graphics · doi:10.1016/j.compmedimag.2021.102008 · Cited by 110
“Applying the Kenward and Roger’s method for the degrees of freedomof the t-statistic [24] and the Tukey’s method for pairwise comparisons [48], we found that the proposed DenResCov-19 network achieves statistically significant classification performance over both DenseNet-121 and ResNet-50 networks in DXR4 dataset in…”
Yield decrease in sugar beet caused by reduced tillage and direct drilling
Koch, H., Dieckmann, J., Büchse, A., & Märländer, B. (2008) · European Journal of Agronomy · doi:10.1016/j.eja.2008.08.001 · Cited by 95
Putative Stem Cells in Human Dental Pulp with Irreversible Pulpitis: An Exploratory Study
Wang, Z., Pan, J., Wright, J. T., Bencharit, S., Zhang, S., Everett, E. T., Teixeira, F. B., & Preisser, J. S. (2010) · Journal of Endodontics · doi:10.1016/j.joen.2010.02.003 · Cited by 107
“Adjusted t test based on Kenward-Roger degrees of freedom correction (32) within a linear mixed models framework to account for multiple batches per subject and repeat experiments within batch (or same mRNA sample); total of 35 replicates comparing 5 control versus 4 diseased subjects, P = .”
Social amoeba farmers carry defensive symbionts to protect and privatize their crops
Brock, D. A., Read, S., Bozhchenko, A., Queller, D. C., & Strassmann, J. E. (2013) · Nature Communications · doi:10.1038/ncomms3385 · Cited by 97
Modeling the distinct phases of skill acquisition.
Tenison, C., & Anderson, J. R. (2016) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/xlm0000204 · Cited by 92
“We calculated t statistics and p values for our fixed effect using the Kenward-Roger approximation for degrees of freedom (Kenward & Roger, 1997).”
MethodTang, S., Wang, I.-T. J., Yue, C., Takano, H., Terzic, B., Pance, K., Lee, J. Y., Cui, Y., Coulter, D. A., & Zhou, Z. (2017) · Journal of Neuroscience · doi:10.1523/jneurosci.0539-17.2017 · Cited by 110
“The KRmodcomp function reports a modified F test statistic based on the Kenward and Roger approximation (Kenward and Roger, 1997), which accounts for the small sample sizes in our study, modified numerator and denominator degrees of freedom, and a p value.”
MethodPalermo, T. M., de la Vega, R., Murray, C., Law, E., & Zhou, C. (2020) · Pain · doi:10.1097/j.pain.0000000000001994 · Cited by 93
Ferron, J. M., Farmer, J. L., & Owens, C. M. (2010) · Behavior Research Methods · doi:10.3758/brm.42.4.930 · Cited by 94
“Consequently, its performance has been examined in Monte Carlo studies (Fouladi & Shieh, 2004; Gomez, Schaalje, & Fellingham, 2005; Kenward & Roger, 1997; Kowalchuk, Keselman, Algina, & Wolfinger, 2004; Schaalje et al., 2001).”
MethodInfluentialHunting intensity alters movement behaviour of white-tailed deer
Little, A. R., Webb, S. L., Demarais, S., Gee, K. L., Riffell, S. K., & Gaskamp, J. A. (2015) · Basic and Applied Ecology · doi:10.1016/j.baae.2015.12.003 · Cited by 112
Lkhagvadorj, S., Qu, L., Cai, W., Couture, O. P., Barb, C. R., Hausman, G. J., Nettleton, D. S., Anderson, L. L., Dekkers, J. C. M., & Tuggle, C. K. (2009) · American Journal of Physiology-Regulatory, Integrative and Comparative Physiology · doi:10.1152/ajpregu.00632.2009 · Cited by 105
A STATISTICAL TEST TO SHOW NEGLIGIBLE TREND
Dixon, P. M., & Pechmann, J. H. K. (2005) · Ecology · doi:10.1890/04-1343 · Cited by 93
“The rejection region of a statistical test is the set of sample statistics that lead to rejecting the null hypothesis.”
BackgroundSiemens, T., & Blossey, B. (2007) · American Journal of Botany · doi:10.3732/ajb.94.5.776 · Cited by 93
Nooij, S. A. E., Pretto, P., Oberfeld, D., Hecht, H., & Bülthoff, H. (2017) · PLoS ONE · doi:10.1371/journal.pone.0175305 · Cited by 106
The Effective Sample Size and an Alternative Small-Sample Degrees-of-Freedom Method
Faes, C., Molenberghs, G., Aerts, M., Verbeke, G. N., & Kenward, M. G. (2009) · The American Statistician · doi:10.1198/tast.2009.08196 · Cited by 92
“This is similar to the method proposed by Kenward and Roger (1997), where a scaled form of the F -statistic is used for multivariate tests.”
MethodSelf-citationRamanau, A., Kluge, H., Eder, K., & Spilke, J. (2004) · Journal of Nutrition · doi:10.1093/jn/134.1.86 · Cited by 92
T-Cell Immunity to Subclinical Cytomegalovirus Infection Reduces Cardiac Allograft Disease
Tu, W., Potena, L., Stepick‐Biek, P., Liu, L., Dionis, K. Y., Luikart, H. I., Fearon, W. F., Holmes, T. H., Chin, C. C., Cooke, J. P., et al. (2006) · Circulation · doi:10.1161/circulationaha.105.607549 · Cited by 106
Gas transport and subsoil pore characteristics: Anisotropy and long-term effects of compaction
Berisso, F. E., Schjønning, P., Keller, T., Lamandé, M., Simojoki, A., Iversen, B. V., Alakukku, L., & Forkman, J. (2013) · Geoderma · doi:10.1016/j.geoderma.2012.12.002 · Cited by 92
Buhre, C., Kluth, C., Bürcky, K., Märländer, B., & Varrelmann, M. (2009) · Plant Disease · doi:10.1094/pdis-93-2-0155 · Cited by 92
Hostinar, C. E., Johnson, A. E., & Gunnar, M. R. (2015) · Developmental Psychology · doi:10.1037/dev0000029 · Cited by 91
“Kenward-Roger adjusted degrees of freedom were used (Kenward & Roger, 1997).”
Methodfor the ISCOLE Research Group, Sarmiento, O. L., Lemoine, P., Gonzalez, S. A., Broyles, S. T., Denstel, K. D., Larouche, R., Onywera, V, Barreira, T. V., Chaput, J.-P., et al. (2015) · International Journal of Obesity Supplements · doi:10.1038/ijosup.2015.27 · Cited by 89
Parameter estimation and inference in the linear mixed model
Gumedze, F. N., & Dunne, T. (2011) · Linear Algebra and its Applications · doi:10.1016/j.laa.2011.04.015 · Cited by 98
Hierarchical assembly rules in arbuscular mycorrhizal (AM) fungal communities
Davison, J., Moora, M., Jairus, T., Vasar, M., Öpik, M., & Zobel, M. (2016) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2016.03.003 · Cited by 91
Longitudinal association between social media use and psychological distress among adolescents
Thorisdottir, I. E., Sigurvinsdottir, R., Kristjansson, A. L., Allegrante, J. P., Lilly, C. L., & Sigfusdottir, I. D. (2020) · Preventive Medicine · doi:10.1016/j.ypmed.2020.106270 · Cited by 90
Enhanced diagnostics for the spatial analysis of field trials
Stefanova, K. T., Smith, A. B., & Cullis, B. R. (2009) · Journal of Agricultural, Biological, and Environmental Statistics · doi:10.1198/jabes.2009.07098 · Cited by 88
Sambunaris, A., Bose, A., Gommoll, C. P., Chen, C., Greenberg, W. M., & Sheehan, D. V. (2014) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0000000000000060 · Cited by 90
Television Broadcast Demand in Markets Without Local Teams
Tainsky, S., & McEvoy, C. D. (2011) · Journal of Sports Economics · doi:10.1177/1527002511406129 · Cited by 91
“The Kenward-Rogers correction is a counter measure for the bias that is introduced by using estimated covariance parameters in formulas that assume these quantities are known (Kenward & Rogers, 1997).”
MethodMcNeish, D. M., & Harring, J. R. (2017) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610918.2014.983648 · Cited by 90
“Kenward and Roger (1997) provide four simulation studies and three examples with realworld data to support their method, while many simulation studies have shown its utility in a variety of scenarios (see, e.g., Kowalchuk et al., 2004; Spilke et al., 2005).”
BackgroundMethodParticle emissions from fused deposition modeling 3D printers: Evaluation and meta-analysis
Byrley, P., George, B. J., Boyes, W. K., & Rogers, K. R. (2018) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2018.11.070 · Cited by 95
“The KenwardRoger method was used to calculate the denominator degrees of freedom; it is protective against Type I error and corrects test statistics and standard errors for bias (Guerin and Stroup, 2000; Kenward and Roger, 1997).”
MethodSchram, E., Roques, J. A. C., Abbink, W., Yokohama, Y., Spanings, T., de Vries, P., Bierman, S. M., van de Vis, H., & Flik, G. (2012) · Aquaculture Research · doi:10.1111/are.12098 · Cited by 90
Checa, M. F., Rodríguez, J., Willmott, K. R., & Liger, B. (2014) · Florida Entomologist · doi:10.1653/024.097.0101 · Cited by 89
Bennett, N. J., Calò, A., FRANCO, A. D., Niccolini, F., Marzo, D., Domina, I., Dimitriadis, C., Sobrado, F., Santoni, M.-C., Charbonnel, É., et al. (2020) · Biological Conservation · doi:10.1016/j.biocon.2020.108531 · Cited by 103
Hair as an Indicator of Endogenous Tissue Levels of Brominated Flame Retardants in Mammals
D’Havé, H., Covaci, A., Scheirs, J., Schepens, P., Verhagen, R., & Coen, W. D. (2005) · Environmental Science & Technology · doi:10.1021/es0507259 · Cited by 89
Massinga, P. H. (2004) · Annals of Botany · doi:10.1093/aob/mci040 · Cited by 89
“Denominator degrees of freedom for F-tests were calculated by Kenward and Roger’s approximation (Kenward and Roger, 1997).”
MethodPaula, R. R., Bouillet, J., Trivelin, P. C. O., Zeller, B., Gonçalves, J. L. D. M., Nouvellon, Y., Bouvet, J., Plassard, C., & Laclau, J. (2015) · Soil Biology and Biochemistry · doi:10.1016/j.soilbio.2015.08.017 · Cited by 100
The epidemiological transition and the global childhood obesity epidemic
Broyles, S. T., Denstel, K. D., Church, T. S., Chaput, J.-P., Fogelholm, M., Hu, G., Kuriyan, R., Kurpad, A. V., Lambert, E. V., Maher, C. A., et al. (2015) · International Journal of Obesity Supplements · doi:10.1038/ijosup.2015.12 · Cited by 108
Ellis, V. A., Collins, M. D., Medeiros, M. C. I., Sari, E. H. R., Coffey, E. D., Dickerson, R. C., Lugarini, C., Stratford, J. A., Henry, D. R., Merrill, L., et al. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1515309112 · Cited by 92
Tamborlane, W. V., Laffel, L. M., Shehadeh, N., ISGANAITIS, E. M., Name, M. A. V., Ratnayake, J., Karlsson, C., & Norjavaara, E. (2022) · The Lancet Diabetes & Endocrinology · doi:10.1016/s2213-8587(22)00052-3 · Cited by 90
Multi-environment analysis and improved mapping of a yield-related QTL on chromosome 3B of wheat
Bonneau, J. P., Taylor, J., Parent, B., Bennett, D., Reynolds, M. P., Feuillet, C., Langridge, P., & Mather, D. E. (2012) · Theoretical and Applied Genetics · doi:10.1007/s00122-012-2015-3 · Cited by 92
“From each MET QTL model, the single marker multi-environment QTL effects were tested simultaneously under the null hypothesis H0 : ai1 1⁄4 ai2 1⁄4 1⁄4 ait 1⁄4 0 and a Wald statistic was calculated (Kenward and Roger 1997).”
MethodRoot mass for oilseed and pulse crops: Growth and distribution in the soil profile
Gan, Y., Campbell, C. A., Janzen, H. H., Lemke, R. L., Liu, L. P., Basnyat, P., & McDonald, C. L. (2009) · Canadian Journal of Plant Science · doi:10.4141/cjps08154 · Cited by 88
Hoekstra, N. J., Suter, M., Finn, J. A., Husse, S., & LÜSCHER, A. (2014) · Plant and Soil · doi:10.1007/s11104-014-2352-x · Cited by 106
“Inference on fixed main effects was based on single term deletion (each one in turn) from a main effects model and subsequent F-tests for comparison of models while applying the Kenward-Roger method to determine the approximate denominator degrees of freedom (Kenward and Roger 1997); interactions were tested likewise,…”
MethodScaling, Selection, and Evolutionary Dynamics of the Mitotic Spindle
Farhadifar, R., Baer, C. F., Valfort, A.-C., Andersen, E. C., Müller‐Reichert, T., Delattre, M., & Needleman, D. J. (2015) · Current Biology · doi:10.1016/j.cub.2014.12.060 · Cited by 97
“Degrees of freedom were determined using the Ken-ward-Rogermethod [46].”
Multistratum Response Surface Designs
Trinca, L. A., & Gilmour, S. G. (2001) · Technometrics · doi:10.1198/00401700152404291 · Cited by 87
“In practice, ‘ is usually replaced by its REML estimator, O‘ , in the estimator O‚, although Kenward and Roger (1997) gave an improved small-sample approximation.”
BackgroundDimidjian, S., Beck, A., Felder, J. N., Boggs, J. M., Gallop, R., & Segal, Z. V. (2014) · Behaviour Research and Therapy · doi:10.1016/j.brat.2014.09.004 · Cited by 87
“Degrees of freedomwere estimated with the Kenward and Roger (1997) approximation, which accommodates small sample inferences.”
MethodCompas, B. E., Forehand, R., Thigpen, J. C., Hardcastle, E. J., Garai, E., McKee, L. G., Keller, G., Dunbar, J. P., Watson, K. H., Rakow, A., et al. (2015) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0039053 · Cited by 93
“Kenward and Roger (1997) method, as recommended by Bauer et al. (2008) due to the complex covariance structure.”
A theory of memory for binary sequences: Evidence for a mental compression algorithm in humans
Planton, S., van Kerkoerle, T., Abbih, L., Maheu, M., Meyniel, F., Sigman, M., Wang, L., Figueira, S. D., Romano, S., & Dehaene, S. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1008598 · Cited by 104
The Dynamics of Reference and Shared Visual Attention
Dale, R. A. C., Kirkham, N. Z., & Richardson, D. C. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00355 · Cited by 100
“Where reported, approximate degrees of freedom are estimated using a Kenward–Roger correction technique described in Kenward and Roger (1997) using KRmodcomp in R (it is important to note that the MCMC significance levels are established based on simulation of the data, and not on the approximate…”
Method
Metadata
- Authors
- Kenward, M. G., & Roger, J. H.
- Affiliations
- University of Kent (GB)
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1997-09
- Volume
- 53
- Issue
- 3
- Pages
- 983
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1981747359
- Cited by
- 4,552
- References
- 23
- Citations by year
- 2026: 217 · 2025: 196 · 2024: 216 · 2023: 213 · 2022: 261 · 2021: 299 · 2020: 287 · 2019: 270 · 2018: 247 · 2017: 240 · 2016: 286 · 2015: 256 · 2014: 217 · 2013: 189 · 2012: 218
- FWCI
- 7.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Rothamsted Repository (Rothamsted Repository) (submittedVersion)
- Kent Academic Repository (University of Kent) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Mathematics › Applied Mathematics › Statistical and numerical algorithms
- Keywords
- restricted maximum likelihood, small sample inference, fixed effects, Wald statistic, covariance matrix estimation, small sample bias, Hotelling's T2 statistic, linear mixed models, linear Gaussian models
- MeSH terms
- Analysis of Variance, Biometry, Clinical Trials as Topic, Humans, Intermittent Claudication, Nitrogen Fixation, Plants, Probability, Regression Analysis, Research Design, Rhizobium, Soil Microbiology, Reproducibility of Results, Models, Statistical, Bias, Randomized Controlled Trials as Topic, Cross-Over Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.