Small Sample Inference for Fixed Effects from Restricted Maximum Likelihood
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Restricted maximum likelihood (REML) is now well established as a method for estimating the parameters of the general Gaussian linear model with a structured covariance matrix, in particular for mixed linear models. Conventionally, estimates of precision and inference for fixed effects are based on their asymptotic distribution, which is known to be inadequate for some small-sample problems. In this paper, we present a scaled Wald statistic, together with an F approximation to its sampling distribution, that is shown to perform well in a range of small sample settings. The statistic uses an adjusted estimator of the covariance matrix that has reduced small sample bias. This approach has the advantage that it reproduces both the statistics and F distributions in those settings where the latter is exact, namely for Hotelling T2 type statistics and for analysis of variance F-ratios. The performance of the modified statistics is assessed through simulation studies of four different REML analyses and the methods are illustrated using three examples.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Accurate model parameter estimations were ensured by use of the residual maximum likelihood approach with the Kenward and Roger, 1997 approximation of degrees of freedom.”
From Longitudinal association between social media use and psychological distress among adolescents (2020) · cites this paper as Kenward and Roger, 1997
In the citing paper
“Not only does the data in the motivating example have different flowering days for each genotype (see for example Fig. 2), but the proposed methodology also accounts for the different strata in the Wald test by approximating the denominator degrees of freedom (Kenward and Roger, 1997).”
From Incorporating environmental covariates to explore genotype × environment × management (G × E × M) interactions: A one-stage predictive model (2023) · cites this paper as Kenward and Roger, 1997
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923
Recovery of inter-block information when block sizes are unequal
PATTERSON, H. D., & THOMPSON, R. (1971) · Biometrika · doi:10.1093/biomet/58.3.545 · Cited by 4,058
Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems
Harville, D. A. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10480998 · Cited by 2,667 · cited 1×
“Restricted (or residual) maximum likelihood (REML) has become well established for the estimation of the parameters of Z (Patterson and Thompson, 1971; Harville, 1977; Thompson, 1980; Robinson, 1991) and the corresponding estimator of 3, 3 say, has a generalized least squares form that uses the REML estimate of Z.”
BackgroundThat BLUP is a Good Thing: The Estimation of Random Effects
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011926 · Cited by 1,686
Gilmour, A. R., Thompson, R., & Cullis, B. R. (1995) · Biometrics · doi:10.2307/2533274 · Cited by 915
15 Design and Analysis of Cross-Over Trials
Kenward, M. G., & Jones, B. (2007) · Handbook of Statistics · doi:10.1016/s0169-7161(07)27015-4 · Cited by 871
Self-citationPrinciples of Multivariate Analysis
Ling, R. F. (1990) · Technometrics · doi:10.1080/00401706.1990.10484645 · Cited by 812
Satterthwaite, F. E. (1941) · Psychometrika · doi:10.1007/bf02288586 · Cited by 809
Approximations for Standard Errors of Estimators of Fixed and Random Effects in Mixed Linear Models
Kackar, R. N., & Harville, D. A. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477102 · Cited by 445
Cited by
Items 801–900 of 1,051
Harms, M. P., Wang, L., Csernansky, J. G., & Barch, D. M. (2012) · Brain Structure and Function · doi:10.1007/s00429-012-0391-8 · Cited by 55
“Degrees of freedom in the mixed model were estimated using the method of Kenward and Roger (1997) (i.e., DDFM = KR option in SAS).”
Toews, M. D., Arthur, F. H., & Campbell, J. F. (2005) · Environmental Entomology · doi:10.1603/0046-225x-34.1.164 · Cited by 48
Lee, E., Giovanello, K. S., Saykin, A. J., Xie, F., Kong, D., Wang, Y., Yang, L., Ibrahim, J. G., Doraiswamy, P. M., Zhu, H., et al. (2017) · Alzheimer s & Dementia Diagnosis Assessment & Disease Monitoring · doi:10.1016/j.dadm.2017.04.004 · Cited by 60
“To test the interaction effect, we used an approximate F-test based on the Kenward-Roger approach [27].”
MethodSwartz, T. H., Findlay, A. N., & Petersson-Wolfe, C. S. (2017) · Journal of Dairy Science · doi:10.3168/jds.2016-12280 · Cited by 47
“All variables were modeled with the autoregressive covariance structure, and the Kenward-Roger procedure was used for degrees of freedom approximation (Kenward and Roger, 1997).”
Rosenberg, A. R., Zhou, C., Bradford, M. C., Salsman, J. M., Sexton, K., O’Daffer, A., & Yi‐Frazier, J. P. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.36039 · Cited by 61
Gill, J. L., Bishop, S. C., McCorquodale, C. C., Williams, J. L., & Wiener, P. (2010) · Meat Science · doi:10.1016/j.meatsci.2010.08.005 · Cited by 48
“Statistical significance for the fixed effects was determined using approximate F-statistics with denominator degrees of freedom (Kenward & Roger, 1997) estimated in the Genstat REML procedure.”
MethodDekkers, J. C., Podolsky, R. H., Treiber, F. A., Barbeau, P., Gutin, B., & Snieder, H. (2004) · American Journal of Clinical Nutrition · doi:10.1093/ajcn/79.4.661 · Cited by 53
The size of individualDelphiniumflowers and the opportunity for geitonogamous pollination
Ishii, H. S., & Harder, L. D. (2006) · Functional Ecology · doi:10.1111/j.1365-2435.2006.01181.x · Cited by 48
Utility of Ground Beetle Species in Field Tests of Potential Nontarget Effects of Bt Crops
Lopez, M. D., Prasifka, J. R., Bruck, D. J., & Lewis, L. C. (2005) · Environmental Entomology · doi:10.1093/ee/34.5.1317 · Cited by 48
“Degrees of freedom forF tests of model effects were determined using the Kenward-Roger method, which reduces bias for experiments with modest sample sizes ( Kenward and Roger 1997 ).”
MethodD-optimal design of split-split-plot experiments
Jones, B., & Goos, P. (2009) · Biometrika · doi:10.1093/biomet/asn070 · Cited by 47
Smith, A. ‘., Thewes, B., Turner, J., Gilchrist, J., Fardell, J., Sharpe, L., Bell, M. L., Girgis, A., Grier, M., Byrne, D., et al. (2015) · Psycho-Oncology · doi:10.1002/pon.3775 · Cited by 47
Shared mechanisms underlie mental imagery and motor planning
Bennet, R., & Reiner, M. (2022) · Scientific Reports · doi:10.1038/s41598-022-06800-9 · Cited by 52
Shirdelmoghanloo, H., Chen, K., Paynter, B. H., Angessa, T. T., Westcott, S., Khan, H. A., Hill, C. B., & Li, C. (2022) · Frontiers in Plant Science · doi:10.3389/fpls.2022.858652 · Cited by 58
“Likelihood ratio tests were used for random effects, and conditional Wald tests (Kenward and Roger, 1997) were used for fixed effects.”
MethodTatosian, D. A., Guo, Y. Q., Schaeffer, A. K., Gaibu, N., Popa, S., Stoch, A., Langdon, R. B., & Kauh, E. A. (2013) · Diabetes Therapy · doi:10.1007/s13300-013-0045-8 · Cited by 47
“Roger’s method [16] was used to calculate the denominator degrees of freedom for the fixed effects.”
MethodMayfield, A. E., Reynolds, B. C., Coots, C., Havill, N. P., Brownie, C., Tait, A. R., Hanula, J. L., Joseph, S. V., & Lamb, A. (2014) · Forest Ecology and Management · doi:10.1016/j.foreco.2014.09.021 · Cited by 47
High‐resolution time‐resolved imaging of in vitro Arabidopsis rosette growth
Dhondt, S., González, N., Blomme, J., Milde, L. D., Daele, T. V., Akoleyen, D. V., Storme, V., Coppens, F., Beemster, G. T. S., & Inzé, D. (2014) · The Plant Journal · doi:10.1111/tpj.12610 · Cited by 47
“The Kenward–Roger approximation for calculating the denominator degrees of freedom for the tests of fixed effects was used (Kenward and Roger, 1997; Schaalje et al., 2001).”
MethodMetformin for Weight Control in Pediatric Patients on Atypical Antipsychotic Medication
Shin, L., Bregman, H., Breeze, J. L., Noyes, N., & Frazier, J. A. (2009) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2008.094 · Cited by 49
“A Toeplitz covariance structure was fit to the within-patient repeated measures using the Kenward–Roger method (Kenward and Roger 1997) to estimate degrees of freedom.”
Checa, M. F., Barragán, Á., Rodríguez, J., & Christman, M. C. (2009) · Annales de la Société entomologique de France (N S ) · doi:10.1080/00379271.2009.10697630 · Cited by 47
Biotic and abiotic edge effects in highly fragmented heathlands adjacent to cropland and forest
Piessens, K., Honnay, O., Devlaeminck, R., & Hermy, M. (2006) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2005.11.016 · Cited by 47
“Because of the small sample size, denominator degrees of freedom were estimated by the Kenward–Roger method (Kenward and Roger, 1997).”
MethodUppalapati, S. R., Serba, D. D., Ishiga, Y., Szabo, L. J., Mittal, S., Bhandari, H. S., Bouton, J. H., Mysore, K. S., & Saha, M. C. (2012) · BioEnergy Research · doi:10.1007/s12155-012-9263-6 · Cited by 48
“We also used a Kenward–Roger denominator degrees of freedom adjustment to account for random effects and correlated errors [28, 29].”
MethodRamaekers, M. G., Boesveldt, S., Gort, G., Lakemond, C. M. M., van Boekel, M. A. J. S., & Luning, P. A. (2014) · Journal of Nutrition · doi:10.3945/jn.114.192567 · Cited by 51
Liebe, S., & Varrelmann, M. (2015) · Phytopathology · doi:10.1094/phyto-07-15-0172-r · Cited by 47
Riesch, R., Tobler, M., Lerp, H., Jourdan, J., Doumas, T., Nosil, P., Langerhans, R. B., & Plath, M. W. (2016) · BMC Evolutionary Biology · doi:10.1186/s12862-016-0705-1 · Cited by 47
“restricted maximum likelihood and the Kenward-Roger degrees of freedom adjustment [68] for clade, H2S, and clade × H2S to appropriately test these fixed effects while treating site as a random term (i.”
BackgroundCampbell, M. S., Berrones, A. J., Krishnakumar, I. M., Charnigo, R. J., Westgate, P. M., & Fleenor, B. S. (2016) · Journal of Functional Foods · doi:10.1016/j.jff.2016.12.013 · Cited by 48
“The Kenward and Roger degrees of freedommethod was used for inference (Kenward & Roger, 1997).”
MethodGangloff, E. J., Sparkman, A. M., Holden, K. G., Corwin, C. J., Topf, M. A., & Bronikowski, A. M. (2016) · Comparative Biochemistry and Physiology Part A Molecular & Integrative Physiology · doi:10.1016/j.cbpa.2016.12.019 · Cited by 50
Oxytocin reduces alcohol consumption in prairie voles
Stevenson, J. R., Wenner, S. M., Freestone, D. M., Romaine, C. C., Parian, M. C., Christian, S. M., Bohidar, A. E., Ndem‐Galbert, J. R., Vogel, I., & O'Kane, C. M. (2017) · Physiology & Behavior · doi:10.1016/j.physbeh.2017.07.021 · Cited by 53
Effect of chitosan on the preservation quality of sugarcane silage
Valle, T. A. D., Zenatti, T. F., Antônio, G., Campana, M., Gandra, J. R., Zilio, E. M. C., Mattos, L. F. A., & de Morais, J. G. P. (2018) · Grass and Forage Science · doi:10.1111/gfs.12356 · Cited by 55
Feasting on terrestrial organic matter: Dining in a dark lake changes microbial decomposition
Fitch, A. A., Orland, C., Willer, D. F., Emilson, E. J. S., & Tanentzap, A. J. (2018) · Global Change Biology · doi:10.1111/gcb.14391 · Cited by 49
“Degrees of freedom were adjusted with the Kenward–Roger method, which reduces bias in small sample settings (Kenward & Roger, 1997).”
MethodSantangelo, J. S., Thompson, K. A., & Johnson, M. T. J. (2018) · Journal of Evolutionary Biology · doi:10.1111/jeb.13392 · Cited by 55
Park, S., & Beretvas, S. N. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1156-y · Cited by 54
Effect of self-assembling peptide P11-4 on orthodontic treatment-induced carious lesions
Welk, A., Ratzmann, A., Reich, M., Krey, K., & Schwahn, C. (2020) · Scientific Reports · doi:10.1038/s41598-020-63633-0 · Cited by 55
Tsiouris, V., Tassis, P. D., Raj, J., Mantzios, T., Kiskinis, K., Vasiljević, M., Delić, N., Petridou, E., Brellou, G. D., Polizopoulou, Z. S., et al. (2021) · Toxins · doi:10.3390/toxins13060367 · Cited by 54
“The p-values for the fixed component of the model were calculated from a F-test based on the Kenward–Roger approach [69] in order to get approximate degrees of freedom.”
MethodChagas, J. K. M., de Figueiredo, C. C., & Paz‐Ferreiro, J. (2021) · Geoderma · doi:10.1016/j.geoderma.2021.115323 · Cited by 54
Treatment with soluble CD24 attenuates COVID-19-associated systemic immunopathology
Song, N., Allen, C., Vilgelm, A. E., Riesenberg, B., Weller, K. P., Reynolds, K., Chakravarthy, K. B., Kumar, A., Khatiwada, A., Sun, Z., et al. (2022) · Journal of Hematology & Oncology · doi:10.1186/s13045-021-01222-y · Cited by 53
“Second, the p-value for evaluating the overall difference in trends between CD24Fc and placebo groups across all the time points was calculated using the KenwardRoger method [27].”
MethodModified Brown–Forsythe Procedure for Testing Interaction Effects in Split-Plot Designs
Vallejo, G., & Ato, M. (2006) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr4104_6 · Cited by 47
“To deal with the effect of bias in the asymptotic estimate of standard errors on inference about the mean structure, Kenward and Roger (1997) extended Kackar and Harville’s (1984) approximation to obtain an adjusted estimator of the small sample covariance of .”
MethodCornwallis, C. K., & Birkhead, T. R. (2008) · Evolution · doi:10.1111/j.1558-5646.2008.00346.x · Cited by 47
Gheller, L. S., Ghizzi, L. G., Takiya, C. S., Grigoletto, N. T. S., Silva, T. B. P., Marques, J. A., Dias, M. S. S., Freu, G., & Rennó, F. P. (2021) · Animal Feed Science and Technology · doi:10.1016/j.anifeedsci.2021.115083 · Cited by 51
Wenker, M. L., Verwer, C. M., Bokkers, E. A. M., Beest, D. E. T., Gort, G., de Oliveira, D., Koets, A. P., Bruckmaier, R. M., Gross, J. J., & van Reenen, C. G. (2022) · Frontiers in Veterinary Science · doi:10.3389/fvets.2022.855086 · Cited by 53
“For all fixed effects, approximate Ftests were used (41) and significance was declared at P < 0.”
MethodCommon Cents: Bank Account Structure and Couples’ Relationship Dynamics
Olson, J. G., Rick, S. I., Small, D. A., & Finkel, E. J. (2023) · Journal of Consumer Research · doi:10.1093/jcr/ucad020 · Cited by 51
Soft robot–mediated autonomous adaptation to fibrotic capsule formation for improved drug delivery
Beatty, R., Mendez, K. L., Schreiber, L. H. J., Tarpey, R., Whyte, W., Fan, Y., Robinson, S. T., O’Dwyer, J., Simpkin, A. J., Tannian, J., et al. (2023) · Science Robotics · doi:10.1126/scirobotics.abq4821 · Cited by 50
“For the linear mixed models, the summ() function by jtools was used (78).”
MethodMartin, R. A., Riesch, R., Heinen‐Kay, J. L., & Langerhans, R. B. (2013) · Evolution · doi:10.1111/evo.12277 · Cited by 46
“…nested within predation regime, and an F test employing restricted maximum likelihood (REML) and the Kenward–Roger degrees of freedom adjustment (Kenward and Roger 1997) for predation regime to appropriately test this fixed effect while treating population as a random term (i.e., effectively…”
MethodSex-Specific Patterns of Aging in Sexual Ornaments and Gametes
Cornwallis, C. K., Dean, R., & Pizzari, T. (2014) · The American Naturalist · doi:10.1086/677385 · Cited by 53
“The significance of fixed effects was tested using approximate F tests, and degrees of freedom were calculated using the Kenward-Roger method (Kenward and Roger 1997).”
MethodEfficacy of vilazodone on anxiety symptoms in patients with major depressive disorder
Thase, M. E., Chen, D., Edwards, J., & Ruth, A. (2014) · International Clinical Psychopharmacology · doi:10.1097/yic.0000000000000045 · Cited by 46
“The Kenward–Roger approximation was used to estimate denominator degrees of freedom (Kenward and Roger, 1997).”
MethodAmmunét, T., Kaukoranta, T., Saikkonen, K., Repo, T., & Klemola, T. (2012) · Ecological Entomology · doi:10.1111/j.1365-2311.2012.01358.x · Cited by 51
Bots, J., Bruyn, L. D., Snijkers, T., den Branden, B. V., & GOSSUM, H. V. (2009) · Environmental Pollution · doi:10.1016/j.envpol.2009.09.016 · Cited by 52
Turechek, W. W., & Peres, N. A. (2009) · Plant Disease · doi:10.1094/pdis-93-3-0299 · Cited by 46
Receptive Language and Educational Attainment for Sexually Abused Females
Noll, J. G., Shenk, C. E., Yeh, M. T., Ji, J., Putnam, F. W., & Trickett, P. K. (2010) · Pediatrics · doi:10.1542/peds.2010-0496 · Cited by 47
Gomes, M., Díaz-Ordaz, K., Grieve, R., & Kenward, M. G. (2013) · Medical Decision Making · doi:10.1177/0272989x13492203 · Cited by 46
Self-citationStatistical Challenges in Analyses of Chamber‐Based Soil CO 2 and N 2 O Emissions Data
Kravchenko, A., & Robertson, G. P. (2015) · Soil Science Society of America Journal · doi:10.2136/sssaj2014.08.0325 · Cited by 55
Ferguson, J. C., Chechetto, R. G., O’Donnell, C. C., Dorr, G. J., Moore, J. H., Baker, G. J., Powis, K., & Hewitt, A. J. (2016) · Pest Management Science · doi:10.1002/ps.4214 · Cited by 46
Bottom-up influences of voice continuity in focusing selective auditory attention
Bressler, S., Masud, S., Bharadwaj, H., & Shinn‐Cunningham, B. G. (2014) · Psychological Research · doi:10.1007/s00426-014-0555-7 · Cited by 45
“To make inferences about the experimental fixed effects, the F approximation for the scaled Wald statistic was employed (Kenward and Roger 1997).”
MethodCarrico, C., Chelette, K. C., Westgate, P. M., Powell, E. S., Nichols, L., & Sawaki, L. A. (2016) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0000000000000476 · Cited by 46
Starkey, C. P., Geesink, G. H., van de Ven, R., & Hopkins, D. L. (2016) · Meat Science · doi:10.1016/j.meatsci.2016.12.006 · Cited by 46
Shortened sleep fuels inflammatory responses to marital conflict: Emotion regulation matters
Wilson, S. J., Jaremka, L. M., Fagundes, C. P., Andridge, R., Peng, J., Malarkey, W. B., Habash, D., Belury, M. A., & Kiecolt‐Glaser, J. K. (2017) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2017.02.015 · Cited by 49
“Residual plots were also inspected for outliers. emoval of one identified residual outlier did not change results. he Kenward-Roger degrees of freedom adjustment was used to ontrol type I error (Kenward and Roger, 1997).”
Skin sloughing in susceptible and resistant amphibians regulates infection with a fungal pathogen
Ohmer, M. E. B., Cramp, R. L., Russo, C. J. M., White, C. R., & Franklin, C. E. (2017) · Scientific Reports · doi:10.1038/s41598-017-03605-z · Cited by 52
Challenging Conventional Wisdom for Multivariate Statistical Models With Small Samples
McNeish, D. (2017) · Review of Educational Research · doi:10.3102/0034654317727727 · Cited by 58
Fanali, L. Z., Franco‐Belussi, L., Bonini-Domingos, C. R., & de Oliveira, C. (2018) · Environmental Pollution · doi:10.1016/j.envpol.2018.02.030 · Cited by 44
Drug‐Drug Interaction Study of Apixaban with Cyclosporine and Tacrolimus in Healthy Volunteers
Bashir, B., Stickle, D. F., Chervoneva, I., & Kraft, W. K. (2018) · Clinical and Translational Science · doi:10.1111/cts.12580 · Cited by 48
Greenberg, T., Fournier, J. C. J., Stiffler, R. S., Chase, H. W., Almeida, J., Aslam, H. A., Deckersbach, T., Cooper, C. M., Toups, M. S. P., Carmody, T., et al. (2019) · Molecular Psychiatry · doi:10.1038/s41380-019-0490-5 · Cited by 51
Nakonezny, P. A., & Byerly, M. (2005) · Schizophrenia Research · doi:10.1016/j.schres.2005.10.015 · Cited by 46
“Restricted maximum likelihood estimation and Type 3 tests were used, with the Kenward–Roger correction (Kenward and Roger, 1997) applied to the unstructured covariance model.”
MethodMajor Genetic Changes in Wheat with Potential to Affect Disease Tolerance
Foulkes, J. M., Paveley, N. D., Worland, A. J., Welham, S. J., Thomas, J. M., & Snape, J. W. (2006) · Phytopathology · doi:10.1094/phyto-96-0680 · Cited by 46
Small sample inference for the fixed effects in the mixed linear model
Manor, O., & Zucker, D. M. (2003) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2003.10.005 · Cited by 54
Nitrogen limitation in a sweetgum plantation: implications for carbon allocation and storage
Iversen, C. M., & Norby, R. J. (2008) · Canadian Journal of Forest Research · doi:10.1139/x07-213 · Cited by 46
“We specified the ‘‘Kenward–Roger’’ option in the model statement to estimate the denominator degrees of freedom (Kenward and Roger 1997) for tests of the fixed fertilization effect.”
MethodConsistent changes in the intestinal microbiota of Atlantic salmon fed insect meal diets
Li, Y., Gajardo, K., Jaramillo-Torres, A., Kortner, T. M., & Krogdahl, Å. (2022) · Animal Microbiome · doi:10.1186/s42523-021-00159-4 · Cited by 53
“The statis- 284 tical significance of fixed predictors was estimated by Type 285 III ANOVA with Kenward-Roger’s approximation (49) of de- 286 nominator degrees of freedom.”
MethodKishimoto, S., Watanabe, N., Yamamoto, Y., Imai, T., Aida, R., Germer, C. K., Tamagawa‐Mineoka, R., Shimizu, R., Hickman, S. D., Nakayama, Y., et al. (2023) · JAMA Dermatology · doi:10.1001/jamadermatol.2023.0975 · Cited by 59
Schwedt, T. J., Oakes, T. M. M., Martinez, J. M., Vargas, B. B., Pandey, H., Pearlman, E. M., Richardson, D. R., Varnado, O. J., Meyer, M. C., & Goadsby, P. J. (2023) · Neurology and Therapy · doi:10.1007/s40120-023-00562-w · Cited by 53
“The Newton–Raphson method with ridging was used for nonlinear optimization and the Ken-ward–Roger approximation was used to estimate denominator degrees of freedom [26].”
Haseneyer, G., Stracke, S., Piepho, H., Sauer, S., Geiger, H. H., & Graner, A. (2010) · BMC Plant Biology · doi:10.1186/1471-2229-10-5 · Cited by 46
“Tests of fixed effects were based on variance estimates using the restricted maximum likelihood (REML) method and denominator degrees of freedom approximated by the method of Kenward and Roger [36].”
MethodGage‐Bouchard, E. A., Devine, K. A., & Heckler, C. E. (2013) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-013-9362-3 · Cited by 60
“Hypothesis tests for the fixed effects used the Kenward–Roger degrees of freedom adjustment procedure for small samples (Kenward & Roger, 1997).”
MethodToews, M. D., Campbell, J. F., & Arthur, F. H. (2010) · Journal of Insect Science · doi:10.1673/031.010.19601 · Cited by 45
Pfeufer, E. E., & Ngugi, H. K. (2011) · Phytopathology · doi:10.1094/phyto-04-11-0117 · Cited by 45
Synthesizing single-case studies: A Monte Carlo examination of a three-level meta-analytic model
Owens, C. M., & Ferron, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0180-y · Cited by 52
“As a consequence, variance inflation factors have been proposed (Kackar & Harville, 1984), as well as methods that approximate the degrees of freedom based on the inflated variances (Kenward & Roger, 1997).”
MethodLkhagvadorj, S., Qu, L., Cai, W., Couture, O. P., Barb, C. R., Hausman, G. J., Nettleton, D. S., Anderson, L. L., Dekkers, J. C. M., & Tuggle, C. K. (2009) · Physiological Genomics · doi:10.1152/physiolgenomics.90372.2008 · Cited by 51
“Fixed effect estimates and least squares means were obtained using generalized least squares, and fixed effects contrasts were tested using Wald-type F-tests with Kenward-Roger’s correction (38).”
MethodWebb, L. E., Bokkers, E. A. M., ENGEL, B., Gerrits, W. J. J., Berends, H., & van Reenen, C. G. (2012) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2011.12.004 · Cited by 46
Scahill, R. I., Ridgway, G. R., Bartlett, J. W., Barnes, J., Ryan, N. S., Mead, S., Beck, J., Clarkson, M. J., Crutch, S. J., Schott, J. M., et al. (2013) · Journal of Alzheimer's Disease · doi:10.3233/jad-121255 · Cited by 45
“The Kenward-Rogers degrees of freedom adjustment was used to allow for the small sample sizes [42].”
MethodWeiss, D., Ristl, R., Griss, J., Bangert, C., Foedinger, D., Stingl, G., & Brunner, P. M. (2015) · Acta Dermato Venereologica · doi:10.2340/00015555-2023 · Cited by 45
“The method of Kenward & Roger (35) was applied to calculate modified standard errors for the model coefficients and denominator degrees of freedom for the resulting test statistics.”
Food abundance and weather modify reproduction of two arboreal squirrel species
Selonen, V., Wistbacka, R., & Korpimäki, E. (2016) · Journal of Mammalogy · doi:10.1093/jmammal/gyw096 · Cited by 53
“—Analyses for time-corrected body mass (flying squirrel) or parturition index (red squirrel) of litters as a dependent variable were done assuming log-normal distributions and with year as a random factor using Kenward–Roger estimated degrees of freedom (Kenward and Roger 1997).”
MethodFerguson, J. C., Chechetto, R. G., O’Donnell, C. C., Fritz, B. K., Hoffmann, W. C., Coleman, C. E., Chauhan, B. S., Adkins, S. W., Kruger, G. R., & Hewitt, A. J. (2016) · Computers and Electronics in Agriculture · doi:10.1016/j.compag.2016.08.022 · Cited by 45
“The denominator degrees of freedom (df) was protected from bias through the inclusion of the Kenward-Roger adjustment for the generalised linear mixed model (Kenward and Roger, 1997).”
MethodResults of a Doravirine-Atorvastatin Drug-Drug Interaction Study
Khalilieh, S. G., Yee, K. L., Sánchez, R. I., Triantafyllou, I., Li, F., Maklad, N. S., Jordan, H., Martell, M., & Iwamoto, M. (2016) · Antimicrobial Agents and Chemotherapy · doi:10.1128/aac.01364-16 · Cited by 45
“The method of Kenward and Roger was used to calculate the number of degrees of freedom in the denominator for the fixed effects (29).”
MethodTudorascu, D., Karim, H. T., Maronge, J. M., Alhilali, L. M., Fakhran, S., Aizenstein, H. J., Muschelli, J., & Crainiceanu, C. M. (2016) · Frontiers in Neuroscience · doi:10.3389/fnins.2016.00503 · Cited by 57
Egg size investment in superb fairy-wrens: helper effects are modulated by climate
Langmore, N. E., Bailey, L. D., Heinsohn, R., Russell, A. F., & Kilner, R. M. (2016) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2016.1875 · Cited by 55
Heat exposure and productivity in orchards: Implications for climate change research
Quiller, G., Krenz, J. E., Ebi, K. L., Hess, J. J., Fenske, R. A., Sampson, P. D., Pan, M., & Spector, J. T. (2017) · Archives of Environmental & Occupational Health · doi:10.1080/19338244.2017.1288077 · Cited by 50
“The association of daily maximum measured WBGT (WBGT max ) with productivity (mean kg/hour) was modeled using linear mixed effects models with intercept random effects for worksites, using the Kenward-Rogers method for small samples 13,14 .”
Neural correlates of empathic accuracy in adolescence
Kral, T. R. A., Solis, E., Mumford, J. A., Schuyler, B. S., Flook, L., Rifken, K. M., Patsenko, E. G., & Davidson, R. J. (2017) · Social Cognitive and Affective Neuroscience · doi:10.1093/scan/nsx099 · Cited by 57
“P-value computation used the modelSummary function of the lmSupport package, which is based on the Kenward–Rogers approximation for degrees of freedom (Kenward and Roger, 1997).”
Decline in Search Speed and Verbal Memory Over 26 Years of Midlife in a British Birth Cohort
Davis, D. H. J., Bendayan, R., Terrera, G. M., Hardy, R., Richards, M., & Kuh, D. J. (2017) · Neuroepidemiology · doi:10.1159/000481136 · Cited by 54
Genome‐Wide Association and Genomic Prediction Models of Tocochromanols in Fresh Sweet Corn Kernels
Baseggio, M., Murray, M., Magallanes‐Lundback, M., Kaczmar, N. S., Chamness, J., Buckler, E. S., Smith, M. E., DellaPenna, D., Tracy, W. F., & Gore, M. A. (2019) · The Plant Genome · doi:10.3835/plantgenome2018.06.0038 · Cited by 54
“Degrees of freedom were calculated via the Kenward–Rogers approximation (Kenward and Roger, 1997).”
MethodBoonpiyathad, T., Tantilipikorn, P., Ruxrungtham, K., Pradubpongsa, P., Mitthamsiri, W., Piedvache, A., Thantiworasit, P., Sirivichayakul, S., Jacquet, A., Suratannon, N., et al. (2020) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2020.10.029 · Cited by 47
Changes in the abundance of weeds in spring cereal fields in Finland
Hyvönen, T., Ketoja, E., & Salonen, J. (2003) · Weed Research · doi:10.1046/j.1365-3180.2003.00351.x · Cited by 45
Gan, Y., Liu, L., Cutforth, H. W., Wang, X., & Ford, G. (2011) · Australian Journal of Agricultural Research · doi:10.1071/cp10406 · Cited by 45
Chauhan, K. R., Klun, J. A., Debboun, M., & Kramer, M. (2005) · Journal of Medical Entomology · doi:10.1603/0022-2585(2005)042[0643:fdeoco]2.0.co;2 · Cited by 45
Reichert, C., Veitz, S., Bühler, M., Gruber, G., Deuring, G., Rehm, S., Rentsch, K., Garbazza, C., Meyer, M., Slawik, H. C., et al. (2020) · Biochemical Pharmacology · doi:10.1016/j.bcp.2020.114283 · Cited by 59
Soil nitrogen fertilization reduces relative leaf nitrogen allocation to photosynthesis
Waring, E. F., Perkowski, E. A., & Smith, N. G. (2023) · Journal of Experimental Botany · doi:10.1093/jxb/erad195 · Cited by 48
Sleep in Dementia Caregivers and the Effect of a Nighttime Monitoring System
Rowe, M. A., Kairalla, J. A., & McCrae, C. S. (2010) · Journal of Nursing Scholarship · doi:10.1111/j.1547-5069.2010.01337.x · Cited by 52
“For all tests, we used the widely employed Kenward and Roger (1997) denominator degrees of freedom adjustment to account for small sample uncertainty of the unadjusted approach.”
MethodAging and KIBRA/WWC1 genotype affect spatial memory processes in a virtual navigation task
Schuck, N. W., Doeller, C. F., Schjeide, B. M., Schröder, J., Frensch, P. A., Bertram, L., & Li, S. (2013) · Hippocampus · doi:10.1002/hipo.22148 · Cited by 44
The effects of age and environment on the expression of inbreeding depression in Eucalyptus globulus
Silva, J. C. E., Hardner, C. M., Tilyard, P., & Potts, B. M. (2011) · Heredity · doi:10.1038/hdy.2010.154 · Cited by 46
“reduced genetic variance for DBH under outcrossing on the least productive site are consistent with the simulations of Ronce et al. (2009), that showed reduced ID when populations are maladapted and express low overall genetic variance (see also Waller et al.”
BackgroundCarpenter, M. A., Joyce, N. I., Genet, R. A., Cooper, R. D., Murray, S. R., Noble, A. D. L., Butler, R. C., & Timmerman‐Vaughan, G. M. (2015) · Frontiers in Plant Science · doi:10.3389/fpls.2015.00143 · Cited by 49
Compressed sensing fMRI using gradient-recalled echo and EPI sequences
Zong, X., Lee, J. Y., Poplawsky, A. J., Kim, S., & Ye, J. C. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.01.045 · Cited by 44
“…linear model (GLM) framework with restricted maximum likelihood (ReML) covariance estimation (Friston et al., 2011; Graser et al., 1987; Harville, 1977; Kenward and Roger, 1997; Searle, 1979) was used to take into account the potential temporal correlation confounds introduced by CS reconstruction.”
MethodMaulfair, D. D., & Heinrichs, A. J. (2013) · Journal of Dairy Science · doi:10.3168/jds.2012-6048 · Cited by 58
Brys, R., & Jacquemyn, H. (2009) · Plant Biology · doi:10.1111/j.1438-8677.2009.00259.x · Cited by 44
Reduced hippocampal neurogenesis and skill reaching performance in adult Emx1 mutant mice
Hong, S. M., Liu, Z., Fan, Y., Neumann, M., Won, S. J., Lac, D., Lum, X., Weinstein, P. R., & Liu, J. (2007) · Experimental Neurology · doi:10.1016/j.expneurol.2007.03.028 · Cited by 44
Andreas Buerkert, A., Piepho, H., & Bationo, A. (2002) · Experimental Agriculture · doi:10.1017/s0014479702000236 · Cited by 44
Molecular brakes regulating mTORC1 activation in skeletal muscle following synergist ablation
Hamilton, D. L., Philp, A., MacKenzie, M. G., Patton, A., Towler, M. C., Gallagher, I. J., Bodine, S. C., & Baar, K. (2014) · American Journal of Physiology-Endocrinology and Metabolism · doi:10.1152/ajpendo.00674.2013 · Cited by 52
“We used the approach of Kenward and Roger (26) to generate P values for these models, which is suitable for small samples.”
Method
Metadata
- Authors
- Kenward, M. G., & Roger, J. H.
- Affiliations
- University of Kent (GB)
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1997-09
- Volume
- 53
- Issue
- 3
- Pages
- 983
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1981747359
- Cited by
- 4,552
- References
- 23
- Citations by year
- 2026: 217 · 2025: 196 · 2024: 216 · 2023: 213 · 2022: 261 · 2021: 299 · 2020: 287 · 2019: 270 · 2018: 247 · 2017: 240 · 2016: 286 · 2015: 256 · 2014: 217 · 2013: 189 · 2012: 218
- FWCI
- 7.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Rothamsted Repository (Rothamsted Repository) (submittedVersion)
- Kent Academic Repository (University of Kent) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Mathematics › Applied Mathematics › Statistical and numerical algorithms
- Keywords
- restricted maximum likelihood, small sample inference, fixed effects, Wald statistic, covariance matrix estimation, small sample bias, Hotelling's T2 statistic, linear mixed models, linear Gaussian models
- MeSH terms
- Analysis of Variance, Biometry, Clinical Trials as Topic, Humans, Intermittent Claudication, Nitrogen Fixation, Plants, Probability, Regression Analysis, Research Design, Rhizobium, Soil Microbiology, Reproducibility of Results, Models, Statistical, Bias, Randomized Controlled Trials as Topic, Cross-Over Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.