Small Sample Inference for Fixed Effects from Restricted Maximum Likelihood
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Restricted maximum likelihood (REML) is now well established as a method for estimating the parameters of the general Gaussian linear model with a structured covariance matrix, in particular for mixed linear models. Conventionally, estimates of precision and inference for fixed effects are based on their asymptotic distribution, which is known to be inadequate for some small-sample problems. In this paper, we present a scaled Wald statistic, together with an F approximation to its sampling distribution, that is shown to perform well in a range of small sample settings. The statistic uses an adjusted estimator of the covariance matrix that has reduced small sample bias. This approach has the advantage that it reproduces both the statistics and F distributions in those settings where the latter is exact, namely for Hotelling T2 type statistics and for analysis of variance F-ratios. The performance of the modified statistics is assessed through simulation studies of four different REML analyses and the methods are illustrated using three examples.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Accurate model parameter estimations were ensured by use of the residual maximum likelihood approach with the Kenward and Roger, 1997 approximation of degrees of freedom.”
From Longitudinal association between social media use and psychological distress among adolescents (2020) · cites this paper as Kenward and Roger, 1997
In the citing paper
“Not only does the data in the motivating example have different flowering days for each genotype (see for example Fig. 2), but the proposed methodology also accounts for the different strata in the Wald test by approximating the denominator degrees of freedom (Kenward and Roger, 1997).”
From Incorporating environmental covariates to explore genotype × environment × management (G × E × M) interactions: A one-stage predictive model (2023) · cites this paper as Kenward and Roger, 1997
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923
Recovery of inter-block information when block sizes are unequal
PATTERSON, H. D., & THOMPSON, R. (1971) · Biometrika · doi:10.1093/biomet/58.3.545 · Cited by 4,058
Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems
Harville, D. A. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10480998 · Cited by 2,667 · cited 1×
“Restricted (or residual) maximum likelihood (REML) has become well established for the estimation of the parameters of Z (Patterson and Thompson, 1971; Harville, 1977; Thompson, 1980; Robinson, 1991) and the corresponding estimator of 3, 3 say, has a generalized least squares form that uses the REML estimate of Z.”
BackgroundThat BLUP is a Good Thing: The Estimation of Random Effects
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011926 · Cited by 1,686
Gilmour, A. R., Thompson, R., & Cullis, B. R. (1995) · Biometrics · doi:10.2307/2533274 · Cited by 915
15 Design and Analysis of Cross-Over Trials
Kenward, M. G., & Jones, B. (2007) · Handbook of Statistics · doi:10.1016/s0169-7161(07)27015-4 · Cited by 871
Self-citationPrinciples of Multivariate Analysis
Ling, R. F. (1990) · Technometrics · doi:10.1080/00401706.1990.10484645 · Cited by 812
Satterthwaite, F. E. (1941) · Psychometrika · doi:10.1007/bf02288586 · Cited by 809
Approximations for Standard Errors of Estimators of Fixed and Random Effects in Mixed Linear Models
Kackar, R. N., & Harville, D. A. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477102 · Cited by 445
Cited by
Items 701–800 of 1,051
Schure, M. B., Lindow, J. C., Greist, J. H., Nakonezny, P. A., Bailey, S. J., Bryan, W. L., & Byerly, M. J. (2019) · Journal of Medical Internet Research · doi:10.2196/14754 · Cited by 53
Cabezas-Garcia, E. H., Gordon, A. W., Mulligan, F. J., & Ferris, C. P. (2021) · Animals · doi:10.3390/ani11113256 · Cited by 54
“Denominator degrees of freedom were calculated by the Kenward–Roger adjustment [38].”
MethodRefining the Predictive Pursuit Endophenotype in Schizophrenia
Hong, L. E., Turano, K. A., O’Neill, H., Lei, H., Wonodi, I., McMahon, R. P., Elliott, A., & Thaker, G. K. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.06.004 · Cited by 56
“The dependent measures were compared using a mixed model ANOVA (PROC MIXED in SAS, SAS, Inc), applying Kenward-Roger approximation to calculate the appropriate denominator degrees of freedom (18;19).”
MethodSpecies matter when considering landscape effects on carabid distributions
Jowett, K., Milne, A. E., Metcalfe, H., Hassall, K. L., Potts, S. G., Senapathi, D., & Storkey, J. (2019) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2019.106631 · Cited by 53
Szott, I. D., Pretorius, Y., Ganswindt, A., & Koyama, N. F. (2019) · Wildlife Research · doi:10.1071/wr19045 · Cited by 64
Kohler, D., Tsai, T., Verschueren, E., Huang, T. C., Hinkle, T. B., Phu, L., Choi, M., & Vitek, O. (2022) · Molecular & Cellular Proteomics · doi:10.1016/j.mcpro.2022.100477 · Cited by 61
“Parameters of the model are estimated using restricted maximum likelihood (36).”
MethodSolar UVR Exposure, Concurrent Activities and Sun-Protective Practices Among Primary Schoolchildren
Wright, C. Y., Reeder, A. I., Bodeker, G. E., Gray, A. R., & Cox, B. (2007) · Photochemistry and Photobiology · doi:10.1562/2006-08-22-ra-1010 · Cited by 55
“Denominator degrees of freedom were determined using the Kenward-Rogers method (48).”
MethodVilte, D. A., Larzábal, M., Garbaccio, S., Gammella, M., Rabinovitz, B. C., Elizondo, A. M., Cantet, R. J. C., Delgado, F., Meikle, V., Cataldi, Á., et al. (2011) · Vaccine · doi:10.1016/j.vaccine.2011.03.079 · Cited by 53
Gartus, A., Klemer, N. T., & Leder, H. (2015) · Acta Psychologica · doi:10.1016/j.actpsy.2015.01.005 · Cited by 63
Saastamoinen, M., Ikonen, S., Wong, S. C., Lehtonen, R., & Hanski, I. (2013) · Journal of Animal Ecology · doi:10.1111/1365-2656.12034 · Cited by 61
Gill, J. L., Bishop, S. C., McCorquodale, C. C., Williams, J. L., & Wiener, P. (2008) · Animal Genetics · doi:10.1111/j.1365-2052.2008.01790.x · Cited by 59
Direct control of perennial weeds between crops – Implications for organic farming
Melander, B., Holst, N., Rasmussen, I. A., & Hansen, P. K. (2012) · Crop Protection · doi:10.1016/j.cropro.2012.04.029 · Cited by 53
“Pekrun and Claupein (2004) also found that cultivation depth and implement type were of minor importance for autumn cultivation against C.”
BackgroundWeekly Cycles in Daily Report Data: An Overlooked Issue
Liu, Y., & West, S. G. (2016) · Journal of Personality · doi:10.1111/jopy.12182 · Cited by 52
Barton, K. E., Valkama, E., Vehviläinen, H., Ruohomäki, K., Knight, T. M., & Koricheva, J. (2014) · Oikos · doi:10.1111/oik.01663 · Cited by 59
Estes, B. L., Knapp, E. E., Skinner, C. N., & Uzoh, F. C. C. (2012) · International Journal of Wildland Fire · doi:10.1071/wf11056 · Cited by 56
“In order to account for a complex covariance structure, aKenward– Roger (KR) adjustment was applied to the degrees of freedom (Kenward and Roger 1997).”
MethodStage-dependent loss of cortical gyrification as Parkinson disease “unfolds”
Sterling, N. W., Wang, M., Zhang, L., Lee, E.-Y., Du, G., Lewis, M. M., Styner, M. A., & Huang, X. (2016) · Neurology · doi:10.1212/wnl.0000000000002492 · Cited by 56
Hannam, K. D., Neilsen, G., Neilsen, D., Midwood, A. J., Millard, P., Zhang, Z., Thornton, B., & Steinke, D. (2015) · American Journal of Enology and Viticulture · doi:10.5344/ajev.2015.15015 · Cited by 53
“Kenward-Roger’s adjustment was used to estimate degrees of freedom (Kenward and Roger 1997).”
MethodPrologo, J. D., Gilliland, C. A., Miller, M. J., Harkey, P., Knight, J., Kies, D. D., Hawkins, C. M., Corn, D. J., Monson, D. K., Edalat, F., et al. (2016) · Journal of Vascular and Interventional Radiology · doi:10.1016/j.jvir.2016.09.020 · Cited by 53
“For all reported analyses, multilevel models were fit using restricted maximum likelihood estimation, and to account for the small sample size, calculations of degrees of freedom were made using the Kenward-Roger method (17); likelihood ratio tests employed in the selection of fixed effects used values obtained using…”
MethodLapointe, D., Vogelbein, W. K., Fabrizio, M. C., Gauthier, D., & Brill, R. (2013) · Diseases of Aquatic Organisms · doi:10.3354/dao02693 · Cited by 76
Ferguson, J. C., Hewitt, A. J., & O’Donnell, C. C. (2016) · Crop Protection · doi:10.1016/j.cropro.2016.07.032 · Cited by 53
“The denominator degrees of freedom (df) was protected from bias through the inclusion of the Kenward-Roger adjustment for the generalized linear mixed model (Kenward and Roger, 1997).”
MethodFentabil, M. M., Nichol, C., Jones, M. D., Neilsen, G., Neilsen, D., & Hannam, K. D. (2016) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2016.09.033 · Cited by 62
Ulrich, N. H., Burgstaller, J. M., Pichierri, G., Wertli, M. M., Farshad, M., Porchet, F., Steurer, J., & Held, U. (2017) · Spine · doi:10.1097/brs.0000000000002068 · Cited by 58
“Conservative P values for the fixed effects were calculated as proposed by Kenward and Roger.(29) The level of significance was set to 5%.”
MethodLobo, G., Wittmann, F., & Piedade, M. T. F. (2018) · Forest Ecology and Management · doi:10.1016/j.foreco.2018.12.001 · Cited by 63
Gomes, F. J., Pedreira, B. C. E., Santos, P. M., Bosi, C., Lulu, J., & Pedreira, C. G. S. (2020) · European Journal of Agronomy · doi:10.1016/j.eja.2020.126029 · Cited by 53
Kozel, F. A., Johnson, K. A., Nahas, Z., Nakonezny, P. A., Morgan, P. S., Anderson, B. S., Kose, S., Li, X., Lim, K. O., Trivedi, M. H., et al. (2011) · The Journal of ECT · doi:10.1097/yct.0b013e3181e6317d · Cited by 51
Gallo, J. A., Draper, D. O., Brody, L. T., & Fellingham, G. W. (2004) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2004.34.7.395 · Cited by 53
Natal habitat-biased dispersal in the Siberian flying squirrel
Selonen, V., Hanski, I. K., & Desrochers, A. (2007) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2007.0570 · Cited by 53
The impact of daily caffeine intake on nighttime sleep in young adult men
Weibel, J., Lin, Y.-S., Landolt, H.-P., Kistler, J., Rehm, S., Rentsch, K. M., Slawik, H., Borgwardt, S., Cajochen, C., & Reichert, C. F. (2021) · Scientific Reports · doi:10.1038/s41598-021-84088-x · Cited by 52
Pilot randomized controlled trial of a symptom cluster intervention in advanced cancer.
Wells‐Di Gregorio, S. M., Marks, D. R., DeCola, J., Peng, J., Probst, D., Zaleta, A., Benson, D., Cohn, D. E., Lustberg, M., Carson, W. E., et al. (2019) · Psycho-Oncology · doi:10.1002/pon.4912 · Cited by 52
Rucklidge, J. J., Andridge, R., Gorman, B., Blampied, N., Gordon, H., & Boggis, A. (2012) · Human Psychopharmacology: Clinical and Experimental · doi:10.1002/hup.2246 · Cited by 52
Bisno, D. I., Reid, M. W., Fogel, J. L., Pyatak, E. A., Majidi, S., & Raymond, J. K. (2022) · Journal of Diabetes Science and Technology · doi:10.1177/19322968211035768 · Cited by 50
Stingl, K., Stingl, K., Schwartz, H., Reid, M. W., Kempf, M., Dimopoulos, S., Kortuem, F., Borchert, M. S., Lee, T. C., & Nagiel, A. (2023) · Ophthalmology · doi:10.1016/j.ophtha.2023.02.015 · Cited by 52
Growth and yield of spring cereals during transition to zero tillage on clay soils
Känkänen, H., Alakukku, L., Salo, Y., & Pitkänen, T. P. (2010) · European Journal of Agronomy · doi:10.1016/j.eja.2010.10.002 · Cited by 52
Temperature Affects the Germination of Forage Legume Seeds
Butler, T. J., Çelen, A., Webb, S. L., Krstić, Đ., & Interrante, S. M. (2014) · Crop Science · doi:10.2135/cropsci2014.01.0063 · Cited by 52
“The GLIMMIX procedure was used for all analyses as well as the Kenward-Roger denominator degrees of freedom adjustment to account for multiple random effects and correlated errors (Kenward and Roger, 1997; Littell et al., 2006).”
MethodPredation‐associated divergence of male genital morphology in a livebearing fish
Heinen‐Kay, J. L., & Langerhans, R. B. (2013) · Journal of Evolutionary Biology · doi:10.1111/jeb.12229 · Cited by 52
“…for all terms except predation regime, which used an F test employing restricted maximum likelihood and the Kenward–Roger degrees of freedom adjustment (Kenward & Roger, 1997, 2009; SAS, 2011), which allowed us to use population as the unit of replication, effectively treating population as a…”
MethodC : N ratios and carbon distribution profile across rooting zones in oilseed and pulse crops
Gan, Y., Liang, B. C., Liu, L. P., Xiao-Ting, W. A. N. G., & McDonald, C. L. (2011) · Australian Journal of Agricultural Research · doi:10.1071/cp10360 · Cited by 52
Specification of covariance structure in longitudinal data analysis for randomized clinical trials
Lu, K., & Mehrotra, D. V. (2009) · Statistics in Medicine · doi:10.1002/sim.3820 · Cited by 56
“The ddfm=KR option was used in SAS PROC MIXED to account for the small sample bias and variability of V̂ in the variance estimate of b̂ [28].”
MethodBehavioral Phenotyping of Casper Mutant and 1-Pheny-2-Thiourea Treated Adult Zebrafish
Parker, M. O., Brock, A. J., Millington, M. E., & Brennan, C. H. (2013) · Zebrafish · doi:10.1089/zeb.2013.0878 · Cited by 56
“Finally, for all LMMs, to facilitate Type-III null-hypothesis testing, F-statistics were estimated using the Kenward-Roger (K-R) approximation for denominator degrees of freedom.(22) All data were analyzed in R (version 2.”
Smith, A. D., & Dufty, A. M. (2005) · Ornithological Applications · doi:10.1093/condor/107.3.547 · Cited by 52
He, H., & Hu, Y. (2021) · Journal of Business Research · doi:10.1016/j.jbusres.2021.03.007 · Cited by 63
The Fab region of IgG impairs the internalization pathway of FcRn upon Fc engagement
Brinkhaus, M., Pannecoucke, E., van der Kooi, E. J., Bentlage, A. E. H., Derksen, N. I. L., Andries, J., Balbino, B., Sips, M., Ulrichts, P., Verheesen, P., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-33764-1 · Cited by 51
Michael, D., Cunningham, R. B., & Lindenmayer, D. B. (2010) · Biological Conservation · doi:10.1016/j.biocon.2010.09.019 · Cited by 52
Shallow tillage effects on soil properties for temperate-region hard-setting soils
Schjønning, P., & Thomsen, I. K. (2013) · Soil and Tillage Research · doi:10.1016/j.still.2013.04.006 · Cited by 69
Kahan, B. C., & Harhay, M. O. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.03.016 · Cited by 51
Buehring, B., Krueger, D. C., Libber, J., Heiderscheit, B. C., Sanfilippo, J. L., Johnson, B., Haller, I. V., & Binkley, N. (2013) · Journal of Clinical Densitometry · doi:10.1016/j.jocd.2013.02.012 · Cited by 62
Horký, P., Douda, K., Maciak, M., Závorka, L., & Slavík, O. (2014) · Freshwater Biology · doi:10.1111/fwb.12357 · Cited by 62
Kanga, E., Ogutu, J. O., Olff, H., & Santema, P. (2011) · Oryx · doi:10.1017/s0030605310000931 · Cited by 60
Postnatal development of collagen structure in ovine articular cartilage
van Turnhout, M. C., Schipper, H., ENGEL, B., Buist, W. G., Kranenbarg, S., & LEEUWEN, J. L. V. (2010) · BMC Developmental Biology · doi:10.1186/1471-213x-10-62 · Cited by 55
A recommended analysis for 2 × 2 crossover trials with baseline measurements
Mehrotra, D. V. (2014) · Pharmaceutical Statistics · doi:10.1002/pst.1638 · Cited by 59
Montague, E., Xu, J., & Chiou, E. (2014) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2014.2325859 · Cited by 51
“The denominator degrees of freedom in the F-tests were approximated using the Kenward–Roger method [38].”
MethodHsu, C. L., Hoepting, C. A., Fuchs, M., Shelton, A. M., & Nault, B. A. (2010) · Environmental Entomology · doi:10.1603/en09165 · Cited by 51
“…of Þnal IYSV levels in both 2007 and 2008 was early larval densities (Table 4). aDegrees of freedom are calculated using methods proposed by Kenward and Roger (1997). b Julian date is the last date a thrips sample was collected from a Þeld. c Field type is either a seeded or a…”
MethodEffects of online intervention for depression on mood and positive symptoms in schizophrenia
Moritz, S., Schröder, J., Klein, J. P., Lincoln, T. M., Andreou, C., Fischer, A., & Arlt, S. (2016) · Schizophrenia Research · doi:10.1016/j.schres.2016.04.033 · Cited by 49
“This type of analysis accounts for regression to the mean and raises power of the analyses (Borm et al., 2007; Kenward and Roger, 1997).”
Gangloff, E. J., Holden, K. G., Telemeco, R. S., Baumgard, L. H., & Bronikowski, A. M. (2016) · Journal of Experimental Biology · doi:10.1242/jeb.143107 · Cited by 58
“For all mixed models, we estimated denominator degrees of freedom for F-tests using the Kenward– Roger degrees of freedom approximation (Kenward and Roger, 1997).”
MethodDietary chitosan improves nitrogen use and feed conversion in diets for mid-lactation dairy cows
Valle, T. A. D., de Paiva, P. G., de Jesus, E. F., de Almeida, G. F., Zanferari, F., Costa, A. G. B. V. B., Bueno, I. C. D. S., & Rennó, F. P. (2017) · Livestock Science · doi:10.1016/j.livsci.2017.04.003 · Cited by 59
Talia, A., Miller‐Bottome, M., Katznelson, H., Pedersen, S. H., Steele, H., Schröder, P., Origlieri, A., Scharff, F. B., Giovanardi, G., Andersson, M., et al. (2018) · Psychotherapy Research · doi:10.1080/10503307.2017.1417651 · Cited by 51
“Confidence intervals and significance values for fixed effects were computed using Kenward–Roger approximation (Kenward & Roger, 1997).”
MethodGenomic prediction of agronomic traits in wheat using different models and cross-validation designs
Haile, T. A., Walkowiak, S., N’Diaye, A., Clarke, J. M., Hucl, P., Cuthbert, R. D., Knox, R. E., & Pozniak, C. J. (2020) · Theoretical and Applied Genetics · doi:10.1007/s00122-020-03703-z · Cited by 62
Downs, D. S., Savage, J. S., Rivera, D. E., Pauley, A. M., Leonard, K. S., Hohman, E. E., Guo, P., McNitt, K. M., Stetter, C., & Kunselman, A. (2021) · Journal of Behavioral Medicine · doi:10.1007/s10865-021-00227-9 · Cited by 51
Tao, R., Emslie, G., Mayes, T., Nakonezny, P., Kennard, B., & Hughes, C. (2009) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e318190043e · Cited by 51
Srivastava, R., Downey, E. C., Feola, P., Samore, M. H., Coburn, L., Holubkov, R., Mundorff, M. B., Nkoy, F. L., Desrochers, D., James, B. C., et al. (2007) · Journal of Hospital Medicine · doi:10.1002/jhm.167 · Cited by 51
“The Kenward-Roger approximation of degrees of freedom was used to compute P values from the overall tests.(44) Repeated-measures models were fit to the data using restricted maximum likelihood estimation.”
MethodReisinger, D. L., Shaffer, R. C., Horn, P. S., Hong, M. P., Pedapati, E. V., Dominick, K. C., & Erickson, C. A. (2020) · Frontiers in Integrative Neuroscience · doi:10.3389/fnint.2019.00076 · Cited by 57
Development and evaluation of measurement tools for conceptual profiling of unbranded products
Thomson, D. M. H., & Crocker, C. (2013) · Food Quality and Preference · doi:10.1016/j.foodqual.2013.10.008 · Cited by 53
Urban, M. C. (2010) · Oikos · doi:10.1111/j.1600-0706.2009.17970.x · Cited by 55
“Probabilities were calculated based on the Wald-statistic using a method that approximates the denominator degrees of freedom for an unbalanced design (Kenward and Roger 1997).”
MethodAlgorithms for compact letter displays: Comparison and evaluation
Gramm, J., Guo, J., Hüffner, F., Niedermeier, R., Piepho, H., & Schmid, R. (2006) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2006.09.035 · Cited by 61
“Multiple comparisons among all pairs of treatments were performed using a t-test with degrees of freedom determined by the Kenward–Roger method (Kenward and Roger, 1997).”
MethodNegative impact of urban habitat on immunity in the great tit Parus major
Bailly, J., Scheifler, R., Belvalette, M., Garnier, S., Boissier, E., Clément-Demange, V.-A., Gète, M., Leblond, M., Pasteur, B., Piget, Q., et al. (2016) · Oecologia · doi:10.1007/s00442-016-3730-2 · Cited by 54
“The variations in the initial concentration of Hp, initial BM, and the changes in BM and Hp concentration after injection were analysed using General Linear Mixed Models (GLMMs).”
MethodInfluentialBrezzi, M., Schmid, B., Niklaus, P. A., & Schuldt, A. (2017) · Journal of Plant Ecology · doi:10.1093/jpe/rtw038 · Cited by 59
“Denominator degrees of freedom for the F-tests in the mixed-effects models were calculated with the Kenward and Roger adjustment method (Kenward and Roger 1997).”
MethodOvenden, B. W., Milgate, A., Lisle, C., Wade, L. J., Rebetzke, G. J., & Holland, J. B. (2017) · Theoretical and Applied Genetics · doi:10.1007/s00122-017-2969-2 · Cited by 55
Ramos, A. F. O., Terry, S. A., Holman, D. B., Breves, G., Pereira, L. G. R., Silva, A. G. M. E., & Chaves, A. V. (2018) · Frontiers in Microbiology · doi:10.3389/fmicb.2018.01647 · Cited by 50
The contribution of spatial mass effects to plant diversity in arable fields
Metcalfe, H., Hassall, K. L., Boinot, S., & Storkey, J. (2019) · Journal of Applied Ecology · doi:10.1111/1365-2664.13414 · Cited by 50
“Terms were selected using backwards elimination according to the largest p‐value given by an approximate F‐test when that term was dropped (Kenward & Roger, 1997).”
MethodRhoads, T. W., Clark, J. P., Gustafson, G. E., Miller, K. N., Conklin, M. W., DeMuth, T. M., Berres, M. E., Eliceiri, K. W., Vaughan, L. K., Lary, C. W., et al. (2020) · Cell Systems · doi:10.1016/j.cels.2019.12.002 · Cited by 50
“To correct for potential heterogeneity of variance across the age groups, adjustment of the degrees-of freedom were used (Kenward and Roger, 1997).”
MethodStegmann, Y., Ahrens, L. M., Pauli, P., Keil, A., & Wieser, M. J. (2020) · eLife · doi:10.7554/elife.55204 · Cited by 52
Sun, K., & Zhou, J. (2021) · Telematics and Informatics · doi:10.1016/j.tele.2021.101566 · Cited by 61
Ramanau, A., Kluge, H., Spilke, J., & Eder, K. (2002) · Archiv für Tierernaehrung · doi:10.1080/00039420214348 · Cited by 50
“The standard errors of the estimated fixed effects and their combination to least square means (LSmeans) as well as the degrees of freedom for estimates and hypothesis tests, resp. were calculated according to Kenward and Roger (1997).”
MethodHubbard, R. M., Carneiro, R. L., Campoe, O. C., Álvares, C. A., Figura, M. A., & Moreira, G. G. (2020) · Forest Ecology and Management · doi:10.1016/j.foreco.2020.118407 · Cited by 51
Karriker-Jaffe, K. J., Foshee, V. A., Ennett, S. T., & Suchindran, C. (2013) · Journal of Youth and Adolescence · doi:10.1007/s10964-012-9832-1 · Cited by 49
“All analyses were conducted using PROC MIXED in SAS version 9.3 using restricted maximum likelihoods and the Kenward-Roger adjustment of the standard errors and degrees of freedom for more conservative tests of the fixed effects (Kenward and Roger 1997).”
InfluentialKort, H. D., Vandepitte, K., & Honnay, O. (2012) · Evolutionary Ecology · doi:10.1007/s10682-012-9624-9 · Cited by 52
Interpersonal Psychotherapy-Adolescent Skills Training: Anxiety Outcomes and Impact of Comorbidity
Young, J. F., Makover, H. B., Cohen, J. R., Mufson, L., Gallop, R. J., & Benas, J. S. (2012) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2012.704843 · Cited by 49
“The degrees of freedom were estimated with the Kenward-Roger’s approximation (Kenward & Roger, 1997) which accommodates small sample inferences, and effect sizes for intervention contrasts (Cohen’s d) were derived as specified by Verbeke and Molenberghs (2000).”
MethodCognitive Workload and Sleep Restriction Interact to Influence Sleep Homeostatic Responses
Goel, N., Abe, T., Braun, M. E., & Dinges, D. F. (2014) · Sleep · doi:10.5665/sleep.4164 · Cited by 49
What do calves choose to eat and how do preferences affect behaviour?
Webb, L. E., ENGEL, B., Berends, H., van Reenen, C. G., Gerrits, W. J. J., de Boer, I. J. M., & Bokkers, E. A. M. (2014) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2014.09.016 · Cited by 61
Arp, T., Howard, S. T., Woerner, D. R., Scanga, J. A., McKenna, D. R., Kolath, W. H., Chapman, P. L., Tatum, J. D., & Belk, K. E. (2014) · Journal of Animal Science · doi:10.2527/jas.2013-7122 · Cited by 52
van der Voet, H., PERRY, J. N., Amzal, B., & Paoletti, C. (2011) · BMC Biotechnology · doi:10.1186/1472-6750-11-15 · Cited by 54
“For the calculation of df the method of Kenward and Roger [32] has been recommended [33].”
MethodInfluentialZetterberg, T., Olsson, B. A., Löfgren, S., von Brömssen, C., & Brandtberg, P. (2013) · Forest Ecology and Management · doi:10.1016/j.foreco.2013.03.030 · Cited by 59
“Kenward and Roger (1997) corrections were used to adjust the degrees of freedom in unbalanced data sets (e.”
MethodPhenotypic plasticity and precipitation response in Sonoran Desert winter annuals
Angert, A. L., Horst, J. L., Huxman, T. E., & Venable, D. L. (2010) · American Journal of Botany · doi:10.3732/ajb.0900242 · Cited by 55
Coster, G. D., Neve, L. D., Martín‐Gálvez, D., Therry, L., & Lens, L. (2010) · Journal of Experimental Biology · doi:10.1242/jeb.042721 · Cited by 49
“Kenward, M. G. and Roger, J. H. (1997).”
MethodLiebe, S., Wibberg, D., Winkler, A., Pühler, A., Schlüter, A., & Varrelmann, M. (2016) · FEMS Microbiology Ecology · doi:10.1093/femsec/fiw004 · Cited by 49
“The denominator degrees of freedom for the tests of fixed effects were approximated according to the method of Kenward and Roger (1997).”
MethodPerceived distance and obesity: It's what you weigh, not what you think
Sugovic, M., Turk, P. J., & Witt, J. K. (2016) · Acta Psychologica · doi:10.1016/j.actpsy.2016.01.012 · Cited by 57
“We used Kenward-Roger degrees of freedom (Kenward & Roger, 1997) and a variance components covariance structure for the random effects.”
MethodChoosing appropriate analysis methods for cluster randomised cross‐over trials with a binary outcome
Morgan, K. E., Forbes, A. B., Keogh, R. H., Jairath, V., & Kahan, B. C. (2017) · Statistics in Medicine · doi:10.1002/sim.7137 · Cited by 48
“It may therefore be beneficial to use a more sophisticated degree-of-freedom correction, such as the Kenward–Roger method [26, 27].”
MethodParasite-induced increases in the energy costs of movement of host freshwater fish
Slavík, O., Horký, P., Douda, K., Velíšek, J., Kolářová, J., & Lepič, P. (2017) · Physiology & Behavior · doi:10.1016/j.physbeh.2017.01.010 · Cited by 49
“Degrees of freedom were calculated using the KenwardRoger’s method [47].”
MethodLikelihood and model selection
Richards, S. A. (2015) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199672547.003.0004 · Cited by 59
Comparison of intent-to-treat analysis strategies for pre-post studies with loss to follow-up
Xi, W., Pennell, M. L., Andridge, R., & Paskett, E. D. (2018) · Contemporary Clinical Trials Communications · doi:10.1016/j.conctc.2018.05.008 · Cited by 55
Bird guilds show different responses to tree retention levels: a meta-analysis
Basile, M., Mikusiński, G., & Storch, I. (2019) · Global Ecology and Conservation · doi:10.1016/j.gecco.2019.e00615 · Cited by 59
Moritz, S., Fricke, S., Treszl, A., & Wittekind, C. E. (2012) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2011.11.001 · Cited by 48
“standard errors and degrees of freedom derived by Kenward and Roger (1997).”
BackgroundIntraclutch variation in avian eggshell pigmentation: the anaemia hypothesis
Coster, G. D., Neve, L. D., & Lens, L. (2012) · Oecologia · doi:10.1007/s00442-012-2304-1 · Cited by 66
Comparison Between Non-Invasive Methane Measurement Techniques in Cattle
Rey, J., Atxaerandio, R., Ruiz, R., Ugarte, E., González-Recio, Ó., García-Rodríguez, A., & Goiri, I. (2019) · Animals · doi:10.3390/ani9080563 · Cited by 48
Karmaliani, R., McFARLANE, J. M., Khuwaja, H. M. A., Somani, Y., Bhamani, S. S., Ali, T. S., Asad, N., Chirwa, E. D., & Jewkes, R. K. (2020) · Global Health Action · doi:10.1080/16549716.2020.1836604 · Cited by 49
Randomised trial of indwelling pleural catheters for refractory transudative pleural effusions
Walker, S. P., Bintcliffe, O. J., Keenan, E. K., Stadon, L. J., Evison, M., Haris, M., Nagarajan, T., West, A., Ionescu, A., Prudon, B., et al. (2021) · European Respiratory Journal · doi:10.1183/13993003.01362-2021 · Cited by 51
“6 included a random-intercept for patient, used an autoregressive (order 1) correlation, and was estimated using restricted maximum likelihood with a Kenward-Roger degree-offreedom correction(18).”
MethodGill, H. K., Lantz, T. C., O'Neill, H. B., & Kokelj, S. V. (2014) · Arctic Antarctic and Alpine Research · doi:10.1657/1938-4246-46.4.947 · Cited by 64
Careau, V., Biro, P. A., Bonneaud, C., Fokam, E. B., & Herrel, A. (2014) · Oecologia · doi:10.1007/s00442-014-2925-7 · Cited by 48
Use of regression kriging to develop a Carbon:Nitrogen ratio surface for New Zealand
Watt, M. S., & Palmer, D. J. (2012) · Geoderma · doi:10.1016/j.geoderma.2012.03.013 · Cited by 48
Lee, Y., Lee, J., Tak, S., Lee, K., Na, D. L., Seo, S. W., Jeong, Y., & Ye, J. C. (2015) · NeuroImage · doi:10.1016/j.neuroimage.2015.10.081 · Cited by 56
O’Connor, E., Parker, M. O., McLeman, M. A., Demmers, T. G. M., Lowe, J. C., Cui, L., Davey, E. L., Owen, R. C., Wathes, C. M., & Abeyesinghe, S. M. (2010) · animal · doi:10.1017/s1751731110001072 · Cited by 67
“Degrees of freedom (d.f.) were calculated using the Kenward–Roger method (Kenward and Roger, 1997), which is appropriate for unbalanced data with multiple random effects.”
Method
Metadata
- Authors
- Kenward, M. G., & Roger, J. H.
- Affiliations
- University of Kent (GB)
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1997-09
- Volume
- 53
- Issue
- 3
- Pages
- 983
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1981747359
- Cited by
- 4,552
- References
- 23
- Citations by year
- 2026: 217 · 2025: 196 · 2024: 216 · 2023: 213 · 2022: 261 · 2021: 299 · 2020: 287 · 2019: 270 · 2018: 247 · 2017: 240 · 2016: 286 · 2015: 256 · 2014: 217 · 2013: 189 · 2012: 218
- FWCI
- 7.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Rothamsted Repository (Rothamsted Repository) (submittedVersion)
- Kent Academic Repository (University of Kent) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Mathematics › Applied Mathematics › Statistical and numerical algorithms
- Keywords
- restricted maximum likelihood, small sample inference, fixed effects, Wald statistic, covariance matrix estimation, small sample bias, Hotelling's T2 statistic, linear mixed models, linear Gaussian models
- MeSH terms
- Analysis of Variance, Biometry, Clinical Trials as Topic, Humans, Intermittent Claudication, Nitrogen Fixation, Plants, Probability, Regression Analysis, Research Design, Rhizobium, Soil Microbiology, Reproducibility of Results, Models, Statistical, Bias, Randomized Controlled Trials as Topic, Cross-Over Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.