Small Sample Inference for Fixed Effects from Restricted Maximum Likelihood
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Restricted maximum likelihood (REML) is now well established as a method for estimating the parameters of the general Gaussian linear model with a structured covariance matrix, in particular for mixed linear models. Conventionally, estimates of precision and inference for fixed effects are based on their asymptotic distribution, which is known to be inadequate for some small-sample problems. In this paper, we present a scaled Wald statistic, together with an F approximation to its sampling distribution, that is shown to perform well in a range of small sample settings. The statistic uses an adjusted estimator of the covariance matrix that has reduced small sample bias. This approach has the advantage that it reproduces both the statistics and F distributions in those settings where the latter is exact, namely for Hotelling T2 type statistics and for analysis of variance F-ratios. The performance of the modified statistics is assessed through simulation studies of four different REML analyses and the methods are illustrated using three examples.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Accurate model parameter estimations were ensured by use of the residual maximum likelihood approach with the Kenward and Roger, 1997 approximation of degrees of freedom.”
From Longitudinal association between social media use and psychological distress among adolescents (2020) · cites this paper as Kenward and Roger, 1997
In the citing paper
“Not only does the data in the motivating example have different flowering days for each genotype (see for example Fig. 2), but the proposed methodology also accounts for the different strata in the Wald test by approximating the denominator degrees of freedom (Kenward and Roger, 1997).”
From Incorporating environmental covariates to explore genotype × environment × management (G × E × M) interactions: A one-stage predictive model (2023) · cites this paper as Kenward and Roger, 1997
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923
Recovery of inter-block information when block sizes are unequal
PATTERSON, H. D., & THOMPSON, R. (1971) · Biometrika · doi:10.1093/biomet/58.3.545 · Cited by 4,058
Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems
Harville, D. A. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10480998 · Cited by 2,667 · cited 1×
“Restricted (or residual) maximum likelihood (REML) has become well established for the estimation of the parameters of Z (Patterson and Thompson, 1971; Harville, 1977; Thompson, 1980; Robinson, 1991) and the corresponding estimator of 3, 3 say, has a generalized least squares form that uses the REML estimate of Z.”
BackgroundThat BLUP is a Good Thing: The Estimation of Random Effects
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011926 · Cited by 1,686
Gilmour, A. R., Thompson, R., & Cullis, B. R. (1995) · Biometrics · doi:10.2307/2533274 · Cited by 915
15 Design and Analysis of Cross-Over Trials
Kenward, M. G., & Jones, B. (2007) · Handbook of Statistics · doi:10.1016/s0169-7161(07)27015-4 · Cited by 871
Self-citationPrinciples of Multivariate Analysis
Ling, R. F. (1990) · Technometrics · doi:10.1080/00401706.1990.10484645 · Cited by 812
Satterthwaite, F. E. (1941) · Psychometrika · doi:10.1007/bf02288586 · Cited by 809
Approximations for Standard Errors of Estimators of Fixed and Random Effects in Mixed Linear Models
Kackar, R. N., & Harville, D. A. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477102 · Cited by 445
Cited by
Items 101–200 of 1,051
Split-Plot Designs: What, Why, and How
Jones, B., & Nachtsheim, C. J. (2009) · Journal of Quality Technology · doi:10.1080/00224065.2009.11917790 · Cited by 242
“…linear combination of the elements of β. Goos et al. (2006) studied five alternative approaches to conducting this test, as provided by the SAS Mixed procedure, and concluded that the Satterthwaite method (SATTERTH option) and the method of Kenward and Roger (1997) work well in split-plot studies.”
MethodInfluentialPartlett, C., & Riley, R. D. (2017) · Statistics in Medicine · doi:10.1002/sim.7140 · Cited by 240
“Methods: N, Conventional method; HK, HartungKnapp; HK2, Modified Hartung-Knapp; KR, Kenward-Roger; SJ, Siddik-Jonkman; SJ2, Modified Sidik-Jonkman.”
BackgroundMethodInfluentialGenetic Improvement of U.S. Soybean in Maturity Groups II, III, and IV
Rincker, K., Nelson, R., Specht, J., Sleper, D., Cary, T., Cianzio, S. R., Casteel, S., Conley, S., Chen, P., Davis, V., et al. (2014) · Crop Science · doi:10.2135/cropsci2013.10.0665 · Cited by 237
Persistent effects of subsoil compaction on pore size distribution and gas transport in a loamy soil
Berisso, F. E., Schjønning, P., Keller, T., Lamandé, M., Etana, A., de Jonge, L. W., Iversen, B. V., Arvidsson, J., & Forkman, J. (2012) · Soil and Tillage Research · doi:10.1016/j.still.2012.02.005 · Cited by 237
Veroniki, A. A., Jackson, D., Bender, R., Kuss, O., Langan, D., Higgins, J. P. T., Knapp, G., & Salanti, G. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1319 · Cited by 236
“An alternative approach based on the expected information and on appropriately modified degrees of freedom of the t distribution was suggested by Kenward and Roger.(136) These alternative expressions for var μR̂E ð Þ could also be used in WT CIs but have not been adopted in practice, so we do not explore their use fur…”
MethodFava, M., Memisoglu, A., Thase, M. E., Bodkin, J. A., Trivedi, M. H., de Somer, M., Du, Y., Leigh-Pemberton, R., DiPetrillo, L., Silverman, B., et al. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2015.15070921 · Cited by 232
“The Kenward-Roger approximation (38) was used to adjust the denominator degrees of freedom.”
MethodByerly, M. J., Nakonezny, P. A., & Rush, A. J. (2008) · Schizophrenia Research · doi:10.1016/j.schres.2007.12.470 · Cited by 229
Auditory Brainstem Response Latency in Noise as a Marker of Cochlear Synaptopathy
Mehraei, G., Hickox, A. E., Bharadwaj, H. M., Goldberg, H., Verhulst, S., Liberman, M. C., & Shinn-Cunningham, B. G. (2016) · The Journal of Neuroscience · doi:10.1523/jneurosci.4460-15.2016 · Cited by 227
Dialectical behavior therapy (DBT) applied to college students: A randomized clinical trial.
Pistorello, J., Fruzzetti, A. E., MacLane, C., Gallop, R., & Iverson, K. M. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0029096 · Cited by 228
Jackson, D., Bowden, J., & Baker, R. (2010) · Journal of Statistical Planning and Inference · doi:10.1016/j.jspi.2009.09.017 · Cited by 226
Mean squared error of empirical predictor
Das, K., Jiang, J., & Rao, J. N. K. (2004) · The Annals of Statistics · doi:10.1214/009053604000000201 · Cited by 210
“Kenward and Roger (1997) de- rived a bias-adjusted estimator of cov(β̂) and used it to derive a scaled Wald statistic, together with an F approximation to its distribution.”
BackgroundMethodInfluentialAn Antidepressant Decreases CSF Aβ Production in Healthy Individuals and in Transgenic AD Mice
Sheline, Y. I., West, T., Yarasheski, K., Swarm, R., Jasielec, M. S., Fisher, J. R., Ficker, W. D., Yan, P., Xiong, C., Frederiksen, C., et al. (2014) · Science Translational Medicine · doi:10.1126/scitranslmed.3008169 · Cited by 223
Physical Activity, Sedentary Time, and Obesity in an International Sample of Children
KATZMARZYK, P. T., BARREIRA, T. V., BROYLES, S. T., CHAMPAGNE, C. M., CHAPUT, J.-P., FOGELHOLM, M., HU, G., JOHNSON, W. D., KURIYAN, R., KURPAD, A., et al. (2015) · Medicine & Science in Sports & Exercise · doi:10.1249/mss.0000000000000649 · Cited by 222
“were calculated using the Kenward and Roger approximation (13).”
MethodSuter, M., Connolly, J., Finn, J. A., Loges, R., Kirwan, L., Sebastià, M., & Lüscher, A. (2015) · Global Change Biology · doi:10.1111/gcb.12880 · Cited by 220
Sigdel, T., Archila, F., Constantin, T., Prins, S., Liberto, J., Damm, I., Towfighi, P., Navarro, S., Kirkizlar, E., Demko, Z., et al. (2018) · Journal of Clinical Medicine · doi:10.3390/jcm8010019 · Cited by 219
“It is possible that the overall effect is driven by a sub-category of the non-rejection group (STA, BL, or OI) or the effect between the groups is smaller than detectable with the current sample size [30].”
BackgroundCompas, B. E., Champion, J. E., Forehand, R., Cole, D. A., Reeslund, K. L., Fear, J., Hardcastle, E. J., Keller, G., Rakow, A., Garai, E., et al. (2010) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0020459 · Cited by 217
“Several ways of approximating this test distribution have been proposed in this context, and the most commonly recommended one (e.g., Fitzmaurice, Davidian, Verbeke & Molenberghs, 2009, p. 274; Fitzmaurice, Laird, & Ware, 2004, p. 98) was used here: the Kenward–Roger method (Kenward & Roger, 1997).”
McGuire, J. P., Mitchell, R. J., Moser, E. B., Pecot, S. D., Gjerstad, D. H., & Hedman, C. W. (2001) · Canadian Journal of Forest Research · doi:10.1139/cjfr-31-5-765 · Cited by 217
“Because our model contained nested error terms, denominator degrees of freedom were estimated using the Kenward and Roger (1997) approximation.”
MethodMultilevel Modeling: A Review of Methodological Issues and Applications
Dedrick, R. F., Ferron, J. M., Hess, M. R., Hogarty, K. Y., Kromrey, J. D., Lang, T. R., Niles, J. D., & Lee, R. S. (2009) · Review of Educational Research · doi:10.3102/0034654308325581 · Cited by 209
“Several methods for estimating the degrees of freedom have been given (Giesbrecht & Burns, 1985; Kenward & Roger, 1997).”
MethodDesign-Comparable Effect Sizes in Multiple Baseline Designs: A General Modeling Framework
Pustejovsky, J. E., Hedges, L. V., & Shadish, W. R. (2014) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998614547577 · Cited by 213
“Parametric bootstrapping (Efron & Tibshirani, 1998, section 6.5) and small-sample corrections for the covariance matrix of fixed effect estimates (Kenward & Roger, 1997, 2009) warrant further investigation as well, as they may provide better means of estimating the effect size variance and…”
BackgroundInfluentialVAN STRIEN, M. J., KELLER, D., & HOLDEREGGER, R. (2012) · Molecular Ecology · doi:10.1111/j.1365-294x.2012.05687.x · Cited by 214
“The R2b is calculated from the Kenward–Roger F and degrees of freedom estimates (Kenward & Roger 1997), which we calculated using the ‘KRmodcomp’ function from the R-package ‘pbkrtest’ (Halekoh & Højsgaard 2011).”
MethodLower Pregnancy Losses in Lactating Dairy Cows Fed a Diet Enriched in α-Linolenic Acid
Ambrose, D. J., Kastelic, J. P., Corbett, R., Pitney, P. A., Petit, H. V., Small, J. A., & Zalkovic, P. (2006) · Journal of Dairy Science · doi:10.3168/jds.s0022-0302(06)72581-4 · Cited by 213
“The Kenward-Roger procedure was used for approximating the degrees of freedom ( Kenward and Roger, 1997 ).”
MethodRethorst, C. D., Toups, M. S., Greer, T. L., Nakonezny, P. A., Carmody, T. J., Grannemann, B. D., Huebinger, R. M., Barber, R. C., & Trivedi, M. H. (2013) · Molecular Psychiatry · doi:10.1038/mp.2012.125 · Cited by 211
Time perception in depression: A meta-analysis
Thönes, S., & Oberfeld, D. (2015) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.12.057 · Cited by 210
du Bois, A., Kristensen, G., Ray-Coquard, I., Reuss, A., Pignata, S., Colombo, N., Denison, U., Vergote, I., del Campo, J. M., Ottevanger, P., et al. (2016) · The Lancet Oncology · doi:10.1016/s1470-2045(15)00366-6 · Cited by 211
Missing data in randomised controlled trials: a practical guide
Carpenter, J. R., & Kenward, M. (2007) · LSHTM Research Online (London School of Hygiene and Tropical Medicine) · Cited by 285
Self-citationEstimating the Diets of Animals Using Stable Isotopes and a Comprehensive Bayesian Mixing Model
Hopkins, J. B., & Ferguson, J. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0028478 · Cited by 202
“Ignoring correlations in a model’s covariance structure can have effects on both point estimates [52] and their intervals [53].”
BackgroundEffects of Biocompatible versus Standard Fluid on Peritoneal Dialysis Outcomes
Johnson, D. W., Brown, F. G., Clarke, M., Boudville, N., Elias, T. J., Foo, M. W. Y., Jones, B., Kulkarni, H., Langham, R., Ranganathan, D., et al. (2012) · Journal of the American Society of Nephrology · doi:10.1681/asn.2011121201 · Cited by 200
Telford, R. D., Cunningham, R. B., Telford, R. M., Kerrigan, J., Hickman, P. E., Potter, J. M., & Abhayaratna, W. P. (2012) · PLoS ONE · doi:10.1371/journal.pone.0047438 · Cited by 200
Species coexistence and the dynamics of phenotypic evolution in adaptive radiation
Tobias, J. A., Cornwallis, C. K., Derryberry, E. P., Claramunt, S., Brumfield, R. T., & Seddon, N. (2014) · Nature · doi:10.1038/nature12874 · Cited by 199
Castañeda-Moya, E., Twilley, R. R., Rivera-Monroy, V. H., Marx, B. D., Coronado-Molina, C., & Ewe, S. M. L. (2011) · Ecosystems · doi:10.1007/s10021-011-9473-3 · Cited by 199
“The Kenward– Roger procedure was used to adjust the degrees of freedom of the F test statistics when the design was unbalanced or when an unequal variance model was significant (SAS Institute, Cary, North Carolina, USA; Kenward and Roger 1997).”
MethodReview of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195
Compas, B. E., Forehand, R., Keller, G., Champion, J. E., Rakow, A., Reeslund, K. L., McKee, L., Fear, J. M., Colletti, C. J. M., Hardcastle, E., et al. (2009) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0016930 · Cited by 196
Ferron, J. M., Bell, B. A., Hess, M. R., Rendina-Gobioff, G., & Hibbard, S. T. (2009) · Behavior Research Methods · doi:10.3758/brm.41.2.372 · Cited by 194
“The Kenward–Roger method is an extension of the Satterthwaite method, and was developed by Kenward and Roger (1997) to adjust for small-sample bias in the variance estimation.”
BackgroundMethodInfluentialA Mixed Modelling Approach for Randomized Experiments with Repeated Measures
Piepho, H. P., Büchse, A., & Richter, C. (2004) · Journal of Agronomy and Crop Science · doi:10.1111/j.1439-037x.2004.00097.x · Cited by 196
“Once a suitable correlation structure has been identified, inference for fixed effects may be based on the Kenward and Roger (1997) method.”
MethodInfluentialAntibiotic Losses in Leaching and Surface Runoff from Manure‐Amended Agricultural Land
Dolliver, H., & Gupta, S. (2008) · Journal of Environmental Quality · doi:10.2134/jeq2007.0392 · Cited by 193
Fast and accurate modelling of longitudinal and repeated measures neuroimaging data
Guillaume, B., Hua, X., Thompson, P. M., Waldorp, L., & Nichols, T. E. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.03.029 · Cited by 192
Ballard, C., Banister, C., Khan, Z., Cummings, J., Demos, G., Coate, B., Youakim, J. M., Owen, R., Stankovic, S., Tomkinson, E. B., et al. (2018) · The Lancet Neurology · doi:10.1016/s1474-4422(18)30039-5 · Cited by 190
Friedman, L., Glover, G. H., & The FBIRN Consortium (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.07.012 · Cited by 191
Gross, D., Garvey, C., Julion, W., Fogg, L., Tucker, S., & Mokros, H. (2009) · Prevention Science · doi:10.1007/s11121-008-0116-7 · Cited by 191
“To determine whether center effects would significantly alter the analyses, we reanalyzed the data in PROC MIXED using two alternative statistical methods for estimating degrees of freedom that simultaneously adjust for center effects: Satterthwaite and Kenward–Roger approximations (Giesbrecht and Burns 1985; Kenward…”
Perioperative cerebrospinal fluid and plasma inflammatory markers after orthopedic surgery
Hirsch, J., Vacas, S., Terrando, N., Yuan, M., Sands, L. P., Kramer, J., Bozic, K., Maze, M. M., & Leung, J. M. (2016) · Journal of Neuroinflammation · doi:10.1186/s12974-016-0681-9 · Cited by 190
“The standard errors were computed using the Kackar and Harville approximation [39], and degrees of freedom were computed by the Kenward and Rogers [40] method.”
MethodKahan, B. C., Forbes, G., Ali, Y., Jairath, V., Bremner, S., Harhay, M. O., Hooper, R., Wright, N., Eldridge, S. M., & Leyrat, C. (2016) · Trials · doi:10.1186/s13063-016-1571-2 · Cited by 185
“Small-sample corrections included any degree-offreedom correction for mixed-effects models (such as Kenward-Roger or Satterthwaite) [15, 16] and any smallsample correction for GEEs [11, 14, 17, 18, 20].”
MethodInfluentialPizzagalli, D. A., Webb, C. A., Dillon, D. G., Tenke, C. E., Kayser, J., Goer, F., Fava, M., McGrath, P., Weissman, M., Parsey, R., et al. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.0252 · Cited by 189
jtools: Analysis and Presentation of Social Scientific Data
Long, J. A. (2017) · CRAN: Contributed Packages · doi:10.32614/cran.package.jtools · Cited by 189
Gilbertson, M. W., Paulus, L. A., Williston, S. K., Gurvits, T. V., Lasko, N. B., Pitman, R. K., & Orr, S. P. (2006) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.115.3.484 · Cited by 186
Karriker-Jaffe, K. J., Foshee, V. A., Ennett, S. T., & Suchindran, C. (2008) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-008-9245-5 · Cited by 186
“…analyses used PROC MIXED in SAS version 9.1 on a SunOS 5.9 platform (SAS Institute, 2003) using a restricted maximum likelihood estimation process and the Kenward-Roger adjustment of the standard errors and degrees of freedom for more conservative tests of the fixed effects (Kenward & Roger, 1997).”
MethodInfluentialCORNWALLIS, C. K., WEST, S. A., & GRIFFIN, A. S. (2009) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2009.01853.x · Cited by 186
“The Kenward & Roger (1997) method for estimating standard errors for parameter estimates and denominator degrees of freedom was used as it is specifically designed for models with multiple random effects and unbalanced data, increasing the accuracy of significance tests (Kenward & Roger, 1997;…”
MethodMethods for Analysis of Pre-Post Data in Clinical Research: A Comparison of Five Common Methods
O Connell, N. S., Dai, L., Jiang, Y., Speiser, J. L., Ward, R., Wei, W., Carroll, R., & Gebregziabher, M. (2017) · Journal of Biometrics & Biostatistics · doi:10.4172/2155-6180.1000334 · Cited by 185
“In LMM, the outcome is modeled as a vector of responses with or without KenwardRogers adjustment.”
BackgroundInfluentialNew generation antidepressants for depression in children and adolescents: a network meta-analysis
Hetrick, S. E., McKenzie, J. E., Bailey, A. P., Sharma, V., Moller, C. I., Badcock, P. B., Cox, G., Merry, S., & Meader, N. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd013674.pub2 · Cited by 271
Macready, A. L., George, T. W., Chong, M. F., Alimbetov, D. S., Jin, Y., Vidal, A., Spencer, J. P., Kennedy, O. B., Tuohy, K. M., Minihane, A.-M., et al. (2014) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.074237 · Cited by 184
Gaihre, Y. K., Singh, U., Islam, S. M. M., Huda, A., Islam, M. R., Satter, M. A., Sanabria, J., Islam, M. R., & Shah, A. L. (2015) · Geoderma · doi:10.1016/j.geoderma.2015.06.001 · Cited by 179
“Degrees of freedom (DF) for the denominator (Den DF) in the calculation of the F statistic for all the fixed effects in the ANOVA were obtained using Kenward–Roger method (Gbur et al., 2012; Kenward and Roger, 1997).”
MethodFuchs, L. S., Schumacher, R. F., Sterba, S. K., Long, J., Namkung, J., Malone, A., Hamlett, C. L., Jordan, N. C., Gersten, R., Siegler, R. S., et al. (2014) · Journal of Educational Psychology · doi:10.1037/a0034341 · Cited by 177
Continental-scale decrease in net primary productivity in streams due to climate warming
Song, C., Dodds, W. K., Rüegg, J., Argerich, A., Baker, C. L., Bowden, W. B., Douglas, M. M., Farrell, K. J., Flinn, M. B., Garcia, E. A., et al. (2018) · Nature Geoscience · doi:10.1038/s41561-018-0125-5 · Cited by 177
Phenolic Compound Induction in Plant-Microbe and Plant-Insect Interactions: A Meta-Analysis
Wallis, C. M., & Galarneau, E. R.-A. (2020) · Frontiers in Plant Science · doi:10.3389/fpls.2020.580753 · Cited by 177
“The Kenward-Roger adjustment further assisted with correcting for the number of studies being small to moderate, and for high variations in sample variances (Kenward and Roger, 1997; McNeish, 2017).”
MethodSpatial analysis methods for forest genetic trials
Dutkowski, G. W., Silva, J. C. E., Gilmour, A. R., & Lopez, G. A. (2002) · Canadian Journal of Forest Research · doi:10.1139/x02-111 · Cited by 177
Heinritz, S. N., Weiss, E., Eklund, M., Aumiller, T., Louis, S., Rings, A., Messner, S., Camarinha-Silva, A., Seifert, J., Bischoff, S. C., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0154329 · Cited by 176
KUDO, G., & HARDER, L. D. (2005) · Functional Ecology · doi:10.1111/j.1365-2435.2005.00961.x · Cited by 176
Singh, D., Brooks, J., Hagan, G., Cahn, A., & O'Connor, B. J. (2008) · Thorax · doi:10.1136/thx.2007.087213 · Cited by 177
Hyvönen, T., Ketoja, E., Salonen, J., Jalli, H., & Tiainen, J. (2003) · Agriculture, Ecosystems & Environment · doi:10.1016/s0167-8809(03)00117-8 · Cited by 173
Rainfall influences on ungulate population abundance in the Mara‐Serengeti ecosystem
Ogutu, J. O., Piepho, H. ‐., Dublin, H. T., Bhola, N., & Reid, R. S. (2008) · Journal of Animal Ecology · doi:10.1111/j.1365-2656.2008.01392.x · Cited by 174
A Field Evaluation of Distance Measurement Error in Auditory Avian Point Count Surveys
ALLDREDGE, M. W., SIMONS, T. R., & POLLOCK, K. H. (2007) · The Journal of Wildlife Management · doi:10.2193/2006-161 · Cited by 173
“We based mixed model F tests on Kenwar–Roger’s adjusted degrees of freedom (Kenward and Roger 1997).”
MethodChirase, N. K., Greene, L. W., Purdy, C. W., Loan, R. W., Auvermann, B. W., Parker, D. B., Walborg, E. F., Stevenson, D. E., Xu, Y., & Klaunig, J. E. (2004) · American Journal of Veterinary Research · doi:10.2460/ajvr.2004.65.860 · Cited by 175
“Degrees of freedom were calculated by use of specifications of Kenward and Rogers.16 When a significant (P 0.05) difference was found, as indicated by results of the F test, least-square means procedures were used to separate the means.”
MethodInfluentialElff, M., Heisig, J. P., Schaeffer, M., & Shikano, S. (2021) · British Journal of Political Science · doi:10.1017/s0007123419000097 · Cited by 170
Decreasing annual nest counts in a globally important loggerhead sea turtle population
Witherington, B., Kubilis, P., Brost, B., & Meylan, A. (2009) · Ecological Applications · doi:10.1890/08-0434.1 · Cited by 172
Ganeles, J., Zöllner, A., Jackowski, J., Ten Bruggenkate, C., Beagle, J., & Guerra, F. (2008) · Clinical Oral Implants Research · doi:10.1111/j.1600-0501.2008.01626.x · Cited by 170
Katzmarzyk, P. T., Barreira, T. V., Broyles, S. T., Champagne, C. M., Chaput, J., Fogelholm, M., Hu, G., Johnson, W. D., Kuriyan, R., Kurpad, A., et al. (2015) · Obesity · doi:10.1002/oby.21152 · Cited by 167
“The denominator degrees of freedom for statistical tests pertaining to fixed effects were calculated using the Kenward and Roger approximation (24).”
MethodLandward and eastward shift of Alaskan polar bear denning associated with recent sea ice changes
Fischbach, A. S., Amstrup, S. C., & Douglas, D. C. (2007) · Polar Biology · doi:10.1007/s00300-007-0300-4 · Cited by 167
“We used a linear mixed-eVects model (Kenward and Roger 1997) to assess change in the proportion of polar bears denning on pack ice between the early (autumn years 1985–1994) and latter (autumn years 1997–2004) sampling periods.”
Method(1.1) MEAN SQUARED ERROR OF EMPIRICAL PREDICTORPreprint
Das, K., Jiang, J., & Rao, J. N. K. (2004) · Cited by 172
Dynamics of Mara–Serengeti ungulates in relation to land use changes
Ogutu, J. O., Piepho, H. ‐., Dublin, H. T., Bhola, N., & Reid, R. S. (2009) · Journal of Zoology · doi:10.1111/j.1469-7998.2008.00536.x · Cited by 166
Cop, U., Drieghe, D., & Duyck, W. (2015) · PLOS ONE · doi:10.1371/journal.pone.0134008 · Cited by 164
“Kenward-Roger adjusted degrees of freedom (89) for our fixed effects in the final models.”
BackgroundMethodEvaluating Group-Based Interventions When Control Participants Are Ungrouped
Bauer, D. J., Sterba, S. K., & Hallfors, D. D. (2008) · Multivariate Behavioral Research · doi:10.1080/00273170802034810 · Cited by 164
Kuukasjarvi, S. (2004) · Behavioral Ecology · doi:10.1093/beheco/arh050 · Cited by 165
“The degrees of freedom for the F tests were calculated by the method of Kenward and Roger (1997).”
MethodMechanisms of Pathogenesis, Infective Dose and Virulence in Human Parasites
Leggett, H. C., Cornwallis, C. K., & West, S. A. (2012) · PLoS Pathogens · doi:10.1371/journal.ppat.1002512 · Cited by 163
“Entamoeba histolytica Local 1 1 45 Ingestion Direct [4,9,50,51] Giardia lamblia Local 10 0 0.”
BackgroundMethodMoritz, S., Veckenstedt, R., Andreou, C., Bohn, F., Hottenrott, B., Leighton, L., Köther, U., Woodward, T. S., Treszl, A., Menon, M., et al. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2014.1038 · Cited by 163
FMRI group analysis combining effect estimates and their variances
Chen, G., Saad, Z. S., Nath, A. R., Beauchamp, M. S., & Cox, R. W. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.12.060 · Cited by 163
Vandecasteele, S. J., Peetermans, W. E., Merckx, R., & Van Eldere, J. (2001) · Journal of Bacteriology · doi:10.1128/jb.183.24.7094-7101.2001 · Cited by 164
“detailed by Kenward and Roger (15), were used to estimate all reported pairwise”
MethodCastañeda-Moya, E., Twilley, R. R., Rivera-Monroy, V. H., Zhang, K., Davis, S. E., & Ross, M. (2010) · Estuaries and Coasts · doi:10.1007/s12237-009-9242-0 · Cited by 164
Cold-blooded loneliness: Social exclusion leads to lower skin temperatures
IJzerman, H., Gallucci, M., Pouw, W. T. J. L., Weiβgerber, S. C., Van Doesum, N. J., & Williams, K. D. (2012) · Acta Psychologica · doi:10.1016/j.actpsy.2012.05.002 · Cited by 163
Sorensen, J. L., Haug, N. A., Delucchi, K. L., Gruber, V., Kletter, E., Batki, S. L., Tulsky, J. P., Barnett, P., & Hall, S. (2007) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2006.09.019 · Cited by 163
Nitrate leaching from organic arable crop rotations is mostly determined by autumn field management
Askegaard, M., Olesen, J. E., Rasmussen, I. A., & Kristensen, K. (2011) · Agriculture, Ecosystems & Environment · doi:10.1016/j.agee.2011.04.014 · Cited by 162
Janelsins, M. C., Heckler, C. E., Peppone, L. J., Ahles, T. A., Mohile, S. G., Mustian, K. M., Palesh, O., O’Mara, A. M., Minasian, L. M., Williams, A. M., et al. (2018) · Journal of Clinical Oncology · doi:10.1200/jco.2018.78.6624 · Cited by 160
“Estimation was performed using the restricted maximum likelihood method, and inferences were performed using the KenwardRoger procedure.(53) Marginal adjusted means were used to quantify the changes from A1 to A2 and A1 to A3 (in addition to means for each time) by group.”
MethodChanging value through cued approach: an automatic mechanism of behavior change
Schonberg, T., Bakkour, A., Hover, A. M., Mumford, J. A., Nagar, L., Perez, J., & Poldrack, R. A. (2014) · Nature Neuroscience · doi:10.1038/nn.3673 · Cited by 161
“P values for the effects in the mixed models were calculated using the Kenward-Rogers approximation for degrees-of-freedom 48 .”
Buprenorphine for the Treatment of the Neonatal Abstinence Syndrome
Kraft, W. K., Adeniyi-Jones, S. C., Chervoneva, I., Greenspan, J. S., Abatemarco, D., Kaltenbach, K., & Ehrlich, M. E. (2017) · New England Journal of Medicine · doi:10.1056/nejmoa1614835 · Cited by 162
Parametric modelling of growth curve data: An overview
Zimmerman, D. L., Núñez-Antón, V., Gregoire, T. G., Schabenberger, O., Hart, J. D., Kenward, M. G., Molenberghs, G., Verbeke, G., Pourahmadi, M., Vieu, P., et al. (2001) · Test · doi:10.1007/bf02595823 · Cited by 161
Self-citationA meta-analysis of fauna and flora species richness and abundance in plantations and pasture lands
Felton, A., Knight, E., Wood, J., Zammit, C., & Lindenmayer, D. (2010) · Biological Conservation · doi:10.1016/j.biocon.2009.11.030 · Cited by 160
Schwandt, M. L., Cortes, C. R., Kwako, L. E., George, D. T., Momenan, R., Sinha, R., Grigoriadis, D. E., Pich, E. M., Leggio, L., & Heilig, M. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2016.61 · Cited by 159
“The Kenward–Roger correction (Kenward and Roger, 1997) was used in all models, as the use of this correction is highly recommended in repeated-measures models with more complex covariance structures, especially when there is an unbalanced design (Littell et al, 2006).”
MethodFriedman, L., Glover, G. H., Krenz, D., & Magnotta, V. (2006) · NeuroImage · doi:10.1016/j.neuroimage.2006.03.062 · Cited by 158
Michal, J. J., Zhang, Z. W., Gaskins, C. T., & Jiang, Z. (2006) · Animal Genetics · doi:10.1111/j.1365-2052.2006.01464.x · Cited by 159
Yang, C., Guo, R., Jie, F., Nettleton, D., Peng, J., Carr, T., Yeakley, J. M., Fan, J.-B., & Whitham, S. A. (2007) · Molecular Plant-Microbe Interactions® · doi:10.1094/mpmi-20-4-0358 · Cited by 158
“The data then were analyzed by a mixed model (Chu et al. 2002; Wolfinger et al. 2001) that used the Kenward-Roger method to determine denominator degrees of freedom (Kenward and Roger 1997) (discussed below).”
Kwako, L. E., Spagnolo, P. A., Schwandt, M. L., Thorsell, A., George, D. T., Momenan, R., Rio, D. E., Huestis, M., Anizan, S., Concheiro, M., et al. (2015) · Neuropsychopharmacology · doi:10.1038/npp.2014.306 · Cited by 158
“The Kenward–Roger correction for denominator degrees of freedom (Kenward and Roger, 1997) was used in all models, as the use of this correction is highly recommended in repeated measures models with more complex covariance structures, especially when there is an unbalanced design (Littell, 2006).”
MethodTelford, R. M., Telford, R. D., Cochrane, T., Cunningham, R. B., OLIVE, L. S., & Davey, R. (2015) · Journal of science and medicine in sport · doi:10.1016/j.jsams.2015.04.008 · Cited by 209
Chung, Y.-H., Rico, D. E., Martínez, C. M., Cassidy, T. W., Noirot, V., Ames, A., & Varga, G. A. (2007) · Journal of Dairy Science · doi:10.3168/jds.2007-0426 · Cited by 155
“the Kenward-Roger option in the MODEL statement ( Kenward and Roger, 1997 ).”
MethodBayesian methods for the analysis of small sample multilevel data with a complex variance structure.
Baldwin, S. A., & Fellingham, G. W. (2013) · Psychological Methods · doi:10.1037/a0030642 · Cited by 155
Neural mechanisms tracking popularity in real-world social networks
Zerubavel, N., Bearman, P. S., Weber, J., & Ochsner, K. N. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1511477112 · Cited by 155
Bowles, T. M., Jackson, L. E., & Cavagnaro, T. R. (2017) · Global Change Biology · doi:10.1111/gcb.13884 · Cited by 172
de Moor, C., Sterner, J., Hall, M., Warneke, C., Gilani, Z., Amato, R., & Cohen, L. (2002) · Health Psychology · doi:10.1037//0278-6133.21.6.615 · Cited by 154
Structural equation modeling: building and evaluating causal models
Grace, J. B., Scheiner, S. M., & Schoolmaster, Jr. (2015) · Ecological Statistics · doi:10.1093/acprof:oso/9780199672547.003.0009 · Cited by 153
Archer, S. N., Viola, A. U., Kyriakopoulou, V., von Schantz, M., & Dijk, D.-J. (2008) · Sleep · doi:10.1093/sleep/31.5.608 · Cited by 153
Penson, R. T., Huang, H. Q., Wenzel, L. B., Monk, B. J., Stockman, S., Long, H. J., Ramondetta, L. M., Landrum, L. M., Oaknin, A., Reid, T. J. A., et al. (2015) · The Lancet Oncology · doi:10.1016/s1470-2045(15)70004-5 · Cited by 151
Mahajan, A., Currie, C., Mackie, S., Tree, J. J., McAteer, S. P., McKendrick, I. J., McNeilly, T. N., Roe, A. J., Ragione, R. M. L., Woodward, M. J., et al. (2008) · Cellular Microbiology · doi:10.1111/j.1462-5822.2008.01244.x · Cited by 186
Metadata
- Authors
- Kenward, M. G., & Roger, J. H.
- Affiliations
- University of Kent (GB)
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1997-09
- Volume
- 53
- Issue
- 3
- Pages
- 983
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1981747359
- Cited by
- 4,552
- References
- 23
- Citations by year
- 2026: 217 · 2025: 196 · 2024: 216 · 2023: 213 · 2022: 261 · 2021: 299 · 2020: 287 · 2019: 270 · 2018: 247 · 2017: 240 · 2016: 286 · 2015: 256 · 2014: 217 · 2013: 189 · 2012: 218
- FWCI
- 7.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Rothamsted Repository (Rothamsted Repository) (submittedVersion)
- Kent Academic Repository (University of Kent) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Mathematics › Applied Mathematics › Statistical and numerical algorithms
- Keywords
- restricted maximum likelihood, small sample inference, fixed effects, Wald statistic, covariance matrix estimation, small sample bias, Hotelling's T2 statistic, linear mixed models, linear Gaussian models
- MeSH terms
- Analysis of Variance, Biometry, Clinical Trials as Topic, Humans, Intermittent Claudication, Nitrogen Fixation, Plants, Probability, Regression Analysis, Research Design, Rhizobium, Soil Microbiology, Reproducibility of Results, Models, Statistical, Bias, Randomized Controlled Trials as Topic, Cross-Over Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.