Small Sample Inference for Fixed Effects from Restricted Maximum Likelihood
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Restricted maximum likelihood (REML) is now well established as a method for estimating the parameters of the general Gaussian linear model with a structured covariance matrix, in particular for mixed linear models. Conventionally, estimates of precision and inference for fixed effects are based on their asymptotic distribution, which is known to be inadequate for some small-sample problems. In this paper, we present a scaled Wald statistic, together with an F approximation to its sampling distribution, that is shown to perform well in a range of small sample settings. The statistic uses an adjusted estimator of the covariance matrix that has reduced small sample bias. This approach has the advantage that it reproduces both the statistics and F distributions in those settings where the latter is exact, namely for Hotelling T2 type statistics and for analysis of variance F-ratios. The performance of the modified statistics is assessed through simulation studies of four different REML analyses and the methods are illustrated using three examples.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Accurate model parameter estimations were ensured by use of the residual maximum likelihood approach with the Kenward and Roger, 1997 approximation of degrees of freedom.”
From Longitudinal association between social media use and psychological distress among adolescents (2020) · cites this paper as Kenward and Roger, 1997
In the citing paper
“Not only does the data in the motivating example have different flowering days for each genotype (see for example Fig. 2), but the proposed methodology also accounts for the different strata in the Wald test by approximating the denominator degrees of freedom (Kenward and Roger, 1997).”
From Incorporating environmental covariates to explore genotype × environment × management (G × E × M) interactions: A one-stage predictive model (2023) · cites this paper as Kenward and Roger, 1997
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Random-Effects Models for Longitudinal Data
Laird, N. M., & Ware, J. H. (1982) · Biometrics · doi:10.2307/2529876 · Cited by 8,923
Recovery of inter-block information when block sizes are unequal
PATTERSON, H. D., & THOMPSON, R. (1971) · Biometrika · doi:10.1093/biomet/58.3.545 · Cited by 4,058
Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems
Harville, D. A. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10480998 · Cited by 2,667 · cited 1×
“Restricted (or residual) maximum likelihood (REML) has become well established for the estimation of the parameters of Z (Patterson and Thompson, 1971; Harville, 1977; Thompson, 1980; Robinson, 1991) and the corresponding estimator of 3, 3 say, has a generalized least squares form that uses the REML estimate of Z.”
BackgroundThat BLUP is a Good Thing: The Estimation of Random Effects
Robinson, G. K. (1991) · Statistical Science · doi:10.1214/ss/1177011926 · Cited by 1,686
Gilmour, A. R., Thompson, R., & Cullis, B. R. (1995) · Biometrics · doi:10.2307/2533274 · Cited by 915
15 Design and Analysis of Cross-Over Trials
Kenward, M. G., & Jones, B. (2007) · Handbook of Statistics · doi:10.1016/s0169-7161(07)27015-4 · Cited by 871
Self-citationPrinciples of Multivariate Analysis
Ling, R. F. (1990) · Technometrics · doi:10.1080/00401706.1990.10484645 · Cited by 812
Satterthwaite, F. E. (1941) · Psychometrika · doi:10.1007/bf02288586 · Cited by 809
Approximations for Standard Errors of Estimators of Fixed and Random Effects in Mixed Linear Models
Kackar, R. N., & Harville, D. A. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477102 · Cited by 445
Cited by
Items 601–700 of 1,051
Devanand, D. P., Crocco, E., Forester, B. P., Husain, M. M., Lee, S., Vahia, I. V., Andrews, H., Simon-Pearson, L., Imran, N., Luca, L., et al. (2021) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2021.04.014 · Cited by 68
Environmental variation has stronger effects than plant genotype on competition among plant species
Johnson, M. T. J., Dinnage, R., Zhou, A. Y., & Hunter, M. D. (2008) · Journal of Ecology · doi:10.1111/j.1365-2745.2008.01410.x · Cited by 65
“were adjusted according to Kenward & Roger (1997) .”
MethodKarumendu, L. U., van de Ven, R., Kerr, M. J., Lanza, M., & Hopkins, D. L. (2009) · Meat Science · doi:10.1016/j.meatsci.2009.02.012 · Cited by 61
Rychtarik, R. G., & McGillicuddy, N. B. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.2.249 · Cited by 61
“The Kenward and Rodgers (1997) method was used to provide estimated standard errors and associated F and t values.”
MethodWinkens, B., van Breukelen, G., Schouten, H. J. A., & Berger, M. P. F. (2007) · Contemporary Clinical Trials · doi:10.1016/j.cct.2007.04.002 · Cited by 69
An Overview of Current Software Procedures for Fitting Linear Mixed Models
West, B. T., & Gałecki, A. T. (2011) · The American Statistician · doi:10.1198/tas.2011.11077 · Cited by 64
“For instance, Satterthwaite and Kenward-Roger DF approximations (Kenward and Roger 1997) are computed by PROC MIXED and PROC GLIMMIX in SAS.”
MethodValidation of Software Gating: A Practical Technology for Respiratory Motion Correction in PET
Kesner, A. L., Chung, J. H., Lind, K. E., Kwak, J. J., Lynch, D., Burckhardt, D., & Koo, P. J. (2016) · Radiology · doi:10.1148/radiol.2016152105 · Cited by 61
Maclagan, S. J., Coates, T., & Ritchie, E. G. (2018) · Biological Conservation · doi:10.1016/j.biocon.2018.04.022 · Cited by 72
“Denominator degrees of freedom for the fixed effects were estimated using the Kenward-Roger method (which yields non-integer values) (Kenward and Roger, 1997).”
MethodLamina-specific cortical dynamics in human visual and sensorimotor cortices
Bonaiuto, J. J., Meyer, S. S., Little, S., Rossiter, H., Callaghan, M. F., Dick, F., Barnes, G. R., & Bestmann, S. (2018) · eLife · doi:10.7554/elife.33977 · Cited by 61
Hopkins, J. B., & Ferguson, J. M. (2012) · PLoS ONE · doi:10.1371/annotation/d222580b-4f36-4403-bb1f-cfd449a5ed74 · Cited by 61
Tutorial on Biostatistics: Longitudinal Analysis of Correlated Continuous Eye Data
Ying, G., Maguire, M. G., Glynn, R. J., & ROSNER, B. A. (2020) · Ophthalmic Epidemiology · doi:10.1080/09286586.2020.1786590 · Cited by 60
“…effects models and mixed effects models, we used the DDFM = KR option to calculate the degrees of freedom for testing fixed effects as detailed by Kenward and Roger (1997).9 A simulation study by Schaalje et al. found that the KR method works reasonably well with various covariance structures…”
MethodEffect of Brief Interpersonal Therapy on Depression During Pregnancy: A Randomized Clinical Trial
Hankin, B. L., Demers, C. H., Hennessey, E. P., Perzow, S. E. D., Curran, M. C., Gallop, R., Hoffman, M. C., & Davis, E. P. (2023) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2023.0702 · Cited by 78
Temporal horizon: Modulation by smoking status and gender
Jones, B. A., Landes, R. D., Yi, R., & Bickel, W. K. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2009.04.001 · Cited by 61
Maire, M., Reichert, C., Gabel, V., Viola, A., Strobel, W. M., Krebs, J., Landolt, H., Bachmann, V., Cajochen, C., & Schmidt, C. (2013) · Cortex · doi:10.1016/j.cortex.2013.11.008 · Cited by 69
“All variables were analyzed withmixed-model repeatedmeasures analysis of variance (ANOVA) (ProcMixed) and p values were based on Kenward-Roger’s corrected degrees of freedom (Kenward & Roger, 1997).”
MethodKarnik, M. S., Wang, L., Barch, D. M., Harms, M. P., Campanella, C., & Csernansky, J. G. (2012) · Schizophrenia Research · doi:10.1016/j.schres.2012.03.015 · Cited by 66
“In all mixed model analyses the two different sibling pairs were allowed to be heterogeneous in their covariance structure, and the degrees of freedom calculation used the method of Kenward and Roger (1997).”
MethodLocal adaptation at fine spatial scales: an example from sugar pine (Pinus lambertiana, Pinaceae)
Eckert, A. J., Maloney, P. E., Vogler, D. R., Jensen, C. E., Mix, A. D., & Neale, D. B. (2015) · Tree Genetics & Genomes · doi:10.1007/s11295-015-0863-0 · Cited by 71
“Statistical significance of fixed effects was determined using type III Wald F tests with Kenward-Roger degrees of freedom (Kenward and Roger 1997) as employed in the Anova function from the car package in R.”
MethodZhang, H., Zhang, K., Zhang, X., Zhu, Z., Yan, S., Sun, T., Guo, A., Jones, J., Steen, R. G., Shan, B., et al. (2015) · Arthritis Research & Therapy · doi:10.1186/s13075-015-0557-x · Cited by 67
“Subject baseline assessment, study site, treatment, visit, and treatment-by-visit interactions were fixed effects, patients were the random effect, and degrees of freedom were calculated by an established method [27].”
MethodSwan, C. M., Healey, B., & Richardson, D. C. (2008) · Ecoscience · doi:10.2980/1195-6860(2008)15[27:tronrt]2.0.co;2 · Cited by 70
“For all analyses, we chose the Kenward–Roger adjustment to denominator degrees of freedom in SAS, based on calculations by Kenward and Roger (1997).”
MethodWatkins, P. J., Rose, G., Salvatore, L., Allen, D., Tucman, D., Warner, R. D., Dunshea, F. R., & Pethick, D. W. (2010) · Meat Science · doi:10.1016/j.meatsci.2010.04.009 · Cited by 60
Avian defensive behavior and blood-feeding success of the West Nile vector mosquito, Culex pipiens
Darbro, J. M., & Harrington, L. C. (2007) · Behavioral Ecology · doi:10.1093/beheco/arm043 · Cited by 67
“We calculated degrees of freedom (df) using the Kenwood‐ Rogers method ( Kenwood and Roger 1997 ).”
MethodIdentification of Adult Stem Cells in Schwalbe's Line Region of the Primate Eye
Braunger, B. M., Ademoglu, B., Koschade, S. E., Fuchshofer, R., Gabelt, B. T., Kiland, J. A., Hennes, E. A., Brunner, K. G., Kaufman, P. L., & Tamm, E. R. (2014) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.14-14872 · Cited by 60
Scherner, A., Melander, B., & Kudsk, P. (2016) · Soil and Tillage Research · doi:10.1016/j.still.2016.04.005 · Cited by 70
A New Look at the Longitudinal Relationship Between Motor Carrier Financial Performance and Safety
Miller, J. W., & Saldanha, J. P. (2016) · Journal of Business Logistics · doi:10.1111/jbl.12134 · Cited by 64
Castro, D. C., Gillanders, C., Franco, X., Bryant, D., Zepeda, M., Willoughby, M. T., & Méndez, L. I. (2017) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2017.03.002 · Cited by 81
Debes, P. V., Gross, R., & Vasemägi, A. (2017) · The American Naturalist · doi:10.1086/692536 · Cited by 60
“Then we tested fixed terms, using a backward selection strategy based on conditional F-tests with denominator degrees of freedom approximated according to Kenward and Roger (1997).”
MethodCross-continental importance of CH4 emissions from dry inland-waters
Paranaíba, J. R., Aben, R., Barros, N. O., Quadra, G. R., Linkhorst, A., Amado, A. M., Brothers, S. M., Catalán, N., Condon, J., Finlayson, C. M., et al. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.151925 · Cited by 62
Gan, Y., Campbell, C. A., Janzen, H. H., Lemke, R., Basnyat, P., & McDonald, C. L. (2010) · Plant and Soil · doi:10.1007/s11104-010-0312-7 · Cited by 71
“Statistical analysis Data were analyzed using the MIXED model of SAS (Littell et al. 1996) with Kenward-Roger degree of freedom option being employed because this option uses an adjusted estimator of the covariance matrix to reduce small sample bias (Kenward and Roger 1997).”
MethodJezierny, D., Mosenthin, R., Sauer, N., Roth, S., Piepho, H., Rademacher, M., & Eklund, M. (2011) · Livestock Science · doi:10.1016/j.livsci.2010.12.024 · Cited by 76
“SBM, Soybean meal (490 g kg–1 CP as-fed). a White flowered cultivar. b Coloured flowered cultivar. c L. angustifolius. d L. luteus. within species were performed using a t-test with degrees of freedomdetermined by the Kenward–Rogermethod (Kenward and Roger, 1997).”
MethodLehouck, V., Spanhove, T., Colson, L., Adringa‐Davis, A., Cordeiro, N. J., & Lens, L. (2009) · Oikos · doi:10.1111/j.1600-0706.2009.17300.x · Cited by 81
“Fixed effects were tested by F-tests (PROC MIXED) or Wald-type tests (PROC GLIMMIX), adjusting the denominator degrees of freedom by Satterthwaite’s formula after computation of an inflation factor to balance the data (Kenward and Roger 1997).”
MethodThe effect of quitting smoking on HDL-cholesterol - a review based on within-subject changes
Forey, B. A., Fry, J. S., Lee, P. N., Thornton, A. J., & Coombs, K. J. (2013) · Biomarker Research · doi:10.1186/2050-7771-1-26 · Cited by 60
“For changes in HDL-C, unweighted and inversevariance weighted means and SEs were estimated using repeated measures analysis of variance, accounting for serial correlations between changes at different times within the same group of subjects by the KenwardRoger method [9,10].”
MethodHublet, A., Schmid, H., Clays, E., Godeau, E., Gabhainn, S. N., Joossens, L., & Maes, L. (2009) · Addiction · doi:10.1111/j.1360-0443.2009.02686.x · Cited by 72
“The Kenward–Roger method [38] was used to compute the degrees of freedom for the tests of fixed effects, as it adjusts for any bias in fixed-effects standard errors.”
Integrated Tactics for Managing the Mexican Rice Borer (Lepidoptera: Crambidae) in Sugarcane
Reay‐Jones, F. P. F., Showler, A. T., Reagan, T. E., Legendre, B. L., Way, M. O., & Moser, E. B. (2005) · Environmental Entomology · doi:10.1603/0046-225x-34.6.1558 · Cited by 59
“The Kenward-Roger method (Kenward and Roger 1997) was used to compute denominator degrees of freedom for the test of Þxed effects for all variables.”
MethodBelury, M. A., Cole, R. M., Bailey, B. E., Ke, J., Andridge, R., & Kiecolt‐Glaser, J. K. (2016) · Molecular Nutrition & Food Research · doi:10.1002/mnfr.201500744 · Cited by 63
“The Kenward-Roger degrees of freedom adjustment was used to control type I error in these models [18].”
Park, E., Edirisinghe, I., & Burton‐Freeman, B. M. (2018) · Nutrients · doi:10.3390/nu10091287 · Cited by 74
Applied Mixed Model Analysis: A Practical Guide
Twisk, J. W. R. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108635660 · Cited by 95
Sørensen, J. G., White, C. R., Duffy, G. A., & Chown, S. L. (2018) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2018.1775 · Cited by 58
“The 171 significance of fixed effects was tested using Wald-type F-tests with conditional sums of squares and 172 denominator degrees of freedom calculated according to Kenward and Roger (67).”
MethodLegacy effects of leguminous green manure crops on the weed seed bank in organic crop rotations
Melander, B., Rasmussen, I. A., & Olesen, J. E. (2020) · Agriculture Ecosystems & Environment · doi:10.1016/j.agee.2020.107078 · Cited by 58
Conservation agriculture improves adaptive capacity of cropping systems to climate stress in Malawi
Komarek, A. M., Thierfelder, C., & Steward, P. (2021) · Agricultural Systems · doi:10.1016/j.agsy.2021.103117 · Cited by 68
Green investments and their impact on ESG ratings: An evidence from China
Cao, M., Duan, K., & Ibrahim, H. (2023) · Economics Letters · doi:10.1016/j.econlet.2023.111365 · Cited by 58
Spatiotemporal Models for Region of Interest Analyses of Functional Neuroimaging Data
Bowman, F. D. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001347 · Cited by 58
“In our application, we define the denominator degrees of freedom using the Kenward–Roger method, which is specifically designated for small-sample applications (Kenward and Roger 1997).”
MethodSørensen, C. K., Hovmøller, M. S., Leconte, M., Dedryver, F., & de Vallavieille-Pope, C. (2014) · Phytopathology · doi:10.1094/phyto-12-13-0337-r · Cited by 58
“Tests were performed using F tests with the denominator according to the theory of mixed models, and degrees of freedom were calculated for the denominator using the principles of Kenward-Rogers (28).”
MethodGifford, M. E., Clay, T. A., & Careau, V. (2014) · Physiological and Biochemical Zoology · doi:10.1086/675974 · Cited by 62
Vestberg, M. V., Saari, K., Kukkonen, S. T., & Hurme, T. (2005) · Mycorrhiza · doi:10.1007/s00572-005-0349-2 · Cited by 58
“For all the models mentioned above, REML was used as an estimation method and degrees of freedom were calculated by the Kenward-Roger method (Kenward and Roger 1997).”
MethodStaggs, V. S., & Dunton, N. E. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.03.009 · Cited by 72
Over a Decade of Change in Spatial and Temporal Dynamics of Hawaiian Coral Reef Communities
Rodgers, K. S., Jokiel, P. L., Brown, E. K., Hau, S., & Sparks, R. (2015) · Pacific Science · doi:10.2984/69.1.1 · Cited by 78
Developmental Programming Mediated by Complementary Roles of Imprinted Grb10 in Mother and Pup
Cowley, M., Garfield, A. S., Madon-Simon, M., Charalambous, M., Clarkson, R. W. E., Smalley, M. J., Kendrick, H. D., Isles, A. R., Parry, A., Carney, S., et al. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001799 · Cited by 65
“Degrees of freedom were determined using the Kenward-Roger Degrees of Freedom Approximation [43], which, in this model, effectively corrects the denominator degrees of freedom for the random effects to avoid pseudoreplication when using replicates sampled from the same litters.”
MethodMcNeil, M., Bhuiyan, S. A., Berkman, P. J., Croft, B. J., & Aitken, K. S. (2018) · PLoS ONE · doi:10.1371/journal.pone.0197840 · Cited by 65
Essential Ingredients and Innovations in the Design and Analysis of Group-Randomized Trials
Murray, D. M., Taljaard, M., Turner, E. L., & George, S. M. (2019) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040119-094027 · Cited by 63
“correct model that accounts for all relevant fixed and random effects (105); another is choosing an appropriate method for calculating the degrees of freedom for testing the intervention effect, especially when the number of groups is small (82, 127).”
MethodAquaponic and Hydroponic Solutions Modulate NaCl-Induced Stress in Drug-Type Cannabis sativa L.
Yep, B., Gale, N. V., & Zheng, Y. (2020) · Frontiers in Plant Science · doi:10.3389/fpls.2020.01169 · Cited by 64
“The denominator degrees of freedom in these analyses were adjusted using the Kackar-Harville correction (Kackar and Harville, 1984; Kenward and Roger, 1997).”
MethodSpilke, J., Piepho, H., & Hu, X. (2005) · Journal of Agricultural Biological and Environmental Statistics · doi:10.1198/108571105x58199 · Cited by 58
“The latter fact is exploited in approaches for approximating the degrees of freedom (Fai and Cornelius 1996; Kenward and Roger 1997 ).”
BackgroundMethodInfluentialWenker, M. L., van Reenen, C. G., Bokkers, E. A. M., McCrea, K., de Oliveira, D., Sørheim, K., Cao, Y., Bruckmaier, R. M., Gross, J. J., Gort, G., et al. (2022) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2022.105694 · Cited by 65
Practical Inference from Industrial Split-Plot Designs
Goos, P., Langhans, I., & Vandebroek, M. (2006) · Journal of Quality Technology · doi:10.1080/00224065.2006.11918603 · Cited by 57
“Finally, the method of Kenward and Roger (1997) is not just another way of determining the denominator degrees of freedom, as it involves inflating the estimated covariance matrix of the parameter estimators in Equation (5) to take into account the fact that the variance components, u~ and u;, and thus”
MethodRisk factors associated with health disorders in sport and leisure horses in the Netherlands1
Visser, E. K., Neijenhuis, F., de Graaf‐Roelfsema, E., Hg, W., de Boer, J., van Wijhe-Kiezebrink, M. C., ENGEL, B., & van Reenen, C. G. (2013) · Journal of Animal Science · doi:10.2527/jas.2013-6692 · Cited by 57
“First, each potential risk factor was introduced as a single explanatory factor in a GLMM. Risk factors with a P -value below 0.15 from the F-test (Kenward and Roger, 1997) were considered for further multivariate analysis.”
InfluentialGrowth and wood basic density of acacia hybrid clones at three locations in Vietnam
Kha, L. D., Harwood, C. E., Kien, N. D., Baltunis, B. S., Hai, N. D., & Thinh, H. H. (2011) · New Forests · doi:10.1007/s11056-011-9263-y · Cited by 57
Individual and Sex Differences in Habituation and Neophobia in House Sparrows ( P asser domesticus )
Ensminger, A. L., & Westneat, D. F. (2012) · Ethology · doi:10.1111/eth.12009 · Cited by 74
The perpetual forest: using undesirable species to bridge restoration
Kirkman, L. K., Mitchell, R. J., Kaeser, M. J., Pecot, S. D., & COFFEY, K. L. (2007) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2007.01310.x · Cited by 65
Fine-scale disturbances shape space-use patterns of a boreal forest herbivore
Hodson, J., Fortin, D., & Bélanger, L. (2010) · Journal of Mammalogy · doi:10.1644/09-mamm-a-289.1 · Cited by 68
“We used the Kenward–Roger method (Kenward and Roger 1997) to calculate denominator degrees of freedom for the fixed effects because the number of branch pairs within gaps varied according to gap size, thereby creating an unbalanced design.”
MethodGeographic variation in floral morphology and style‐morph ratios in a sexually polymorphic daffodil
Hodgins, K. A., & Barrett, S. C. H. (2008) · American Journal of Botany · doi:10.3732/ajb.95.2.185 · Cited by 57
Seeking advice: A sampling approach to advice taking
Hütter, M., & Ache, F. (2016) · Judgment and Decision Making · doi:10.1017/s193029750000382x · Cited by 66
“Degrees of freedom are based on the Kenward-Roger approximation (Kenward & Roger, 1997).”
MethodBelowground biota responses to maize biochar addition to the soil of a Mediterranean vineyard
Andrés, P., Rosell-Melé, A., Colomer-Ventura, F., Denef, K., Cotrufo, M. F., Riba, M., & Alcañiz, J. M. (2019) · Science of The Total Environment · doi:10.1016/j.scitotenv.2019.01.101 · Cited by 57
Cederqvist, S., Flinkkilä, T. E., Sormaala, M. J., YLINEN, J. J., Kautiainen, H., Irmola, T., Lehtokangas, H., Liukkonen, J., Pamilo, K., Ridanpää, T., et al. (2020) · Annals of the Rheumatic Diseases · doi:10.1136/annrheumdis-2020-219099 · Cited by 73
Long-Term Exposure to Tamoxifen Induces Hypersensitivity to Estradiol
Berstein, L. M., Wang, J., Zheng, H., Yue, W., Conaway, M. R., & Santen, R. J. (2004) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-0433-03 · Cited by 57
“Tests for statistical significance were carried out using F-tests based on the Kenward-Roger (1997) approximation (9).”
MethodRandomized controlled trial of the “WISER” intervention to reduce healthcare worker burnout
Profit, J., Adair, K. C., Cui, X., Mitchell, B., Brandon, D., Tawfik, D. S., Rigdon, J., Gould, J. B., Lee, H. C., Timpson, W. L., et al. (2021) · Journal of Perinatology · doi:10.1038/s41372-021-01100-y · Cited by 56
Land Improvements under Land Tenure Insecurity: The Case of pH and Phosphate in Finland
Myyrä, S., Ketoja, E., Yli‐Halla, M., & Pietola, K. (2005) · Land Economics · doi:10.3368/le.81.4.557 · Cited by 58
“The method described by Kenward and Roger (1997) was used to calculate degrees of freedom.”
MethodReeves, R. B., Greene, J. K., Reay‐Jones, F. P. F., Toews, M. D., & Gerard, P. D. (2010) · Environmental Entomology · doi:10.1603/en09194 · Cited by 56
“The procedure PROC MIXED (SAS Institute 2004), with degree of freedom adjustments following the Kenward-Roger method (Kenward and Roger 1997), was used to model the relationship of distance from Þeld margin (0, 5, 10, and 25 m), adjacent crop/habitat (cotton, corn, soybean, and woods), and…”
MethodYoung Adolescents’ Responses to Positive Events: Associations With Positive Affect and Adjustment
Gentzler, A. L., Morey, J. N., Palmer, C. A., & Yi, C. Y. (2012) · The Journal of Early Adolescence · doi:10.1177/0272431612462629 · Cited by 73
“Langston (1994) noted a similar pattern in his studies where capitalizing predicted greater positive affect but not less negative affect.”
ResultJohnson, M. T. J. (2006) · Journal of Evolutionary Biology · doi:10.1111/j.1420-9101.2006.01201.x · Cited by 56
“I treated habitat as a fixed effect and determined its significance using weighted least-squares parameter estimation, with the degrees of freedom calculated by the Kenward–Roger method (Kenward & Roger, 1997); all other effects in the model were random.”
BackgroundMethodInfluentialSchram, E., Roques, J. A. C., van Kuijk, T., Abbink, W., van der Heul, J. W., de Vries, P., Bierman, S. M., van de Vis, H., & Flik, G. (2013) · Aquaculture · doi:10.1016/j.aquaculture.2013.10.027 · Cited by 59
The two ribosomal proteinL23Agenes are differentially transcribed inArabidopsis thaliana
McIntosh, K. B., & Bonham‐Smith, P. C. (2005) · Genome · doi:10.1139/g05-007 · Cited by 57
Garcia, M., Greco, L. F., Favoreto, M. G., Marsola, R. S., Wang, D., Shin, J., Block, E., Thatcher, W. W., Santos, J. E. P., & Staples, C. R. (2014) · Journal of Dairy Science · doi:10.3168/jds.2013-7473 · Cited by 69
“The denominator degrees of freedom were computed using the approximation described by Kenward and Roger (1997), using the following model: Yijklm = μ + Di + Mj + Gk + C(ijk)l + (DM)ij + (DG)ik + (MG)jk + (DMG)ijk + Am + DAim + MAjm + GAkm + DMAijm + DGAikm + MGAjkm + DMGAijkm + εijklm, where Yijklm…”
MethodWebb, S. L., Riffell, S. K., Gee, K. L., & Demarais, S. (2009) · Journal of Mammalogy · doi:10.1644/08-mamm-a-278.1 · Cited by 56
Potential of GLMM in modelling invasive spread.
Thiele, J., & Markussen, B. (2012) · CABI Reviews · doi:10.1079/pavsnnr20127016 · Cited by 80
Brien, C. J., Berger, B., Rabie, H. S., & Tester, M. A. (2013) · Plant Methods · doi:10.1186/1746-4811-9-5 · Cited by 67
“Tests for fixed effects were carried out using F-tests with Kenward-Roger adjustments [26].”
Coyle, D. R., Aubrey, D. P., & Coleman, M. D. (2015) · Forest Ecology and Management · doi:10.1016/j.foreco.2015.11.047 · Cited by 59
Experimental design and statistical analyses of fish growth studies
Thorarensen, H., Kubiriza, G. K., & Imsland, A. K. D. (2015) · Aquaculture · doi:10.1016/j.aquaculture.2015.05.018 · Cited by 55
“…methods for mixed model analysis have developed rapidly and now many 92 software packages such as SAS (SAS Institute Inc., Cary, NC, USA) and R (R Core Team 93 2014) offer the possibility of linear mixed models with the Kenward-Roger modification of F-94 tests (Kenward and Roger, 1997, 2009).”
MethodGenomic selection for lentil breeding: Empirical evidence
Haile, T. A., Heidecker, T., Wright, D. M., Neupane, S., Ramsay, L., Vandenberg, A., & Bett, K. E. (2020) · The Plant Genome · doi:10.1002/tpg2.20002 · Cited by 71
“The Kenward-Roger degrees of freedom approximation method was used to compute the degrees of freedom for means (Kenward and Roger 1997).”
MethodTafaj, M., Junck, B., Maulbetsch, A., Steingaß, H., Piepho, H., & Drochner, W. (2004) · Archives of Animal Nutrition · doi:10.1080/00039420412331273259 · Cited by 56
“The variance-covariance structure to model the dependence among repeated measures: UN AR(1) – unstructured and autoregressive, UN CS – unstructured and compound structured (Kenward and Roger, 1997).”
BackgroundMethodInfluentialReporting Practice in Multilevel Modeling: A Revisit After 10 Years
Luo, W., Li, H., Baek, E., Chen, S., Lam, K. H., & Semma, B. (2021) · Review of Educational Research · doi:10.3102/0034654321991229 · Cited by 76
“When the number of clusters is very small (e.g., less than 10), REML with a Kenward-Roger adjustment (Kenward & Roger, 1997) is able to produce accurate standard error estimates for any fixed-effect estimates (Baldwin & Fellingham, 2013; Bell et al., 2014; McNeish & Stapleton, 2016).”
MethodBiomarker correlates with response to NY-ESO-1 TCR T cells in patients with synovial sarcoma
Gyurdieva, A. V., Zajic, S. C., Chang, Y.-F., Houseman, E. A., Zhong, S., Kim, J., Nathenson, M. J., Faitg, T. H., Woessner, M. A., Turner, D. C., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-32491-x · Cited by 59
Huntington’s disease cerebrospinal fluid seeds aggregation of mutant huntingtin
Tan, Z., Dai, W., van Erp, T. G. M., Overman, J., Demuro, A., Digman, M. A., Hatami, A., Albay, R., Sontag, E. M., Potkin, K. T., et al. (2015) · Molecular Psychiatry · doi:10.1038/mp.2015.81 · Cited by 55
Piepho, H.-P. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-61 · Cited by 55
“computed by Kenward-Roger method [17].”
Wang, C., Liu, Q., Yang, W. Z., Huo, W., Dong, K. H., Huang, Y., Yang, X. M., & He, D. C. (2008) · Animal Feed Science and Technology · doi:10.1016/j.anifeedsci.2008.10.009 · Cited by 55
Judson, M. C., Eagleson, K. L., Wang, L., & Levitt, P. (2010) · Journal of Comparative Neurology · doi:10.1002/cne.22467 · Cited by 55
Floral traits mediate the vulnerability of aloes to pollen theft and inefficient pollination by bees
Hargreaves, A. L., Harder, L. D., & Johnson, S. D. (2012) · Annals of Botany · doi:10.1093/aob/mcr324 · Cited by 55
Reisig, D., & Reay‐Jones, F. P. F. (2015) · Environmental Entomology · doi:10.1093/ee/nvv076 · Cited by 64
“Denominator degrees of freedom were calculated following the methods of Kenward and Roger (1997).”
MethodDo Pasture-Scale Nutritional Patterns Affect Cattle Distribution on Rangelands?
Ganskopp, D., & Bohnert, D. (2006) · Rangeland Ecology & Management · doi:10.2111/04-152r1.1 · Cited by 55
Ward, E. C., & Brown, R. L. (2015) · American Journal of Orthopsychiatry · doi:10.1037/ort0000027 · Cited by 54
Videlier, M., Rundle, H. D., & Careau, V. (2019) · The American Naturalist · doi:10.1086/705678 · Cited by 60
“Fixed effects were tested using a conditional Wald F statistic, and the denominator degrees of freedom were determined following Kenward and Roger (1997).”
MethodIndividuals Prioritize the Reach Straightness and Hand Jerk of a Shared Avatar over Their Own
Hagiwara, T., Ganesh, G., Sugimoto, M., İnami, M., & Kitazaki, M. (2020) · iScience · doi:10.1016/j.isci.2020.101732 · Cited by 64
Kiecolt-Glaser, J. K., Fagundes, C. P., Andridge, R., Peng, J., Malarkey, W. B., Habash, D., & Belury, M. A. (2017) · Molecular Psychiatry · doi:10.1038/mp.2016.149 · Cited by 54
“The Kenward-Roger adjustment to the degrees of freedom was used to control type I error (51).”
MethodSandhu, A. K., Huang, Y., Xiao, D., Park, E., Edirisinghe, I., & Burton‐Freeman, B. M. (2016) · Journal of Agricultural and Food Chemistry · doi:10.1021/acs.jafc.6b00805 · Cited by 62
Jewkes, R. K., Gevers, A., Chirwa, E. D., Mahlangu, P., Shamu, S., Shai, N., & Lombard, C. J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0223562 · Cited by 65
Johnson, C. R., Barto, L., Worley, S., Rothstein, R., & Alder, M. L. (2023) · Sleep Medicine · doi:10.1016/j.sleep.2023.08.033 · Cited by 58
Cowan, J. S., Miles, C. A., Andrews, P. K., & Inglis, D. A. (2013) · Journal of the Science of Food and Agriculture · doi:10.1002/jsfa.6504 · Cited by 54
Johnson, M. T. J., & Agrawal, A. A. (2007) · Oikos · doi:10.1111/j.0030-1299.2007.15773.x · Cited by 54
“The significance of habitat was assessed with least-squares estimation and the Fstatistic , and the degrees of freedom were adjusted according to the Kenward-Roger method (Kenward and Roger 1997).”
MethodMaulfair, D. D., Zanton, G. I., Fustini, M., & Heinrichs, A. J. (2010) · Journal of Dairy Science · doi:10.3168/jds.2010-3278 · Cited by 67
“denominator degrees of freedom for F-tests were calculated according to Kenward and Roger (1997), and repeated measurements for rumen samples and refusal particle size, NDF, and starch were analyzed using the first-order autoregressive covariance structure (Littell et al.”
MethodNemec, K. T., Allen, C. R., Helzer, C. J., & Wedin, D. A. (2013) · Ecological Restoration · doi:10.3368/er.31.2.168 · Cited by 55
The efficacy of a relationship building intervention in 5th grade
Miller, C. F., Kochel, K. P., Wheeler, L. A., Updegraff, K. A., Fabes, R. A., Martin, C. L., & Hanish, L. D. (2017) · Journal of School Psychology · doi:10.1016/j.jsp.2017.01.002 · Cited by 54
Sheridan, S. M., Witte, A. L., Holmes, S. R., Wu, C., Bhatia, S. A., & Angell, S. R. (2017) · Journal of School Psychology · doi:10.1016/j.jsp.2017.03.005 · Cited by 64
Lucas, F. M., Pennell, M. L., Huang, Y., Benson, D. M., Efebera, Y. A., Chaudhry, M., Hughes, T. L., Woyach, J. A., Byrd, J. C., Zhang, S., et al. (2019) · Transplantation and Cellular Therapy · doi:10.1016/j.bbmt.2019.08.009 · Cited by 60
“The Kenward-Roger method was used to compute degrees of freedom for these tests [22].”
Method
Metadata
- Authors
- Kenward, M. G., & Roger, J. H.
- Affiliations
- University of Kent (GB)
- Venue
- Biometrics
- Publisher
- JSTOR
- Published
- 1997-09
- Volume
- 53
- Issue
- 3
- Pages
- 983
- ISSN
- 0006-341X (ISSN-L)
- OpenAlex
- W1981747359
- Cited by
- 4,552
- References
- 23
- Citations by year
- 2026: 217 · 2025: 196 · 2024: 216 · 2023: 213 · 2022: 261 · 2021: 299 · 2020: 287 · 2019: 270 · 2018: 247 · 2017: 240 · 2016: 286 · 2015: 256 · 2014: 217 · 2013: 189 · 2012: 218
- FWCI
- 7.02
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Biometrics (publishedVersion)
- PubMed (publishedVersion)
- Rothamsted Repository (Rothamsted Repository) (submittedVersion)
- Kent Academic Repository (University of Kent) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Statistical Methods and Models
- Physical Sciences › Mathematics › Applied Mathematics › Statistical and numerical algorithms
- Keywords
- restricted maximum likelihood, small sample inference, fixed effects, Wald statistic, covariance matrix estimation, small sample bias, Hotelling's T2 statistic, linear mixed models, linear Gaussian models
- MeSH terms
- Analysis of Variance, Biometry, Clinical Trials as Topic, Humans, Intermittent Claudication, Nitrogen Fixation, Plants, Probability, Regression Analysis, Research Design, Rhizobium, Soil Microbiology, Reproducibility of Results, Models, Statistical, Bias, Randomized Controlled Trials as Topic, Cross-Over Studies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.