Restricted maximum likelihood estimation of covariances in sparse linear models
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
This paper surveys the theoretical and computational development of the restricted maximum likelihood (REML) approach for the estimation of covariance matrices in linear stochastic models. A new derivation of this approach is given, valid under very weak conditions on the noise. Then the calculation of the gradient of restricted loglikelihood functions is dis- cussed, with special emphasis on the case of large and sparse model equations with a large number of unknown covariance components and possibly incomplete data. It turns out that the gradient calculations require hardly any extra storage, and only a small multiple of the number of operations needed to calculate the function values alone. The analytic gradient procedure was integrated into the VCE package for co- variance component estimation in large animal breeding models. It resulted in dramatic improvements of performance over the previous implementation with finite difference gradients. An example with more than 250 000 normal equations and 55 covariance components took hours instead of days of CPU time, and this was not an untypical case.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
A Simplex Method for Function Minimization
Nelder, J. A., & Mead, R. (1965) · The Computer Journal · doi:10.1093/comjnl/7.4.308 · Cited by 28,905
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Recovery of inter-block information when block sizes are unequal
PATTERSON, H. D., & THOMPSON, R. (1971) · Biometrika · doi:10.1093/biomet/58.3.545 · Cited by 4,058
Maximum Likelihood Approaches to Variance Component Estimation and to Related Problems
Harville, D. A. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10480998 · Cited by 2,667 · cited 14×
“During recent years restricted maximum likelihood (REML) [22, 42] has emerged as the method of choice in animal breeding for vari-”
InfluentialApplications of linear models in animal breeding
Henderson, C. R. (1984) · University of Guelph eBooks · Cited by 1,646
Direct Methods for Sparse Matrices
Duff, I. S., Erisman, A. M., & Reid, J. K. (2017) · doi:10.1093/acprof:oso/9780198508380.001.0001 · Cited by 1,604
Unbalanced Repeated-Measures Models with Structured Covariance Matrices
Jennrich, R. I., & Schluchter, M. D. (1986) · Biometrics · doi:10.2307/2530695 · Cited by 1,325
Rubin, D. B. (1976) · Biometrika · doi:10.2307/2335739 · Cited by 885
Newton—Raphson and EM Algorithms for Linear Mixed-Effects Models for Repeated-Measures Data
Lindstrom, M. J., & Bates, D. M. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478693 · Cited by 862
Restricted Maximum Likelihood (REML) Estimation of Variance Components in the Mixed Model
Corbeil, R. R., & Searle, S. R. (1976) · Technometrics · doi:10.2307/1267913 · Cited by 471
Meyer, K. (1989) · Genetics Selection Evolution · doi:10.1051/gse:19890308 · Cited by 419
Graser, H.-U., Smith, S. P., & Tier, B. (1987) · Journal of Animal Science · doi:10.2527/jas1987.6451362x · Cited by 354
Johnson, D. L., & Thompson, R. (1995) · Journal of Dairy Science · doi:10.3168/jds.s0022-0302(95)76654-1 · Cited by 341
Algorithm 611: Subroutines for Unconstrained Minimization Using a Model/Trust-Region Approach
Gay, D. M. (1983) · ACM Transactions on Mathematical Software · doi:10.1145/356056.356066 · Cited by 322
Estimation of genetic parameters.
Thompson, R. (2005) · Linear models for the prediction of animal breeding values · doi:10.1079/9780851990002.0235 · Cited by 300
Estimating variances and covariances for multivariate animal models by restricted maximum likelihood
Meyer, K. (1991) · Genetics Selection Evolution · doi:10.1186/1297-9686-23-1-67 · Cited by 239
Block Sparse Cholesky Algorithms on Advanced Uniprocessor Computers
Ng, E., & Peyton, B. W. (1993) · SIAM Journal on Scientific Computing · doi:10.1137/0914063 · Cited by 206
A modular system of algorithms for unconstrained minimization
Schnabel, R. B., Koonatz, J. E., & Weiss, B. E. (1985) · ACM Transactions on Mathematical Software · doi:10.1145/6187.6192 · Cited by 195
Robust Estimation of Variance Components
Fellner, W. H. (1986) · Technometrics · doi:10.1080/00401706.1986.10488097 · Cited by 178
Computing Gaussian Likelihoods and Their Derivatives for General Linear Mixed Models
Wolfinger, R., Tobias, R., & Sall, J. (1994) · SIAM Journal on Scientific Computing · doi:10.1137/0915079 · Cited by 169
Computing Maximum Likelihood Estimates for the Mixed A.O.V. Model Using the W Transformation
Hemmerle, W. J., & Hartley, H. O. (1973) · Technometrics · doi:10.1080/00401706.1973.10489115 · Cited by 143
Estimation of Variances and Covariances under Multiple Trait Models
Henderson, C. (1984) · Journal of Dairy Science · doi:10.3168/jds.s0022-0302(84)81480-0 · Cited by 73
Sparse QR factorization in MATLAB
Matstoms, P. (1994) · ACM Transactions on Mathematical Software · doi:10.1145/174603.174408 · Cited by 70
Misztal, I., & Miguel Pérez-enciso, A. (1993) · Journal of Dairy Science · doi:10.3168/jds.s0022-0302(93)77478-0 · Cited by 70
Alain Ducos, A., Bidanel, J. P., Ducrocq, V., Boichard, D., & Groeneveld, E. (1993) · Genetics Selection Evolution · doi:10.1051/gse:19930506 · Cited by 44
Self-citationMisztal, I. (1994) · Journal of Animal Breeding and Genetics · doi:10.1111/j.1439-0388.1994.tb00473.x · Cited by 33
Sparse matrices, and the estimation of variance components by likelihood methods
Fellner, W. H. (1987) · Communications in Statistics - Simulation and Computation · doi:10.1080/03610918708812599 · Cited by 23
Large-Scale Estimation of Variance and Covariance Components
Fraley, C., & Burns, P. J. (1995) · SIAM Journal on Scientific Computing · doi:10.1137/0916013 · Cited by 13
Cited by
Estimating genetic parameters in natural populations using the ‘animal model’
Kruuk, L. E. B. (2004) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.2003.1437 · Cited by 1,186
Holland, J. B. (2006) · Crop Science · doi:10.2135/cropsci2005.0191 · Cited by 327
Evolution driven by differential dispersal within a wild bird population
Garant, D., Kruuk, L. E. B., Wilkin, T. A., McCleery, R. H., & Sheldon, B. C. (2005) · Nature · doi:10.1038/nature03051 · Cited by 308
Gene flow maintains a large genetic difference in clutch size at a small spatial scale
Postma, E., & van Noordwijk, A. J. (2005) · Nature · doi:10.1038/nature03083 · Cited by 277
Detection of quantitative trait loci for growth and fatness in pigs
Bidanel, J.-P., Milan, D., Iannuccelli, N., Amigues, Y., Boscher, M.-Y., Bourgeois, F., Caritez, J.-C., Gruand, J., Le Roy, P., Lagant, H., et al. (2001) · Genetics Selection Evolution · doi:10.1186/1297-9686-33-3-289 · Cited by 271
Metadata
- Authors
- Neumaier, A., & Groeneveld, E.
- Venue
- Genetics Selection Evolution
- Published
- 1998-01-15
- Volume
- 30
- Issue
- 1
- ISSN
- 0999-193X (ISSN-L)
- 1297-9686
- OpenAlex
- W2101751002
- Cited by
- 428
- References
- 29
- FWCI
- 8.91
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.