The DOI matches its OpenAlex record.
Ridge Regression: Biased Estimation for Nonorthogonal Problems
Abstract
In multiple regression it is shown that parameter estimates based on minimum residual sum of squares have a high probability of being unsatisfactory, if not incorrect, if the prediction vectors are not orthogonal. Proposed is an estimation procedure based on adding small positive quantities to the diagonal of X′X. Introduced is the ridge trace, a method for showing in two dimensions the effects of nonorthogonality. It is then shown how to augment X′X to obtain biased estimates with smaller mean square error.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Extreme Learning Machine for Regression and Multiclass Classification
Huang, G.-B., Zhou, H., Ding, X., & Zhang, R. (2012) · IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) · doi:10.1109/tsmcb.2011.2168604 · Cited by 5,550
Chen, Y., Jiang, H., Li, C., Jia, X., & Ghamisi, P. (2016) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2016.2584107 · Cited by 2,984
Provencher, S. W. (1982) · Computer Physics Communications · doi:10.1016/0010-4655(82)90173-4 · Cited by 2,701
CE-Net: Context Encoder Network for 2D Medical Image Segmentation
Gu, Z., Cheng, J., Fu, H., Zhou, K., Hao, H., Zhao, Y., Zhang, T., Gao, S., & Liu, J. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2903562 · Cited by 2,267
Extreme learning machines: a survey
Huang, G.-B., Wang, D. H., & Lan, Y. (2011) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-011-0019-y · Cited by 1,914
Computationally efficient whole-genome regression for quantitative and binary traits
Mbatchou, J., Barnard, L., Backman, J., Marcketta, A., Kosmicki, J. A., Ziyatdinov, A., Benner, C., O’Dushlaine, C., Barber, M., Boutkov, B., et al. (2021) · Nature Genetics · doi:10.1038/s41588-021-00870-7 · Cited by 1,502
The Relationship Between Variable Selection and Data Agumentation and a Method for Prediction
Allen, D. M. (1974) · Technometrics · doi:10.1080/00401706.1974.10489157 · Cited by 1,469
Making and Evaluating Point Forecasts
Gneiting, T. (2011) · Journal of the American Statistical Association · doi:10.1198/jasa.2011.r10138 · Cited by 1,154
Variable Importance Assessment in Regression: Linear Regression versus Random Forest
Grömping, U. (2009) · The American Statistician · doi:10.1198/tast.2009.08199 · Cited by 1,103
A global test for groups of genes: testing association with a clinical outcome
Goeman, J. J., van de Geer, S. A., de Kort, F., & van Houwelingen, H. C. (2004) · Bioinformatics · doi:10.1093/bioinformatics/btg382 · Cited by 1,069
Tanaka, J. S. (1987) · Child Development · doi:10.2307/1130296 · Cited by 982
Ridge regression:some simulations
Hoerl, A. E., Kannard, R. W., & Baldwin, K. F. (1975) · Communications in Statistics · doi:10.1080/03610927508827232 · Cited by 873
Self-citationLarge-Scale Bayesian Logistic Regression for Text Categorization
Genkin, A., Lewis, D. D., & Madigan, D. (2007) · Technometrics · doi:10.1198/004017007000000245 · Cited by 808
Nielsen, A. A. (2007) · IEEE Transactions on Image Processing · doi:10.1109/tip.2006.888195 · Cited by 746
A Monte Carlo Evaluation of Some Ridge-Type Estimators
McDonald, G. C., & Galarneau, D. I. (1975) · Journal of the American Statistical Association · doi:10.1080/01621459.1975.10479882 · Cited by 685
Machine Learning for Sequential Data: A Review
Dietterich, T. G. (2002) · Lecture Notes in Computer Science · doi:10.1007/3-540-70659-3_2 · Cited by 666
A new class of blased estimate in linear regression
Kejian, L. (1993) · Communications in Statistics - Theory and Methods · doi:10.1080/03610929308831027 · Cited by 655
Regressions by Leaps and Bounds
Furnival, G. M., & Wilson, R. W. (1974) · Technometrics · doi:10.1080/00401706.1974.10489231 · Cited by 625
LASSO: A feature selection technique in predictive modeling for machine learning
Muthukrishnan, R., & Rohini, R. (2016) · 2016 IEEE International Conference on Advances in Computer Applications (ICACA) · doi:10.1109/icaca.2016.7887916 · Cited by 586
Adaptive sparseness for supervised learning
Figueiredo, M. A. T. (2003) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2003.1227989 · Cited by 536
Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks
Wang, J., Jiang, C., Zhang, H., Ren, Y., Chen, K.-C., & Hanzo, L. (2020) · IEEE Communications Surveys & Tutorials · doi:10.1109/comst.2020.2965856 · Cited by 486
Kalman Filter Behavior in Bearings-Only Tracking Applications
Aidala, V. (1979) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.1979.308793 · Cited by 480
Stealing Hyperparameters in Machine Learning
Wang, B., & Gong, N. Z. (2018) · 2018 IEEE Symposium on Security and Privacy (SP) · doi:10.1109/sp.2018.00038 · Cited by 470
Ogutu, J. O., Schulz-Streeck, T., & Piepho, H.-P. (2012) · BMC Proceedings · doi:10.1186/1753-6561-6-s2-s10 · Cited by 440
McNeish, D. M. (2015) · Multivariate Behavioral Research · doi:10.1080/00273171.2015.1036965 · Cited by 432
Mallows, C. L. (1973) · Technometrics · doi:10.1080/00401706.1973.10489103 · Cited by 427
Review of receptor model fundamentals
Henry, R. C., Lewis, C. W., Hopke, P. K., & Williamson, H. J. (1984) · Atmospheric Environment (1967) · doi:10.1016/0004-6981(84)90375-5 · Cited by 418
Unsupervised Domain Adaptation for Zero-Shot Learning
Kodirov, E., Xiang, T., Fu, Z., & Gong, S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.282 · Cited by 403
Brain age prediction using deep learning uncovers associated sequence variants
Jonsson, B. A., Bjornsdottir, G., Thorgeirsson, T. E., Ellingsen, L. M., Walters, G. B., Gudbjartsson, D. F., Stefansson, H., Stefansson, K., & Ulfarsson, M. O. (2019) · Nature Communications · doi:10.1038/s41467-019-13163-9 · Cited by 392
The Geography of Recent Genetic Ancestry across Europe
Ralph, P., & Coop, G. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001555 · Cited by 384
Statistical methods in water resources
(2002) · doi:10.3133/twri04a3 · Cited by 367
A Comparative Review of Dimension Reduction Methods in Approximate Bayesian Computation
Blum, M. G. B., Nunes, M. A., Prangle, D., & Sisson, S. A. (2013) · Statistical Science · doi:10.1214/12-sts406 · Cited by 353
Shashua, A., Gdalyahu, Y., & Hayun, G. (2004) · IEEE Intelligent Vehicles Symposium, 2004 · doi:10.1109/ivs.2004.1336346 · Cited by 352
Wind Turbine Gearbox Failure Identification With Deep Neural Networks
Wang, L., Zhang, Z., Long, H., Xu, J., & Liu, R. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2607179 · Cited by 348
Advanced Statistics: Linear Regression, Part II: Multiple Linear Regression
Marill, K. A. (2004) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2004.tb01379.x · Cited by 341
Regularization and error characterization of GRACE mascons
Loomis, B. D., Luthcke, S. B., & Sabaka, T. J. (2019) · Journal of Geodesy · doi:10.1007/s00190-019-01252-y · Cited by 334
Fast exact leave-one-out cross-validation of sparse least-squares support vector machines
Cawley, G. C., & Talbot, N. L. C. (2004) · Neural Networks · doi:10.1016/j.neunet.2004.07.002 · Cited by 332
Recent trends in deep learning based personality detection
Mehta, Y., Majumder, N., Gelbukh, A., & Cambria, E. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09770-z · Cited by 329
Roth, V. (2004) · IEEE Transactions on Neural Networks · doi:10.1109/tnn.2003.809398 · Cited by 322
Li, Y., & Zhu, J. (2008) · Journal of Computational and Graphical Statistics · doi:10.1198/106186008x289155 · Cited by 316
Position and Velocity Estimation Via Bearing Observations
Lingren, A., & Gong, K. (1978) · IEEE Transactions on Aerospace and Electronic Systems · doi:10.1109/taes.1978.308681 · Cited by 311
MICOM: Metagenome-Scale Modeling To Infer Metabolic Interactions in the Gut Microbiota
Diener, C., Gibbons, S. M., & Resendis-Antonio, O. (2020) · mSystems · doi:10.1128/msystems.00606-19 · Cited by 309
Judson, R. S., Magpantay, F. M., Chickarmane, V., Haskell, C., Tania, N., Taylor, J., Xia, M., Huang, R., Rotroff, D. M., Filer, D. L., et al. (2015) · Toxicological Sciences · doi:10.1093/toxsci/kfv168 · Cited by 309
A Simulation Study of Alternatives to Ordinary Least Squares
Dempster, A. P., Schatzoff, M., & Wermuth, N. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10479910 · Cited by 308
SMIL: Multimodal Learning with Severely Missing Modality
Ma, M., Ren, J., Zhao, L., Tulyakov, S., Wu, C., & Peng, X. (2021) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v35i3.16330 · Cited by 332
Use of the Singular Value Decomposition in Regression Analysis
Mandel, J. (1982) · The American Statistician · doi:10.1080/00031305.1982.10482771 · Cited by 281
Individual Variation in Functional Topography of Association Networks in Youth
Cui, Z., Li, H., Xia, C. H., Larsen, B., Adebimpe, A., Baum, G. L., Cieslak, M., Gur, R. E., Gur, R. C., Moore, T. M., et al. (2020) · Neuron · doi:10.1016/j.neuron.2020.01.029 · Cited by 269
Write a Classifier: Zero-Shot Learning Using Purely Textual Descriptions
Elhoseiny, M., Saleh, B., & Elgammal, A. (2013) · 2013 IEEE International Conference on Computer Vision · doi:10.1109/iccv.2013.321 · Cited by 257
Constructing the L2-Graph for Robust Subspace Learning and Subspace Clustering
Peng, X., Yu, Z., Yi, Z., & Tang, H. (2017) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2536752 · Cited by 257
Canonical ridge and econometrics of joint production
Vinod, H. D. (1976) · Journal of Econometrics · doi:10.1016/0304-4076(76)90010-5 · Cited by 257
Predicting the thermodynamic stability of perovskite oxides using machine learning models
Li, W., Jacobs, R., & Morgan, D. (2018) · Computational Materials Science · doi:10.1016/j.commatsci.2018.04.033 · Cited by 255
Kessler, R. C., Hwang, I., Hoffmire, C. A., McCarthy, J. F., Petukhova, M. V., Rosellini, A. J., Sampson, N. A., Schneider, A. L., Bradley, P. A., Katz, I. R., et al. (2017) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1575 · Cited by 209
Social context, spatial structure and social network structure
Doreian, P., & Conti, N. (2012) · Social Networks · doi:10.1016/j.socnet.2010.09.002 · Cited by 177
Improving the accuracy of single-trial fMRI response estimates using GLMsingle
Prince, J. S., Charest, I., Kurzawski, J. W., Pyles, J. A., Tarr, M. J., & Kay, K. N. (2022) · eLife · doi:10.7554/elife.77599 · Cited by 174
Suryanarayana, G., Lago, J., Geysen, D., Aleksiejuk, P., & Johansson, C. (2018) · Energy · doi:10.1016/j.energy.2018.05.111 · Cited by 155
Anderson, A. J., Kiela, D., Binder, J. R., Fernandino, L., Humphries, C. J., Conant, L. L., Raizada, R. D. S., Grimm, S., & Lalor, E. C. (2021) · The Journal of Neuroscience · doi:10.1523/jneurosci.1152-20.2021 · Cited by 70
Uncovering the genetic blueprint of the C. elegans nervous system
Kovács, I. A., Barabási, D. L., & Barabási, A.-L. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2009093117 · Cited by 42
Metadata
- Authors
- Hoerl, A. E., & Kennard, R. W.
- Venue
- Technometrics
- Publisher
- Taylor & Francis
- Published
- 1970-02-01
- Volume
- 12
- Issue
- 1
- Pages
- 55-55
- ISSN
- 0040-1706 (ISSN-L)
- OpenAlex
- W4255455317
- Cited by
- 1,955
- References
- 0
- FWCI
- 3.47
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.