The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Generalized Additive Models
Abstract
Regression models play an important role in many applied settings, by enabling predictive analysis, revealing classification rules, and providing data-analytic tools for understanding the interactions between different variables. Although attractively simple, traditional linear regression often fails in practical situations because real-life effects are usually nonlinear. This article describes statistical methods that may be used to identify and characterize general nonlinear regressions, without requiring the analyst to prespecify the form of the nonlinear relationship. These methods form the basis of the generalized additive models approach to data analysis. The choice of the link function g permits the analyst to incorporate many of the benefits of the methodology of generalized linear models. The logit link is widely viewed as highly appropriate for the analysis of binary data, and other standard link functions are similarly useful. Besides the identity link g(μ) = μ, which yields the additive model corresponding to ordinary multiple regression, people often use g(μ) = lnμ to give a log-additive model for Poisson count data (See Poisson Distribution). These link functions arise from exponential family sampling models, which also include the gamma and negative‐binomial distributions. These families generate the well-known class of generalized linear models 12, which may all be extended in the same way to generalized additive models by replacing linear terms with nonparametric functions. In this section we describe a modular algorithm for fitting additive models and their generalizations. The basic component is the scatterplot smoother for fitting nonlinear curves in a way that permits a great variety of functional forms. Suppose that we have a scatterplot of points (x i , y i ) like that shown in Fig. 1. Here y is a response or outcome variable, and x is a predictor. We wish to fit a smooth curve f(x) that summarizes the dependence of y on x (see Curve Fitting). More formally, we want to fit the model y = f(x) + ε, where f(x) is specified in a flexible way, yet required to be reasonably smooth. If we were to find the curve that simply minimized ∑[y i − f(x i )]2, the result would be an interpolating curve that would not be smooth at all. Notice that ∫f″(x)2 dx measures the “wiggliness” of the function f: linear functions f have ∫f″(x)2 dx = 0, while nonlinear functions produce values larger than zero. Here λ is a nonnegative smoothing parameter that must be chosen by the data analyst. It governs the trade-off between the goodness of fit* to the data (as measured by ∑[y i − f(x i )]2) and the wiggliness of the function. Larger values of λ force f to be smoother. In fact the interpolating curve corresponds to λ = 0 at one extreme, and the straight line fit is the limit as λ → ∞. For any value of λ, the solution to 1 is a cubic spline, i.e., a piecewise cubic polynomial with pieces joined smoothly at the values of x in the data set. Fast and stable numerical procedures are available for computation of the fitted curve. The right panel of Fig. 1 shows a cubic-spline fit to the data. What value of λ did we use in Fig. 1 ? In fact it is not convenient to express the desired smoothness of f in terms of λ, since the meaning of λ depends on the units of the explanatory variable x. Instead, it is possible to define an “effective number of parameters” or “degrees of freedom” for a cubic spline smoother, and then use a numerical search to determine the value of λ that yields this number. In Fig. 1 we chose the degrees of freedom to be five. Roughly speaking, this means that the complexity of the curve is about the same as that of a polynomial regression of degree four. However, the cubic spline smoother “spreads out” its parameters in a more even manner, and hence allows more diverse curves than a polynomial regression. Note that the degrees of freedom of a smoother need not be an integer. The preceding discussion sought to minimize the least squares fit to the data, subject to a penalty on the roughness of the fitted function. For the logistic regression model and other generalized additive models, the appropriate criterion is penalized maximum likelihood or penalized maximum log partial likelihood. To maximize these, the backfitting procedure is used in conjunction with a maximum likelihood or maximum partial likelihood algorithm. The usual Newton–Raphson method for maximizing log likelihoods in these models can be cast in an iteratively reweighted least squares form. This involves repeated use of weighted linear regression of a constructed response variable on the covariates: each regression yields a new value of the parameter estimates which give a new constructed variable, and the process is iterated. In the generalized additive model, the weighted linear regression is simply replaced by a weighted backfitting algorithm. We describe the algorithm in more detail for logistic regression below, and in more genera
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2005) · Statistics for Biology and Health · doi:10.1007/0-387-27255-0_9 · Cited by 20,133
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Brown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,176
Self-citationMultivariate Adaptive Regression Splines
Friedman, J. H. (1991) · The Annals of Statistics · doi:10.1214/aos/1176347963 · Cited by 8,000
Koyak, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290538 · Cited by 7,596
Self-citationSpline Models for Observational Data.
Muller, H.-G., & Wahba, G. (1991) · Journal of the American Statistical Association · doi:10.2307/2290434 · Cited by 4,928
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Nonparametric Regression and Generalized Linear Models
Green, P. J., & Silverman, B. W. (1994) · Springer eBooks · doi:10.1007/978-1-4899-4473-3 · Cited by 1,925
Chambers, J., Hastie, T., & Pregibon, D. (1990) · Compstat · doi:10.1007/978-3-642-50096-1_48 · Cited by 1,742
Self-citationStatistical data analysis in the computer age
Efron, B., & Tibshirani, R. (1991) · Science · doi:10.1126/science.253.5018.390 · Cited by 1,192
Self-citation
Cited by
Items 201–230 of 230
A phenotypic null hypothesis for the genetics of personality.
Turkheimer, E., Pettersson, E., & Horn, E. E. (2014) · Annual Review of Psychology · doi:10.1146/annurev-psych-113011-143752 · Cited by 194
Brown, C. H., Wang, W., Kellam, S. G., Muthén, B. O., Petras, H., Toyinbo, P., Poduska, J., Ialongo, N., Wyman, P. A., Chamberlain, P., et al. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2007.11.013 · Cited by 177
Particulate matter, sulfur dioxide, and daily mortality in Chongqing China
Venners, S. A., Wang, B., Xu, Z., Schlatter, Y., Wang, L., & Xu, X. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.5664 · Cited by 173
Geoclimatic influences on invasive aspergillosis after hematopoietic stem cell transplantation
Panackal, A. A., Li, H., Kontoyiannis, D. P., Mori, M., Perego, C. A., Boeckh, M., & Marr, K. A. (2010) · Clinical Infectious Diseases · doi:10.1086/652761 · Cited by 169
The Wildlife Picture Index: monitoring top trophic levels
O'Brien, T. G., Baillie, J. E. M., Krueger, L., & Cuke, M. (2010) · Animal Conservation · doi:10.1111/j.1469-1795.2010.00357.x · Cited by 151
Circulating 25-hydroxyvitamin D3 in pregnancy and infant neuropsychological development
Morales, E., Guxens, M., Llop, S., Rodríguez-Bernal, C. L., Tardón, A., Riaño, I., Ibarluzea, J., Lertxundi, N., Espada, M., Rodriguez, A., et al. (2012) · Pediatrics · doi:10.1542/peds.2011-3289 · Cited by 140
Explainable Artificial Intelligence for Tabular Data: A Survey
Sahakyan, M., Aung, Z., & Rahwan, T. (2021) · IEEE Access · doi:10.1109/access.2021.3116481 · Cited by 135
Knudby, A., LeDrew, E., & Brenning, A. (2010) · Remote Sensing of Environment · doi:10.1016/j.rse.2010.01.007 · Cited by 129
Plant species as predictors of soil pH: Replacing expert judgement with measurements
Wamelink, G. W. W., Goedhart, P. W., Van Dobben, H. F., & Berendse, F. (2005) · Journal of Vegetation Science · doi:10.1111/j.1654-1103.2005.tb02386.x · Cited by 116
Olea, P. P., Mateo-Tomás, P., & de Frutos, Á. (2010) · PLoS ONE · doi:10.1371/journal.pone.0011698 · Cited by 109
Davies, G., McIver, L., Kim, Y., Hashizume, M., Iddings, S., & Chan, V. (2014) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph120100191 · Cited by 106
Rooker, J. R., Simms, J. R., Wells, R. J. D., Holt, S. A., Holt, G. J., Graves, J. E., & Furey, N. B. (2012) · PLoS ONE · doi:10.1371/journal.pone.0034180 · Cited by 105
Effects of a Clinical Trial on Mechanical Ventilation Practices in Patients with Acute Lung Injury
Checkley, W., Brower, R., Korpak, A., & Thompson, B. T. (2008) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200709-1424oc · Cited by 104
Multimodal Routing: Improving Local and Global Interpretability of Multimodal Language Analysis
Tsai, Y.-H. H., Ma, M., Yang, M., Salakhutdinov, R., & Morency, L.-P. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.143 · Cited by 98
(2012) · Cited by 90
Deficit of Vitamin D in Pregnancy and Growth and Overweight in the Offspring
Morales, E., Rodriguez, A., Valvi, D., Iñiguez, C., Esplugues, A., Vioque, J., Marina, L. S., Jiménez, A., Espada, M., Dehli, C. R., et al. (2015) · International Journal of Obesity · doi:10.1038/ijo.2014.165 · Cited by 84
BONENFANT, C., GAILLARD, J., KLEIN, F., & HAMANN, J. (2005) · Journal of Applied Ecology · doi:10.1111/j.1365-2664.2005.01008.x · Cited by 80
Rothenberg, S. J., & Rothenberg, J. C. (2005) · Environmental Health Perspectives · doi:10.1289/ehp.7691 · Cited by 63
Sleep duration, vital exhaustion, and odds of spontaneous preterm birth: a case–control study
Kajeepeta, S., Sanchez, S. E., Gelaye, B., Qiu, C., Barrios, Y. V., Enquobahrie, D. A., & Williams, M. A. (2014) · BMC Pregnancy and Childbirth · doi:10.1186/1471-2393-14-337 · Cited by 51
Vinceti, M., Malagoli, C., Fiorentini, C., Longo, C., Crespi, C. M., Albertini, G., Ricci, C., Lanzoni, A., Reggiani, M., Virgili, A., et al. (2011) · Nutrition and Cancer · doi:10.1080/01635581.2011.539314 · Cited by 52
Understanding the Stochastic Partial Differential Equation Approach to Smoothing
Miller, D. L., Glennie, R., & Seaton, A. E. (2020) · Journal of Agricultural, Biological and Environmental Statistics · doi:10.1007/s13253-019-00377-z · Cited by 46
Miller, T. J. (2013) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-2013-0136 · Cited by 44
The Role of Race in Forecasts of Violent Crime
Berk, R. (2009) · Race and Social Problems · doi:10.1007/s12552-009-9017-z · Cited by 41
Dose-dependent model of caffeine effects on human vigilance during total sleep deprivation
Ramakrishnan, S., Laxminarayan, S., Wesensten, N. J., Kamimori, G. H., Balkin, T. J., & Reifman, J. (2014) · Journal of Theoretical Biology · doi:10.1016/j.jtbi.2014.05.017 · Cited by 33
Roberts, S. (2006) · Journal of Toxicology and Environmental Health, Part A · doi:10.1080/15287390500246761 · Cited by 32
Mills, R., Hildenbrandt, H., Taylor, G. K., & Hemelrijk, C. K. (2018) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1006044 · Cited by 30
(1998) · doi:10.1007/3-540-26577-5_17 · Cited by 15
Chu, M., Liu, Z., Fang, X., Wu, Y., Liu, H., Zhao, X., Zhang, T., Wu, Q., & Tan, F. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.898461 · Cited by 11
Play Favorites: A Statistical Method to Measure Self-Bias in LLM-as-a-Judge
Spiliopoulou, E., Fogliato, R., Burnsky, H., Soliman, T., Ma, J., Horwood, G., & Ballesteros, M. (2025) · arXiv · doi:10.48550/arxiv.2508.06709 · Cited by 51
“Second, we relax the assumption of linear dependence between evaluator and reference ratings by fitting generalized additive models (GAMs) that model this relationship using cubic splines [Hastie, 2017].”
Volz, E., Mishra, S., Chand, M., Barrett, J. C., Johnson, R., Geidelberg, L., Hinsley, W. R., Laydon, D. J., Dabrera, G., O’Toole, Á., et al. (2021) · doi:10.1101/2020.12.30.20249034 · Cited by 1,611
Metadata
- Authors
- Hastie, T., & Tibshirani, R.
- Venue
- Wiley StatsRef: Statistics Reference Online
- Publisher
- Wiley
- Published
- 2014-11-20
- OpenAlex
- W3014310718
- Cited by
- 3,156
- References
- 16
- Type
- other
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.