Generalized Additive Models

Open access

Hastie, Trevor, Tibshirani, Robert·1986·Statistical Science

Open this paper in CoChat — free account

Abstract

Likelihood-based regression models such as the normal linear regression model and the linear logistic model, assume a linear (or some other parametric) form for the covariates $X_1, X_2, \cdots, X_p$. We introduce the class of generalized additive models which replaces the linear form $\sum \beta_jX_j$ by a sum of smooth functions $\sum s_j(X_j)$. The $s_j(\cdot)$'s are unspecified functions that are estimated using a scatterplot smoother, in an iterative procedure we call the local scoring algorithm. The technique is applicable to any likelihood-based regression model: the class of generalized linear models contains many of these. In this class the linear predictor $\eta = \Sigma \beta_jX_j$ is replaced by the additive predictor $\Sigma s_j(X_j)$; hence, the name generalized additive models. We illustrate the technique with binary response and survival data. In both cases, the method proves to be useful in uncovering nonlinear covariate effects. It has the advantage of being completely automatic, i.e., no "detective work" is needed on the part of the statistician. As a theoretical underpinning, the technique is viewed as an empirical method of maximizing the expected log likelihood, or equivalently, of minimizing the Kullback-Leibler distance to the true model.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Integrity signals

Registry

Crossref · 10.1214/ss/1177013604

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Lung cancer, cardiopulmonary mortality, and long-term exposure to fine particulate air pollution
Pope III, C. A. (2002) · JAMA · doi:10.1001/jama.287.9.1132 · Cited by 8,447
The dynamics and regulators of cell fate decisions are revealed by pseudotemporal ordering of single cells
Trapnell, C., Cacchiarelli, D., Grimsby, J., Pokharel, P., Li, S., Morse, M., Lennon, N. J., Livak, K. J., Mikkelsen, T. S., & Rinn, J. L. (2014) · Nature Biotechnology · doi:10.1038/nbt.2859 · Cited by 7,314
Association of Sleep-Disordered Breathing, Sleep Apnea, and Hypertension in a Large Community-Based Study
Nieto, F. J. (2000) · JAMA · doi:10.1001/jama.283.14.1829 · Cited by 3,369
A Survey on Explainable Artificial Intelligence (XAI): Toward Medical XAI
Tjoa, E., & Guan, C. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3027314 · Cited by 2,524
Generalized linear and generalized additive models in studies of species distributions: setting the scene
Guisan, A., Edwards, T. C., & Hastie, T. (2002) · Ecological Modelling · doi:10.1016/s0304-3800(02)00204-1 · Cited by 2,356
Self-citation
Definitions, methods, and applications in interpretable machine learning
Murdoch, W. J., Singh, C., Kumbier, K., Abbasi-Asl, R., & Yu, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1900654116 · Cited by 2,167
“Generalized additive models (40) force the relationship between variables in the model to be additive.”
Background
Modeling and variable selection in epidemiologic analysis
Greenland, S. (1989) · American Journal of Public Health · doi:10.2105/ajph.79.3.340 · Cited by 2,208
Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual Conditional Expectation
Goldstein, A., Kapelner, A., Bleich, J., & Pitkin, E. (2015) · Journal of Computational and Graphical Statistics · doi:10.1080/10618600.2014.907095 · Cited by 1,861
Large recurrent microdeletions associated with schizophrenia.
GROUP, Stefansson, H., Rujescu, D., Cichon, S., Pietiläinen, O. P. H., Ingason, A., Steinberg, S., Fossdal, R., Sigurdsson, E., Sigmundsson, T., et al. (2008) · Nature · doi:10.1038/nature07229 · Cited by 1,745
Visualizing the effects of predictor variables in black box supervised learning models
Apley, D. W., & Zhu, J. (2020) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12377 · Cited by 1,535
Group representations in probability and statistics
Diaconis, P. (1988) · doi:10.1214/lnms/1215467407 · Cited by 1,381
Global phytoplankton decline over the past century
Boyce, D. G., Lewis, M. R., & Worm, B. (2010) · Nature · doi:10.1038/nature09268 · Cited by 1,363
Assessing transmissibility of SARS-CoV-2 lineage B.1.1.7 in England
The COVID-19 Genomics UK (COG-UK) consortium, Volz, E., Mishra, S., Chand, M., Barrett, J. C., Johnson, R., Geidelberg, L., Hinsley, W. R., Laydon, D. J., Dabrera, G., et al. (2021) · Nature · doi:10.1038/s41586-021-03470-x · Cited by 1,611
A mid-term analysis of progress toward international biodiversity targets
Tittensor, D. P., Walpole, M., Hill, S. L. L., Boyce, D. G., Britten, G. L., Burgess, N. D., Butchart, S. H. M., Leadley, P. W., Regan, E. C., Alkemade, R., et al. (2014) · Science · doi:10.1126/science.1257484 · Cited by 1,227
Logistic regression, survival analysis, and the Kaplan-Meier curve.
Efron, B. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478612 · Cited by 1,065
Kernel Smoothing in Partial Linear Models
Speckman, P. (1988) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1988.tb01738.x · Cited by 986
How Much Should We Trust Estimates from Multiplicative Interaction Models? Simple Tools to Improve Empirical Practice
Hainmueller, J., Mummolo, J., & Xu, Y. (2019) · Political Analysis · doi:10.1017/pan.2018.46 · Cited by 959
Serum Vaccine Antibody Concentrations in Children Exposed to Perfluorinated Compounds
Grandjean, P., Andersen, E. W., Budtz-Jørgensen, E., Nielsen, F., Mølbak, K., Weihe, P., & Heilmann, C. (2012) · JAMA · doi:10.1001/jama.2011.2034 · Cited by 809
Serum IL‐6 Level and the Development of Disability in Older Persons
Ferrucci, L., Harris, T. B., Guralnik, J. M., Tracy, R. P., Corti, M., Cohen, H. J., Penninx, B., Pahor, M., Wallace, R., & Havlik, R. J. (1999) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1999.tb01583.x · Cited by 809
On the use of generalized additive models in time-series studies of air pollution and health
Dominici, F. (2002) · American Journal of Epidemiology · doi:10.1093/aje/kwf062 · Cited by 728
Transmission of SARS-CoV-2 Lineage B.1.1.7 in England: Insights from linking epidemiological and genetic data
Volz, E., Mishra, S., Chand, M., Barrett, J. C., Johnson, R., Geidelberg, L., Hinsley, W. R., Laydon, D. J., Dabrera, G., O’Toole, Á., et al. (2021) · doi:10.1101/2020.12.30.20249034 · Cited by 1,611
The AIC model selection method applied to path analytic models compared using a d‐separation test
Shipley, B. (2013) · Ecology · doi:10.1890/12-0976.1 · Cited by 606
A review of spline function procedures in R
Perperoglou, A., Sauerbrei, W., Abrahamowicz, M., & Schmid, M. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0666-3 · Cited by 585
Consistency of random forests
Scornet, E., Biau, G., & Vert, J.-P. (2015) · The Annals of Statistics · doi:10.1214/15-aos1321 · Cited by 612
Intelligible models for classification and regression
Lou, Y., Caruana, R., & Gehrke, J. (2012) · Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/2339530.2339556 · Cited by 547
Smoking and mental illness: results from population surveys in Australia and the United States
Lawrence, D., Mitrou, F., & Zubrick, S. R. (2009) · BMC Public Health · doi:10.1186/1471-2458-9-285 · Cited by 517
Randomization, Statistics, and Causal Inference
Greenland, S. (1990) · Epidemiology · doi:10.1097/00001648-199011000-00003 · Cited by 385
An Introduction to the Augmented Inverse Propensity Weighted Estimator
Glynn, A. N., & Quinn, K. M. (2010) · Political Analysis · doi:10.1093/pan/mpp036 · Cited by 374
Analyzing dynamic phonetic data using generalized additive mixed modeling: A tutorial focusing on articulatory differences between L1 and L2 speakers of English
Wieling, M. (2018) · Journal of Phonetics · doi:10.1016/j.wocn.2018.03.002 · Cited by 362
Long-term impacts of prescribed burning on regional extent and incidence of wildfires-Evidence from 50 years of active fire management in SW Australian forests
Boer, M. M., Sadler, R. J., Wittkuhn, R. S., McCaw, L., & Grierson, P. F. (2009) · Forest Ecology and Management · doi:10.1016/j.foreco.2009.10.005 · Cited by 309
Heterogeneous global crop yield response to biochar: a meta-regression analysis
Crane-Droesch, A., Abiven, S., Jeffery, S., & Torn, M. S. (2013) · Environmental Research Letters · doi:10.1088/1748-9326/8/4/044049 · Cited by 297
Post-fire vegetation and fuel development influences fire severity patterns in reburns
Coppoletta, M., Merriam, K. E., & Collins, B. M. (2016) · Ecological Applications · doi:10.1890/15-0225 · Cited by 295
Open Problems in Mechanistic Interpretability
Sharkey, L., Chughtai, B., Batson, J., Lindsey, J., Wu, J., Bushnaq, L., Goldowsky-Dill, N., Heimersheim, S., Ortega, A., Bloom, J., et al. (2025) · arXiv · doi:10.48550/arxiv.2501.16496 · Cited by 291
The National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA): A Multisite Study of Adolescent Development and Substance Use
Brown, S. A., Brumback, T., Tomlinson, K., Cummins, K., Thompson, W. K., Nagel, B. J., De Bellis, M. D., Hooper, S. R., Clark, D. B., Chung, T., et al. (2015) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2015.76.895 · Cited by 255
“How many images do I need?” Understanding how sample size per class affects deep learning model performance metrics for balanced designs in autonomous wildlife monitoring
Shahinfar, S., Meek, P., & Falzon, G. (2020) · Ecological Informatics · doi:10.1016/j.ecoinf.2020.101085 · Cited by 229
Defining Optimal Length of Opioid Pain Medication Prescription After Common Surgical Procedures
Scully, R. E., Schoenfeld, A. J., Jiang, W., Lipsitz, S., Chaudhary, M. A., Learn, P. A., Koehlmoos, T., Haider, A. H., & Nguyen, L. L. (2018) · JAMA Surgery · doi:10.1001/jamasurg.2017.3132 · Cited by 215
General Pitfalls of Model-Agnostic Interpretation Methods for Machine Learning Models
Molnar, C., König, G., Herbinger, J., Freiesleben, T., Dandl, S., Scholbeck, C. A., Casalicchio, G., Grosse-Wentrup, M., & Bischl, B. (2022) · Lecture Notes in Computer Science · doi:10.1007/978-3-031-04083-2_4 · Cited by 211
The global divide in data-driven farming
Mehrabi, Z., McDowell, M. J., Ricciardi, V., Levers, C., Martinez, J. D., Mehrabi, N., Wittman, H., Ramankutty, N., & Jarvis, A. (2020) · Nature Sustainability · doi:10.1038/s41893-020-00631-0 · Cited by 219
Estimating long‐term multivariate progression from short‐term data
Donohue, M. C., Jacqmin‐Gadda, H., Le Goff, M., Thomas, R. G., Raman, R., Gamst, A. C., Beckett, L. A., Jack, C. R., Weiner, M. W., Dartigues, J., et al. (2014) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2013.10.003 · Cited by 197
Neighborhood Resources for Physical Activity and Healthy Foods and Their Association With Insulin Resistance
Auchincloss, A. H., Diez Roux, A. V., Brown, D. G., Erdmann, C. A., & Bertoni, A. G. (2008) · Epidemiology · doi:10.1097/ede.0b013e31815c480 · Cited by 167
Association of Structural Magnetic Resonance Imaging Measures With Psychosis Onset in Individuals at Clinical High Risk for Developing Psychosis: An ENIGMA Working Group Mega-analysis
ENIGMA Clinical High Risk for Psychosis Working Group, Jalbrzikowski, M., Hayes, R. A., Wood, S. J., Nordholm, D., Zhou, J. H., Fusar-Poli, P., Uhlhaas, P. J., Takahashi, T., Sugranyes, G., et al. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.0638 · Cited by 137
Effects of ambient particulate matter and ozone on daily mortality in Rotterdam, the Netherlands
Hoek, G., Schwartz, J. D., Groot, B., & Eilers, P. (1997) · Archives of Environmental Health An International Journal · doi:10.1080/00039899709602224 · Cited by 133
Features that define the best ChIP-seq peak calling algorithms
Thomas, R., Thomas, S., Holloway, A. K., & Pollard, K. S. (2016) · Briefings in Bioinformatics · doi:10.1093/bib/bbw035 · Cited by 112
Improved marketing decision making in a customer churn prediction context using generalized additive models
Coussement, K., Benoit, D. F., & Van den Poel, D. (2010) · Expert Systems with Applications · doi:10.1016/j.eswa.2009.07.029 · Cited by 117
Bankruptcy prediction by generalized additive models
Berg, D. (2007) · Applied Stochastic Models in Business and Industry · doi:10.1002/asmb.658 · Cited by 114
Cured Meat Consumption, Lung Function, and Chronic Obstructive Pulmonary Disease among United States Adults
Jiang, R., Paik, D. C., Hankinson, J. L., & Barr, R. G. (2007) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200607-969oc · Cited by 100
COGAM: Measuring and Moderating Cognitive Load in Machine Learning Model Explanations
Abdul, A., von der Weth, C., Kankanhalli, M., & Lim, B. Y. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376615 · Cited by 96
Harmonizing DTI measurements across scanners to examine the development of white matter microstructure in 803 adolescents of the NCANDA study
Pohl, K. M., Sullivan, E. V., Rohlfing, T., Chu, W., Kwon, D., Nichols, B. N., Zhang, Y., Brown, S. A., Tapert, S. F., Cummins, K., et al. (2016) · NeuroImage · doi:10.1016/j.neuroimage.2016.01.061 · Cited by 85
New approaches to regression by generalized additive models and continuous optimization for modern applications in finance, science and technology
Taylan, P., Weber, G.-W., & Beck, A. (2007) · Optimization · doi:10.1080/02331930701618740 · Cited by 83
Evidential calibration of binary SVM classifiers
Xu, P., Davoine, F., Zha, H., & Denœux, T. (2016) · International Journal of Approximate Reasoning · doi:10.1016/j.ijar.2015.05.002 · Cited by 83
Inferring input nonlinearities in neural encoding models
Ahrens, M. B., Paninski, L., & Sahani, M. (2008) · Network Computation in Neural Systems · doi:10.1080/09548980701813936 · Cited by 72
Untitled work
Abramovitch (2019) · doi:10.1016/j.cpr.2018.09.001 · Cited by 59
Interpretable generalized additive neural networks
Kraus, M., Tschernutter, D., Weinzierl, S., & Zschech, P. (2024) · European Journal of Operational Research · doi:10.1016/j.ejor.2023.06.032 · Cited by 59
Online sensor for monitoring a microalgal bioreactor system using support vector regression
Nadadoor, V. R., De la Hoz Siegler, H., Shah, S. L., McCaffrey, W. C., & Ben-Zvi, A. (2012) · Chemometrics and Intelligent Laboratory Systems · doi:10.1016/j.chemolab.2011.09.007 · Cited by 51
Challenging the Performance-Interpretability Trade-Off: An Evaluation of Interpretable Machine Learning Models
Kruschel, S., Hambauer, N., Weinzierl, S., Zilker, S., Kraus, M., & Zschech, P. (2026) · Business & Information Systems Engineering · doi:10.1007/s12599-024-00922-2 · Cited by 50
Subsistence fishing in a 21st century capitalist society: From commodity to gift
Poe, M. R., Levin, P. S., Tolimieri, N., & Norman, K. (2015) · Ecological Economics · doi:10.1016/j.ecolecon.2015.05.003 · Cited by 38
A machine learning framework for interpretable predictions in patient pathways: the case of predicting ICU admission for patients with symptoms of sepsis
Zilker, S., Weinzierl, S., Kraus, M., Zschech, P., & Matzner, M. (2024) · Health Care Management Science · doi:10.1007/s10729-024-09673-8 · Cited by 29
Stochastic gradient boosting frequency-severity model of insurance claims
Su, X., & Bai, M. (2020) · PLOS ONE · doi:10.1371/journal.pone.0238000 · Cited by 24
Alien species stabilize local fisheries catch in a highly invaded ecosystem
van Rijn, I., Kiflawi, M., & Belmaker, J. (2020) · Canadian Journal of Fisheries and Aquatic Sciences · doi:10.1139/cjfas-2019-0065 · Cited by 24
Predictive claim scores for dynamic multi-product risk classification in insurance
Verschuren, R. M. (2021) · ASTIN Bulletin · doi:10.1017/asb.2020.34 · Cited by 20
Neural Network-Driven Exploration in Polymerization-Induced Self-Assembly: From 2D to 3D Pseudo-Phase Diagram
Fonseca Parra, E. P., Oumerri, J., Arteni, A. A., Six, J.-L., Armes, S. P., & Ferji, K. (2025) · Macromolecules · doi:10.1021/acs.macromol.4c01772 · Cited by 8

Authors: Hastie, T., & Tibshirani, R.
Venue: Statistical Science
Publisher: Institute of Mathematical Statistics
Published: 1986-08-01
Volume: 1
Issue: 3
ISSN: 0883-4237 (ISSN-L)
DOI: 10.1214/ss/1177013604
OpenAlex: W2166163519
Cited by: 3,409
References: 0
FWCI: 25.77
Type: journal article
Language: en
Open access: bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.

Generalized Additive Models

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Self-check

Citations

Cited by

Metadata

Record

About these checks

Data sources