The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Generalized Additive Models for Gigadata: Modeling the U.K. Black Smoke Network Daily Data
Open accessAbstract
We develop scalable methods for fitting penalized regression spline based generalized additive models with of the order of 104 coefficients to up to 108 data. Computational feasibility rests on: (i) a new iteration scheme for estimation of model coefficients and smoothing parameters, avoiding poorly scaling matrix operations; (ii) parallelization of the iteration’s pivoted block Cholesky and basic matrix operations; (iii) the marginal discretization of model covariates to reduce memory footprint, with efficient scalable methods for computing required crossproducts directly from the discrete representation. Marginal discretization enables much finer discretization than joint discretization would permit. We were motivated by the need to model four decades worth of daily particulate data from the U.K. Black Smoke and Sulphur Dioxide Monitoring Network. Although reduced in size recently, over 2000 stations have at some time been part of the network, resulting in some 10 million measurements. Modeling at a daily scale is desirable for accurate trend estimation and mapping, and to provide daily exposure estimates for epidemiological cohort studies. Because of the dataset size, previous work has focused on modeling time or space averaged pollution levels, but this is unsatisfactory from a health perspective, since it is often acute exposure locally and on the time scale of days that is of most importance in driving adverse health outcomes. If computed by conventional means our black smoke model would require a half terabyte of storage just for the model matrix, whereas we are able to compute with it on a desktop workstation. The best previously available reduced memory footprint method would have required three orders of magnitude more computing time than our new method. Supplementary materials for this article are available online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
Spline Models for Observational Data
Wahba, G. (1990) · doi:10.1137/1.9781611970128 · Cited by 4,184
Craven, P., & Wahba, G. (1978) · Numerische Mathematik · doi:10.1007/bf01404567 · Cited by 3,388
Some aspects of the spline smoothing approach to non-parametric regression curve fitting
Silverman, B. W. (1985) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1985.tb01327.x · Cited by 1,117
Cited by
Hierarchical generalized additive models in ecology: an introduction with mgcv
Pedersen, E. J., Miller, D. L., Simpson, G. L., & Ross, N. (2019) · PeerJ · doi:10.7717/peerj.6876 · Cited by 1,193
Generalized additive models: Building evidence of air pollution, climate change and human health
Ravindra, K., Rattan, P., Mor, S., & Aggarwal, A. N. (2019) · Environment International · doi:10.1016/j.envint.2019.104987 · Cited by 458
Understanding the Stochastic Partial Differential Equation Approach to Smoothing
Miller, D. L., Glennie, R., & Seaton, A. E. (2020) · Journal of Agricultural, Biological and Environmental Statistics · doi:10.1007/s13253-019-00377-z · Cited by 46
“…in a wide variety of domains such as spatial epidemiology (Arab, 2015), species distribution mapping (de Rivera et al., 2018), spatial point processes (Simpson et al., 2016; Yuan et al., 2017; Soriano-Redondo et al., 2019) and environmental science (Huang et al., 2017), to name just a few examples.”
BackgroundGiangreco, N. P., & Tatonetti, N. P. (2022) · Med · doi:10.1016/j.medj.2022.06.001 · Cited by 16
Metadata
- Authors
- Wood, S. N., Li, Z., Shaddick, G., & Augustin, N. H.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2017-04-25
- Volume
- 112
- Issue
- 519
- Pages
- 1199-1210
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W2468874071
- Cited by
- 191
- References
- 4
- FWCI
- 13.31
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Generalized Additive Models for Gigadata: Modeling the U.K. Black Smoke Network Daily Data. https://app.cochat.ai/papers/10.1080/01621459.2016.1195744
- The paper
- Wood, S. N., Li, Z., Shaddick, G., & Augustin, N. H. (2017). Generalized Additive Models for Gigadata: Modeling the U.K. Black Smoke Network Daily Data. Journal of the American Statistical Association. https://doi.org/10.1080/01621459.2016.1195744
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.