Model Choice in Time Series Studies of Air Pollution and Mortality
Abstract
Summary: Multicity time series studies of particulate matter and mortality and morbidity have provided evidence that daily variation in air pollution levels is associated with daily variation in mortality counts. These findings served as key epidemiological evidence for the recent review of the US national ambient air quality standards for particulate matter. As a result, methodological issues concerning time series analysis of the relationship between air pollution and health have attracted the attention of the scientific community and critics have raised concerns about the adequacy of current model formulations. Time series data on pollution and mortality are generally analysed by using log-linear, Poisson regression models for overdispersed counts with the daily number of deaths as outcome, the (possibly lagged) daily level of pollution as a linear predictor and smooth functions of weather variables and calendar time used to adjust for time-varying confounders. Investigators around the world have used different approaches to adjust for confounding, making it difficult to compare results across studies. To date, the statistical properties of these different approaches have not been comprehensively compared. To address these issues, we quantify and characterize model uncertainty and model choice in adjusting for seasonal and long-term trends in time series models of air pollution and mortality. First, we conduct a simulation study to compare and describe the properties of statistical methods that are commonly used for confounding adjustment. We generate data under several confounding scenarios and systematically compare the performance of the various methods with respect to the mean-squared error of the estimated air pollution coefficient. We find that the bias in the estimates generally decreases with more aggressive smoothing and that model selection methods which optimize prediction may not be suitable for obtaining an estimate with small bias. Second, we apply and compare the modelling approaches with the National Morbidity, Mortality, and Air Pollution Study database which comprises daily time series of several pollutants, weather variables and mortality counts covering the period 1987–2000 for the largest 100 cities in the USA. When applying these approaches to adjusting for seasonal and long-term trends we find that the Study's estimates for the national average effect of PM10 at lag 1 on mortality vary over approximately a twofold range, with 95% posterior intervals always excluding zero risk.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The discrepancy in the results for 3 df/year between the NS and PS approaches has a theoretical basis related to the tradeoff between the parametric and nonparametric components of the PS models in explaining variation in the outcome variable.
“The discrepancy in the results for 3 df/year between the NS and PS approaches has a theoretical basis related to the tradeoff between the parametric and nonparametric components of the PS models in explaining variation in the outcome variable (Peng et al. 2006; Speckman 1988).”
From Acute effects of ambient ozone on mortality in Europe and North America: results from the APHENA study (2013) · cites this paper as Peng et al. 2006
Various regression models and parameter settings affect regression coefficients.
“Earlier simulation studies have shown that various regression models and parameter setting in the models (e.g. df selection, convergence criteria) would affect the regression coefficients (Dominici et al. 2002; Peng et al. 2006).”
From Differentiating the effects of fine and coarse particles on daily mortality in Shanghai, China (2007) · cites this paper as Peng et al. 2006
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,706 · see citing works
Estimating the Dimension of a Model
Schwarz, G. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344136 · Cited by 47,033 · see citing works
Information Theory and an Extension of the Maximum Likelihood Principle
Akaike, H. (1998) · Springer series in statistics · doi:10.1007/978-1-4612-1694-0_15 · Cited by 18,384 · see citing works
Brown, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Biometrics · doi:10.2307/2532174 · Cited by 8,262 · see citing works
Koyak, R. A., Hastie, T. J., & Tibshirani, R. J. (1991) · Journal of the American Statistical Association · doi:10.2307/2290538 · Cited by 7,717 · see citing works
Pattern Recognition and Neural Networks
Ripley, B. D. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812651 · Cited by 6,446 · see citing works
Flexible smoothing with B-splines and penalties
Eilers, P., & Marx, B. (1996) · Statistical Science · doi:10.1214/ss/1038425655 · Cited by 4,159 · see citing works
Introduction to Time Series and Forecasting
Brockwell, P. J., & Davis, R. A. (2002) · Springer texts in statistics · doi:10.1007/b97391 · Cited by 3,914 · see citing works
Ruppert, D., WAND, M. P., & Carroll, R. J. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511755453 · Cited by 2,153 · see citing works
Nonparametric Regression and Generalized Linear Models
Green, P. J., & Silverman, B. W. (1994) · Springer eBooks · doi:10.1007/978-1-4899-4473-3 · Cited by 1,935 · see citing works
Temperature and Mortality in 11 Cities of the Eastern United States
Curriero, F. C. (2002) · American Journal of Epidemiology · doi:10.1093/aje/155.1.80 · Cited by 1,352 · see citing works
Nonparametric Regression and Generalized Linear Models: A Roughness Penalty Approach.
Best, D. J., Green, P. J., & Silverman, B. W. (1994) · Biometrics · doi:10.2307/2533467 · Cited by 1,194 · see citing works
Linear Smoothers and Additive Models
Buja, A., Hastie, T. J., & Tibshirani, R. J. (1989) · The Annals of Statistics · doi:10.1214/aos/1176347115 · Cited by 998 · see citing works
Kernel Smoothing in Partial Linear Models
Speckman, P. (1988) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1988.tb01738.x · Cited by 986 · see citing works
Katsouyanni, K., Touloumi, G., Samoli, E., Gryparis, A., Tertre, A. L., Monopolis, Y., Rossi, G., Zmirou‐Navier, D., Ballester, F., Boumghar, A., et al. (2001) · Epidemiology · doi:10.1097/00001648-200109000-00011 · Cited by 978 · see citing works
Gu, C. (2013) · Springer series in statistics · doi:10.1007/978-1-4614-5369-7 · Cited by 891 · see citing works
Review of Epidemiological Evidence of Health Effects of Particulate Air Pollution
Pope, C. A., Dockery, D. W., & Schwartz, J. D. (1995) · Inhalation Toxicology · doi:10.3109/08958379509014267 · Cited by 833 · see citing works
Selection of the Order of an Autoregressive Model by Akaike's Information Criterion
Shibata, R. (1976) · Biometrika · doi:10.1093/biomet/63.1.117 · Cited by 789 · see citing works
On the use of generalized additive models in time-series studies of air pollution and health
Dominici, F. (2002) · American Journal of Epidemiology · doi:10.1093/aje/kwf062 · Cited by 728 · see citing works
Self-citationModelling and Smoothing Parameter Estimation With Multiple Quadratic Penalties
Wood, S. N. (2000) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/1467-9868.00240 · Cited by 727 · see citing works
Samet, J. M., Zeger, S. L., Dominici, F., Curriero, F. C., Coursac, I., Dockery, D. W., Schwartz, J. D., & Zanobetti, A. (2000) · PubMed · Cited by 698 · see citing works
Self-citationThe Distributed Lag between Air Pollution and Daily Deaths
Schwartz, J. D. (2000) · Epidemiology · doi:10.1097/00001648-200005000-00016 · Cited by 614 · see citing works
Seasonal analyses of air pollution and mortality in 100 US cities
Peng, R. D., Dominici, F., Pastor-Barriuso, R., Zeger, S. L., & Samet, J. M. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi075 · Cited by 450 · see citing works
Self-citationGu, C. (2002) · Springer series in statistics · doi:10.1007/978-1-4757-3683-0 · Cited by 409 · see citing works
Particulate Air Pollution and Daily Mortality in Steubenville, Ohio
Schwartz, J. D., & Dockery, D. W. (1992) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a116195 · Cited by 407 · see citing works
Harvesting and Long Term Exposure Effects in the Relation between Air Pollution and Mortality
Schwartz, J. D. (2000) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a010228 · Cited by 349 · see citing works
Daniels, M. J. (2000) · American Journal of Epidemiology · doi:10.1093/aje/152.5.397 · Cited by 348 · see citing works
Time-Series Studies of Particulate Matter
Bell, M. L., Samet, J. M., & Dominici, F. (2004) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.25.102802.124329 · Cited by 333 · see citing works
Self-citationComments on Model Selection Criteria of Akaike and Schwarz
Stone, M. (1979) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.2517-6161.1979.tb01084.x · Cited by 318 · see citing works
Generalized additive distributed lag models: quantifying mortality displacement
Zanobetti, A. (2000) · Biostatistics · doi:10.1093/biostatistics/1.3.279 · Cited by 304 · see citing works
Air Pollution and Mortality: Estimating Regional and National Dose-Response Relationships
Dominici, F., Daniels, M., Zeger, S. L., & Samet, J. M. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502753479266 · Cited by 303 · see citing works
Self-citationDominici, F., Samet, J. M., & Zeger, S. L. (2000) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/1467-985x.00170 · Cited by 286 · see citing works
Self-citationDirect generalized additive modeling with penalized likelihood
Marx, B. D., & Eilers, P. H. C. (1998) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(98)00033-4 · Cited by 269 · see citing works
Ramsay, T., Burnett, R. T., & Krewski, D. R. (2003) · Epidemiology · doi:10.1097/00001648-200301000-00009 · Cited by 260 · see citing works
Zanobetti, A., Schwartz, J. D., Samoli, E., Gryparis, A., Touloumi, G., Atkinson, R. W., Tertre, A. L., Bobros, J., Celko, M. A., Goren, A. I., et al. (2002) · Epidemiology · doi:10.1097/00001648-200201000-00014 · Cited by 252 · see citing works
Convergence rates for partially splined models
Rice, J. (1986) · Statistics & Probability Letters · doi:10.1016/0167-7152(86)90067-2 · Cited by 252 · see citing works
The National Morbidity, Mortality, and Air Pollution Study. Part I: Methods and methodologic issues.
Samet, J. M., Dominici, F., Zeger, S. L., Schwartz, J. D., & Dockery, D. W. (2000) · PubMed · Cited by 251 · see citing works
Self-citationIdentification of Dynamic Regression (Distributed Lag) Models Connecting Two Time Series
Haugh, L. D., & Box, G. E. P. (1977) · Journal of the American Statistical Association · doi:10.1080/01621459.1977.10479920 · Cited by 250 · see citing works
Air Pollution and Mortality in Philadelphia, 1974-1988
Kelsall, J. E., Samet, J. M., Zeger, S. L., & Xu, J. (1997) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a009351 · Cited by 240 · see citing works
Schwartz, J. D. (2001) · Epidemiology · doi:10.1097/00001648-200101000-00010 · Cited by 213 · see citing works
Bidirectional Case-Crossover Designs for Exposures with Time Trends
Navidi, W. C. (1998) · Biometrics · doi:10.2307/3109766 · Cited by 206 · see citing works
Harvesting-Resistant Estimates of Air Pollution Effects on Mortality
Zeger, S. L., Dominici, F., & Samet, J. (1999) · Epidemiology · doi:10.1097/00001648-199903000-00015 · Cited by 199 · see citing works
Self-citationEpidemiology of acute health effects: summary of time-series studies
Dockery, D. W., & Pope, A. S. (1996) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · Cited by 190 · see citing works
Improved Semiparametric Time Series Models of Air Pollution and Mortality
Dominici, F., McDermott, A., & Hastie, T. J. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000656 · Cited by 169 · see citing works
Self-citationTransitional Regression Models, with Application to Environmental Time Series
Brumback, B., RYAN, L. M., Schwartz, J. D., Neas, L., Stark, P. C., & Burge, H. A. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473895 · Cited by 167 · see citing works
The Effect of the Urban Ambient Air Pollution Mix on Daily Mortality Rates in 11 Canadian Cities
Burnett, R. T., Cakmak, S., & Brook, J. R. (1998) · Canadian Journal of Public Health · doi:10.1007/bf03404464 · Cited by 163 · see citing works
Does Weather Confound or Modify the Association of Particulate Air Pollution with Mortality?
Samet, J. M., Zeger, S. L., Kelsall, J. E., et al. (1998) · Environmental Research · doi:10.1006/enrs.1997.3821 · Cited by 146 · see citing works
Model uncertainty and health effect studies for particulate matter
Clyde, M. A. (2000) · Environmetrics · doi:10.1002/1099-095x(200011/12)11:6 · Cited by 132 · see citing works
MacNee, W., & Donaldson, K. (1999) · Air Pollution and Health · doi:10.1016/b978-012352335-8/50105-8 · Cited by 122 · see citing works
Total suspended particulate matter and daily mortality in Cincinnati, Ohio.
Schwartz, J. (1994) · Environmental Health Perspectives · doi:10.1289/ehp.94102186 · Cited by 119 · see citing works
Analysis of health outcome time series data in epidemiological studies
Touloumi, G., Atkinson, R. W., Tertre, A. L., Samoli, E., Schwartz, J. D., Schindler, C., Vonk, J. M., Rossi, G., Sáez, M., Rabszenko, D., et al. (2004) · Environmetrics · doi:10.1002/env.623 · Cited by 110 · see citing works
Goldberg, M. S. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.9.817 · Cited by 108 · see citing works
Inference for Multivariate Normal Hierarchical Models
Everson, P. J., & Morris, C. N. (2000) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00239 · Cited by 107 · see citing works
Welty, L. J., & Zeger, S. L. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi157 · Cited by 105 · see citing works
[Meta-analysis of the Italian studies on short-term effects of air pollution--MISA 1996-2002].
Biggeri, A., Bellini, P., & Terracini, B. (2005) · PubMed · Cited by 104 · see citing works
Approximations and consistency of Bayes factors as model dimension grows
Berger, J. O., Ghosh, J. K., & Mukhopadhyay, N. D. (2002) · Journal of Statistical Planning and Inference · doi:10.1016/s0378-3758(02)00336-1 · Cited by 103 · see citing works
Meta-analysis of the Italian Studies of Short-term Effects of Air Pollution (MISA), 1990–1999
Biggeri, A., Baccini, M., Bellini, P., et al. (2005) · International Journal of Occupational and Environmental Health · doi:10.1179/oeh.2005.11.1.107 · Cited by 100 · see citing works
Samoli, E., Schwartz, J., Wojtyniak, B., Touloumi, G., Spix, C., Balducci, F., Médina, S., Rossi, G., Sunyer, J., Bachárová, L., et al. (2001) · Environmental Health Perspectives · doi:10.1289/ehp.01109349 · Cited by 96 · see citing works
Nonparametric smoothing in the analysis of air pollution and respiratory illness
Schwartz, J. D. (1994) · Canadian Journal of Statistics · doi:10.2307/3315405 · Cited by 93 · see citing works
Samoli, E., Touloumi, G., Zanobetti, A., Tertre, A. L., Schindler, C., Atkinson, R. W., Vonk, J. M., Rossi, G., Sáez, M., Rabczenko, D., et al. (2003) · Occupational and Environmental Medicine · doi:10.1136/oem.60.12.977 · Cited by 72 · see citing works
Innes, K. E., Marshall, J. A., Byers, T., & Calonge, N. (1999) · PubMed · Cited by 71 · see citing works
Schwartz, J. D. (2003) · Environmental Health Perspectives · doi:10.1289/ehp.6431 · Cited by 68 · see citing works
Minimum description length model selection criteria for generalized linear models
Hansen, M. H., & Yu, B. (2003) · Lecture notes-monograph series · doi:10.1214/lnms/1215091140 · Cited by 57 · see citing works
Do respiratory epidemics confound the association between air pollution and daily deaths?
Braga, A. L. F., Zanobetti, A., & Schwartz, J. D. (2000) · European Respiratory Journal · doi:10.1034/j.1399-3003.2000.16d26.x · Cited by 56 · see citing works
Goldberg, M. S., Burnett, R. T., & Stieb, D. M. (2003) · Reviews on Environmental Health · doi:10.1515/reveh.2003.18.4.269 · Cited by 49 · see citing works
Analysis of Additive Dependencies and Concurvities Using Smallest Additive Principal Components
Donnell, D. J., Buja, A., & Stuetzle, W. (1994) · The Annals of Statistics · doi:10.1214/aos/1176325746 · Cited by 42 · see citing works
Underestimation of Standard Errors in Multi-site Time Series Studies
Daniels, M. J., Dominici, F., & Zeger, S. L. (2004) · Epidemiology · doi:10.1097/01.ede.0000092721.00997.f7 · Cited by 16 · see citing works
Self-citationSamoli, E., Schwartz, J., Wojtyniak, B., et al. (2001) · Environmental Health Perspectives · doi:10.2307/3454893 · Cited by 14 · see citing works
Simulation from Wishart Distributions with Eigenvalue Constraints
Everson, P. J., & Morris, C. N. (2000) · Journal of Computational and Graphical Statistics · doi:10.2307/1390660 · Cited by 11 · see citing works
Welty, L. J., & Zeger, S. L. (2005) · Cited by 7 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Distributed lag non‐linear models
Gasparrini, A., Armstrong, B., & Kenward, M. G. (2010) · Statistics in Medicine · doi:10.1002/sim.3940 · Cited by 2,481 · see citing works
Multivariate meta-analysis for non-linear and other multi-parameter associations
Gasparrini, A., Armstrong, B., & Kenward, M. G. (2012) · Statistics in Medicine · doi:10.1002/sim.5471 · Cited by 772 · see citing works
Differentiating the effects of fine and coarse particles on daily mortality in Shanghai, China
Kan, H., London, S. J., Chen, G., Zhang, Y., Song, G., Zhao, N., Jiang, L., & Chen, B. (2007) · Environment International · doi:10.1016/j.envint.2006.12.001 · Cited by 339 · see citing works
Yang, C., Yang, H., Guo, S., Wang, Z., Xu, X., Duan, X., & Kan, H. (2012) · Science of The Total Environment · doi:10.1016/j.scitotenv.2012.03.036 · Cited by 161 · see citing works
Peng, Z., Wang, Q., Kan, H., Chen, R., & Wang, W. (2017) · Science of The Total Environment · doi:10.1016/j.scitotenv.2017.02.237 · Cited by 127 · see citing works
Time-series analysis of weather and mortality patterns in Nairobi's informal settlements
Egondi, T., Kyobutungi, C., Kovats, S., Muindi, K., Ettarh, R., & Rocklöv, J. (2012) · Global Health Action · doi:10.3402/gha.v5i0.19065 · Cited by 119 · see citing works
Peng, R. D., Samoli, E., Pham, L., Dominici, F., Touloumi, G., Ramsay, T., Burnett, R. T., Krewski, D., Le Tertre, A., Cohen, A., et al. (2013) · Air Quality, Atmosphere & Health · doi:10.1007/s11869-012-0180-9 · Cited by 110 · see citing works
Self-citationImpact of climate change on ambient ozone level and mortality in southeastern United States
Chang, H. H., Zhou, J., & Fuentes, M. (2010) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph7072866 · Cited by 82 · see citing works
Ozone and daily mortality rate in 21 cities of East Asia: how does season modify the association?
Chen, R., Cai, J., Meng, X., Kim, H., Honda, Y., Guo, Y. L., Samoli, E., Yang, X., & Kan, H. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwu183 · Cited by 77 · see citing works
Liu, Y., Guo, Y., Wang, C., Li, W., Lu, J., Shen, S., Xia, H., He, J., & Qiu, X. (2015) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph120100439 · Cited by 63 · see citing works
Heat and emergency room admissions in the Netherlands
van Loenhout, J. A. F., Delbiso, T. D., Kiriliouk, A., Rodriguez-Llanes, J. M., Segers, J., & Guha-Sapir, D. (2018) · BMC Public Health · doi:10.1186/s12889-017-5021-1 · Cited by 58 · see citing works
Chen, K., Yang, H. B., Ma, Z. W., Bi, J., & Huang, L. (2013) · Atmospheric Environment · doi:10.1016/j.atmosenv.2013.06.004 · Cited by 35 · see citing works
- Authors
- Peng, R. D., Dominici, F., & Louis, T. A.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- Peng, Roger D.
- Venue
- Journal of the Royal Statistical Society Series A: Statistics in Society
- Publisher
- Oxford University Press (OUP)
- Published
- 2006-02-14
- Volume
- 169
- Issue
- 2
- Pages
- 179-203
- ISSN
- 0964-1998 (ISSN-L)
- 1467-985X
- OpenAlex
- W2134434400
- Cited by
- 583
- References
- 70
- Citations by year
- 2026: 25 · 2025: 29 · 2024: 14 · 2023: 21 · 2022: 33 · 2021: 52 · 2020: 54 · 2019: 32 · 2018: 24 · 2017: 43 · 2016: 30 · 2015: 33 · 2014: 38 · 2013: 41 · 2012: 33
- FWCI
- 11.67
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Journal of the Royal Statistical Society Series A (Statistics in Society) (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Collection of Biostatistics Research Archive (COBRA) (submittedVersion)
- Topics
- Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Air Quality and Health Impacts
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Climate Change and Health Impacts
- Keywords
- model selection, model uncertainty, air pollution mortality, particulate matter, PM10, confounding adjustment, seasonal patterns, long-term trends, meteorological parameters, overdispersion, ambient air quality standards
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review