Population time series: process variability, observation errors, missing values, lags, and hidden states.
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Population sample data are complex; inference and prediction require proper accommodation of not only the nonlinear interactions that determine the expected future abundance, but also the stochasticity inherent in data and variable (often unobserved) environmental factors. Moreover, censuses may occur sporadically, and observation errors change with sample methods and effort. The state variable (usually density or abundance) may be hidden from view and known only through highly indirect observational schemes (such as public health records, hunting reports, or fossil/archeological surveys). We extend the basic state-space model for time-series analysis to accommodate these dominant sources of variability that influence population data. Using examples, we show how different types of process error and observation error, unequal sample intervals, and missing values can be accounted for within the flexible framework of Bayesian state-space models. We provide algorithms based on Gibbs sampling that can be used to obtain posterior estimates of population states and of model parameters. For models that can be linearized, results can be used for direct sampling of the posterior, including those with missing values and unequal sample intervals. For nonlinear models, we make use of Metropolis-Hastings within the Gibbs sampling framework. Examples derive from long-term census and population data. We illustrate the extension to discrete state variables with multiple stages using a Time-series Susceptible–Infected–Recovered (TSIR) model for mid 20th-century measles infection in London, where birth rates are assumed known, but susceptibles and infected individuals arise from imperfect reporting.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In time-series population data, ignoring process error can result in biases in parameter estimation because errors propagate through time [50].”
From A Disease-Mediated Trophic Cascade in the Serengeti and its Implications for Ecosystem C (2009) · cites this paper as [50]
Citations
Cites
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Infectious Diseases of Humans: Dynamics and Control
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-117-2-174_4 · Cited by 7,746
Sampling-based approaches to calculating marginal densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476213 · Cited by 6,606 · cited 2×
“This constant can be obtained by a sampling-based approach (Gelfand and Smith 1990), such as Markov Chain Monte Carlo (MCMC) integration.”
Method(1992) · Reviews in Fish Biology and Fisheries · doi:10.1007/bf00042883 · Cited by 3,500 · cited 1×
“As a consequence, descriptive timeseries analysis ‘‘has not proven terribly useful in analysis of (population) dynamics’’ (Hilborn and Walters 1992:309).”
BackgroundQuantitative Fisheries Stock Assessment
Hilborn, R., & Walters, C. J. (1992) · doi:10.1007/978-1-4615-3598-0 · Cited by 3,068 · cited 1×
“As a consequence, descriptive timeseries analysis ‘‘has not proven terribly useful in analysis of (population) dynamics’’ (Hilborn and Walters 1992:309).”
BackgroundBayesian Forecasting and Dynamic Models
(1997) · Springer Series in Statistics · doi:10.1007/b98971 · Cited by 1,917
Sampling-Based Approaches to Calculating Marginal Densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.2307/2289776 · Cited by 1,504
Parametric empirical Bayes inference: theory and applications
Morris, C. N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477920 · Cited by 1,448
Analytical Population Dynamics
Royama, T. (1992) · Springer eBooks · doi:10.1007/978-94-011-2916-9 · Cited by 1,438 · cited 3×
“The ‘‘latent’’ variables—unobserved abundance of key species or life stages—may require estimation (Calder et al. 2003, Wikle 2003) or accommodation using time-lagged responses (e.g., Royama 1992, Bjørnstad et al. 2001).”
BackgroundMethodBoyce, M. S. (1992) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.es.23.110192.002405 · Cited by 1,242 · cited 1×
“These issues are of immediate concern in population risk assessment, which depends on a full treatment of variability and uncertainty (Boyce 1992, Ludwig 1999, Ellner and Feiberg 2003, Staples et al. 2004).”
Background
Cited by
Seven Shortfalls that Beset Large-Scale Knowledge of Biodiversity
Hortal, J., de Bello, F., Diniz-Filho, J. A. F., Lewinsohn, T. M., Lobo, J. M., & Ladle, R. J. (2015) · Annual Review of Ecology, Evolution, and Systematics · doi:10.1146/annurev-ecolsys-112414-054400 · Cited by 1,743
“However, uncertainties in estimates of population size can affect the results (and conclusions) of analyses of the data in the GPDD and in most population time series (Clark & Bjørnstad 2004, Knape & de Valpine 2012).”
BackgroundEcological models and data in R
Bolker, B. M. (2008) · doi:10.2307/j.ctvcm4g37 · Cited by 1,297
State–space models of individual animal movement
PATTERSON, T., THOMAS, L., WILCOX, C., OVASKAINEN, O., & MATTHIOPOULOS, J. (2008) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2007.10.009 · Cited by 921
“SSM methods originated in engineering, but have been applied in a range of disciplines, including population ecology, to estimate population trajectories from imprecise or incomplete survey data [46, 47 ].”
BackgroundWhy environmental scientists are becoming Bayesians
Clark, J. S. (2005) · Ecology Letters · doi:10.1111/j.1461-0248.2004.00702.x · Cited by 862
“We might use the model to draw inference on population sizes at many more dates than those for which we have observations (Clark & Bjornstad 2004).”
BackgroundMethodSelf-citationSchaub, M., & Abadi, F. (2011) · Journal of Ornithology · doi:10.1007/s10336-010-0632-7 · Cited by 562
“Some papers specifically deal with how census data are included (Besbeas and Freeman 2006), and Cave et al. (2010) explored the use of ringing data from constant effort sites as indices of population size.”
BackgroundMethod
Metadata
- Authors
- Clark, J. S., & Bjørnstad, O. N.
- Affiliations
- Duke University (US)
- Pennsylvania State University (US)
- Corresponding author
- Clark, James S.
- Venue
- Ecology
- Publisher
- Wiley
- Published
- 2004-11
- Volume
- 85
- Issue
- 11
- Pages
- 3140-3150
- ISSN
- 0012-9658 (ISSN-L)
- OpenAlex
- W2000032310
- Cited by
- 348
- References
- 55
- Citations by year
- 2026: 8 · 2025: 8 · 2024: 9 · 2023: 13 · 2022: 16 · 2021: 18 · 2020: 21 · 2019: 12 · 2018: 16 · 2017: 14 · 2016: 20 · 2015: 23 · 2014: 21 · 2013: 22 · 2012: 23
- FWCI
- 11.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 3956 d)
- Locations
- Ecology (publishedVersion)
- Funders
- Division of Environmental Biology
- Topics
- Physical Sciences › Mathematics › Applied Mathematics › Mathematical and Theoretical Epidemiology and Ecology Models
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- population time series, state-space model, process error, observation error, missing data, hidden states, Bayesian inference, Gibbs sampling, Metropolis-Hastings algorithm, measles, population abundance estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Population time series: process variability, observation errors, missing values, lags, and hidden states. https://app.cochat.ai/papers/10.1890/03-0520
- The paper
- Clark, J. S., & Bjørnstad, O. N. (2004). Population time series: process variability, observation errors, missing values, lags, and hidden states. Ecology. https://doi.org/10.1890/03-0520
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.