Population time series: process variability, observation errors, missing values, lags, and hidden states.
The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Abstract
Population sample data are complex; inference and prediction require proper accommodation of not only the nonlinear interactions that determine the expected future abundance, but also the stochasticity inherent in data and variable (often unobserved) environmental factors. Moreover, censuses may occur sporadically, and observation errors change with sample methods and effort. The state variable (usually density or abundance) may be hidden from view and known only through highly indirect observational schemes (such as public health records, hunting reports, or fossil/archeological surveys). We extend the basic state-space model for time-series analysis to accommodate these dominant sources of variability that influence population data. Using examples, we show how different types of process error and observation error, unequal sample intervals, and missing values can be accounted for within the flexible framework of Bayesian state-space models. We provide algorithms based on Gibbs sampling that can be used to obtain posterior estimates of population states and of model parameters. For models that can be linearized, results can be used for direct sampling of the posterior, including those with missing values and unequal sample intervals. For nonlinear models, we make use of Metropolis-Hastings within the Gibbs sampling framework. Examples derive from long-term census and population data. We illustrate the extension to discrete state variables with multiple stages using a Time-series Susceptible–Infected–Recovered (TSIR) model for mid 20th-century measles infection in London, where birth rates are assumed known, but susceptibles and infected individuals arise from imperfect reporting.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In time-series population data, ignoring process error can result in biases in parameter estimation because errors propagate through time [50].”
From A Disease-Mediated Trophic Cascade in the Serengeti and its Implications for Ecosystem C (2009) · cites this paper as [50]
Citations
Cites
Markov Chain Monte Carlo in Practice
(1995) · Chapman & Hall/CRC eBooks · doi:10.1201/b14835 · Cited by 7,757
Infectious Diseases of Humans: Dynamics and Control
(1992) · Annals of Internal Medicine · doi:10.7326/0003-4819-117-2-174_4 · Cited by 7,746
Sampling-based approaches to calculating marginal densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.1080/01621459.1990.10476213 · Cited by 6,606 · cited 2×
“This constant can be obtained by a sampling-based approach (Gelfand and Smith 1990), such as Markov Chain Monte Carlo (MCMC) integration.”
Method(1992) · Reviews in Fish Biology and Fisheries · doi:10.1007/bf00042883 · Cited by 3,500 · cited 1×
“As a consequence, descriptive timeseries analysis ‘‘has not proven terribly useful in analysis of (population) dynamics’’ (Hilborn and Walters 1992:309).”
BackgroundQuantitative Fisheries Stock Assessment
Hilborn, R., & Walters, C. J. (1992) · doi:10.1007/978-1-4615-3598-0 · Cited by 3,068 · cited 1×
“As a consequence, descriptive timeseries analysis ‘‘has not proven terribly useful in analysis of (population) dynamics’’ (Hilborn and Walters 1992:309).”
BackgroundBayesian Forecasting and Dynamic Models
(1997) · Springer Series in Statistics · doi:10.1007/b98971 · Cited by 1,917
Sampling-Based Approaches to Calculating Marginal Densities
Gelfand, A. E., & Smith, A. F. M. (1990) · Journal of the American Statistical Association · doi:10.2307/2289776 · Cited by 1,504
Parametric empirical Bayes inference: theory and applications
Morris, C. N. (1983) · Journal of the American Statistical Association · doi:10.1080/01621459.1983.10477920 · Cited by 1,448
Analytical Population Dynamics
Royama, T. (1992) · Springer eBooks · doi:10.1007/978-94-011-2916-9 · Cited by 1,438 · cited 3×
“The ‘‘latent’’ variables—unobserved abundance of key species or life stages—may require estimation (Calder et al. 2003, Wikle 2003) or accommodation using time-lagged responses (e.g., Royama 1992, Bjørnstad et al. 2001).”
BackgroundMethodBoyce, M. S. (1992) · Annual Review of Ecology and Systematics · doi:10.1146/annurev.es.23.110192.002405 · Cited by 1,242 · cited 1×
“These issues are of immediate concern in population risk assessment, which depends on a full treatment of variability and uncertainty (Boyce 1992, Ludwig 1999, Ellner and Feiberg 2003, Staples et al. 2004).”
Background
Cited by
Items 301–349 of 349
Stevens, K. L., Altwegg, R., Connan, M., & Ryan, P. G. (2024) · Antarctic Science · doi:10.1017/s0954102024000336 · Cited by 2
Barrile, G. M., Chalfoun, A. D., Walters, A. W., & Merkle, J. A. (2025) · Ecology · doi:10.1002/ecy.70265
USING BARE-ROOT AND ROOTSTOCK SEEDLINGS FROM NATURAL REGENERATION OF CEDRELA FISSILIS
Schröder, T., Zimmermann, A. P. L., Pereira, L. D., Hofiço, N. D. S. A., Rocha, D. S., Fleig, F. D., & Meyer, E. A. (2016) · CERNE · doi:10.1590/01047760201622032203 · Cited by 1
Practical Methods for Imputing Follower Count Dynamics
Gibson, C. B., Sutton, J. N., Vos, S. C., & Butts, C. T. (2020) · Sociological Methods & Research · doi:10.1177/0049124120926210 · Cited by 2
“While latent missing data models (see, e.g., Clark and Bjørnstad 2004; Dufouil, Brayne, and Clayton 2004; Van Dongen 2001) can be employed for this purpose, such models are typically complex and reliant on computationally intensive approaches such as Markov chain Monte Carlo that are challenging to…”
Taboada, F. G., & Anadón, R. (2015) · Ecological Applications · doi:10.1890/15-0006.1 · Cited by 1
Statistical Methods for Nonlinear Dynamic Models with Measurement Error Using the Ricker Model
Resendes, D. J. (2011) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/2395813 · Cited by 1
Moullec, M. L. (2014) · NORA - Norwegian Open Research Archives · Cited by 1
ESTIMABILITY AND LIKELIHOOD INFERENCE FOR GENERAL HIERARCHICAL MODELS USING DATA CLONING
Nadeem, K. (2013) · ERA: Education and Research Archive (University of Alberta) · doi:10.7939/r3ht2j · Cited by 1
A framework for assessing the skill and value of operational recruitment forecastsPreprint
Kiær, C. M. R., Neuenfeldt, S., & Payne, M. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.07.05.451182 · Cited by 1
Harms, T. M. (2021) · doi:10.31274/td-20240329-503 · Cited by 1
Mécanismes d'infection de l'ectoparasite de poissons d'eau douce Tracheliastes polycolpus
Mathieu‐Bégné, E. (2020) · theses.fr (ABES) · doi:10.70675/da524fb3z25e6z4095zabc5zb6fbba47cc9c · Cited by 1
“To obtain posterior distributions of parameters (Clark and Bjørnstad 2004), we adopted a Bayesian approach using JAGS 3.3.0 (Plummer 2003) run through the R package ‘R2jags’ (Su and Yajima 2012).”
MethodInfluentialSistemas dinámicos y aplicaciones
Ferrari, M., Urriza, J. M., Bonfili, P., Pérez, C., Saavedra, E. A., Roberts, D. I., & Soulier, S. M. (2012) · El Servicio de Difusión de la Creación Intelectual (National University of La Plata)
Reprint of: Fitting population growth models in the presence of measurement and detection error
Hefley, T. J., Tyre, A. J., & Blankenship, E. E. (2013) · Ecological Modelling · doi:10.1016/j.ecolmodel.2013.10.021
Analyzing long-term data from biological surveys
Roth, T. (2012) · edoc (University of Basel) · doi:10.5451/unibas-005855021
A critical review of the literature on population modelling
Cabrelli, A. L., Harwood, J., Matthiopoulos, J., New, L., & Thomas, L. (2009) · St Andrews Research Repository (St Andrews Research Repository) · Cited by 1
Coulson, T. N. (2011) · Cited by 2
Neubauer, P., Abraham, E. R., & Berkenbusch, K. (2015) · doi:10.7287/peerj.preprints.1422v1
“Specifically, we assumed that the true mean density di,y in survey i and year y is gamma distributed, with mean νi,y and variance νi,y/τi, where di,y ∼ G(νi,y ∗ τi,τi) (1) νi,y = μi +ρi(di,y−1 −μi) (2) = ρidi,y−1 +(1−ρi)μi (3) τi ∼ G(α,α) (4) ρi ∼ B(δ ,1) (5) In this formulation, the second line illustrates the mean r…”
BackgroundDo we need demographic data to forecast plant population dynamics?Preprint
Tredennick, A. T., Hooten, M. B., & Adler, P. B. (2015) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/025742
The Emergence of Disease Ecology
L., L. S., & A., H. B. (2016) · Japanese Journal of Zoo and Wildlife Medicine · doi:10.5686/jjzwm.21.53
A More Precise Living Planet Index (LPI)
Hébert, K. (2019) · Biodiversity Information Science and Standards · doi:10.3897/biss.3.36517
“…and source are credited. undetected errors in its supporting data, including process errors (i.e. random population fluctuations), and observation errors (i.e. poor detectability of certain species) (Clark and Bjørnstad 2004, Gotelli and Colwell 2001, Dennis et al. 2006, Buckland et al. 2004).”
BackgroundSize and Density-Dependent Survival in a Brown Shrimp (Farfantepenaeus aztecus) Population
Piper, C. B. (2017) · OakTrust (Texas A&M University Libraries)
Population Projection Model in an Ecological Framework
Obisesan, K. O., & Odigie, A. D. (2015) · Journal for Studies in Management and Planning
State-space modeling of the dynamics of temporal plant cover using visually determined class data
Itô, H. (2020) · PeerJ · doi:10.7717/peerj.9383
“50 In recent decades, state-space models have been applied to many subjects in ecology, such as pop51 ulation dynamics (Clark and Bjørnstad, 2004; Damgaard, 2012; Iijima et al., 2013), metapopulation 52 dynamics (Harrison et al.”
BackgroundJohnson‐Bice, S. M. (2019) · University of Minnesota Digital Conservancy (University of Minnesota)
(2011) · Elsevier eBooks · doi:10.1016/b978-0-12-387020-9.00020-1
Schmitz, O. J., & Suttle, K. B. (2009) · Faculty Opinions – Post-Publication Peer Review of the Biomedical Literature · doi:10.3410/f.1165174.628330
PALEOBOTANY | Paleophytogeography
MCLACHLAN, J. (2007) · Elsevier eBooks · doi:10.1016/b0-44-452747-8/00188-5
Bjørnstad, O. N. (2018) · Use R! · doi:10.1007/978-3-319-97487-3_7
Self-citationBjørnstad, O. N. (2022) · Use R! · doi:10.1007/978-3-031-12056-5_8
Self-citationAn improved ARIMA fitting procedure
Lah, M. S. C., Arbaiy, N. B., & Lin, P. (2022) · AIP conference proceedings · doi:10.1063/5.0104053
Predator-Prey Dynamics of Bald Eagles and Glaucous-Winged Gulls
Cushing, J. M., Henson, S. M., & Hayward, J. L. (2023) · Interdisciplinary applied mathematics · doi:10.1007/978-3-031-34283-7_10
Density Dependence in Large Herbivores Inhabiting an Insular Nature Reserve
Louw, C. J., Parrini, F., & Marshal, J. P. (2024) · Ecology and Evolution · doi:10.1002/ece3.70689 · Cited by 1
The Roles of Environmental Change and Fishing in Norwegian Coastal Cod Stock Dynamics
Stige, L. C., Fall, J., & Langangen, Ø. (2025) · Fisheries Oceanography · doi:10.1111/fog.12728
ITNet: Irregular Timeseries Data Fusion with Attention Mechanisms
Honoré, A., Appelquist, P., & Xiao, M. (2025) · International Conference on Information Fusion (FUSION) · doi:10.23919/fusion65864.2025.11123961 · Cited by 1
“In practice, these assumptions can fail to hold in a variety of contexts, including health care [1]– [3], ecology [4] and predictive maintenance [5], [6].”
Ruiz‐Moreno, A., Emslie, M. J., & Connolly, S. R. (2025) · Ecology · doi:10.1002/ecy.70270
Inoue, S., Mizutani, Y., Sugiyama, H., Goto, Y., & Yoda, K. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.01.25.701645
MoTM: Towards a Foundation Model for Time Series Imputation Based on Continuous Modeling
Naour, É. L., Nabil, T., & Agoua, G. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-15535-1_5
Pacoureau, N. (2018) · theses.fr (ABES) · doi:10.70675/3c9ab0afzd4e5z4641zb1a1z25f521ee5246 · Cited by 2
Impact des changements globaux sur la dynamique de population des galliformes de montagne
Canonne, C. (2020) · theses.fr (ABES) · doi:10.70675/f50301f1z8eeez4714z9fffz391cc3970650
Learning neural representation for time series
Naour, É. L. (2024) · theses.fr (ABES) · doi:10.70675/26f2fe87z93ccz4840za636z5cf51c0db90a
Wiens, A., Bohner, T. F., Udell, B. J., & Thogmartin, W. E. (2026) · Journal of Agricultural Biological and Environmental Statistics · doi:10.1007/s13253-025-00709-2
Ellis, S. L., & Shriver, R. K. (2026) · Biological Conservation · doi:10.1016/j.biocon.2026.111898
Hierarchical Bayesian state-space modeling of tritrophic dynamics with cryptic life stages
Chan, K. H., Moerkens, R., Bellinkx, S., Huysmans, M., & Sluydts, V. (2026) · Ecological Modelling · doi:10.1016/j.ecolmodel.2026.111727
Chávez, F., Schirmer, S., Scheuerlein, A., & Kerth, G. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7488428
Interaction matrices as unifying tools for navigating ecological complexity
Terry, J. C. D., Tabi, A., García‐Callejas, D., & Domínguez‐García, V. (2026) · Nature Ecology & Evolution · doi:10.1038/s41559-026-03188-x
Metadata
- Authors
- Clark, J. S., & Bjørnstad, O. N.
- Affiliations
- Duke University (US)
- Pennsylvania State University (US)
- Corresponding author
- Clark, James S.
- Venue
- Ecology
- Publisher
- Wiley
- Published
- 2004-11
- Volume
- 85
- Issue
- 11
- Pages
- 3140-3150
- ISSN
- 0012-9658 (ISSN-L)
- OpenAlex
- W2000032310
- Cited by
- 348
- References
- 55
- Citations by year
- 2026: 8 · 2025: 8 · 2024: 9 · 2023: 13 · 2022: 16 · 2021: 18 · 2020: 21 · 2019: 12 · 2018: 16 · 2017: 14 · 2016: 20 · 2015: 23 · 2014: 21 · 2013: 22 · 2012: 23
- FWCI
- 11.01
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 3956 d)
- Locations
- Ecology (publishedVersion)
- Funders
- Division of Environmental Biology
- Topics
- Physical Sciences › Mathematics › Applied Mathematics › Mathematical and Theoretical Epidemiology and Ecology Models
- Physical Sciences › Mathematics › Statistics and Probability › Markov Chains and Monte Carlo Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- population time series, state-space model, process error, observation error, missing data, hidden states, Bayesian inference, Gibbs sampling, Metropolis-Hastings algorithm, measles, population abundance estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.