The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Time series modeling for syndromic surveillance
Open accessAbstract
BACKGROUND: Emergency department (ED) based syndromic surveillance systems identify abnormally high visit rates that may be an early signal of a bioterrorist attack. For example, an anthrax outbreak might first be detectable as an unusual increase in the number of patients reporting to the ED with respiratory symptoms. Reliably identifying these abnormal visit patterns requires a good understanding of the normal patterns of healthcare usage. Unfortunately, systematic methods for determining the expected number of (ED) visits on a particular day have not yet been well established. We present here a generalized methodology for developing models of expected ED visit rates. METHODS: Using time-series methods, we developed robust models of ED utilization for the purpose of defining expected visit rates. The models were based on nearly a decade of historical data at a major metropolitan academic, tertiary care pediatric emergency department. The historical data were fit using trimmed-mean seasonal models, and additional models were fit with autoregressive integrated moving average (ARIMA) residuals to account for recent trends in the data. The detection capabilities of the model were tested with simulated outbreaks. RESULTS: Models were built both for overall visits and for respiratory-related visits, classified according to the chief complaint recorded at the beginning of each visit. The mean absolute percentage error of the ARIMA models was 9.37% for overall visits and 27.54% for respiratory visits. A simple detection system based on the ARIMA model of overall visits was able to detect 7-day-long simulated outbreaks of 30 visits per day with 100% sensitivity and 97% specificity. Sensitivity decreased with outbreak size, dropping to 94% for outbreaks of 20 visits per day, and 57% for 10 visits per day, all while maintaining a 97% benchmark specificity. CONCLUSIONS: Time series methods applied to historical ED utilization data are an important tool for syndromic surveillance. Accurate forecasting of emergency department total utilization as well as the rates of particular syndromes is possible. The multiple models in the system account for both long-term and recent trends, and an integrated alarms strategy combining these two perspectives may provide a more complete picture to public health authorities. The systematic methodology described here can be generalized to other healthcare settings to develop automated surveillance systems capable of detecting anomalies in disease patterns and healthcare utilization.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Barr, A. J. (1979) · Medical Entomology and Zoology · Cited by 7,198
The Emerging Science of Very Early Detection of Disease Outbreaks
Wagner, M. M., Tsui, F.-C., Espino, J. U., Dato, V. M., Sitting, D. F., Caruana, R. A., McGinnis, L. F., Deerfield, D. W., Druzdzel, M. J., & Fridsma, D. B. (2001) · Journal of Public Health Management and Practice · doi:10.1097/00124784-200107060-00006 · Cited by 228
Early statistical detection of anthrax outbreaks by tracking over-the-counter medication sales
Goldenberg, A., Shmueli, G., Caruana, R. A., & Fienberg, S. E. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.042117499 · Cited by 165
Lewis, M. D., Pavlin, J. A., Mansfield, J., O’Brien, S., Boomsma, L. G., Elbert, Y., & Kelley, P. W. (2002) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(02)00490-7 · Cited by 138
Lazarus, R. M., Kleinman, K., Dashevsky, I., Adams, C., Kludt, P., DeMaria, A., & Platt, R. G. (2002) · Emerging infectious diseases · doi:10.3201/eid0808.020239 · Cited by 128
Using temporal context to improve biosurveillance
Reis, B. Y., Pagano, M., & Mandl, K. D. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0335026100 · Cited by 128
Self-citationValue of ICD-9 coded chief complaints for detection of epidemics.
Tsui, F.-C., D, M. M. W. M., Dato, V., & Chang, C. (2001) · Europe PMC (PubMed Central) · Cited by 88
Value of ICD-9-Coded Chief Complaints for Detection of Epidemics
Tsui, F. R. (2002) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1224 · Cited by 70
Barthell, E. N., Cordell, W. H., Moorhead, J. C., Handler, J. A., Feied, C. F., Stafford‐Smith, M., Cochrane, D. G., Felton, C. W., & Collins, M. (2002) · Annals of Emergency Medicine · doi:10.1067/mem.2002.123127 · Cited by 59
Associations between Outdoor Air Pollutants and Hospitalization for Respiratory Diseases
Hagen, J. A., Nafstad, P. H. J., Skrondal, A., Bjørkly, S., & Magnus, P. M. (2000) · Epidemiology · doi:10.1097/00001648-200003000-00009 · Cited by 56
Cited by
A Space–Time Permutation Scan Statistic for Disease Outbreak Detection
Kulldorff, M., Heffernan, R., Hartman, J., Assunção, R., & Mostashari, F. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020059 · Cited by 1,148
Walker, J., Pan, E., Johnston, D., Adler-Milstein, J., Bates, D. W., & Middleton, B. (2005) · Health Affairs · doi:10.1377/hlthaff.w5.10 · Cited by 811
Implementing Syndromic Surveillance: A Practical Guide Informed by the Early Experience
Mandl, K. D. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1356 · Cited by 410
Self-citationSyndromic surveillance for health information system failures: a feasibility study
Ong, M.-S., Magrabi, F., & Coiera, E. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001144 · Cited by 22
Metadata
- Authors
- Reis, B. Y., & Mandl, K. D.
- Venue
- BMC Medical Informatics and Decision Making
- Published
- 2003-01-23
- Volume
- 3
- Issue
- 1
- Pages
- 2-2
- ISSN
- 1472-6947 (ISSN-L)
- OpenAlex
- W2154531209
- Cited by
- 254
- References
- 14
- FWCI
- 11.21
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Time series modeling for syndromic surveillance. https://app.cochat.ai/papers/10.1186/1472-6947-3-2
- The paper
- Reis, B. Y., & Mandl, K. D. (2003). Time series modeling for syndromic surveillance. BMC Medical Informatics and Decision Making. https://doi.org/10.1186/1472-6947-3-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.