Methods for estimating confidence intervals in interrupted time series analyses of health interventions
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
Objective Interrupted time series is a strong quasi-experimental research design that is increasingly applied to estimate the effects of health services and policy interventions. We describe and illustrate two methods for estimating confidence intervals around absolute and relative changes in outcomes calculated from segmented regression parameter estimates. Study Design and Setting We used multivariate delta and bootstrapping methods to construct confidence intervals around relative changes in level and trend and around absolute changes in outcome based on segmented linear regression analyses of time series data corrected for auto-correlated errors. Results Using previously published time series data, we estimated confidence intervals around the effect of prescription alerts for interacting medications with warfarin on the rate of prescriptions per 10,000 warfarin users per month. Both the multivariate delta method and the bootstrapping method produced similar results. Conclusion The bootstrapping method is preferred for calculating confidence intervals of relative changes in outcomes of time series studies since it does not require large sample sizes when parameter estimates are obtained correctly from the model. Caution is needed when sample size is small.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Agresti, A. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/0471249688 · Cited by 6,746
Segmented regression analysis of interrupted time series studies in medication use research
Wagner, A. K., Soumerai, S. B., Zhang, F., & Ross-Degnan, D. (2002) · Journal of Clinical Pharmacy and Therapeutics · doi:10.1046/j.1365-2710.2002.00430.x · Cited by 3,279 · cited 1×
“This article focuses on segmented linear regression autoregressive error models [1,11], which are more commonly used in health services research, because they can be applied to aggregate outcome estimates, tolerate fewer time points than ARIMA models, and are amenable to intuitive graphical presentation of the data an…”
BackgroundSelf-citation
Cited by
Use of Interrupted Time Series Analysis in Evaluating Health Care Quality Improvements
Penfold, R. B., & Zhang, F. (2013) · Academic Pediatrics · doi:10.1016/j.acap.2013.08.002 · Cited by 1,150
Self-citationJandoc, R., Burden, A. M., Mamdani, M., Lévesque, L. E., & Cadarette, S. M. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.12.018 · Cited by 474
Linden, A., & Adams, J. L. (2011) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01504.x · Cited by 219
“Additionally, the magnitude of change in the outcome at any time-point after introduction of the intervention can be expressed in either absolute or relative terms [17,18].”
BackgroundMyran, D. T., Pugliese, M., Tanuseputro, P., Cantor, N., Rhodes, E., & Taljaard, M. (2022) · Addiction · doi:10.1111/add.15834 · Cited by 86
Ruton, H., Musabyimana, A., Gaju, E., Berhe, A., Grépin, K. A., Ngenzi, J., Nzabonimana, E., & Law, M. R. (2018) · Health Policy and Planning · doi:10.1093/heapol/czy066 · Cited by 74
Metadata
- Authors
- Zhang, F., Wagner, A. K., Soumerai, S. B., & Ross-Degnan, D.
- Venue
- Journal of Clinical Epidemiology
- Publisher
- Elsevier BV
- Published
- 2009-02
- Volume
- 62
- Issue
- 2
- Pages
- 143-148
- ISSN
- 0895-4356 (ISSN-L)
- OpenAlex
- W2081073758
- Cited by
- 247
- References
- 2
- FWCI
- 4.35
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.