CoChat

The DOI matches its Crossref record; 71 of the 74 references it cites were found in a registry or an index.

INTERRUPTED TIME SERIES DESIGNS IN HEALTH TECHNOLOGY ASSESSMENT: LESSONS FROM TWO SYSTEMATIC REVIEWS OF BEHAVIOR CHANGE STRATEGIES

Ramsay, Craig R., Matowe, Lloyd, Grilli, Roberto, Grimshaw, Jeremy M., Thomas, Ruth E. · 2003 · International Journal of Technology Assessment in Health Care

Abstract

Objectives: In an interrupted time series (ITS) design, data are collected at multiple instances over time before and after an intervention to detect whether the intervention has an effect significantly greater than the underlying secular trend. We critically reviewed the methodological quality of ITS designs using studies included in two systematic reviews (a review of mass media interventions and a review of guideline dissemination and implementation strategies). Methods: Quality criteria were developed, and data were abstracted from each study. If the primary study analyzed the ITS design inappropriately, we reanalyzed the results by using time series regression. Results: Twenty mass media studies and thirty-eight guideline studies were included. A total of 66% of ITS studies did not rule out the threat that another event could have occurred at the point of intervention. Thirty-three studies were reanalyzed, of which eight had significant preintervention trends. All of the studies were considered “effective” in the original report, but approximately half of the reanalyzed studies showed no statistically significant differences. Conclusions: We demonstrated that ITS designs are often analyzed inappropriately, underpowered, and poorly reported in implementation research. We have illustrated a framework for appraising ITS designs, and more widespread adoption of this framework would strengthen reviews that use ITS designs.

Overview

Integrity signals

Registry

Crossref · 10.1017/s0266462303000576

Cites

71 of 71 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 74 references

Research works printed but not linked: 1

  1. Bero L , Grilli R , Grimshaw JM et al .2002 The Cochrane Effective Practice and Organisation of care Group (EPOC) Module.In: The Cochrane Library.Oxford:Update Software Issue 1.

Cited by

See all 766

Metadata

Authors
Ramsay, C. R., Matowe, L., Grilli, R., Grimshaw, J. M., & Thomas, R. E.
Affiliations
  • University of Aberdeen (GB)
  • Kuwait University (KW)
  • Agenzia Sanitaria e Sociale Regionale (IT)
  • University of Ottawa (CA)
Venue
International Journal of Technology Assessment in Health Care
Published
2003-12
Volume
19
Issue
4
Pages
613-623
ISSN
  • 0266-4623 (ISSN-L)
  • 1471-6348
OpenAlex
W2119566762
Cited by
703
References
74
Citations by year
2026: 12 · 2025: 17 · 2024: 25 · 2023: 33 · 2022: 46 · 2021: 39 · 2020: 58 · 2019: 37 · 2018: 50 · 2017: 46 · 2016: 41 · 2015: 55 · 2014: 52 · 2013: 37 · 2012: 37
FWCI
1.21
Type
journal article
Language
en
Open access
closed
Locations
  • International Journal of Technology Assessment in Health Care (publishedVersion)
  • PubMed (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
Keywords
interrupted time series design, methodological quality, behaviour change interventions, mass media interventions, guideline dissemination, implementation strategies, underpowered studies, reanalysis, time series regression, health technology assessment
MeSH terms
Cross-Sectional Studies, Diffusion of Innovation, Health Services, Mass Media, Regression Analysis, Research Design, Technology Assessment, Biomedical, Time Factors, Practice Guidelines as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: INTERRUPTED TIME SERIES DESIGNS IN HEALTH TECHNOLOGY ASSESSMENT: LESSONS FROM TWO SYSTEMATIC REVIEWS OF BEHAVIOR CHANGE STRATEGIES. https://app.cochat.ai/papers/10.1017/s0266462303000576
The paper
Ramsay, C. R., Matowe, L., Grilli, R., Grimshaw, J. M., & Thomas, R. E. (2003). INTERRUPTED TIME SERIES DESIGNS IN HEALTH TECHNOLOGY ASSESSMENT: LESSONS FROM TWO SYSTEMATIC REVIEWS OF BEHAVIOR CHANGE STRATEGIES. International Journal of Technology Assessment in Health Care. https://doi.org/10.1017/s0266462303000576

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.