The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
The Value of Interrupted Time-Series Experiments for Community Intervention Research
Open accessAbstract
Greater use of interrupted time-series experiments is advocated for community intervention research. Time-series designs enable the development of knowledge about the effects of community interventions and policies in circumstances in which randomized controlled trials are too expensive, premature, or simply impractical. The multiple baseline time-series design typically involves two or more communities that are repeatedly assessed, with the intervention introduced into one community at a time. It is particularly well suited to initial evaluations of community interventions and the refinement of those interventions. This paper describes the main features of multiple baseline designs and related repeated-measures time-series experiments, discusses the threats to internal validity in multiple baseline designs, and outlines techniques for statistical analyses of time-series data. Examples are given of the use of multiple baseline designs in evaluating community interventions and policy changes.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The multiple baseline interrupted time series design is recommended for evaluating interventions when randomized controlled trials are not practical.
“The multiple baseline interrupted time series design (ITS) is recommended for evaluating interventions when randomized controlled trials are not practical (Biglan et al. 2000; Shadish et al. 2002).”
From Intervening at the Setting Level to Prevent Behavioral Incidents in Residential Child Care: Efficacy of the CARE Program Model (2016) · cites this paper as Biglan et al. 2000
Citations
Cites
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067 · cited 2×
“Ironically, labeling these designs ''quasi-experimental'' may also undermine the movement toward selection of practices on the basis of sound empirical evidence (e.g., Chambless & Hollon, 1998).”
BackgroundBiglan, A., & Hayes, S. C. (1996) · Applied and Preventive Psychology · doi:10.1016/s0962-1849(96)80026-6 · Cited by 234 · cited 2×
“The mechanist assumption that nomothetic laws will necessarily be discovered has been increasingly criticized in recent years (Biglan, 1995a,b; Biglan & Hayes, 1996; Cronbach, 1986; Sarbin, 1977).”
BackgroundSelf-citation
Flagged first, then by citations
Research works printed but not linked: 59
- Allison, D. B., & Gorman, B. S. (1993). Calculating effect sizes for meta-analysis: The case of the single case. Behavioral Research Therapy, 31, 621–631. · DOI
- Barlow, D. H., Hayes, S. C., & Nelson, R. O. (1984). The essentials of time-series methodology: Case studies&single-case experimentation; Within-series elements; Between-series elements; Combined-series elements. In A. P. Goldstein & L. Krasner (Eds.), The scientist practitioner–Research and accountability in clinical and educational settings. Pergamon general psychology series (pp. 157–272). New York: Pergamon Press.
- Barlow, D. H., & Hersen, M. (1984). Single case experimental designs. Strategies for studying behavior change (2). NewYork: Pergamon Press.
- Biglan, A. (1995a). Changing cultural practices: A contextualist framework for intervention research. Reno, NV: Context Press.
- Biglan, A. (1995b). Choosing a paradigm to guide prevention research and practice. Drugs and Society, 8, 149–160. · DOI
- Biglan, A., Ary, D., Koehn, V., & Levings, D. (1996d). Mobilizing positive reinforcement in communities to reduce youth access to tobacco. American Journal of Community Psychology, 24, 625–638. · DOI
- Biglan, A., Henderson, J., Humphreys, D., Yasui, M., Whisman, R., Black, C., & James, L. (1995). Mobilising positive reinforcement to reduce youth access to tobacco. Tobacco Control, 4, 42–48. · DOI
- Biglan, A., Mrazek, P. J., Carnine, D., & Flay, B. R. (in press). The integration of research and practice in the prevention of youth problem behaviors. American Psychologist.
- Box, G. E. P., & Jenkins, G. M. (1976). Times series analysis: Forecasting and control (Revised). Oakland, CA: Holden-Day, Inc.
- Busk, P. L., & Serlin, R. C. (1992). Meta-analysis for single-case research. In T. R. Kratochwill & J. R. Levin (Eds.), Singlecase research designs and analysis (pp. 187–212). Hillsdale, NJ: Lawrence Erlbaum.
- Campbell, D. T. (1969). Reforms as experiments. American Psychologist, 24, 409–429. · DOI
- Chaloupka, F. J., & Grossman, M. (1996). Price, tobacco control policies and youth smoking. (NBER Working Paper 5740). Chicago: National Bureau of Economic Research and University of Illinois at Chicago Department of Economics. · DOI
- COMMIT Research Group. (1995a). Community intervention trial for smoking cessation (COMMIT): I. Cohort results from a four-year community intervention. American Journal of Public Health, 85, 183–192. · DOI
- COMMIT Research Group. (1995b). Community intervention trial for smoking cessation (COMMIT): II. Changes in adult cigarette smoking prevalence. American Journal of Public Health, 85, 193–200. · DOI
- Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and Analysis Issues for Field Settings. Chicago: Rand McNally.
- Cronbach, L. J. (1986). Social inquiry by and for earthlings. In D. W. Fiske & R. A. Schweder (Eds.), Metatheory in Social Science: Pluralism and Subjectivities (pp. 83–107). Chicago: University of Chicago Press.
- Crosbie, J. (1993). Interrupted time-series analysis with brief single-subject data. Journal of Consulting and Clinical Psychology, 61, 966–974. · DOI
- Crosbie, J. (1995). Interrupted time-series analysis with short series: Why it is problematic; how it can be improved. In J. M. Gottman (Ed.), The Analysis of Change (pp. 361–395). Mahwah, NJ: Lawrence Erlbaum.
- Enders, W. (1995). Applied econometric time series. New York: John Wiley & Sons.
- Fawcett, S. B., Paine, A. L., Francisco, V. T., & Vliet, M. (1995). Promoting health through community development. In D. Glenwick & L. A. Jason (Eds.), Promoting health and mental health: Behavioral approaches to prevention. New York, NY: Haworth Press.
- Forster, J. L., Murray, D. M., Wolfson, M., Blaine, T. M., Wagenaar, A. C., & Hennrikus, D. J. (1998). The effects of community policies to reduce youth access to tobacco. American Journal of Public Health, 88, 1193–1198. · DOI · Paper page
- Glass, G. V., Willson, V. L., & Gottman, J. M. (1975). Design and analysis of time-series experiments. Boulder: University of Colorado Press.
- Gottman, J. M. (1981). Time-series analysis.Acomprehensive introduction for social scientists. New York: Cambridge University Press.
- Harrop, J. W., & Velicer, W. F. (1985). A comparison of alternative approaches to the analysis of interrupted time-series. Multivariate Behavioral Research, 20, 27–44. · DOI
- Hayes, S. C. (1993). Goals and the varieties of scientific contextualism. In S. C. Hayes, L. J. Hayes, T. R. Sarbin, & H. W. Reese (Eds.), The varieties of scientific contextualism (pp. 11–27). Reno, NV: Context Press.
- Hingson, R., Heeren, T., Kovenock, D., Mangione, T., Meyers, A., Morelock, S., Lederman, R., & Scotch, N. A. (1987). Effects of Maine's 1981 and Massachusetts' 1982 drivingunder-the-influence legislation. American Journal of Public Health, 77, 593–597. · DOI
- Hollis, J. F., Lichtenstein, E., Vogt, T. M., Stevens, V. J., & Biglan, A. (1993). Nurse-assisted counseling for smokers in primary care. Annals of Internal Medicine, 118, 521–525. · DOI
- Kellam, S.G. (1999). Integrating prevention science strategies. Presidential address at the 7th Annual Society for Prevention Research Conference, June 24–26, 1999, New Orleans.
- Kratochwill, T. R. (1978). Single subject research. Strategies for evaluation change. New York: Academic Press.
- Liu, L. M., & Hudak, G. B. (1994). Forecasting and time series analysis using the SCA Statistical System. Oak Brook, IL: Scientific Computing Associates Corp.
- Matyas, T. A., & Greenwood, K. M. (1990). Visual analysis of single-case time series: Effects of variability, serial dependence, and magnitude of intervention effects. Journal of Applied Behavior Analysis, 23, 341–351. · DOI · Paper page
- McArdle, J. J. (1988). Dynamic but structural equation modeling of repeated measures data. In J. R. Nesselroade & R. B. Cattell (Eds.), Handbook of mulivariate experimental psychology (2nd ed.) (pp. 561–613). New York: Plenum Press. · DOI
- McCleary, R., & Hay Jr., R. A. (1980). Applied time series analysis for the social sciences. Newbury Park, CA: Sage Publications, Inc.
- Meredith, W., & Tisak, J. (1990). Latent curve analysis. Psychometrika, 55, 107–122. · DOI
- Metzler, C. W., Biglan, A., Ary, D. V., & Li, F. (1998). The stability and validity of early adolescents' reports of parenting practices constructs. Journal of Family Psychology, 12, 600–619. · DOI
- O'Malley, P. M., & Wagenaar, A. C. (1991). Effects of minimum drinking age laws on alcohol use, related behaviors and traffic crash involvement among American youth: 1976–1987. Journal of Studies on Alcohol, 52, 478–491. · DOI
- Ockene, J. K. (1987). Physician-delivered interventions for smoking cessation: Strategies for increasing effectiveness. Preventive Medicine, 16, 723–737. · DOI
- Perry, C. L., Finnegan, J. R., Forster, J. L., Wagenaar, A. C., & Wolfson, M. (1996). Project Northland: Outcomes of a communitywide alcohol use prevention program during early adolescence. American Journal of Public Health, 86, 956–965. · DOI
- Ross, H. L. (1973). Law, science, and accidents: The British Road Safety Act of 1967. The Journal of Legal Studies, 11, 1–78. · DOI
- Sarbin, T. R. (1977). Contextualism: A world view for modern psychology. Nebraska symposium on motivation, Vol. 24 (pp. 3–40). Lincoln: University of Nebraska Press.
- Sidman, M. (1960). Tactics of scientific research. New York: Basic Books.
- Simonton, D. K. (1977a). Cross-sectional time-series experiments: Some suggested statistical analyses. Psychological Bulletin, 84, 489–502. · DOI
- Simonton, D. K. (1977b). Erratum to Simonton. Psychological Bulletin, 84, 1097. · DOI
- Trickett, E. J. (1991). Living an idea. Empowerment and the evolution of an alternative high school. Cambridge, MA: Brookline Books.
- Tryon, W. W. (1982). Reinforcement history as possible basis for the relationship between self-percepts of efficacy and responses to treatment. Journal of Behavioral and Experimental Psychiatry, 13, 201–202. · DOI
- US Department of Health and Human Services. (1994). Preventing tobacco use among young people: A report of the Surgeon General. Atlanta, Georgia: U.S. Department of Health and Human Services, Public Health Service, Centers for Disease Control and Prevention, National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health.
- Velicer, W. F., & Harrop, J. (1983). The reliability and accuracy of time series model identification. Evaluation Review, 7, 551–560. · DOI
- Velicer, W. F., & McDonald, R. P. (1984). Time series analysis without model identification. Multivariate Behavioral Research, 19, 33–47. · DOI
- Velicer, W. F., & McDonald, R. P. (1991). Cross-sectional time series designs: A general transformation approach. Multivariate Behavioral Research, 26, 247–254. · DOI
- Wagenaar, A. C. (1983). Alcohol, young drivers, and traffic accidents: Effects of minimum age laws. Lexington, MA: Lexington Books.
- Wagenaar, A. C. (1986). Preventing highway crashes by raising the legal minimum age for drinking: TheMichigan experience six years later. Journal of Safety Research, 17, 101–109. · DOI
- Wagenaar, A. C. (1993). Minimum drinking age and alcohol availability to youth: Issues and research needs. Alcohol and health monograph: Economics and the prevention of alcohol-related problems (pp. 175–200). Rockville, MD: National Institute on Alcohol Abuse and Alcoholism.
- Wagenaar, A. C., Gehan, J. P., Jones-Webb, R., Wolfson, M., Toomey, T. L., Forster, J. L., & Murray, D. M. (1999). Communities mobilizing for change on alcohol: Lessons and results from a 15-community randomized trial. Journal of Community Psychology, 27, 315–326. · DOI
- Wagenaar, A. C., & Maybee, R. G. (1986). The legal minimum drinking age in Texas: Effects of an increase from 18 to 19. Journal of Safety Research, 17, 165–178. · DOI
- Wagenaar, A. C., Murray, D. M., Gehan, J. P., Wolfson, M., Forster, J. L., Toomey, T. L., Perry, C. L., & Jones-Webb, R. Interrupted Time-Series Experiments 49 (in press). Communities mobilizing for change on alcohol: Outcomes from a randomized community trial. Journal of Studies on Alcohol.
- Wagenaar, A. C., Murray, D. M., Wolfson, M., & Forster, J. L. (1994). Communities mobilizing for change on alcohol: Design of a randomized community trial. Journal of Community Psychology, 1994–101. · DOI
- Wagenaar, A. C., & Webster, D. W. (1986). Preventing injuries to children through compulsory automobile safety seat use. Pediatrics, 78, 662–672.
- Warner, K. E. (1977). The effects of the anti-smoking campaign on cigarette consumption. American Journal of Public Health, 67, 645–650. · DOI
- Windsor, R. A. (1986). The utility of time series designs and analysis in evaluating health promotion and education programs. Advances in Health Education and Promotion, 1, 435–465.
Cited by
Sorted by citations
Interrupted time series regression for the evaluation of public health interventions: a tutorial
Lopez Bernal, J., Cummins, S., & Gasparrini, A. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw098 · Cited by 3,049
Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination
Flay, B. R., Biglan, A., Boruch, R. F., Castro, F. G., Gottfredson, D., Kellam, S., Mościcki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005) · Prevention Science · doi:10.1007/s11121-005-5553-y · Cited by 1,338
Self-citationUse of Interrupted Time Series Analysis in Evaluating Health Care Quality Improvements
Penfold, R. B., & Zhang, F. (2013) · Academic Pediatrics · doi:10.1016/j.acap.2013.08.002 · Cited by 1,150
The Delivery of Public Health Interventions via the Internet: Actualizing Their Potential
Bennett, G. G., & Glasgow, R. E. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100235 · Cited by 800
Design and analysis of group-randomized trials: a review of recent methodological developments
Murray, D. M., Varnell, S. P., & Blitstein, J. L. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.423 · Cited by 677
Limitations of the Randomized Controlled Trial in Evaluating Population-Based Health Interventions
Sanson-Fisher, R. W., Bonevski, B., Green, L. W., & D’Este, C. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.04.007 · Cited by 514
An Overview of Research and Evaluation Designs for Dissemination and Implementation
Brown, C. H., Curran, G., Palinkas, L. A., Aarons, G. A., Wells, K. B., Jones, L., Collins, L. M., Duan, N., Mittman, B. S., Wallace, A., et al. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044215 · Cited by 509
Society for Prevention Research Type 2 Translational Task Force Members and Contributing Authors, Spoth, R., Rohrbach, L. A., Greenberg, M., Leaf, P., Brown, C. H., Fagan, A., Catalano, R. F., Pentz, M. A., Sloboda, Z., et al. (2013) · Prevention Science · doi:10.1007/s11121-012-0362-6 · Cited by 283
Study Designs for Effectiveness and Translation Research
Mercer, S. L., DeVinney, B. J., Fine, L. J., Green, L. W., & Dougherty, D. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.04.005 · Cited by 222
Boyd, M. R., Powell, B. J., Endicott, D., & Lewis, C. C. (2018) · Behavior Therapy · doi:10.1016/j.beth.2017.11.012 · Cited by 137
Izzo, C. V., Smith, E. G., Holden, M. J., Norton, C. I., Nunno, M. A., & Sellers, D. E. (2016) · Prevention Science · doi:10.1007/s11121-016-0649-0 · Cited by 56
Finding order in heterogeneity: types of quality-improvement intervention publications
Rubenstein, L. V., Hempel, S., Farmer, M. M., Asch, S. M., Yano, E. M., Dougherty, D., & Shekelle, P. W. (2008) · Quality and Safety in Health Care · doi:10.1136/qshc.2008.028423 · Cited by 52
EQUIP Emergency: Study protocol for an organizational intervention to promote equity in health care.
Varcoe, C., Bungay, V., Browne, A. J., Wilson, E., Wathen, C. N., Kolar, K., Perrin, N., Comber, S., Blanchet Garneau, A., Byres, D., et al. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4494-2 · Cited by 47
Wyman, P. A., Henry, D., Knoblauch, S., & Brown, C. H. (2015) · Prevention Science · doi:10.1007/s11121-014-0535-6 · Cited by 42
McKeon, G., Steel, Z., Wells, R., Newby, J., Hadzi-Pavlovic, D., Vancampfort, D., & Rosenbaum, S. (2021) · JMIR Formative Research · doi:10.2196/23432 · Cited by 29
Varcoe, C., Browne, A. J., Perrin, N., Wilson, E., Bungay, V., Byres, D., Wathen, N., Stones, C., Liao, C., & Price, E. R. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08475-4 · Cited by 27
“We compared the level of the outcome (% patients LWCC) and the rate of change over time between the time period prior to the intervention and the time period after the intervention [67].”
Method
Metadata
- Authors
- Biglan, A., Ary, D., & Wagenaar, A. C.
- Affiliations
- Oregon Research Institute (US)
- University of Minnesota (US)
- Venue
- Prevention Science
- Published
- 2000-03
- Volume
- 1
- Issue
- 1
- Pages
- 31-49
- ISSN
- 1389-4986 (ISSN-L)
- 1573-6695
- PMC
- PMC4553062
- OpenAlex
- W2138039555
- Cited by
- 444
- References
- 2
- Citations by year
- 2026: 10 · 2025: 16 · 2024: 19 · 2023: 20 · 2022: 26 · 2021: 39 · 2020: 34 · 2019: 29 · 2018: 32 · 2017: 28 · 2016: 25 · 2015: 31 · 2014: 21 · 2013: 21 · 2012: 21
- FWCI
- 0.77
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- Locations
- Prevention Science (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Drug Abuse (R01DA009306, DA 09306, DA 09678, R01DA009678)
- National Cancer Institute (R01CA038273, CA38273)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- interrupted time series design, multiple baseline design, policy evaluation
- MeSH terms
- Community Health Services, Humans, Research Design, Time Factors, Reproducibility of Results, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review