Integrating quasi-experimental and inductive designs in evaluation: A case study of the impact of free bus travel on public health
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Evaluations of ‘natural experiments’ in public policy are typically considered ‘weak’ evidence. Challenges include: making credible claims for causal inference (internal validity); generalizing beyond the case (external validity); and providing useful evidence for decision makers. In public health, where experimental evidence is encouraged by funders and enjoys a degree of rhetorical favour, in theory if not practice, current guidance for evaluating natural experiments focuses largely on methods for strengthening internal validity. Using a case study of the evaluation of free bus travel for young people in London, UK, we demonstrate a pragmatic approach to strengthening both internal and external validity in evaluations through integrating the logic of quasi-experimental methods with inductive qualitative analysis. Combining theoretical and inductive analysis in this way to address questions of policy interest through evaluations of natural experiments may be fruitful, and have methodological advantages over randomized designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
What types of interventions generate inequalities? Evidence from systematic reviews
Lorenc, T., Petticrew, M., Welch, V., & Tugwell, P. (2013) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2012-201257 · Cited by 927
Self-citationEvidence, hierarchies, and typologies: horses for courses: Table 1
Petticrew, M., & Roberts, H. (2003) · Journal of Epidemiology and Community Health · doi:10.1136/jech.57.7.527 · Cited by 539
Self-citationNatural experiments: an underused tool for public health?
Petticrew, M., Cummins, S., Ferrell, C., Findlay, A., Higgins, C., Hoy, C., Kearns, A., & Sparks, L. (2005) · Public Health · doi:10.1016/j.puhe.2004.11.008 · Cited by 318 · cited 1×
“Randomised controlled trials (RCTs) are frequently inappropriate or impossible for evaluating complex interventions in domains such as public health, transport or housing (Petticrew et al., 2005; Petticrew and Roberts, 2003), and are typically used in few evaluations (Woolcock, 2013).”
BackgroundSelf-citationStudy Designs for Effectiveness and Translation Research
Mercer, S. L., DeVinney, B. J., Fine, L. J., Green, L. W., & Dougherty, D. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.04.005 · Cited by 222
Ogilvie, D., Egan, M., Hamilton, V., & Petticrew, M. (2005) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2005.034199 · Cited by 167
Self-citation
Cited by
Craig, P., Di Ruggiero, E., Frohlich, K. L., Mykhalovskiy, E., White, M., on behalf of the Canadian Institutes of Health Research (CIHR)–National Institute for Health Research (NIHR) Context Guidance Authors Group (listed alphabetically), Campbell, R., Cummins, S., Edwards, N., Hunt, K., et al. (2018) · doi:10.3310/cihr-nihr-01 · Cited by 370
Self-citationCase study research for better evaluations of complex interventions: rationale and challenges
Paparini, S., Green, J., Papoutsi, C., Murdoch, J., Petticrew, M., Greenhalgh, T., Hanckel, B., & Shaw, S. (2020) · BMC Medicine · doi:10.1186/s12916-020-01777-6 · Cited by 175
Self-citationHanckel, B., Petticrew, M., Thomas, J., & Green, J. (2021) · BMC Public Health · doi:10.1186/s12889-021-10926-2 · Cited by 147
Self-citation
Metadata
- Authors
- Green, J., Roberts, H., Petticrew, M., Steinbach, R., Goodman, A., Jones, A., & Edwards, P.
- Venue
- Evaluation
- Publisher
- SAGE Publications
- Published
- 2015-10
- Volume
- 21
- Issue
- 4
- Pages
- 391-406
- ISSN
- 1356-3890 (ISSN-L)
- 1461-7153
- OpenAlex
- W1864039718
- Cited by
- 39
- References
- 5
- FWCI
- 3.33
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Integrating quasi-experimental and inductive designs in evaluation: A case study of the impact of free bus travel on public health. https://app.cochat.ai/papers/10.1177/1356389015605205
- The paper
- Green, J., Roberts, H., Petticrew, M., Steinbach, R., Goodman, A., Jones, A., & Edwards, P. (2015). Integrating quasi-experimental and inductive designs in evaluation: A case study of the impact of free bus travel on public health. Evaluation. https://doi.org/10.1177/1356389015605205
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.