Quasi-Experimental Designs in Practice-based Research Settings: Design and Implementation Considerations
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Although randomized controlled trials are often a gold standard for determining intervention effects, in the area of practice-based research (PBR), there are many situations in which individual randomization is not possible. Alternative approaches to evaluating interventions have received increased attention, particularly those that can retain elements of randomization such that they can be considered "controlled" trials. METHODS: Methodological design elements and practical implementation considerations for two quasi-experimental design approaches that have considerable promise in PBR settings--the stepped-wedge design, and a variant of this design, a wait-list cross-over design, are presented along with a case study from a recent PBR intervention for patients with diabetes. RESULTS: PBR-relevant design features include: creation of a cohort over time that collects control data but allows all participants (clusters or patients) to receive the intervention; staggered introduction of clusters; multiple data collection points; and one-way cross-over into the intervention arm. Practical considerations include: randomization versus stratification, training run in phases; and extended time period for overall study completion. CONCLUSION: Several design features of practice based research studies can be adapted to local circumstances yet retain elements to improve methodological rigor. Studies that utilize these methods, such as the stepped-wedge design and the wait-list cross-over design, can increase the evidence base for controlled studies conducted within the complex environment of PBR.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The stepped wedge trial design: a systematic review
Brown, C. A., & Lilford, R. J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-54 · Cited by 907
Killam, W. P., Tambatamba, B. C., Chintu, N., Rouse, D., Stringer, E., Bweupe, M., Yu, Y., & Stringer, J. S. (2010) · AIDS · doi:10.1097/qad.0b013e32833298be · Cited by 96 · cited 2×
“An example of a completed clinic-based study that used this stepped-wedge approach with a phased in intervention examined the impact of integration of HIV testing and anti-retroviral therapy (ARV) within prenatal care services in 8 primary care practices in Zambia on rates of ARV therapy before delivery.(12) Sites wer…”
BackgroundHandley, M. A., Shumway, M., & Schillinger, D. (2008) · The Annals of Family Medicine · doi:10.1370/afm.889 · Cited by 95
Self-citationTurner, J., Kelly, B., Clarke, D., Yates, P., Aranda, S., Jolley, D., Chambers, S., Hargraves, M., & McFadyen, L. (2011) · BMC Cancer · doi:10.1186/1471-2407-11-48 · Cited by 4 · cited 2×
“More recently, the literature indicates stepped-wedge designs are increasingly being implemented in clinic-based settings world-wide, for example, in a trial of guideline implementation for therapeutic hypothermia in post-cardiac patients in a network of Emergency Departments in Canada(10) and in evaluating implementa…”
Background
Cited by
Selecting and Improving Quasi-Experimental Designs in Effectiveness and Implementation Research
Handley, M. A., Lyles, C. R., McCulloch, C., & Cattamanchi, A. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014128 · Cited by 428
Self-citationmHealth for HIV Treatment & Prevention: A Systematic Review of the Literature
Catalani, C., Philbrick, W., Fraser, H., Mechael, & Israelski, D. M. (2013) · The Open AIDS Journal · doi:10.2174/1874613620130812003 · Cited by 230
“However, when RCTs are not feasible or ethical in practice-based contexts, implementers and researchers can push for more rigorous quasi-experimental studies [52-54] and further grounding [55] and analytical rigor [56] in qualitative studies.”
BackgroundAdvancing the science of mHealth
Nilsen, W., Kumar, S., Shar, A., Varoquiers, C., Wiley, T., Riley, W. T., Pavel, M., & Atienza, A. A. (2012) · Journal of Health Communication · doi:10.1080/10810730.2012.677394 · Cited by 226
Review of recent methodological developments in group-randomized trials: part 2—analysis
Turner, E. L., Prague, M., Gallis, J. A., Li, F., & Murray, D. M. (2017) · American Journal of Public Health · doi:10.2105/ajph.2017.303707 · Cited by 195
Sample size calculation for a stepped wedge trial
Baio, G., Copas, A., Ambler, G., Hargreaves, J., Beard, E., & Omar, R. Z. (2015) · Trials · doi:10.1186/s13063-015-0840-9 · Cited by 163
Metadata
- Authors
- Handley, M. A., Schillinger, D., & Shiboski, S.
- Venue
- The Journal of the American Board of Family Medicine
- Published
- 2011-09-01
- Volume
- 24
- Issue
- 5
- Pages
- 589-596
- ISSN
- 1557-2625 (ISSN-L)
- 1558-7118
- OpenAlex
- W2127135518
- Cited by
- 111
- References
- 4
- FWCI
- 5.84
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Quasi-Experimental Designs in Practice-based Research Settings: Design and Implementation Considerations. https://app.cochat.ai/papers/10.3122/jabfm.2011.05.110067
- The paper
- Handley, M. A., Schillinger, D., & Shiboski, S. (2011). Quasi-Experimental Designs in Practice-based Research Settings: Design and Implementation Considerations. The Journal of the American Board of Family Medicine. https://doi.org/10.3122/jabfm.2011.05.110067
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.