The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Circular instead of hierarchical: methodological principles for the evaluation of complex interventions
Open accessAbstract
BACKGROUND: The reasoning behind evaluating medical interventions is that a hierarchy of methods exists which successively produce improved and therefore more rigorous evidence based medicine upon which to make clinical decisions. At the foundation of this hierarchy are case studies, retrospective and prospective case series, followed by cohort studies with historical and concomitant non-randomized controls. Open-label randomized controlled studies (RCTs), and finally blinded, placebo-controlled RCTs, which offer most internal validity are considered the most reliable evidence. Rigorous RCTs remove bias. Evidence from RCTs forms the basis of meta-analyses and systematic reviews. This hierarchy, founded on a pharmacological model of therapy, is generalized to other interventions which may be complex and non-pharmacological (healing, acupuncture and surgery). DISCUSSION: The hierarchical model is valid for limited questions of efficacy, for instance for regulatory purposes and newly devised products and pharmacological preparations. It is inadequate for the evaluation of complex interventions such as physiotherapy, surgery and complementary and alternative medicine (CAM). This has to do with the essential tension between internal validity (rigor and the removal of bias) and external validity (generalizability). SUMMARY: Instead of an Evidence Hierarchy, we propose a Circular Model. This would imply a multiplicity of methods, using different designs, counterbalancing their individual strengths and weaknesses to arrive at pragmatic but equally rigorous evidence which would provide significant assistance in clinical and health systems innovation. Such evidence would better inform national health care technology assessment agencies and promote evidence based health reform.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563
Evaluating non-randomised intervention studies
Deeks, J., Dinnes, J., D'Amico, R., Sowden, A., Sakarovitch, C., Song, F., Petticrew, M., & Altman, D. (2003) · Health Technology Assessment · doi:10.3310/hta7270 · Cited by 2,907 · cited 1×
“However, we must address the issue of variability and divergence in non-randomized studies and how this should be managed [69].”
A comparison of observational studies and randomized, controlled trials.
Benson, K., & Hartz, A. J. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422506 · Cited by 2,347
Why we need observational studies to evaluate the effectiveness of health care
Black, N. (1996) · BMJ · doi:10.1136/bmj.312.7040.1215 · Cited by 1,598
Placebo and Opioid Analgesia-- Imaging a Shared Neuronal Network
Petrovic, P., Kalso, E., Petersson, K. M., & Ingvar, M. (2002) · Science · doi:10.1126/science.1067176 · Cited by 1,488 · cited 1×
“The expectancy of patients does modulate therapeutic effects so that pharmacological and psychological components are inseparable [24,25].”
Linde, K., Clausius, N., Ramirez, G., Melchart, D., Eitel, F., Hedges, L. V., & Jonas, W. B. (1997) · The Lancet · doi:10.1016/s0140-6736(97)02293-9 · Cited by 979
Self-citationThe double-blind, randomized, placebo-controlled trial
Kaptchuk, T. J. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00347-4 · Cited by 595
Kalauokalani, D., Cherkin, D. C., Sherman, K. J., Koepsell, T. D., & Deyo, R. A. (2001) · Spine · doi:10.1097/00007632-200107010-00005 · Cited by 407 · cited 1×
“Expectancy of patients seems a key factor [36,37] that has been shown to modulate therapeutic effects of anti-emetic treatments in chemotherapy [38-42] and of massage in low back pain [43,44].”
Large-scale randomized evidence: Large, simple trials and overviews of trials
Peto, R., Collins, R., & Gray, R. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00150-o · Cited by 365
‘Powerful Placebo: The Dark Side of the Randomised Controlled Trial’
Kaptchuk, T. J. (1998) · The Lancet · doi:10.1016/s0140-6736(97)10111-8 · Cited by 339
Cited by
Best care at lower cost: the path to continuously learning health care in America
(2014) · Choice Reviews Online · doi:10.5860/choice.51-3277 · Cited by 1,363
Visted, E., Vøllestad, J., Nielsen, M. B., & Nielsen, G. H. (2015) · Mindfulness · doi:10.1007/s12671-014-0283-5 · Cited by 178
10 years of mindlines: a systematic review and commentary
Wieringa, S., & Greenhalgh, T. (2015) · Implementation Science · doi:10.1186/s13012-015-0229-x · Cited by 150
Randomised controlled trials may underestimate drug effects: balanced placebo trial design
Lund, K., Vase, L., Petersen, G. L., Jensen, T. S., & Finnerup, N. B. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084104 · Cited by 72
Movsisyan, A., Melendez-Torres, G. J., & Montgomery, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.03.014 · Cited by 50
Metadata
- Authors
- Walach, H., Falkenberg, T., Fønnebø, V., Lewith, G., & Jonas, W. B.
- Venue
- BMC Medical Research Methodology
- Published
- 2006-06-24
- Volume
- 6
- Issue
- 1
- Pages
- 29-29
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2114497206
- Cited by
- 249
- References
- 11
- FWCI
- 17.68
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Circular instead of hierarchical: methodological principles for the evaluation of complex interventions. https://app.cochat.ai/papers/10.1186/1471-2288-6-29
- The paper
- Walach, H., Falkenberg, T., Fønnebø, V., Lewith, G., & Jonas, W. B. (2006). Circular instead of hierarchical: methodological principles for the evaluation of complex interventions. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-6-29
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.