The DOI matches its Crossref record; 84 of the 86 references it cites were found in a registry or an index.
Mechanisms and the Evidence Hierarchy
Open accessOverview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Russo and Williamson (2007) and Clarke et al. (2014) have revived the arguments of Bradford Hill (1965) and Mackie (1974) to show how this can be done.”
From Identifying the characteristics of effective teacher professional development: a critical review (2021) · cites this paper as Clarke et al. (2014)
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In variance-based approaches, the methodological gold standard is an actual experiment (randomized controlled trial, or RCT), which if properly designed, enables strong causal inferences about the mean causal effect of a given treatment variable within the studied sample (Gerring, 2011; Clarke et al, 2014).”
From Multi-Method Research in the Social Sciences: A Review of Recent Frameworks and a Way Forward (2020) · cites this paper as Clarke et al, 2014
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Evidence of (causal) correlation between a PD intervention and pupil outcomes provides evidence that an intervention as a whole is effective.”
From Identifying the characteristics of effective teacher professional development: a critical review (2021) · cites this paper as Clarke et al., 2014
The cited source says what the claim attributes to it.
In the citing paper
“Clarke et al. (2014, p. 19) argue that these two types of evidence”
From Identifying the characteristics of effective teacher professional development: a critical review (2021) · cites this paper as Clarke et al. (2014)
The cited source says what the claim attributes to it.
In the citing paper
“The second key challenge is the problem of 'masking' (Steel, 2008: 68; Clarke et al 2014). Masking means that a given cause might be linked to the same outcome through multiple mechanisms that can have different effects on the outcome.”
From Multi-Method Research in the Social Sciences: A Review of Recent Frameworks and a Way Forward (2020) · cites this paper as Clarke et al 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769
(1979) · Medical Entomology and Zoology · Cited by 11,252
The environment and disease: association or causation?
Hill, A. B. (2015) · Journal of the Royal Society of Medicine · doi:10.1177/0141076814562718 · Cited by 7,804
Quasi-experimentation: Design and analysis issues for field settings
Shrout, P. E. (1980) · Evaluation and Program Planning · doi:10.1016/0149-7189(80)90063-4 · Cited by 6,091
Yeh, M. (2014) · Journal of Nursing Research · doi:10.1097/jnr.0000000000000065 · Cited by 3,836
Machamer, P., Darden, L., & Craver, C. F. (2000) · Philosophy of Science · doi:10.1086/392759 · Cited by 3,179
Craver, C. F. (2007) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199299317.001.0001 · Cited by 2,099
Effects of dalcetrapib in patients with a recent acute coronary syndrome
Schwartz, G. G., Olsson, A. G., Abt, M., Ballantyne, C. M., Barter, P. J., Brumm, J., Chaitman, B. R., Holme, I. M., Kallend, D., Leiter, L. A., et al. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1206797 · Cited by 2,022
Patient Adherence to Tuberculosis Treatment: A Systematic Review of Qualitative Research
Munro, S. A., Lewin, S. A., Smith, H. J., Engel, M. E., Fretheim, A., & Volmink, J. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040238 · Cited by 1,080
Evidence-Based Public Health: Moving Beyond Randomized Trials
Victora, C. G., Habicht, J.-P., & Bryce, J. (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.400 · Cited by 1,056
An Introduction to the Study of Experimental Medicine
Bernard, C., Wolf, S., & Greene, H. C. (2018) · Routledge eBooks · doi:10.4324/9781351320764-1 · Cited by 937
Bem, D. J. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0021524 · Cited by 893
The Gold Standard-The Challenge of Evidence-Based Medicine and Standardization in Health Care
Stqan Timinerrnans and Marc Berg Tenrple University Press (2004) · Journal for Healthcare Quality · doi:10.1097/01445442-200407000-00016 · Cited by 787
The gold standard : the challenge of evidence-based medicine and standardization in health care
Timmermans, S., & Berg, M. (2003) · Cited by 758
Fox, W., Ellard, G. A., & MITCHISON, D. A. (1999) · PubMed · Cited by 676
Evidence-Based Policy: A Practical Guide to Doing It Better
Cartwright, N., & Hardie, J. (2012) · doi:10.1093/acprof:osobl/9780199841608.001.0001 · Cited by 672
Mental Mechanisms: Philosophical Perspectives on Cognitive Neuroscience
Bizarro, S. F. (2008) · Disputatio · doi:10.2478/disp-2008-0012 · Cited by 650
Bassler, D. (2010) · JAMA · doi:10.1001/jama.2010.310 · Cited by 613
STREPTOMYCIN treatment of pulmonary tuberculosis.
D’Esopo, N. D., & Allison, S. T. (1947) · PubMed · Cited by 606
What is a mechanism? Thinking about mechanisms across the sciences
Illari, P. K., & Williamson, J. (2011) · European Journal for Philosophy of Science · doi:10.1007/s13194-011-0038-2 · Cited by 551
Self-citationInterpreting Causality in the Health Sciences
Russo, F., & Williamson, J. (2007) · International Studies in the Philosophy of Science · doi:10.1080/02698590701498084 · Cited by 549
Self-citationStatistical Explanation and Statistical Relevance
Salmon, W. C. (1971) · doi:10.2307/j.ctt6wrd9p · Cited by 543
Evidence-based policy: a practical guide to doing it better
Cartwright, N. D., & Hardie, J. M. (2013) · Choice Reviews Online · doi:10.5860/choice.50-5831 · Cited by 535
Fayad, Z. A., Mani, V., Woodward, M., Kallend, D. G., Abt, M., Burgess, T., Fuster, V., Ballantyne, C. M., Stein, E. A., Tardif, J., et al. (2011) · The Lancet · doi:10.1016/s0140-6736(11)61383-4 · Cited by 534
Mental Mechanisms: Philosophical Perspectives on Cognitive Neuroscience
Bechtel, W. (2007) · Medical Entomology and Zoology · Cited by 466
Statistical explanation & statistical relevance
Salmon, W. C. (1971) · Medical Entomology and Zoology · Cited by 360
Palmer, K. T. (2011) · Occupational Medicine · doi:10.1093/occmed/kqr127 · Cited by 337
Reasoning in Biological Discoveries
Darden, L. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511498442 · Cited by 322
Why There's No Cause to Randomize
WORRALL, J. L. (2007) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axm024 · Cited by 308
What are randomised controlled trials good for?
Cartwright, N. D. (2009) · Philosophical Studies · doi:10.1007/s11098-009-9450-2 · Cited by 284
Robert Koch, a life in medicine and bacteriology
Worboys, M. (1989) · Choice Reviews Online · doi:10.5860/choice.26-3255 · Cited by 269
Evidence of clinical efficacy of homeopathy
Cucherat, M., Haugh, M., Gooch, M., & Boissel, J. (2000) · European Journal of Clinical Pharmacology · doi:10.1007/s002280050716 · Cited by 249
Kshirsagar, A. V., Carpenter, M. A., Bang, H., Wyatt, S. B., & Colindres, R. E. (2006) · The American Journal of Medicine · doi:10.1016/j.amjmed.2005.08.023 · Cited by 228
Cartwright, N. D. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199574131.001.0001 · Cited by 204
Bayesian Nets and Causality: Philosophical and Computational Foundations
Williamson, J. (2005) · Cited by 199
Self-citationLeibovici, L. (2001) · BMJ · doi:10.1136/bmj.323.7327.1450 · Cited by 197
What Evidence in Evidence‐Based Medicine?
Worrall, J. (2002) · Philosophia Scientiæ · doi:10.1086/341855 · Cited by 195
Is meta-analysis the platinum standard of evidence?
Stegenga, J. (2011) · Studies in History and Philosophy of Science Part C: Studies in History and Philosophy of Biological and Biomedical Sciences · doi:10.1016/j.shpsc.2011.07.003 · Cited by 193 · cited 1×
“Moreover, most hierarchies rank meta-analyses and systematic reviews more highly even than randomised trials, a move that has been criticised by Stegenga (2011).”
BackgroundThe limitations of randomized controlled trials in predicting effectiveness
Cartwright, N. D., & Munro, E. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01382.x · Cited by 189
Mechanistic Evidence: Disambiguating the Russo–Williamson Thesis
Illari, P. M. (2011) · International Studies in the Philosophy of Science · doi:10.1080/02698595.2011.574856 · Cited by 171
Self-citationAcross the Boundaries: Extrapolation in Biology and Social Science
Dupré, J. (2009) · The Philosophical Review · doi:10.1215/00318108-2009-034 · Cited by 168
Analytical Sociology and Social Mechanisms
(2011) · Cambridge University Press eBooks · doi:10.1017/cbo9780511921315 · Cited by 167
Memories of the British streptomycin trial in tuberculosis
Hill, S. A. B. (1990) · Controlled Clinical Trials · doi:10.1016/0197-2456(90)90001-i · Cited by 155
Evidence: philosophy of science meets medicine
WORRALL, J. L. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01400.x · Cited by 147
Chemotherapy of Pulmonary Tuberculosis in Young Adults
Daniels, M., & Hill, A. (1952) · BMJ · doi:10.1136/bmj.1.4769.1162 · Cited by 142
Papineau, D. (1994) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/45.2.437 · Cited by 127
The evidence that evidence-based medicine omits
Clarke, B., Gillies, D. A., Illari, P. K., Federica Russo, B., & Williamson, J. (2012) · Preventive Medicine · doi:10.1016/j.ypmed.2012.10.020 · Cited by 115
Self-citationThe North Karelia Project : From North Karelia to national action
Puska, P., Vartiainen, E. A., Laatikainen, T. K., Jousilahti, P., & Paavola, M. (2009) · Cited by 114
Safety and tolerability of dalcetrapib (RO4607381/JTT-705): results from a 48-week trial
Stein, E. A., Roth, E. M., Rhyne, J. M., Burgess, T., Kallend, D. G., & Robinson, J. G. (2010) · European Heart Journal · doi:10.1093/eurheartj/ehp601 · Cited by 109
Across the Boundaries: Extrapolation in Biology and Social Science
Steel, D. (2007) · doi:10.1093/acprof:oso/9780195331448.001.0001 · Cited by 109
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-3-361 · Cited by 96
The Principle of the Common Cause
Sober, E. R. (1988) · Springer eBooks · doi:10.1007/978-94-009-3997-4_10 · Cited by 94
Epistemic causality and evidence-based medicine.
Federica Russo, B., & Williamson, J. (2011) · PubMed · Cited by 85
Self-citationNagel, E., Reichenbach, H., Hutten, E. H., & Reichenbach, M. (1950) · The Journal of Philosophy · doi:10.2307/2021352 · Cited by 75
Williams, D. C., Reichenbach, H., Hutten, E. H., & Reichenbach, M. (1950) · Philosophy and Phenomenological Research · doi:10.2307/2103642 · Cited by 74
Just a paradigm: evidence-based medicine in epistemological context
Solomon, M. (2011) · European Journal for Philosophy of Science · doi:10.1007/s13194-011-0034-6 · Cited by 71
Howick, J. (2011) · Philosophy of Science · doi:10.1086/662561 · Cited by 70
Inferring causation in epidemiology: Mechanisms, black boxes, and contrasts
Broadbent, A. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199574131.003.0003 · Cited by 69
Generic versus single-case causality: the case of autopsy
Russo, F., & Williamson, J. (2011) · European Journal for Philosophy of Science · doi:10.1007/s13194-010-0012-4 · Cited by 66
Self-citationThe role of basic science in evidence-based medicine
Caze, A. L. (2010) · Biology & Philosophy · doi:10.1007/s10539-010-9231-5 · Cited by 60
The Russo–Williamson thesis and the question of whether smoking causes heart disease
Gillies, D. A. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199574131.003.0006 · Cited by 54
Self-citationEvidence-Based Medicine Must Be ...
Caze, A. L. (2009) · The Journal of Medicine and Philosophy A Forum for Bioethics and Philosophy of Medicine · doi:10.1093/jmp/jhp034 · Cited by 53
Objectively homogeneous reference classes
Salmon, W. C. (1977) · Synthese · doi:10.1007/bf00486104 · Cited by 53
Out of context? Translating evidence from the North Karelia project over place and time
McLaren, L., Ghali, L. M., Lorenzetti, D., & Rock, M. J. (2006) · Health Education Research · doi:10.1093/her/cyl097 · Cited by 47
Understanding mechanisms in the health sciences
Campaner, R. (2010) · Metamedicine · doi:10.1007/s11017-010-9166-5 · Cited by 31
Claveau, F. (2012) · Studies in History and Philosophy of Science Part C Studies in History and Philosophy of Biological and Biomedical Sciences · doi:10.1016/j.shpsc.2012.05.004 · Cited by 31
Evidence and the Assessment of Causal Relations in the Health Sciences
Campaner, R., & Galavotti, M. C. (2012) · International Studies in the Philosophy of Science · doi:10.1080/02698595.2012.653113 · Cited by 28
How Can Causal Explanations Explain?
Williamson, J. (2013) · Erkenntnis · doi:10.1007/s10670-013-9512-x · Cited by 27
Self-citationEvidence‐Based Medicine Can’t Be…
Caze, A. L. (2008) · Social Epistemology · doi:10.1080/02691720802559438 · Cited by 25
Stopping Randomized Trials Early for Benefit and Estimation of Treatment Effects
Bassler, D., Briel, M., Montori, V. M., Glasziou, P., Zhou, Q. X., Heels‐Ansdell, D., Walter, S. D., & Guyatt, G. H. (2012) · Cited by 24
How Probabilistic Causation Can Account for the Use of Mechanistic Evidence
Weber, E. (2009) · International Studies in the Philosophy of Science · doi:10.1080/02698590903197757 · Cited by 20
Causality, theories and medicine
Thompson, R. P. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199574131.003.0002 · Cited by 20
The North Karelia Project: what it tells us about the prevention of cardiovascular disease.
Wagner, E. H. (1982) · American Journal of Public Health · doi:10.2105/ajph.72.1.51 · Cited by 19
Causality in medicine with particular reference to the viral causation of cancers
Clarke, B. (2011) · PhilPapers (PhilPapers Foundation) · Cited by 17
Self-citationFederica Russo, B., & Williamson, J. (2012) · Medicine Studies · doi:10.1007/s12376-012-0079-7 · Cited by 16
Self-citationWhat does randomisation achieve?
Caze, A. L., Djulbegović, B., & Senn, S. J. (2011) · BMJ Evidence-Based Medicine · doi:10.1136/ebm.2011.100061 · Cited by 16
Drăgulinescu, Ş. (2011) · Synthese · doi:10.1007/s11229-011-0011-9 · Cited by 15
The DECLINE of THERAPEUTIC BLOODLETTING and the Collapse of Traditional Medicine
Carter, K. C. (2017) · Routledge eBooks · doi:10.4324/9781315131641 · Cited by 13
Imaging Technology and the Philosophy of Causality
Darby, G., & Williamson, J. (2011) · Philosophy & Technology · doi:10.1007/s13347-010-0010-7 · Cited by 11
Self-citationCausation and melanoma classification
Clarke, B. (2010) · Metamedicine · doi:10.1007/s11017-010-9168-3 · Cited by 8
Self-citationColeman, W. P. (2009) · Monographs in clinical neuroscience/Frontiers of neurology and neuroscience/Monographs in neural sciences · doi:10.1159/000209484 · Cited by 5
Florey, M. E. (1961) · Cited by 4
How necessary are randomized controlled trials
Northcott, R. (2012) · BIROn (Birkbeck, University of London) · Cited by 2
Clinical trial dropouts: Analysis of demography and reasons
Probstfield, J. L., Russell, M. L., & Insull, W. (1981) · Controlled Clinical Trials · doi:10.1016/0197-2456(81)90095-7 · Cited by 1
Flagged first, then by citations
2 of the 86 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- Debré P (1994) Louis Pasteur. The John Hopkins University Press. English translation by Elborg Forster, 1998
- Hedström P, Swedberg R (1988) Social mechanism: an analytical approach to social theory. Cambridge University Press, Cambridge
- Howick J (2011) Exposing the vanities—and a qualified defence—of mechanistic evidence in clinical decision-making. Philos Sci 78(5):926–940. Proceedings of the Biennial PSA 2010
- Lucas R (1976) Econometric policy evaluation. In: Brunner K, Meltzer A (eds) The Phillips curve and labor markets, volume 1 of Carnegie–Rochester conference series on public policy. North-Holland, Amsterdam, pp 161–168
- OCEBM Levels of Evidence Working Group (2011) The Oxford 2011 levels of evidence. Oxford Centre for Evidence-Based Medicine, http://www.cebm.net/index.aspx?o=5653
- Rothman K, Greenland S, Lash T (2008) Modern epidemiology. Lippincott Williams & Wilkins, Philadelphia, PA
Cited by
Sorted by citations
Identifying the characteristics of effective teacher professional development: a critical review
Sims, S., & Fletcher-Wood, H. (2021) · School Effectiveness and School Improvement · doi:10.1080/09243453.2020.1772841 · Cited by 582
Repertoires: A post-Kuhnian perspective on scientific change and collaborative research
Ankeny, R. A., & Leonelli, S. (2016) · Studies in History and Philosophy of Science Part A · doi:10.1016/j.shpsa.2016.08.003 · Cited by 186
Craver, C. F., & Krickel, B. (2019) · doi:10.1093/obo/9780195396577-0395 · Cited by 185
Diener, E., Northcott, R., Zyphur, M. J., & West, S. G. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211037670 · Cited by 174
Love, P. E. D., Ahiaga-Dagbui, D. D., & Irani, Z. (2016) · Transportation Research Part A: Policy and Practice · doi:10.1016/j.tra.2016.08.007 · Cited by 138
Metadata
- Authors
- Clarke, B., Gillies, D., Illari, P., Russo, F., & Williamson, J.
- Affiliations
- University College London (GB)
- University of Kent (GB)
- Corresponding author
- Illari, Phyllis
- Venue
- Topoi
- Published
- 2013-12-03
- Volume
- 33
- Issue
- 2
- Pages
- 339-360
- ISSN
- 0167-7411 (ISSN-L)
- 1572-8749
- OpenAlex
- W1965394391
- Cited by
- 253
- References
- 86
- Citations by year
- 2026: 9 · 2025: 40 · 2024: 15 · 2023: 32 · 2022: 27 · 2021: 15 · 2020: 19 · 2019: 24 · 2018: 22 · 2017: 18 · 2016: 17 · 2015: 10 · 2014: 2 · 2013: 2
- FWCI
- 70.15
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Topoi (publishedVersion)
- Kent Academic Repository (University of Kent) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- VUBIR (Vrije Universiteit Brussel) (submittedVersion)
- Funders
- University of Cambridge
- University of Oxford
- Fonds Wetenschappelijk Onderzoek
- Vlaamse regering
- Arts and Humanities Research Council (AH/J011185/1)
- Medical Research Council
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- evidence hierarchy, evidence-based medicine, causal claims, causal inference
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
