Evidence‐based education: development of an instrument to critically appraise reports of educational interventions
Open accessThe DOI matches its Crossref record.
Abstract
Objectives: Educational interventions may ultimately impact on patient care as well as affecting individuals’ learning. Critical evaluation of educational literature by those involved in designing and developing educational interventions is therefore important. A checklist instrument for critically appraising reports of educational interventions is described. Design: The instrument was developed by an iterative process and piloted. The instrument consists of nine questions: 1 Is there a clear question which the study seeks to answer? 2 Is there a clear learning need which the intervention seeks to address? 3 Is there a clear description of the educational context for the intervention? 4 Is the precise nature of the intervention clear? 5 Is the study design able to answer the question posed by the study? 6 Are the methods within the design capable of appropriately measuring the phenomena which the intervention ought to produce? 7 Are the outcomes chosen to evaluate the intervention appropriate? 8 Are there any other explanations of the results explored in the study? 9 Are any unanticipated outcomes explained? A worked example is given to illustrate how the instrument can be used in practice. Setting: The Department of General Practice in Glasgow. Subjects: Young general practitioners and the Educational Journal Club. Results: The instrument was feasible. Conclusions: The use of the checklist allows the reader to critically appraise reports of educational interventions and helps in the practice of evidence‐based education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Association Between Funding and Quality of Published Medical Education Research
Reed, D. A., Cook, D. A., Beckman, T. J., Levine, R. B., Kern, D. E., & Wright, S. M. (2007) · JAMA · doi:10.1001/jama.298.9.1002 · Cited by 958
The Role of Background Knowledge in Reading Comprehension: A Critical Review
Smith, R., Snow, P., Serry, T., & Hammond, L. (2021) · Reading Psychology · doi:10.1080/02702711.2021.1888348 · Cited by 326
GINA guidelines on asthma and beyond*
Bousquet, J., Clark, T. J. H., Hurd, S., Khaltaev, N., Lenfant, C., O'Byrne, P., & Sheffer, A. (2007) · Allergy · doi:10.1111/j.1398-9995.2006.01305.x · Cited by 305
Koufogiannakis, D., & Wiebe, N. (2006) · Evidence Based Library and Information Practice · doi:10.18438/b8ms3d · Cited by 96
Reproducibility of Literature Search Reporting in Medical Education Reviews
Maggio, L. A., Tannery, N. H., & Kanter, S. L. (2011) · Academic Medicine · doi:10.1097/acm.0b013e31822221e7 · Cited by 77
Metadata
- Authors
- Morrison, J. M., Sullivan, F., Murray, E., & Jolly, B.
- Venue
- Medical Education
- Publisher
- Wiley
- Published
- 1999-12
- Volume
- 33
- Issue
- 12
- Pages
- 890-893
- ISSN
- 0308-0110 (ISSN-L)
- 1365-2923
- OpenAlex
- W2043019241
- Cited by
- 72
- References
- 0
- FWCI
- 3.41
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evidence‐based education: development of an instrument to critically appraise reports of educational interventions. https://app.cochat.ai/papers/10.1046/j.1365-2923.1999.00479.x
- The paper
- Morrison, J. M., Sullivan, F., Murray, E., & Jolly, B. (1999). Evidence‐based education: development of an instrument to critically appraise reports of educational interventions. Medical Education. https://doi.org/10.1046/j.1365-2923.1999.00479.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.