The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Analysing clinical reasoning characteristics using a combined methods approach.
Open accessAbstract
BACKGROUND: Despite a major research focus on clinical reasoning over the last several decades, a method of evaluating the clinical reasoning process that is both objective and comprehensive is yet to be developed.The aim of this study was to test whether a dual approach, using two measures of clinical reasoning, the Clinical Reasoning Problem (CRP) and the Script Concordance Test (SCT), provides a valid, reliable and targeted analysis of clinical reasoning characteristics to facilitate the development of diagnostic thinking in medical students. METHODS: Three groups of participants, general practitioners, and third and fourth (final) year medical students completed 20 on-line clinical scenarios -10 in CRP and 10 in SCT format. Scores for each format were analysed for reliability, correlation between the two formats and differences between subject-groups. RESULTS: Cronbach's alpha coefficient ranged from 0.36 for SCT 1 to 0.61 for CRP 2, Statistically significant correlations were found between the mean f-score of the CRP 2 and total SCT 2 score (0.69); and between the mean f-score for all CRPs and all mean SCT scores (0.57 and 0.47 respectively). The pass/fail rates of the SCT and CRP f-score are in keeping with the findings from the correlation analysis (i.e. 31% of students (11/35) passed both, 26% failed both, and 43% (15/35) of students passed one but not the other test), and suggest that the two formats measure overlapping but not identical characteristics. One-way ANOVA showed consistent differences in scores between levels of expertise with these differences being significant or approaching significance for the CRPs. CONCLUSION: SCTs and CRPs are overlapping and complementary measures of clinical reasoning. Whilst SCTs are more efficient to administer, the use of both measures provides a more comprehensive appraisal of clinical skills than either single measure alone, and as such could potentially facilitate the customised teaching of clinical reasoning for individuals. The modest reliability of SCTs and CRPs in this study suggests the need for an increased number of items for testing. Further work is needed to determine the suitability of a combined approach for assessment purposes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic error in internal medicine
Graber, M. L., Franklin, N., & Gordon, R. (2005) · Archives of Internal Medicine · doi:10.1001/archinte.165.13.1493 · Cited by 1,549 · cited 1×
“Indeed, the patient safety literature abounds with studies which describe common types of diagnostic error [3,4] but few, if any, propose a way of identifying these errors in practice and approaches to remediation [5].”
BackgroundResearch in clinical reasoning: past history and current trends
Norman, G. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02127.x · Cited by 1,018 · cited 1×
“; licensee BioMed Central Commons Attribution License (http://creativec reproduction in any medium, provided the or much enhanced understanding of the cognitive processes involved in diagnosis and their relationship to knowledge [6], but also an increased focus on developing and enhancing clinical reasoning skills in…”
BackgroundEducational Strategies to Promote Clinical Diagnostic Reasoning
Bowen, J. L. (2006) · New England Journal of Medicine · doi:10.1056/nejmra054782 · Cited by 931 · cited 1×
“In pursuit of this goal, numerous strategies have been devised to teach and to learn the diagnostic process and develop clinical reasoning skills, using both cognitive and formulaic approaches (such as heuristics and decision trees) [8-13].”
BackgroundWhat every teacher needs to know about clinical reasoning
Eva, K. W. (2005) · Medical Education · doi:10.1111/j.1365-2929.2004.01972.x · Cited by 930 · cited 1×
“; licensee BioMed Central Commons Attribution License (http://creativec reproduction in any medium, provided the or much enhanced understanding of the cognitive processes involved in diagnosis and their relationship to knowledge [6], but also an increased focus on developing and enhancing clinical reasoning skills in…”
BackgroundTeaching Clinical Reasoning: Case-Based and Coached
Kassirer, J. P. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181d5dd0d · Cited by 445 · cited 1×
“In pursuit of this goal, numerous strategies have been devised to teach and to learn the diagnostic process and develop clinical reasoning skills, using both cognitive and formulaic approaches (such as heuristics and decision trees) [8-13].”
BackgroundAn analysis of the causes of adverse events from the Quality in Australian Health Care Study
Wilson, R. M., Harrison, B. T., Gibberd, R. W., & Hamilton, J. D. (1999) · Medical Journal of Australia · doi:10.5694/j.1326-5377.1999.tb127814.x · Cited by 395 · cited 1×
“This has been due as much to an inherent fascination with the topic itself as to the need to reduce the high incidence of adverse events due to missed and delayed diagnoses [1,2].”
BackgroundThe Script Concordance Test: A Tool to Assess the Reflective Clinician
Charlin, B., Roy, L., Brailovsky, C., Goulet, F., & van der Vleuten, C. (2000) · Teaching and Learning in Medicine · doi:10.1207/s15328015tlm1204_5 · Cited by 373 · cited 3×
“Two possible, already established, methods are the Clinical Reasoning Problems (CRPs) [15] and the Script Concordance Test (SCT) [16].”
MethodResultFive pitfalls in decisions about diagnosis and prescribing
Klein, J. G. (2005) · BMJ · doi:10.1136/bmj.330.7494.781 · Cited by 289 · cited 1×
“In pursuit of this goal, numerous strategies have been devised to teach and to learn the diagnostic process and develop clinical reasoning skills, using both cognitive and formulaic approaches (such as heuristics and decision trees) [8-13].”
BackgroundWhy did I miss the diagnosis? Some cognitive explanations and educational implications
Bordage, G. (1999) · Academic Medicine · doi:10.1097/00001888-199910000-00065 · Cited by 186 · cited 1×
“Indeed, the patient safety literature abounds with studies which describe common types of diagnostic error [3,4] but few, if any, propose a way of identifying these errors in practice and approaches to remediation [5].”
BackgroundStandardized Assessment of Reasoning in Contexts of Uncertainty: The Script Concordance Approach
Charlin, B., & van der Vleuten, C. P. M. (2004) · Evaluation & the Health Professions · doi:10.1177/0163278704267043 · Cited by 164 · cited 1×
“The SCT has been well-described in several studies [16,18,19].”
Result
Cited by
Large Language Model Influence on Diagnostic Reasoning: A Randomized Clinical Trial
Goh, E., Gallo, R., Hom, J., Strong, E., Weng, Y., Kerman, H., Cool, J. A., Kanjee, Z., Parsons, A. S., Ahuja, N., et al. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2024.40969 · Cited by 724
Clinical Reasoning in Physical Therapy: A Concept Analysis
Huhn, K., Gilliland, S. J., Black, L. L., Wainwright, S. F., & Christensen, N. (2018) · Physical Therapy · doi:10.1093/ptj/pzy148 · Cited by 168
Brentnall, J., Thackray, D., & Judd, B. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19020936 · Cited by 51
“Script Concordance Test with Think Aloud (Medicine) [37], [90] *”
BackgroundMethodThe script concordance test for clinical reasoning: re‐examining its utility and potential weakness
See, K. C., Tan, K. L., & Lim, T. K. (2014) · Medical Education · doi:10.1111/medu.12514 · Cited by 49
Influence of a Large Language Model on Diagnostic Reasoning: A Randomized Clinical Vignette Study
Goh, E., Gallo, R., Hom, J., Strong, E., Weng, Y., Kerman, H., Cool, J., Kanjee, Z., Parsons, A. S., Ahuja, N., et al. (2024) · doi:10.1101/2024.03.12.24303785 · Cited by 38
“This assessment tool demonstrated substantial agreement between graders and internal reliability similar or superior to other measures used in the assessment of reasoning 31,32,33,34 .”
Result
Metadata
- Authors
- Groves, M., Dick, M.-L., McColl, G., & Bilszta, J.
- Affiliations
- The University of Queensland (AU)
- The University of Melbourne (AU)
- Corresponding author
- Groves, Michele
- Venue
- BMC Medical Education
- Published
- 2013-10-29
- Volume
- 13
- Issue
- 1
- Pages
- 144-144
- ISSN
- 1472-6920 (ISSN-L)
- PMC
- PMC4231458
- OpenAlex
- W2069269993
- Cited by
- 22
- References
- 23
- Citations by year
- 2025: 3 · 2024: 2 · 2022: 1 · 2021: 1 · 2020: 2 · 2019: 2 · 2018: 4 · 2016: 2 · 2015: 2 · 2014: 2 · 2013: 1
- FWCI
- 1.98
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- BMC Medical Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Minerva Access (University of Melbourne) (submittedVersion, cc-by)
- Funders
- University of Melbourne
- University of Queensland
- Topics
- Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Keywords
- clinical reasoning, script concordance test, diagnostic reasoning, medical students, general practitioners, clinical reasoning assessment, test reliability, test validity, clinical expertise, clinical reasoning instruction
- MeSH terms
- Clinical Competence, Diagnosis, Humans, Models, Psychological, Students, Medical, Thinking, General Practitioners
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Analysing clinical reasoning characteristics using a combined methods approach. https://app.cochat.ai/papers/10.1186/1472-6920-13-144
- The paper
- Groves, M., Dick, M.-L., McColl, G., & Bilszta, J. (2013). Analysing clinical reasoning characteristics using a combined methods approach. BMC Medical Education. https://doi.org/10.1186/1472-6920-13-144
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.