The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Performance-Based Assessment: Lessons from the Health Professions
Abstract
Performance-based assessment methods have been used in the health professions for centuries, and dozens of studies of their psychometric characteristics have been reported over the past several decades. During that period, the health professions have seen a variety of performance-based assessment methods come and go, and some hard lessons have been learned from the many studies and frequent missteps. This article shares some of those lessons, using four performance-based assessment methods as examples: written clinical simulations (more commonly termed patient management problems), computer-based clinical simulations, oral examinations, and standardized patients (“live” simulations).
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2020) · Journal of Medical Education · doi:10.5812/jme · Cited by 3,490
Assessment of clinical competence using objective structured examination.
Harden, R. M., Stevenson, M., Downie, W. W., & Wilson, G. M. (1975) · BMJ · doi:10.1136/bmj.1.5955.447 · Cited by 1,687
Medical Education in the United States and Canada.
(1911) · Archives of Internal Medicine · doi:10.1001/archinte.1911.00060010141008 · Cited by 1,625
Medical Problem Solving: An Analysis of Clinical Reasoning
Elstein, A. S., Shulman, L. S., & Sprafka, S. A. (1978) · doi:10.4159/harvard.9780674189089 · Cited by 1,377
The interplay of evidence and consequences in the validation of performance assessments
Messick, S. (1994) · Educational Researcher · doi:10.3102/0013189x023002013 · Cited by 1,315
Schmidt, H. G., Norman, G. R., & Boshuizen, H. P. (1990) · Academic Medicine · doi:10.1097/00001888-199010000-00001 · Cited by 1,109
Self-citationComplex, Performance-Based Assessment: Expectations and Validation Criteria
Linn, R. L., Baker, E. L., & Dunbar, S. B. (1991) · Educational Researcher · doi:10.2307/1176232 · Cited by 926
Self-citationMedical Education in the United States and Canada
Flexner, A. (1910) · Science · doi:10.1126/science.32.810.41 · Cited by 824
A True Test: Toward More Authentic and Equitable Assessment
Wiggins, G. (2011) · Phi Delta Kappan · doi:10.1177/003172171109200721 · Cited by 820
A Systems Approach to Educational Testing
Frederiksen, J. R., & Collins, A. (1989) · Educational Researcher · doi:10.2307/1176716 · Cited by 648
Assessment of clinical skills with standardized patients: State of the art
van der Vleuten, C. P. M., & Swanson, D. B. (1990) · Teaching and Learning in Medicine · doi:10.1080/10401339009539432 · Cited by 572
Self-citationThe real test bias: Influences of testing on teaching and learning.
Frederiksen, N. (1984) · American Psychologist · doi:10.1037//0003-066x.39.3.193 · Cited by 531
The effect of assessments and examinations on the learning of medical students
NEWBLE, D. I., & JAEGER, K. (1983) · Medical Education · doi:10.1111/j.1365-2923.1983.tb00657.x · Cited by 490
White, M. S. (1962) · NSPI Journal · doi:10.1002/pfi.4180010512 · Cited by 386
Sampling Variability of Performance Assessments
Shavelson, R. J., Baxter, G. P., & Gao, X. (1993) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1993.tb00424.x · Cited by 338
Assessing Clinical Competence.
(1985) · Annals of Internal Medicine · doi:10.7326/0003-4819-102-4-569_2 · Cited by 306
Elaborated knowledge: a key to successful diagnostic thinking
Bordage, G. (1994) · Academic Medicine · doi:10.1097/00001888-199411000-00004 · Cited by 286
Pitfalls in the pursuit of objectivity: issues of reliability
VAN DER VLEUTEN, C. P. M., NORMAN, G. R., & DE GRAAFF, E. (1991) · Medical Education · doi:10.1111/j.1365-2923.1991.tb00036.x · Cited by 283
Self-citationQuality Control in the Development and Use of Performance Assessments
Dunbar, S. B., Koretz, D. M., & Hoover, H. D. (1991) · Applied Measurement in Education · doi:10.1207/s15324818ame0404_3 · Cited by 274
Educational Assessment: Expanded Expectations and Challenges
Linn, R. L. (1993) · Educational Evaluation and Policy Analysis · doi:10.2307/1164248 · Cited by 232
Self-citationUse of Standardized Patients in Clinical Assessments: Recent Developments and Measurement Findings
Vu, N. V., & Barrows, H. S. (1994) · Educational Researcher · doi:10.2307/1177222 · Cited by 192
Policy and validity prospects for performance-based assessment.
Baker, E. L., O'Neil, H. F., & Linn, R. L. (1993) · American Psychologist · doi:10.1037//0003-066x.48.12.1210 · Cited by 187
Self-citationPerformance Assessments: Political Rhetoric and Measurement Reality
Shavelson, R. J., Baxter, G. P., & Pine, J. (1992) · Educational Researcher · doi:10.2307/1177207 · Cited by 183
Pitfalls in the pursuit of objectivity: issues of validity, efficiency and acceptability
NORMAN, G. R., VAN DER VLEUTEN, C. P. M., & DE GRAAFF, E. (1991) · Medical Education · doi:10.1111/j.1365-2923.1991.tb00037.x · Cited by 170
Self-citationUsing Performance Assessment for Accountability Purposes
Mehrens, W. A. (1992) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1992.tb00220.x · Cited by 151
SIMULATION TECHNIQUE IN THE MEASUREMENT OF PROBLEM‐SOLVING SKILLS1
McGUIRE, C. H., & Babbott, D. (1967) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1967.tb00562.x · Cited by 151
Cannell, J. J. (1988) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1988.tb00424.x · Cited by 150
Will National Tests Improve Student Learning
Shepard, L. A. (1991) · Cited by 142
Measuring physiciansʼ performances by using simulated patients
Norman, G. R., Neufeld, V. R., Walsh, A., Woodward, C., & Gliva‐McConvey, G. A. (1985) · Academic Medicine · doi:10.1097/00001888-198512000-00004 · Cited by 135
Self-citationResearch news and Comment: Performance Assessments
Shavelson, R. J., Baxter, G. P., & Pine, J. (1992) · Educational Researcher · doi:10.3102/0013189x021004022 · Cited by 134
The Effects of Standardized Testing on Teaching and Schools
Herman, J. L., & Golan, S. (1993) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1993.tb00550.x · Cited by 129
An objective structured clinical examination for the licentiate
Reznick, R. K., Smee, S. N., Rothman, A., Chalmers, A., Swanson, D. B., Dufresne, L., Lacombe, G., Baumber, J. S., Poldre, P. A., & Levasseur, L. (1992) · Academic Medicine · doi:10.1097/00001888-199208000-00001 · Cited by 123
Self-citationASSESSMENT OF CLINICAL COMPETENCE: WRITTEN AND COMPUTER‐BASED SIMULATIONS
Swanson, D. B., Norcini, J. J., & Grosso, L. J. (1987) · Assessment & Evaluation in Higher Education · doi:10.1080/0260293870120307 · Cited by 111
Self-citationThe test of diagnostic skills.
Hj, R. (1961) · PubMed · Cited by 71
(1979) · Annals of Internal Medicine · doi:10.7326/0003-4819-90-3-486_6 · Cited by 67
Carithers, H. A. (1972) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.1972.02110090136031 · Cited by 64
Measurement Driven Instruction: A Closer Look
Airasian, P. W. (1988) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1988.tb00837.x · Cited by 59
A Comparison of Knowledge, Synthesis, and Clinical Judgment
Norcini, J. J., Swanson, D. B., Grosso, L. J., Shea, J. A., & Webster, G. D. (1984) · Evaluation & the Health Professions · doi:10.1177/016327878400700409 · Cited by 46
Self-citationGeneralizability of Job Performance Measurements: Marine Corps Rifleman
Shavelson, R. J., Mayberry, P. W., Li, W., & Webb, N. M. (1990) · Military Psychology · doi:10.1207/s15327876mp0203_1 · Cited by 33
Positive effects of a clinical performance assessment program
Stillman, P. L., Haley, H.-L. A., Regan, M. B., & Philbin, M. M. (1991) · Academic Medicine · doi:10.1097/00001888-199108000-00015 · Cited by 32
Impact of repeated use of objective structured clinical examination stations
Cohen, R., Rothman, A. I., Ross, J., & Poldre, P. A. (1993) · Academic Medicine · doi:10.1097/00001888-199310000-00051 · Cited by 23
Is Test Security an Issue in a Multistation Clinical Assessment?—A Preliminary Study
Dawson-Saunders, B. K., Stillman, P. L., Haley, H.-L. A., Sutnick, A. I., PHILBIN, M. M., Smith, R. S., OʼDONNELL, J., & Pohl, H. S. (1991) · Academic Medicine · doi:10.1097/00001888-199109001-00010 · Cited by 21
Cipani, E. C., & Morrow, R. (1992) · Springer eBooks · doi:10.1007/978-1-4613-9133-3_3 · Cited by 17
Cited by
Assessing professional competence: from methods to programmes
Van Der Vleuten, C. P. M., & Schuwirth, L. W. T. (2005) · Medical Education · doi:10.1111/j.1365-2929.2005.02094.x · Cited by 1,268
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
Assessment of clinical competence
Wass, V., Van der Vleuten, C., Shatzer, J., & Jones, R. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04221-5 · Cited by 1,024
Workplace-based assessment as an educational tool: AMEE Guide No. 31
Norcini, J., & Burch, V. (2007) · Medical Teacher · doi:10.1080/01421590701775453 · Cited by 984
What every teacher needs to know about clinical reasoning
Eva, K. W. (2005) · Medical Education · doi:10.1111/j.1365-2929.2004.01972.x · Cited by 930
Metadata
- Authors
- Swanson, D. B., Norman, G. R., & Linn, R. L.
- Venue
- Educational Researcher
- Published
- 1995-06
- Volume
- 24
- Issue
- 5
- Pages
- 5
- ISSN
- 0013-189X (ISSN-L)
- OpenAlex
- W2065026656
- Cited by
- 290
- References
- 43
- FWCI
- 14.06
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.