The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Sampling Variability of Performance Assessments
Abstract
In this article, performance assessments are cast within a sampling framework. More specifically, a performance assessment is viewed as a sample of student performance drawn from a complex universe defined by a combination of all possible tasks, occasions, raters, and measurement methods. Using generalizability theory, we present evidence bearing on the generalizability and convergent validity of performance assessments sampled from a range of measurement facets and measurement methods. Results at both the individual and school level indicate that task‐sampling variability is the major source ofmeasurment error. Large numbers of tasks are needed to get a reliable measure of mathematics and science achievement at the elementary level. With respect to convergent validity, results suggest that methods do not converge. Students' performance scores, then, are dependent on both the task and method sampled.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Douglas, O. B., & Holland, B. F. (2015) · Fundamentals of educational psychology. · doi:10.1037/14910-020 · Cited by 2,272
Generalizability theory: a primer
(1992) · Choice Reviews Online · doi:10.5860/choice.29-4192 · Cited by 1,298
Elements of Generalizability Theory
Brennan, R. L. (1992) · Medical Entomology and Zoology · Cited by 599
Assessing the Thinking Curriculum: New Tools for Educational Reform
Resnick, L. B., & Resnick, D. P. (1992) · Changing Assessments · doi:10.1007/978-94-011-2968-8_3 · Cited by 589
Shavelson, R. J., Webb, N. M., & Rowley, G. L. (1989) · American Psychologist · doi:10.1037/0003-066x.44.6.922 · Cited by 329
Self-citationQuality Control in the Development and Use of Performance Assessments
Dunbar, S. B., Koretz, D. M., & Hoover, H. D. (1991) · Applied Measurement in Education · doi:10.1207/s15324818ame0404_3 · Cited by 274
Performance Assessments: Political Rhetoric and Measurement Reality
Shavelson, R. J., Baxter, G. P., & Pine, J. (1992) · Educational Researcher · doi:10.2307/1177207 · Cited by 183
Self-citationPerformance Assessment in Science
Shavelson, R., Baxter, G., & Pine, J. (1991) · Applied Measurement in Education · doi:10.1207/s15324818ame0404_7 · Cited by 170
Self-citationKane, M. T. (1982) · Applied Psychological Measurement · doi:10.1177/014662168200600201 · Cited by 148
Research news and Comment: Performance Assessments
Shavelson, R. J., Baxter, G. P., & Pine, J. (1992) · Educational Researcher · doi:10.3102/0013189x021004022 · Cited by 134
Self-citation
Research works printed but not linked: 14
- Baron J. B.(1990 October).Use of alternative assessments in state assessment: The Connecticut experience.Paper presented at the conference on the Promise and Peril of Alternative Assessment Washington DC.
- Brennan R. L., 1991, Elements of generalizabitity theory
- Bush G. W., 1991, America 2000: An education strategy
- California State Department of Education, 1985, Mathematics framework for California public schools: Kindergarten through grade twelve
- California State Department of Education, 1987, Mathematics framework for California public schools: Kindergarten through grade twelve
- California State Department of Education, 1989, A question of thinking: A first look at students' performance on open‐ended questions in mathematics
- California State Department of Education, 1990, Sixth‐grade science performance‐based assessment administration manual
- Camplin J.(1989 October).New York State science assessment.Paper presented at the Curriculum/Assessment Alignment Conference Long Beach.
- Cronbach L. J., 1972, The dependability of behavioral measurements
- Jaeger R. M., 1992, “World class” standards, choice, and privatization: Weak measurement serving presumptive policy, Phi Delta Kappan, 74, 118
- Lane S., 1992, Learning by doing
- Shavelson R. J., 1990, Indicators of science achievement: Options for a powerful policy instrument, Phi Delta Kappan, 77, 692
- Vermont Department of Education, 1991, Vermont's writing assessment program
- Wigdor A. K., 1991, Performance assessment in the workplace(Vol 1)
Cited by
Scientific Research in Education
(2002) · National Academies Press eBooks · doi:10.17226/10236 · Cited by 1,723
The assessment of professional competence: Developments, research and practical implications
Van Der Vleuten, C. P. M. (1996) · Advances in Health Sciences Education · doi:10.1007/bf00596229 · Cited by 1,247
Problems and issues in the use of concept maps in science assessment
Ruiz-Primo, M. A., & Shavelson, R. J. (1996) · Journal of Research in Science Teaching · doi:10.1002/(sici)1098-2736(199608)33:6<569::aid-tea1>3.0.co;2-m · Cited by 706
Self-citationCan There Be Validity without Reliability?
Moss, P. A. (1994) · Educational Researcher · doi:10.2307/1176218 · Cited by 556
Noble, S., Spann, M. N., Tokoglu, F., Shen, X., Constable, R. T., & Scheinost, D. (2017) · Cerebral Cortex · doi:10.1093/cercor/bhx230 · Cited by 377
Metadata
- Authors
- Shavelson, R. J., Baxter, G. P., & Gao, X.
- Venue
- Journal of Educational Measurement
- Publisher
- Wiley
- Published
- 1993-09
- Volume
- 30
- Issue
- 3
- Pages
- 215-232
- ISSN
- 0022-0655 (ISSN-L)
- 1745-3984
- OpenAlex
- W2098655575
- Cited by
- 338
- References
- 19
- FWCI
- 21.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Sampling Variability of Performance Assessments. https://app.cochat.ai/papers/10.1111/j.1745-3984.1993.tb00424.x
- The paper
- Shavelson, R. J., Baxter, G. P., & Gao, X. (1993). Sampling Variability of Performance Assessments. Journal of Educational Measurement. https://doi.org/10.1111/j.1745-3984.1993.tb00424.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.