The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
A Systems Approach to Educational Testing
Abstract
Our concern in this paper is with the validity of educational tests when they are employed as critical measures of educational outcomes within a dynamic system. The problem of validity arises if an educational system adapts itself to the characteristics of the outcome measures. We introduce the concept of systemically valid tests as ones that induce curricular and instructional changes in education systems (and learning strategy changes in students) that foster the development of the cognitive traits that the tests are designed to measure. We analyze some general characteristics that contribute to or detract from a testing system's systemic validity, such as the use of direct rather than indirect assessment. We then apply these characteristics in developing a set of design principles for creating testing systems that are systemically valid. Finally, we provide an illustration of the proposed principles, by applying them to the design of a student assessment system. This design example addresses not only specifications for the tests, but also the means of teaching the process of assessment to users of the system.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Situated Cognition and the Culture of Learning
Brown, J. S., Collins, A., & Duguid, P. (1989) · Educational Researcher · doi:10.3102/0013189x018001032 · Cited by 13,645
Self-citationAnderson, J. R., Boyle, C. F., & Reiser, B. J. (1985) · Science · doi:10.1126/science.228.4698.456 · Cited by 3,119
Gunderman, R. B. (2011) · Achieving Excellence in Medical Education · doi:10.1007/978-0-85729-307-7_10 · Cited by 2,892
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,883
Moses, L. E., & Lindquist, E. F. (1951) · Journal of the American Statistical Association · doi:10.2307/2280411 · Cited by 1,661
Students’ preconceptions in introductory mechanics
Clement, J. (1982) · American Journal of Physics · doi:10.1119/1.12989 · Cited by 1,230
Bouwman, M. J. (1983) · European Journal of Operational Research · doi:10.1016/0377-2217(83)90060-7 · Cited by 1,064
Cognitive Processes in Writing
Gregg, L. W. (2016) · Routledge eBooks · doi:10.4324/9781315630274 · Cited by 931
A True Test: Toward More Authentic and Equitable Assessment
Wiggins, G. (2011) · Phi Delta Kappan · doi:10.1177/003172171109200721 · Cited by 820
Informal Reasoning and Education
(2012) · Routledge eBooks · doi:10.4324/9780203052228 · Cited by 702
Cited by
Enhancing teaching through constructive alignment
Biggs, J. (1996) · Higher Education · doi:10.1007/bf00138871 · Cited by 4,084
Validating the interpretations and uses of test scores
Kane, M. T. (2013) · Journal of Educational Measurement · doi:10.1111/jedm.12000 · Cited by 2,110
The Role of Assessment in a Learning Culture
Shepard, L. A. (2000) · Educational Researcher · doi:10.3102/0013189x029007004 · Cited by 2,161
Design Research: Theoretical and Methodological Issues
Collins, A., Joseph, D., & Bielaczyc, K. (2004) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1301_2 · Cited by 1,923
Self-citationThe use of scoring rubrics: Reliability, validity and educational consequences
Jonsson, A., & Svingby, G. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.05.002 · Cited by 1,509
Inquiry, modeling, and metacognition: making science accessible to all students
White, B. Y., & Frederiksen, J. R. (1998) · Cognition and Instruction · doi:10.1207/s1532690xci1601_2 · Cited by 1,394
Self-citationThe interplay of evidence and consequences in the validation of performance assessments
Messick, S. (1994) · Educational Researcher · doi:10.3102/0013189x023002013 · Cited by 1,315
Windschitl, M. (2002) · Review of Educational Research · doi:10.3102/00346543072002131 · Cited by 1,118
Complex, Performance-Based Assessment: Expectations and Validation Criteria
Linn, R. L., Baker, E. L., & Dunbar, S. B. (1991) · Educational Researcher · doi:10.2307/1176232 · Cited by 926
Validity and washback in language testing
Messick, S. (1996) · Language Testing · doi:10.1177/026553229601300302 · Cited by 867
Brown, A. L. (1994) · Educational Researcher · doi:10.2307/1176856 · Cited by 729
Scouller, K. (1998) · Higher Education · doi:10.1023/a:1003196224280 · Cited by 724
Formative Assessment: Assessment Is for Self-regulated Learning
Clark, I. (2012) · Educational Psychology Review · doi:10.1007/s10648-011-9191-6 · Cited by 688
From Theory to Practice: A Cognitive Systems Approach
Biggs, J. B. (1993) · Higher Education Research & Development · doi:10.1080/0729436930120107 · Cited by 627
Assessment of clinical skills with standardized patients: State of the art
van der Vleuten, C. P. M., & Swanson, D. B. (1990) · Teaching and Learning in Medicine · doi:10.1080/10401339009539432 · Cited by 572
Can There Be Validity without Reliability?
Moss, P. A. (1994) · Educational Researcher · doi:10.2307/1176218 · Cited by 556
The Case for Authentic Assessment
Wiggins, G. (1990) · University of Massachusetts Amherst · doi:10.7275/ffb1-mm19 · Cited by 493
Ryan, A. (2000) · Journal of Management · doi:10.1016/s0149-2063(00)00041-6 · Cited by 481
The reflective institution: Assuring and enhancing the quality of teaching and learning
Biggs, J. (2001) · Higher Education · doi:10.1023/a:1004181331049 · Cited by 456
Shifting Conceptions of Validity in Educational Measurement: Implications for Performance Assessment
Moss, P. A. (1992) · Review of Educational Research · doi:10.2307/1170738 · Cited by 434
Rich environments for active learning: a definition
Grabinger, R. S., & Dunlap, J. C. (2011) · Research in Learning Technology · doi:10.3402/rlt.v3i2.9606 · Cited by 412
Student responses to criteria‐referenced self‐assessment
Andrade, H., & Du, Y. (2007) · Assessment & Evaluation in Higher Education · doi:10.1080/02602930600801928 · Cited by 382
Putting Case-Based Instruction Into Context: Examples From Legal and Medical Education
Williams, S. M. (1992) · Journal of the Learning Sciences · doi:10.1207/s15327809jls0204_2 · Cited by 365
Sambell, K., McDowell, L., & Brown, S. (1997) · Studies in Educational Evaluation · doi:10.1016/s0191-491x(97)86215-3 · Cited by 320
Within-teacher predictors of teacher efficacy
Ross, J. A., Bradley Cousins, J., & Gadalla, T. (1996) · Teaching and Teacher Education · doi:10.1016/0742-051x(95)00046-m · Cited by 317
Baartman, L. K. J., Bastiaens, T. J., Kirschner, P. A., & van der Vleuten, C. P. M. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.06.001 · Cited by 312
Grades and Test Scores: Accounting for Observed Differences
Willingham, W. W., Pollack, J. M., & Lewis, C. (2002) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2002.tb01133.x · Cited by 306
Validating Measures of Performance
Kane, M., Crooks, T., & Cohen, A. (1999) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.1999.tb00010.x · Cited by 299
Performance-Based Assessment: Lessons from the Health Professions
Swanson, D. B., Norman, G. R., & Linn, R. L. (1995) · Educational Researcher · doi:10.2307/1177072 · Cited by 290
Assessment 2000: Towards a Pluralistic Approach to Assessment
Birenbaum, M. (1996) · Alternatives in Assessment of Achievements, Learning Processes and Prior Knowledge · doi:10.1007/978-94-011-0657-3_1 · Cited by 275
Grossman, P., Loeb, S., Cohen, J., & Wyckoff, J. (2013) · American Journal of Education · doi:10.1086/669901 · Cited by 271
Assessment and learning: fields apart?
Baird, J.-A., Andrich, D., Hopfenbeck, T. N., & Stobart, G. (2017) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969594x.2017.1319337 · Cited by 260
New Assessment Forms in Problem-based Learning: The value-added of the students' perspective
Segers, M., & Dochy, F. (2001) · Studies in Higher Education · doi:10.1080/03075070120076291 · Cited by 253
Children and the Internet: experiments with minimally invasive education in India
Mitra, S., & Rana, V. (2001) · British Journal of Educational Technology · doi:10.1111/1467-8535.00192 · Cited by 154
A review of the benefits and drawbacks of high-stakes final examinations in higher education
French, S., Dickerson, A., & Mulder, R. A. (2024) · Higher Education · doi:10.1007/s10734-023-01148-z · Cited by 126
The learning effect of assessment and evaluation in high school
Becker, W. E., & Rosen, S. (1992) · Economics of Education Review · doi:10.1016/0272-7757(92)90002-k · Cited by 108
Fairness as a multifaceted quality in classroom assessment
Tierney, R. D. (2014) · Studies in Educational Evaluation · doi:10.1016/j.stueduc.2013.12.003 · Cited by 88
The effects of reflection on seventh grade social studies student learning and perception
Denton, D. W., & Ellis, A. K. (2023) · Educational Studies · doi:10.1080/03055698.2020.1835616 · Cited by 4
“Frederiksen and Collins (1989) further support this conclusion when they”
BackgroundResultInfluential
Metadata
- Authors
- Frederiksen, J. R., & Collins, A.
- Venue
- Educational Researcher
- Published
- 1989-12
- Volume
- 18
- Issue
- 9
- Pages
- 27
- ISSN
- 0013-189X (ISSN-L)
- OpenAlex
- W2051013971
- Cited by
- 648
- References
- 24
- FWCI
- 148.40
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.