The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Implications of Evidence‐Centered Design for Educational Testing
Abstract
Evidence‐centered assessment design (ECD) provides language, concepts, and knowledge representations for designing and delivering educational assessments, all organized around the evidentiary argument an assessment is meant to embody. This article describes ECD in terms of layers for analyzing domains, laying out arguments, creating schemas for operational elements such as tasks and measurement models, implementing the assessment, and carrying out the operational processes. We argue that this framework helps designers take advantage of developments from measurement, technology, cognitive psychology, and learning in the domains. Examples of ECD tools and applications are drawn from the Principled Assessment Design for Inquiry (PADI) project. Attention is given to implications for large‐scale tests such as state accountability measures, with a special eye for computer‐based simulation tasks.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Situated Cognition and the Culture of Learning
Brown, J. S., Collins, A., & Duguid, P. (1989) · Educational Researcher · doi:10.3102/0013189x018001032 · Cited by 13,645
National Science Education Standards
Shea, J. H. (1995) · Journal of Geological Education · doi:10.5408/0022-1368-43.2.102 · Cited by 7,888
Toulmin, S. E. (2003) · doi:10.1017/cbo9780511840005 · Cited by 7,101
Johnson-Laird, P. N. (1983) · Cited by 5,190
Artificial neural networks: a tutorial
Jain, A. K., Mao, J., & Mohiuddin, K. M. (1996) · Computer · doi:10.1109/2.485891 · Cited by 4,946
A Pattern Language: Towns, Buildings, Construction
Alexander, C., Ishikawa, S., Silverstein, M., Jacobson, M., Fiksdahl-King, I., & Angel, S. (1977) · Cited by 4,543
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,857
Knowing What Students Know: The Science and Design of Educational Assessment
Pellegrino, J. W., Chudowsky, N., & Glaser, R. A. (2013) · Cited by 2,402
Kenyon, D. M., Bachman, L. F., & Palmer, A. S. (1998) · The Modern Language Journal · doi:10.2307/328718 · Cited by 2,323
Douglas, O. B., & Holland, B. F. (2015) · Fundamentals of educational psychology. · doi:10.1037/14910-020 · Cited by 2,272
Research works printed but not linked: 22
- American Association for the Advancement of Science (AAAS), 1993, Benchmarks for scientific literacy
- 10.1080/00405849709543775 · doi:10.1080/00405849709543775
- Baker E. L.(2002).Design of automated authoring systems for tests.Proceedings of technology and assessment: Thinking ahead proceedings from a workshop(pp.79–89). Washington DC: National Research Council Board on Testing and Assessment Center for Education Division of Behavioral and Social Sciences and Education.
- Chung G. K. Delacruz W. K. Dionne G. B. &Bewley W. L.(2003 December).Linking assessment and instruction using ontologies.Proceedings of the I/ITSEC Orlando FL .
- Cisco Systems, 2000, Internetworking technology basics
- 10.1037/1082-989X.3.3.380 · doi:10.1037/1082-989x.3.3.380 · Paper page
- Ericsson K. A., 1996, The road to excellence: The acquisition of expert performances, sports, and games
- Gotwals A. W., 2006, Cognitive predictions: BioKIDS implementation of the PADI assessment system
- Hamel L., 2006, A Wizard for PADI assessment design
- IMS Global Learning Consortium(2000).IMS question and test interoperability specification: A review(White Paper IMSWP‐1 Version A). Burlington MA :IMS Global Learning Consortium.
- Messick S., 1989, Educational measurement, 13
- Niemi D., 2005, Moving technology up‐design requirements for valid, effective classroom and large‐scale assessment
- Niemi D., 2005, Moving technology up‐design requirements for valid, effective classroom and large‐scale assessment
- Pearlman M.(2001).Performance assessments for adult education: How to design performance tasks. Presented at the workshop“Performance Assessments for Adult Education: Exploring the Measurement Issues ” hosted by the National Research Council's Board on Testing and Assessment December 12–13 Washington DC .
- 10.1207/S15327574IJT023&4_7 · doi:10.1207/s15327574ijt023&4_7
- Scalise K., 2003, Innovative item types and outcome spaces in computer‐adaptive assessment: A literature survey
- Shute V. J., 2000, Computers as Cognitive Tools, Volume 2, 309
- Simon H. A., 2001, The sciences of the artificial
- Songer N. B.(2004)Evidence of complex reasoning in technology and science: Notes from Inner City Detroit Michigan USA. IPSI‐2004 Pescara Conference Italy .
- Stevens R., 2006, Automated scoring of complex tasks in computer based testing, 259
- Webb N., 2006, Handbook of test development, 155
- Wickham D., 2002, Designing effective wizards: A multidisciplinary approach
Cited by
Siddiq, F., Hatlevik, O. E., Olsen, R. V., Throndsen, I., & Scherer, R. (2016) · Educational Research Review · doi:10.1016/j.edurev.2016.05.002 · Cited by 269
Building a Conceptual Framework for Data Literacy
Gummer, E. S., & Mandinach, E. B. (2015) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811511700401 · Cited by 263
Gobert, J. D., Sao Pedro, M. A., Baker, R. S. J. D., Toto, E., & Montalvo, O. (2012) · Zenodo · doi:10.5281/zenodo.3554645 · Cited by 122
Grover, S., Basu, S., Bienkowski, M., Eagle, M., Diana, N., & Stamper, J. (2017) · ACM Transactions on Computing Education · doi:10.1145/3105910 · Cited by 93
Molerov, D., Zlatkin-Troitschanskaia, O., Nagel, M.-T., Brückner, S., Schmidt, S., & Shavelson, R. J. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.577843 · Cited by 70
Metadata
- Authors
- Mislevy, R. J., & Haertel, G. D.
- Venue
- Educational Measurement: Issues and Practice
- Publisher
- Wiley
- Published
- 2006-12
- Volume
- 25
- Issue
- 4
- Pages
- 6-20
- ISSN
- 0731-1745 (ISSN-L)
- 1745-3992
- OpenAlex
- W2063747225
- Cited by
- 543
- References
- 45
- FWCI
- 5.28
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Implications of Evidence‐Centered Design for Educational Testing. https://app.cochat.ai/papers/10.1111/j.1745-3992.2006.00075.x
- The paper
- Mislevy, R. J., & Haertel, G. D. (2006). Implications of Evidence‐Centered Design for Educational Testing. Educational Measurement: Issues and Practice. https://doi.org/10.1111/j.1745-3992.2006.00075.x
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.