The Technical Adequacy of Curriculum-Based and Rating-Based Measures of Written Expression for Elementary School Students
Abstract
Five hundred thirty-eight elementary school students participated in a study designed to examine the technical characteristics of curriculum-based measures (CBMs) for the assessment of writing. In addition, the study investigated rating-based measures of writing using the Six Trait model, an assessment instrument and writing program in use in many schools throughout the United States (Northwest Regional Educational Laboratory, 2000). Technical characteristics of both models were evaluated. Results indicated that, using the Stanford-9 standard scores for written language subtests as the criterion, most scoring conventions of CBMs for written expression were reliable and valid. Despite adequate interobserver agreement on the Six Trait measures according to scoring conventions, exact agreement was low. The Six Trait measures do not measure distinct components of writing, nor do they share a significant amount of variance with Stanford-9 measures of written expression. CBMs of written expression have shown sufficient technical adequacy across several studies to warrant their use in writing assessment. These results do not support the use of the Six Trait model as a measure of written expression. Implications for research are presented.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Cites
Best Practices in School Psychology IV
Thomas, A., Grimes, J., & McKevitt, B. C. (1995) · Medical Entomology and Zoology · Cited by 1,333 · see citing works
Curriculum-based measurement: Assessing special children.
Shinn, M. R. (1989) · Guilford Press eBooks · Cited by 919 · see citing works
Formative Evaluation of Academic Progress: How Much Growth Can We Expect?
Fuchs, L. S., Fuchs, D., Hamlett, C. L., Walz, L., & Germann, G. (1993) · School Psychology Review · doi:10.1080/02796015.1993.12085636 · Cited by 442 · see citing works
A curriculum-based measurement approach to assessing academic performance: What it is and why do it.
Marston, D. (1989) · Cited by 306 · see citing works
Fuchs, L. S., Hamlett, D. F. C. L., Hamlett, C. L., & Stecker, P. M. (1991) · American Educational Research Journal · doi:10.3102/00028312028003617 · Cited by 252 · see citing works
Valid Measurement Procedures for Continuous Evaluation of Written Expression
Deno, S. L., Marston, D., & Mirkin, P. K. (1982) · Exceptional Children · doi:10.1177/001440298204800417 · Cited by 238 · see citing works
Daly, E. J., Martens, B. K., Hamler, K. R., Dool, E. J., & Eckert, T. L. (1999) · Journal of Applied Behavior Analysis · doi:10.1901/jaba.1999.32-83 · Cited by 191 · see citing works
Relevant Classroom Assessment Training for Teachers
Stiggins, R. J. (1991) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1991.tb00171.x · Cited by 156 · see citing works
Identifying Indicators of Written Expression Proficiency for Middle School Students
Espin, C., Shin, J., Deno, S. L., Skare, S., Robinson, S., & Benner, B. (2000) · The Journal of Special Education · doi:10.1177/002246690003400303 · Cited by 142 · see citing works
Jewell, J., & Malecki, C. K. (2005) · School Psychology Review · doi:10.1080/02796015.2005.12086273 · Cited by 124 · see citing works
Correct Word Sequences: A Valid Indicator of Proficiency in Written Expression.
Videen, J. (1982) · Cited by 115 · see citing works
Assessment of Written Expression for Students in Compensatory and Special Education Programs
Tindal, G. A., & Parker, R. (1989) · The Journal of Special Education · doi:10.1177/002246698902300204 · Cited by 86 · see citing works
Deno, S. L. (1980) · Cited by 82 · see citing works
Best Practices in Curriculum-Based Assessment.
Gravois, T. A., & Gickling, E. E. (2002) · Cited by 80 · see citing works
Essential Assessment Skills in Professional Education of Teachers
Schafer, W. D. (1991) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1991.tb00170.x · Cited by 77 · see citing works
Espin, C. A., De La Paz, S., Scierka, B. J., & Roelofs, L. (2005) · The Journal of Special Education · doi:10.1177/00224669050380040201 · Cited by 74 · see citing works
Jones, E. D., & Krouse, J. P. (1988) · Teacher Education and Special Education The Journal of the Teacher Education Division of the Council for Exceptional Children · doi:10.1177/088840648801100102 · Cited by 68 · see citing works
Teachers' Knowledge of Accommodations As a Validity Issue in High-Stakes Testing
Hollenbeck, K. L., Tindal, G. A., & Almond, P. (1998) · The Journal of Special Education · doi:10.1177/002246699803200304 · Cited by 62 · see citing works
CRITERION-RELATED VALIDITY OF CURRICULUM-BASED MEASURES IN WRITING FOR SECONDARY SCHOOL STUDENTS
Espin, C. A. (1999) · Reading & Writing Quarterly · doi:10.1080/105735699278279 · Cited by 58 · see citing works
Patterns of Writing Skills Derived From Cluster Analysis of Direct-Writing Assessments
Roid, G. H. (1994) · Applied Measurement in Education · doi:10.1207/s15324818ame0702_4 · Cited by 57 · see citing works
Measurement‐Related Course Work Requirements for Teacher Certification and Recertification
O’Sullivan, R. G., & Chalnick, M. K. (1991) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.1991.tb00173.x · Cited by 54 · see citing works
Assessing the Writing Product: Qualitative and Quantitative Measures
Isaacson, S. L. (1988) · Exceptional Children · doi:10.1177/001440298805400606 · Cited by 41 · see citing works
Misguided assumptions of DSM-III-R: Implications for school psychological practice.
Gresham, F. M., & Gansle, K. A. (1992) · School Psychology Quarterly · doi:10.1037/h0088253 · Cited by 39 · see citing works
Self-citationElementary school teachers' perceptions of curriculum-based measures of written expression
Gansle, K. A., Gilbertson, D., & VanDerHeyden, A. M. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/17ny-dw61 · Cited by 36 · see citing works
Self-citationTeachers' Ratings of the Acceptability of Curriculum-Based Assessment Methods
Eckert, T. L., Shapiro, E. S., & Lutz, J. G. (1995) · School Psychology Review · doi:10.1080/02796015.1995.12085784 · Cited by 35 · see citing works
Writing Performance Assessments
Crawford, L., Helwig, R., & Tindal, G. A. (2004) · Journal of Learning Disabilities · doi:10.1177/00222194040370020401 · Cited by 27 · see citing works
The immediate effects of pictographic representation on children's narratives
McFadden, T. U. (1998) · Child Language Teaching and Therapy · doi:10.1177/026565909801400103 · Cited by 26 · see citing works
Measuring Pupil Progress Toward the Least Restrictive Environment.
Jenkins, J. R. (1979) · Cited by 21 · see citing works
Effect on Performance of Timely Feedback on State Writing Assessments
Crehan, K. D., & Curfman, M. (2003) · Psychological Reports · doi:10.2466/pr0.2003.92.3.1015 · Cited by 3 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Curriculum-Based Measurement: A Brief History of Nearly Everything from the 1970s to the Present
Tindal, G. (2013) · ISRN Education · doi:10.1155/2013/958530 · Cited by 59 · see citing works
The Predictive Validity of CBM Writing Indices for Eighth-Grade Students
Amato, J. M., & Watkins, M. W. (2011) · The Journal of Special Education · doi:10.1177/0022466909333516 · Cited by 37 · see citing works
- Authors
- Gansle, K. A., VanDerHeyden, A. M., Noell, G. H., Resetar, J. L., & Williams, K. L.
- Affiliations
- Louisiana State University (US)
- Vail School District
- Corresponding author
- Gansle, Kristin A.
- Venue
- School Psychology Review
- Publisher
- Informa UK Limited
- Published
- 2006-09-01
- Volume
- 35
- Issue
- 3
- Pages
- 435-450
- ISSN
- 0279-6015 (ISSN-L)
- 2372-966X
- OpenAlex
- W3351325
- Cited by
- 88
- References
- 29
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 3 · 2023: 4 · 2022: 4 · 2021: 3 · 2020: 6 · 2019: 4 · 2018: 5 · 2017: 9 · 2016: 5 · 2015: 5 · 2014: 9 · 2013: 5 · 2012: 3
- FWCI
- 13.16
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- School Psychology Review (publishedVersion)
- Topics
- Social Sciences › Education › Writing and Handwriting Education
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- curriculum-based measurement, written expression assessment, elementary school students, test-retest reliability, interobserver agreement, criterion validity, writing instruction
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
