The DOI matches its Crossref record.
Reliability of the Grading of High-School Work in English
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Starch and Elliott (1912) found that grades on the same English paper varied from 50 to 98% between 142 teachers.
“Starch and Elliott (1912) asked 142 teachers to grade the same English paper and found that grades on the paper varied from 50 to 98% between teachers.”
From Teaching More by Grading Less (or Differently) (2014) · cites this paper as Starch and Elliott, 1912
Starch and Elliott (1912) concluded that the promotion or retardation of a pupil depends to a considerable extent upon the subjective estimate of the teacher rather than upon the actual work produced.
“the researchers concluded “the promotion or retardation of a pupil depends to a considerable extent upon the subjective estimate of his teacher” rather than upon the actual work produced by the student (Starch and Elliott, 1912).”
From Teaching More by Grading Less (or Differently) (2014) · cites this paper as Starch and Elliott, 1912
Citations
Cites
Still being checked.
Cited by
Sorted by citations
Teaching For Quality Learning At University
BIGGS, J. B., & Tang, C. S. (1999) · Cited by 7,559
Brookhart, S. M., Guskey, T. R., Bowers, A. J., McMillan, J. H., Smith, J. K., Smith, L. F., Stevens, M. T., & Welsh, M. E. (2016) · Review of Educational Research · doi:10.3102/0034654316672069 · Cited by 486
Rearticulating Writing Assessment for Teaching and Learning
Huot, B. (2003) · Utah State University Press eBooks · doi:10.2307/j.ctt46nx5z · Cited by 355
Specifying and Promulgating Achievement Standards
Sadler, D. R. (1987) · Oxford Review of Education · doi:10.1080/0305498870130207 · Cited by 350
Teaching More by Grading Less (or Differently)
Schinske, J., & Tanner, K. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.cbe-14-03-0054 · Cited by 326
Educational Assessment: Expanded Expectations and Challenges
Linn, R. L. (1993) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737015001001 · Cited by 232
Grades as Valid Measures of Academic Achievement of Classroom Learning
Allen, J. D. (2005) · The Clearing House: A Journal of Educational Strategies, Issues and Ideas · doi:10.3200/tchs.78.5.218-223 · Cited by 185
More Unintended Consequences of High‐Stakes Testing
Cizek, G. J. (2001) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.2001.tb00072.x · Cited by 157
Performance Assessments from the Perspective of Generalizability Theory
Brennan, R. L. (2000) · Applied Psychological Measurement · doi:10.1177/01466210022031796 · Cited by 150
Making the grade: a history of the A–F marking scheme
Schneider, J., & Hutt, E. L. (2013) · Journal of Curriculum Studies · doi:10.1080/00220272.2013.790480 · Cited by 192
The society for research into higher education
Page, C. F. (1988) · Journal of Geography in Higher Education · doi:10.1080/03098268808709029 · Cited by 145
Bacon, D. R. (2003) · Journal of Marketing Education · doi:10.1177/0273475302250570 · Cited by 132
Assuring academic achievement standards: from moderation to calibration
Sadler, D. R. (2012) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2012.714742 · Cited by 127
WRITING NEATNESS, COMPOSITION ERRORS, AND ESSAY GRADES
Marshall, J. C., & Powers, J. M. (1969) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1969.tb00665.x · Cited by 87
COMPOSITION RESEARCH AND PRACTICE: A UNIFIED APPROACH
Graham, S. (1982) · Focus on Exceptional Children · doi:10.17161/foec.v14i8.7447 · Cited by 77
(1994) · UKnowledge (University of Kentucky) · Cited by 76
The Effects of Tests on Students and Schools
Kirkland, M. C. (1971) · Review of Educational Research · doi:10.3102/00346543041004303 · Cited by 72
In the Absence of Grades: Dissonance and Desire in Course-Contract Classrooms
Inman, J. O., & Powell, R. A. (2018) · College Composition and Communication · doi:10.58680/ccc201829783 · Cited by 72
Theorizing Failure in US Writing Assessments
Inoue, A. B. (2014) · Research in the Teaching of English · doi:10.58680/rte201424581 · Cited by 67
The use of teacher judgement for summative assessment in the USA
Brookhart, S. M. (2012) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2012.703170 · Cited by 66
Frameworks of State: Assessment Policy in Historical Perspective
Mazzeo, C. (2001) · Teachers College Record The Voice of Scholarship in Education · doi:10.1111/0161-4681.00119 · Cited by 65
Pockets of Resistance in the Assessment Revolution
Cizek, G. J. (2000) · Educational Measurement Issues and Practice · doi:10.1111/j.1745-3992.2000.tb00026.x · Cited by 56
Testing Reasoning and Reasoning About Testing
Haney, W. (1984) · Review of Educational Research · doi:10.3102/00346543054004597 · Cited by 47
A critique of grading: Policies, practices, and technical matters
Anderson, L. W. (2018) · Education Policy Analysis Archives · doi:10.14507/epaa.26.3814 · Cited by 43
The Case Against Percentage Grades
Guskey, T. R. (2013) · UKnowledge (University of Kentucky) · Cited by 42
A National Testing System: Manna From Above? An Historical/Technological Perspective
Madaus, G. F. (1993) · Educational Assessment · doi:10.1207/s15326977ea0101_2 · Cited by 41
Measurement of Writing Ability at the College-Entrance Level
Huddleston, E. M. (1954) · The Journal of Experimental Education · doi:10.1080/00220973.1954.11010477 · Cited by 40
A Usable Past for Writing Assessment
Huot, B., O’Neill, P., & Moore, C. L. (2010) · College English · doi:10.58680/ce201010801 · Cited by 39
Grant, D., & Green, W. B. (2013) · Empirical Economics · doi:10.1007/s00181-012-0578-0 · Cited by 37
Graded Achievement, Tested Achievement, and Validity
Brookhart, S. M. (2015) · Educational Assessment · doi:10.1080/10627197.2015.1093928 · Cited by 36
Moving Toward Equity: Experiences With Ungrading
Rapchak, M. E., Hands, A. S., & Hensley, M. K. (2022) · Journal of Education for Library and Information Science · doi:10.3138/jelis-2021-0062 · Cited by 35
Analytic or holistic? A study about how to increase the agreement in teachers’ grading
Jönsson, A., Balan, A., & Hartell, E. (2021) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2021.1884041 · Cited by 34
Assessment as a Context for Student Engagement
Nichols, S. L., & Dawson, H. S. (2012) · Springer eBooks · doi:10.1007/978-1-4614-2018-7_22 · Cited by 37
Huddleston, E. M. (1952) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1952.tb00925.x · Cited by 30
Ebel, R. L. (1974) · IEEE Transactions on Education · doi:10.1109/te.1974.4320885 · Cited by 27
External (Public) Examinations
Kellaghan, T., & Madaus, G. F. (2003) · Springer eBooks · doi:10.1007/978-94-010-0309-4_34 · Cited by 25
Practices of grading: an ethnographic study of educational assessment
Kalthoff, H. (2013) · Ethnography & Education · doi:10.1080/17457823.2013.766436 · Cited by 24
White, L. T., & Ransdell, S. (2000) · Teaching of Psychology · doi:10.1207/s15328023top2703_09 · Cited by 23
Unterscheidung und Härtung. Bewertungs- und Notenkommunikation in Lehrerzimmer und Zeugniskonferenz
Kalthoff, H., & Dittrich, T. (2016) · Berliner Journal für Soziologie · doi:10.1007/s11609-017-0324-8 · Cited by 22
The Minimum Grading Controversy
Carey, T., & Carifio, J. (2012) · Educational Researcher · doi:10.3102/0013189x12453309 · Cited by 21
A brief history of educational psychology
Watson, R. I. (1961) · The Psychological Record · doi:10.1007/bf03393406 · Cited by 19
Schutz, K. R., Drake, B. M., Lessner, J., & Hughes, G. F. (2015) · The Journal of Continuing Higher Education · doi:10.1080/07377363.2015.1085951 · Cited by 18
Huck, S. W., & Bounds, W. G. (1972) · American Educational Research Journal · doi:10.2307/1161688 · Cited by 18
EVALUATION AND EDUCATIONAL OBJECTIVES
Ebel, R. L. (1973) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1973.tb00804.x · Cited by 18
Jølle, L. (2014) · Assessing Writing · doi:10.1016/j.asw.2014.01.002 · Cited by 17
The Effect of Family Background on Student Effort
Kuehn, Z., & Landeras, P. (2014) · The B E Journal of Economic Analysis & Policy · doi:10.1515/bejeap-2013-0150 · Cited by 17
Marks and Marking Systems: A Digest
Crooks, A. D. (1933) · The Journal of Educational Research · doi:10.1080/00220671.1933.10880402 · Cited by 17
The impact on stakeholder confidence of increased transparency in the examination assessment process
Bamber, M. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2014.921662 · Cited by 17
GRADES AND TEST SCORES: ACCOUNTING FOR OBSERVED DIFFERENCES
Willingham, W. W., Pollack, J. M., & Lewis, C. (2000) · ETS Research Report Series · doi:10.1002/j.2333-8504.2000.tb01838.x · Cited by 19
"Why did I get a C?": Communicating Student Performance Using Standards-Based Grading
Scarlett, M. H. (2018) · InSight A Journal of Scholarly Teaching · doi:10.46504/14201804sc · Cited by 16
Grading of Student's Attainment: Purposes and Functions
Lysne, A. (1984) · Scandinavian Journal of Educational Research · doi:10.1080/0031383840280303 · Cited by 16
Reliability and Distribution of Grades
Starch, D. (1913) · Science · doi:10.1126/science.38.983.630 · Cited by 15
Self-citationEffects of introductions and conclusions in assessment of student essays.
Townsend, M. A. R., Anderman, L. H., Thompson, J. D., Wilton, K. M., Tuck, B. F., & Moore, D. W. (1993) · Journal of Educational Psychology · doi:10.1037//0022-0663.85.4.670 · Cited by 13
Duke, J. D. (1983) · Psychological Reports · doi:10.2466/pr0.1983.53.3f.1023 · Cited by 13
Assessment for the Masses: A Historical Critique of High-Stakes Testing in Reading.
Huddleston, A., & Rockwell, E. C. (2015) · Cited by 12
Addressing inconsistencies in grading practices
Guskey, T. R. (2024) · Phi Delta Kappan · doi:10.1177/00317217241251883 · Cited by 11
The shape of educational inequality
Quarles, C. L., Budak, C., & Resnick, P. (2020) · Science Advances · doi:10.1126/sciadv.aaz5954 · Cited by 12
An Immanent Machine: Reconsidering grades, historical and present
Tocci, C. (2008) · Educational Philosophy and Theory · doi:10.1111/j.1469-5812.2008.00440.x · Cited by 11
Herridge, M., & Talanquer, V. (2020) · Journal of Chemical Education · doi:10.1021/acs.jchemed.0c00944 · Cited by 10
Further Investigation of Teachers' Assessment Practices.
Cizek, G. J. (1995) · Cited by 10
GENDER DIFFERENCES IN HIGH SCHOOL GRADES: AN EXPLORATORY STUDY
Ekstrom, R. B. (1994) · ETS Research Report Series · doi:10.1002/j.2333-8504.1994.tb01598.x · Cited by 10
Pass/Fail and Discretionary Grading: A Snapshot of Their Influences on Learning
Melrose, S. (2017) · Open Journal of Nursing · doi:10.4236/ojn.2017.72016 · Cited by 9
Formative and Summative Assessment: A Possible Alternative to The Grading-Reporting Dilemma
Reedy, R. (1995) · NASSP Bulletin · doi:10.1177/019263659507957308 · Cited by 9
First Grade GPA as a Predictor of Later Academic Performance in High School
Papadogıannıs, I., Poulopoulos, V., Platis, N., Vassilakis, C., Lepouras, G., & Wallace, M. (2023) · Knowledge · doi:10.3390/knowledge3030033 · Cited by 8
Considering Standards-based Grading
Townsley, M. (2019) · Journal of School Administration Research and Development · doi:10.32674/jsard.v4i1.1941 · Cited by 8
Student Criterion Grading: An Attempt to Reduce Some Common Grading Problems
Carter, K. R. (1977) · Teaching of Psychology · doi:10.1207/s15328023top0402_2 · Cited by 8
The Assessment Revolution's Unfinished Business
Cizek, G. J. (1998) · Kappa Delta Pi Record · doi:10.1080/00228958.1998.10518753 · Cited by 8
High-Stakes Uses of Performance-Based Assessments
Linn, R. L. (1995) · Springer eBooks · doi:10.1007/978-94-011-0639-9_3 · Cited by 7
Grading and Reporting Student Learning
Aitken, E. N. (2015) · The enabling power of assessment · doi:10.1007/978-3-319-23398-7_10 · Cited by 6
Artificial Intelligence for Automated Scoring and Feedback in Chemistry Courses
Rudniy, A. (2024) · The Journal of Writing Analytics · doi:10.37514/jwa-j.2024.7.1.02 · Cited by 5
A Course in the Theory of Mental Tests
Gulliksen, H. O. (1943) · Psychometrika · doi:10.1007/bf02288706 · Cited by 5
Dahl, T. I. (2006) · Assessment in Education Principles Policy and Practice · doi:10.1080/09695940600563579 · Cited by 5
A Case for Naturalistic Assessment of Reading Comprehension
Moore, D. W. (1983) · Language Arts · doi:10.58680/la198326366 · Cited by 5
Weaver, D. (2018) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 4
A Consideration of Gradeless Learning in Higher Education
Amer, A., Sidhu, G., & Srinivasan, S. (2023) · IJPTE International Journal of Pedagogy and Teacher Education · doi:10.20961/ijpte.v0i0.73153 · Cited by 4
Policy Issues in Testing and Evaluation
Spolsky, B. (1994) · The Annals of the American Academy of Political and Social Science · doi:10.1177/0002716294532001016 · Cited by 4
Brookhart, S. M., & Brookhart Enterprises Llc (2011) · Cited by 4
If Freud Could Define Psychoanalysis, Why Can't ABPP Do It?
Meehl, P. E. (1993) · Psychoanalysis and contemporary thought · Cited by 4
Reconceptualizing Scoring Reliability Through Linguistic Similarity
Jung, J. Y., Bezirhan, U., & von Davier, M. (2025) · Educational and Psychological Measurement · doi:10.1177/00131644251397428 · Cited by 4
Enhancing graduate students’ evaluative skills through AI-supported collaborative marking
Wu, D., Goh, T., Chen, D., & Yin, H. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1739222 · Cited by 3
Landherr, L. (2024) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--44552 · Cited by 2
Il “senso” della valutazione. Fenomenologia sociale e opzioni epistemologiche
Damiano, E. (2012) · EDUCATION SCIENCES AND SOCIETY · Cited by 2
Observing – Treating – Classifying: On the Educational Practice of Human Differentiation
Kalthoff, H. (2016) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2016.07.099 · Cited by 2
Reliability, Validity, and Writing Assessment: A Timeline
Dobrić, N. (2018) · ELOPE English Language Overseas Perspectives and Enquiries · doi:10.4312/elope.15.2.9-24 · Cited by 2
EENY, MEENY, MINY, MOE: Testing Policy and Practice in Early Childhood
Cunningham, A. E. (1993) · Springer eBooks · doi:10.1007/978-94-011-2226-9_5 · Cited by 2
Criterion reliability: A study of folkways and mores of the psychological profession.
Sydiaha, D. (1964) · The Canadian Psychologist · doi:10.1037/h0083010 · Cited by 2
High school grading practices: Teacher leaders' reflections, insights, and recommendations
Webster, K. L. (2011) · ProQuest Demo Repository · Cited by 2
Discriminating Behavior: Evidence of Teachers' Grading Bias
Ferman, B., & Fontes, L. F. (2021) · Munich Personal RePEc Archive (Ludwig Maximilian University of Munich) · Cited by 2
Kollman, A., Sinner, E., Nurmi, H., & O'Shea, C. M. (2026) · Journal of school administration research and development · doi:10.32674/ftm8de57 · Cited by 1
McMullan, J. (2016) · Research Portal (Queen's University Belfast) · Cited by 1
Another Visit to the World of Grading
Ellsworth, R. A., & Willson, D. D. (1977) · The Clearing House A Journal of Educational Strategies Issues and Ideas · doi:10.1080/00098655.1977.9957038 · Cited by 1
A Half Century of Research on Essay Testing
Yeasmeen, N., & Barker, D. G. (1973) · Improving College and University Teaching · doi:10.1080/00193089.1973.10533348 · Cited by 1
Beauvais, C. (2017) · History of Education Quarterly · doi:10.1017/heq.2017.16 · Cited by 1
The Simple Economics of Thresholds: Grades as IncentivesPreprint
Grant, D., & Green, W. B. (2009) · RePEc: Research Papers in Economics · Cited by 1
Percell, J. C. (2014) · doi:10.30707/etd2014.percell.j · Cited by 1
SECTION V: BIBLIOGRAPHIES OF SELECTED TOPICS ON GENDER AND FAIR ASSESSMENT
(1997) · ETS Research Report Series · doi:10.1002/j.2333-8504.1997.tb01722.x
The quality of regulatory judgments of health care inspectors
Tuijn, S. M. (2014) · Utrecht University Repository (Utrecht University)
PERSONAL JUDGMENTS AS A FACTOR IN GRADING
Zerbe, J. L. (1918) · School Science and Mathematics · doi:10.1111/j.1949-8594.1918.tb03813.x
REGIONAL DIFFERENCES IN GRADING PRACTICES
Pinchak, B. M. (1974) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1974.tb00466.x
Golden, C. H. (2011) · KU ScholarWorks (The University of Kansas)
Metadata
- Authors
- Starch, D., & Elliott, E. C.
- ORCID
- Elliott, Edward C.
- Venue
- The School Review
- Publisher
- University of Chicago Press
- Published
- 1912-09
- Volume
- 20
- Issue
- 7
- Pages
- 442-457
- ISSN
- 0036-6773 (ISSN-L)
- OpenAlex
- W2088686590
- Cited by
- 142
- References
- 0
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 3 · 2023: 5 · 2022: 3 · 2021: 4 · 2020: 8 · 2019: 5 · 2018: 8 · 2017: 3 · 2016: 5 · 2015: 4 · 2014: 8 · 2013: 6 · 2012: 6
- FWCI
- 76.15
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The School Review (publishedVersion)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- rating reliability, English grades, high school English, teacher judgment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review