The DOI matches its Crossref record; 84 of the 86 references it cites were found in a registry or an index.
Subjectivity of teacher judgments: Exploring student characteristics that influence teacher judgments of student ability
Open accessAbstract
Teacher judgments of student achievement are increasingly used for high-stakes decision-making, making it imperative that judgments be as fair and reliable as possible. Using a large national database from New Zealand, we explored the relation between psychometrically designed standardized achievement results and teacher judgments in reading (N = 4771 students) and writing (N = 11,765 students) using hierarchical linear modelling. Our findings indicated that judgments were systematically lower for marginalized learners after controlling for standardized achievement differences. Additionally, classroom and school achievement composition were inversely related to teacher judgments. These discrepancies are concerning, with important implications for equitable educational opportunities.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology · doi:10.2307/2075823 · Cited by 18,724
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,723
Kim, H.-Y. (2013) · Restorative Dentistry & Endodontics · doi:10.5395/rde.2013.38.1.52 · Cited by 4,035
Psychological Testing: A Practical Approach to Design and Evaluation
Kline, T. (2005) · doi:10.4135/9781483385693 · Cited by 1,588
Jussim, L., & Harber, K. D. (2005) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0902_3 · Cited by 1,197
Clark, C. (1984) · Cited by 855
The Effect of Different Forms of Centering in Hierarchical Linear Models
Kreft, I. G. G., de Leeuw, J., & Aiken, L. S. (1995) · Multivariate Behavioral Research · doi:10.1207/s15327906mbr3001_1 · Cited by 850
An introduction to hierarchical linear modeling
Woltman, H., Feldstain, A., MacKay, J. C., & Rocchi, M. (2012) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.08.1.p052 · Cited by 768
Accuracy of teachers' judgments of students' academic achievement: A meta-analysis
Südkamp, A., Kaiser, J., & Möller, J. (2012) · Journal of Educational Psychology · doi:10.1037/a0027627 · Cited by 696
Reducing implicit racial preferences: I. A comparative investigation of 17 interventions.
Lai, C. K., Marini, M., Lehr, S. A., Cerruti, C., Shin, J.-E. L., Joy-Gaba, J. A., Ho, A. K., Teachman, B. A., Wojcik, S. P., Koleva, S. P., et al. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0036260 · Cited by 679
Placing Equity Front and Center: Some Thoughts on Transforming Teacher Education for a New Century
Nieto, S. (2000) · Journal of Teacher Education · doi:10.1177/0022487100051003004 · Cited by 641
Teacher expectations, classroom context, and the achievement gap
McKown, C., & Weinstein, R. S. (2008) · Journal of School Psychology · doi:10.1016/j.jsp.2007.05.001 · Cited by 620
Teacher-Based Judgments of Academic Achievement: A Review of Literature
Hoge, R. D., & Coladarci, T. (1989) · Review of Educational Research · doi:10.3102/00346543059003297 · Cited by 588
Bayesian Methods: A Social and Behavioral Sciences Approach
Gill, J. (2002) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420057478 · Cited by 579
OECD (2005) · PISA · doi:10.1787/9789264010543-en · Cited by 465
Does school autonomy make sense everywhere? Panel estimates from PISA
Hanushek, E. A., Link, S., & Woessmann, L. (2013) · Journal of Development Economics · doi:10.1016/j.jdeveco.2012.08.002 · Cited by 409
Ready, D. D., & Wright, D. L. (2011) · American Educational Research Journal · doi:10.3102/0002831210374874 · Cited by 392
Expecting the best for students: Teacher expectations and academic outcomes
Rubie‐Davies, C., Hattie, J., & Hamilton, R. (2006) · British Journal of Educational Psychology · doi:10.1348/000709905x53589 · Cited by 385
Self-citationThe Role of Schooling in Perpetuating Educational Inequality: An International Perspective
Schmidt, W. H., Burroughs, N. A., Zoido, P., & Houang, R. T. (2015) · Educational Researcher · doi:10.3102/0013189x15603982 · Cited by 380
Early teacher perceptions and later student academic achievement.
Alvidrez, J., & Weinstein, R. S. (1999) · Journal of Educational Psychology · doi:10.1037//0022-0663.91.4.731 · Cited by 312
Peterson, E. R., Rubie-Davies, C., Osborne, D., & Sibley, C. (2016) · Learning and Instruction · doi:10.1016/j.learninstruc.2016.01.010 · Cited by 308
Self-citationSustainability of teacher expectation bias effects on long-term student performance
de Boer, H., Bosker, R. J., & van der Werf, M. P. C. (2010) · Journal of Educational Psychology · doi:10.1037/a0017289 · Cited by 284
Benner, A. D., & Mistry, R. S. (2007) · Journal of Educational Psychology · doi:10.1037/0022-0663.99.1.140 · Cited by 257
Teacher expectations and perceptions of student attributes: Is there a relationship?
Rubie‐Davies, C. M. (2010) · British Journal of Educational Psychology · doi:10.1348/000709909x466334 · Cited by 237
Self-citationRacial Mismatch in the Classroom: Beyond Black-white Differences
McGrady, P. B., & Reynolds, J. R. (2013) · Sociology of Education · doi:10.1177/0038040712444857 · Cited by 227
A teacher expectation intervention: Modelling the practices of high expectation teachers
Rubie-Davies, C. M., Peterson, E. R., Sibley, C. G., & Rosenthal, R. (2015) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2014.03.003 · Cited by 222
Self-citationFrancis, B., Archer, L., Hodgen, J., Pepper, D., Taylor, B., & Travers, M.-C. (2017) · Cambridge Journal of Education · doi:10.1080/0305764x.2015.1093095 · Cited by 195
Achievement and engagement: How student characteristics influence teacher judgments
Kaiser, J., Retelsdorf, J., Südkamp, A., & Møller, J. (2013) · Learning and Instruction · doi:10.1016/j.learninstruc.2013.06.001 · Cited by 189
Wiliam, D., & Bartholomew, H. (2004) · British Educational Research Journal · doi:10.1080/0141192042000195245 · Cited by 183
Harlen, W. (2005) · Research Papers in Education · doi:10.1080/02671520500193744 · Cited by 182
Influence of behavior perceptions and gender on teachers' judgments of students' academic skill.
Bennett, R. E., Gottesman, R. L., Rock, D. A., & Cerullo, F. (1993) · Journal of Educational Psychology · doi:10.1037//0022-0663.85.2.347 · Cited by 181
The centrality of teachers’ judgement practice in assessment: a study of standards in moderation
Wyatt‐Smith, C., Klenowski, V., & Gunn, S. (2010) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/09695940903565610 · Cited by 174
The effects of race and problem type on teachers' assessments of student behavior.
Chang, D. F., & Sue, S. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.2.235 · Cited by 162
Begeny, J. C., Eckert, T. L., Montarello, S. A., & Storie, M. S. (2008) · School Psychology Quarterly · doi:10.1037/1045-3830.23.1.43 · Cited by 154
Bayesian methods: a social and behavioral sciences approach
(2003) · Choice Reviews Online · doi:10.5860/choice.40-3452 · Cited by 153
Martínez, J. F., Stecher, B. M., & Borko, H. (2009) · Educational Assessment · doi:10.1080/10627190903039429 · Cited by 150
Meisels, S. J., Bickel, D. D., Nicholson, J., Xue, Y., & Atkins-Burnett, S. (2001) · American Educational Research Journal · doi:10.3102/00028312038001073 · Cited by 145
Accuracy of teacher judgments in predicting oral reading fluency.
Feinberg, A. B., & Shapiro, E. S. (2003) · School Psychology Quarterly · doi:10.1521/scpq.18.1.52.20876 · Cited by 144
Analysis of teacher judgments of pupil achievement levels.
Hoge, R. D., & Butcher, R. B. (1984) · Journal of Educational Psychology · doi:10.1037/0022-0663.76.5.777 · Cited by 115
Erwin, J. O., & Worrell, F. C. (2012) · Journal of Psychoeducational Assessment · doi:10.1177/0734282911428197 · Cited by 106
Influence of Elementary Student Gender on Teachers' Perceptions of Mathematics Achievement
Helwig, R., Anderson, L., & Tindal, G. A. (2001) · The Journal of Educational Research · doi:10.1080/00220670109596577 · Cited by 102
Dompnier, B., Pansu, P., & Bressoux, P. (2006) · European Journal of Psychology of Education · doi:10.1007/bf03173572 · Cited by 101
Begeny, J. C., Krouse, H. E., Brown, K. G., & Mann, C. M. (2011) · School Psychology Review · doi:10.1080/02796015.2011.12087726 · Cited by 99
Glock, S., Krolak‐Schwerdt, S., & Cate, I. P.-T. (2014) · European Journal of Psychology of Education · doi:10.1007/s10212-014-0237-2 · Cited by 89
A Decade of Research on School Principals
Ärlestig, H., Day, C. W., Johansson, O., & Publishing, S. I. (2015) · Springer eBooks · doi:10.1007/978-3-319-23027-6 · Cited by 86
Becoming a High Expectation Teacher: Raising the bar
Rubie-Davies, C. (2014) · doi:10.4324/9781315761251 · Cited by 81
Self-citationHecht, S. A., & Greenfield, D. B. (2002) · Reading and Writing · doi:10.1023/a:1020985701556 · Cited by 79
Ogle, L. T., Sen, A., Pahlke, E. E., Jocelyn, L., Kastberg, D., Roey, S., & Williams, T. (2003) · PsycEXTRA Dataset · doi:10.1037/e492162006-021 · Cited by 76
Successive teacher expectation effects across the early school years
Rubie-Davies, C. M., Weinstein, R. S., Huang, F. L., Gregory, A., Cowan, P. A., & Cowan, C. P. (2014) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2014.03.006 · Cited by 75
Self-citationHopkins, K. D., George, C. M., & Williams, D. D. (1985) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1985.tb01056.x · Cited by 67
Sharpley, C. F., & Edgar, E. (1986) · Psychology in the Schools · doi:10.1002/1520-6807(198601)23:1<106::aid-pits2310230117>3.0.co;2-c · Cited by 66
The impact of streaming on attainment at age seven: evidence from the Millennium Cohort Study
Parsons, S., & Hallam, S. (2014) · Oxford Review of Education · doi:10.1080/03054985.2014.959911 · Cited by 64
Hurwitz, J. T., Elliott, S. N., & Braden, J. P. (2007) · School Psychology Quarterly · doi:10.1037/1045-3830.22.2.115 · Cited by 56
(2009) · Routledge eBooks · doi:10.4324/9780203875186 · Cited by 53
Social Justice and Teacher Education: Context, Theory, and Practice
Chubbuck, S. M., & Zembylas, M. (2016) · Springer eBooks · doi:10.1007/978-981-10-0369-1_14 · Cited by 50
Validation and Decision Accuracy of Early Numeracy Skill Indicators
Methe, S. A., Hintze, J. M., & Floyd, R. G. (2008) · School Psychology Review · doi:10.1080/02796015.2008.12087883 · Cited by 45
Bayesian methods a social and behavioral sciences approach
Gill, J. (2002) · Cited by 43
Doherty, J. P., & Conolly, M. (1985) · Educational Studies · doi:10.1080/0305569850110105 · Cited by 42
Wilson, A., Madjar, I., & McNaughton, S. (2016) · The Curriculum Journal · doi:10.1080/09585176.2015.1134339 · Cited by 42
Cultural Bias in Assessment: Can Creativity Assessment Help?
Kim, K. H., & Zabelina, D. L. (2015) · The international journal of critical pedagogy · Cited by 40
National Standards for student achievement: Is New Zealand’s idiosyncratic approach any better?
Thrupp, M. (2013) · The Australian Journal of Language and Literacy · doi:10.1007/bf03651915 · Cited by 38
Validation of the Gifted Rating Scales–School Form in China
Li, H., Pfeiffer, S. I., Petscher, Y., Kumtepe, A. T., & Mo, G. (2008) · Gifted Child Quarterly · doi:10.1177/0016986208315802 · Cited by 38
Beswick, J. F., Willms, J. D., & Sloat, E. A. (2005) · Cited by 38
The effect of clustering on statistical tests: an illustration using classroom environment data
Dorman, J. P. (2008) · Educational Psychology · doi:10.1080/01443410801954201 · Cited by 35
Brown, G. (2009) · ResearchSpace (University of Auckland) · Cited by 34
Establishing Technically Adequate Measures of Progress in Early Numeracy
Lembke, E. S., Foegen, A., Whittaker, T. A., & Hampton, D. (2008) · Assessment for Effective Intervention · doi:10.1177/1534508407313479 · Cited by 31
Unconscious bias and education: A comparative study of Māori and African American students
Blank, A., Houkamau, C. A., & Kingi, H. (2016) · ResearchSpace (University of Auckland) · Cited by 28
Criterion-Referencing, Norm-Referencing, and the SAT.
Angoff, W. H. (1974) · The College Board review · Cited by 27
Five beginning teachers' reflections on enacting New Zealand's national standards
Smith, L. A., Anderson, V. R., & Blanch, K. (2015) · Teaching and Teacher Education · doi:10.1016/j.tate.2015.11.014 · Cited by 26
Brown, G. (2013) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1474-7863(2013)0000014003 · Cited by 22
Teachers’ Judgments of Students’ Academic Achievement: Results From Field and Experimental Studies
Südkamp, A., Kaiser, J., & Møller, J. (2014) · SensePublishers eBooks · doi:10.1007/978-94-6209-536-6_2 · Cited by 21
Teachers' Professional Development: Assessment, Training, and Learning
Krolak‐Schwerdt, S., Glock, S., & Böhmer, M. (2014) · Cited by 21
Ethnicity and Teacher Expectations in New Zealand
Rubie-Davies, C. M., Peterson, E. R., Flint, A., Garrett, L., Donald, L. M., Watson, P. W. S. J., & O’Neill, H. (2012) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2012.11.407 · Cited by 16
Self-citationÖzerk, K. Z., Whitehead, D., & Whitehead, D. (2017) · lnternational Electronic Journal of Elementary Education · Cited by 16
Raphael, T. E., Au, K. H., & Goldman, S. R. (2009) · Routledge eBooks · doi:10.4324/9780203875186-23 · Cited by 12
New Zealand Principals: Autonomy at a Cost
Wylie, C., Cosslett, G., & Burgon, J. (2015) · Springer eBooks · doi:10.1007/978-3-319-23027-6_13 · Cited by 12
Narrow The Gap, Fix The Tail, Or Close The Curves: The Power of Words
Hattie, J. (2008) · Minerva Access (University of Melbourne) · Cited by 11
National Standards: A Parent’s Perspective
Courtney, B. (2010) · Teachers Work · doi:10.24135/teacherswork.v7i1.525 · Cited by 4
A National Developmental and Negotiated Approach to School and Curriculum Evaluation
Lai, M. (2013) · Cited by 3
Testing Tamariki: How Suitable is the PPVT-III?
Haitana, T. (2007) · UC Research Repository (University of Canterbury) · doi:10.26021/7637 · Cited by 2
Progressive achievement test : mathematics (specimen set 1-7)
Darr, C., Neill, A., & Stephanou, A. (2006) · Cited by 1
(2002)
Cited by
Gentrup, S., Lorenz, G., Kristen, C., & Kogan, I. (2020) · Learning and Instruction · doi:10.1016/j.learninstruc.2019.101296 · Cited by 275
“…Ready & Wright, 2011), for boys and girls in gender-untypical domains (e.g., Hinnant et al., 2009; Holder & Kessels, 2017; Lorenz et al., 2016; Meissel et al., 2017; Ready & Wright, 2011; Riegle-Crumb & Humphries, 2012; Rubie-Davies & Peterson, 2016) as well as for students with special…”
BackgroundA systematic review of the teacher expectation literature over the past 30 years
Wang, S., Rubie-Davies, C. M., & Meissel, K. (2018) · Educational Research and Evaluation · doi:10.1080/13803611.2018.1548798 · Cited by 259
Self-citationPerseverant grit and self-efficacy: Are both essential for children’s academic success?
Usher, E. L., Li, C. R., Butz, A. R., & Rojas, J. P. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000324 · Cited by 250
Key Skills for the 21st Century: An evidence-based review
Lamb, S., Maire, Q., & Doecke, E. (2017) · Victoria University Research Repository (Victoria University) · Cited by 215
A review on the accuracy of teacher judgments
Urhahne, D., & Wijnia, L. (2021) · Educational Research Review · doi:10.1016/j.edurev.2020.100374 · Cited by 183
Metadata
- Authors
- Meissel, K., Meyer, F., Yao, E. S., & Rubie-Davies, C. M.
- Venue
- Teaching and Teacher Education
- Publisher
- Elsevier BV
- Published
- 2017-07
- Volume
- 65
- Pages
- 48-60
- ISSN
- 0742-051X (ISSN-L)
- OpenAlex
- W2598299317
- Cited by
- 192
- References
- 86
- FWCI
- 54.88
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.