Cited by 222Student Assessment and FeedbackNames, Identity, and Discrimination ResearchEducational Technology and Assessment

The DOI matches its Crossref record; 42 of the 43 references it cites were found in a registry or an index.

Bias in grading: A meta-analysis of experimental research findings

Malouff, John M, Thorsteinsson, Einar B·2016·Australian Journal of Education

DOI 10.1177/0004944116664618

Open this paper in CoChat — free account

Abstract

This article provides a meta-analysis of experimental research findings on the existence of bias in subjective grading of student work such as essay writing. Twenty-three analyses, from 20 studies, with a total of 1935 graders, met the inclusion criteria for the meta-analysis. All studies involved graders being exposed to a specific type of information about a student other than the student’s performance on a task. The hypothesized biasing characteristics included different race/ethnic backgrounds, education-related deficiencies, physical unattractiveness and poor quality of prior performance. The statistically significant overall between-groups effect size was g = 0.36. Moderator analyses showed no significant difference in effect size related to whether the work graded was from a primary school student or a university student. No one type of biasing characteristic showed a significantly higher effect size than other types. The results suggest that bias can occur in subjective grading when graders are aware of irrelevant information about the students.

Integrity signals

Registry

Crossref · 10.1177/0004944116664618

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Untitled work
(2011) · Cited by 14,317
Untitled work
(2000) · Cited by 9,198
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Implicit social cognition: Attitudes, self-esteem, and stereotypes
Greenwald, A. G., & Banaji, M. R. (1995) · Psychological Review · doi:10.1037/0033-295x.102.1.4 · Cited by 6,682
The use of scoring rubrics: Reliability, validity and educational consequences
Jonsson, A., & Svingby, G. (2007) · Educational Research Review · doi:10.1016/j.edurev.2007.05.002 · Cited by 1,509
A hypothesis-confirming bias in labeling effects
Darley, J. M., & Gross, P. H. (1983) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.44.1.20 · Cited by 1,173
Ubiquitous halo.
Cooper, W. H. (1981) · Psychological Bulletin · doi:10.1037/0033-2909.90.2.218 · Cited by 492
Beauty is talent: Task evaluation as a function of the performer's physical attractiveness.
Landy, D., & Sigall, H. (1974) · Journal of Personality and Social Psychology · doi:10.1037/h0036018 · Cited by 449
Eurasian Journal of Educational Research
(2015) · Eurasian Journal of Educational Research · doi:10.14689/ejer.2015 · Cited by 299
Name stereotypes and teachers' expectations.
Harari, H., & McDavid, J. W. (1973) · Journal of Educational Psychology · doi:10.1037/h0034978 · Cited by 214

Show all 43 references

Research works printed but not linked: 7

10.3102/00028312022002175 · DOI
Belsey, C. (1988). Marking by numbers. AUT women , No. 15 (pp. 1–2). London, UK: Association of University Teachers.
Borenstein M., 2005, Comprehensive Meta-Analysis Version 2
*Gerritson, M. (2013). Rubrics as a mitigating instrument for bias in the grading of student writing (Doctoral dissertation, Walden University).
Haeran J., 2010, College Teaching, 57, 51
*King J. L., 1998, Educational Research Quarterly, 22, 13
Warren Piper D., 1996, Examination practices and procedures in Australian universities

Sorted by citations

Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
Holstein, K., Wortman Vaughan, J., Daumé, H., Dudik, M., & Wallach, H. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300830 · Cited by 777
The need to disentangle assessment and feedback in higher education
Winstone, N., & Boud, D. J. (2020) · Studies in Higher Education · doi:10.1080/03075079.2020.1779687 · Cited by 369
Novice Programmers and Introductory Programming
Robins, A. V. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.013 · Cited by 191
The Cambridge Handbook of Computing Education Research
Fincher, S., Robins, A. V., Margulieux, L. E., Morrison, B. B., Shephard, K., Loui, M., Borrego, M., Lancaster, T., Falkner, K., Sheard, J., et al. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555 · Cited by 141
Experimental Evidence on Teachers’ Racial Bias in Student Evaluation: The Role of Grading Scales
Quinn, D. M. (2020) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373720932188 · Cited by 124
Disrupting White Supremacy in Assessment: Toward a Justice-Oriented, Antiracist Validity Framework
Randall, J., Slomp, D., Poe, M., & Oliveri, M. E. (2022) · Educational Assessment · doi:10.1080/10627197.2022.2042682 · Cited by 126
Improving fairness in machine learning systems: What do industry practitioners need?Preprint
Holstein, K., Vaughan, J. W., Daumé, H., Dudík, M., & Wallach, H. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1812.05239 · Cited by 81
A typology for a social justice approach to assessment: learning from universal design and culturally sustaining pedagogy
Hanesworth, P., Bracken, S., & Elkington, S. (2019) · Teaching in Higher Education · doi:10.1080/13562517.2018.1465405 · Cited by 80
Computational Thinking
Curzon, P., Bell, T., Waite, J., & Dorling, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.018 · Cited by 85
The effectiveness of a school-based, universal mental health programme in six European countries
Cefai, C., Camilleri, L., Bartolo, P. A., Grazzani, I., Cavioni, V., Conte, E., Ornaghi, V., Agliati, A., Gandellini, S., Vorkapić, S. T., et al. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.925614 · Cited by 99
Technology and Feedback Design
Dawson, P., Henderson, M., Ryan, T., Mahoney, P., Boud, D. J., Phillips, M., & Molloy, E. (2018) · Springer eBooks · doi:10.1007/978-3-319-17727-4_124-1 · Cited by 67
Programming Paradigms and Beyond
Krishnamurthi, S., & Fisler, K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.014 · Cited by 69
Women Are Underrepresented and Receive Differential Outcomes at ASM Journals: a Six-Year Retrospective Analysis
Hagan, A. K., Topçuoğlu, B. D., Gregory, M. E., Barton, H. A., & Schloss, P. D. (2020) · mBio · doi:10.1128/mbio.01680-20 · Cited by 62
Tangible Computing
Horn, M., & Bers, M. U. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.023 · Cited by 63
Retention in Computer Science Undergraduate Programs in the U.S.
Stephenson, C., Miller, A. D., Alvarado, C., Barker, L. J., Barr, V., Camp, T. K., Frieze, C., Lewis, C. M., Mindell, E., Limbird, L. E., et al. (2018) · ACM eBooks · doi:10.1145/3406772 · Cited by 61
The History of Computing Education Research
Guzdial, M., & du Boulay, B. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.002 · Cited by 66
Effect of a 20-week physical activity intervention on selective attention and academic performance in children living in disadvantaged neighborhoods: A cluster randomized control trial
Gall, S., Adams, L., Joubert, N., Ludyga, S., Müller, I., Nqweniso, S., Pühse, U., du Randt, R., Seelig, H., Smith, D., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0206908 · Cited by 52
Teaching as Social Influence: Empowering Teachers to Become Agents of Social Change
Butera, F., Batruch, A., Autin, F., Mugny, G., Quiamzade, A., & Pulfrey, C. (2020) · Social Issues and Policy Review · doi:10.1111/sipr.12072 · Cited by 78
Teacher judgments in school exams: Influences of students' lower-order-thinking skills on the assessment of students’ higher-order-thinking skills
Jansen, T., & Møller, J. (2021) · Teaching and Teacher Education · doi:10.1016/j.tate.2021.103616 · Cited by 80
The function of selection of assessment leads evaluators to artificially create the social class achievement gap.
Autin, F., Batruch, A., & Butera, F. (2018) · Journal of Educational Psychology · doi:10.1037/edu0000307 · Cited by 63
ACM RETENTION COMMITTEETwelve tips for creating a culture that supports all students in computing
Lewis, C. M. (2017) · ACM Inroads · doi:10.1145/3148524 · Cited by 45
Impact of a School Mental Health Program on Children’s and Adolescents’ Socio-Emotional Skills and Psychosocial Difficulties
Colomeischi, A. A., Duca, D., Bujor, L., Rusu, P., Grazzani, I., & Cavioni, V. (2022) · Children · doi:10.3390/children9111661 · Cited by 32
Biased grades? Changes in grading after a blinding of examinations reform
Bygren, M. (2019) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2019.1638885 · Cited by 40
Cognitive Sciences for Computing Education
Robins, A. V., Margulieux, L. E., & Morrison, B. B. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.010 · Cited by 44
Our validity looks like justice. Does yours?
Randall, J., Poe, M., Slomp, D., & Oliveri, M. E. (2023) · Language Testing · doi:10.1177/02655322231202947 · Cited by 54
Justice-Oriented, Antiracist Validation: Continuing to Disrupt White Supremacy in Assessment Practices
Randall, J., Poe, M., Oliveri, M. E., & Slomp, D. (2023) · Educational Assessment · doi:10.1080/10627197.2023.2285047 · Cited by 51
Computing EducationLiterature Review and Voices from the Field
Blikstein, P., & Moghadam, S. H. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.004 · Cited by 43
Analytic or holistic? A study about how to increase the agreement in teachers’ grading
Jönsson, A., Balan, A., & Hartell, E. (2021) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2021.1884041 · Cited by 34
A Fairness Evaluation of Automated Methods for Scoring Text Evidence Usage in Writing
Litman, D. J., Zhang, H., Correnti, R. J., Matsumura, L. C., & Wang, E. L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78292-4_21 · Cited by 33
Learning Sciences for Computing Education
Margulieux, L. E., Dorn, B., & Searle, K. A. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.009 · Cited by 33
Equity and Diversity
Lewis, C. M., Shah, N., & Falkner, K. E. K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.017 · Cited by 36
Time for Change: Understanding Teacher Social-Emotional Learning Supports for Anti-Racism and Student Well-Being During COVID-19, and Beyond
Beard, K. S., Vakil, J. B., Chao, T., & Hilty, C. D. (2021) · Education and Urban Society · doi:10.1177/00131245211062527 · Cited by 38
Teacher Learning and Professional Development
Fincher, S. A., Kolikant, Y. B., & Falkner, K. E. K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.026 · Cited by 29
Discrimination in grading: A scoping review of studies on teachers’ discrimination in school
Zanga, G., & Gioannis, E. D. (2023) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2023.101284 · Cited by 32
Motivation, Attitudes, and Dispositions
Lishinski, A., & Yadav, A. K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.029 · Cited by 34
Pedagogic Approaches
Falkner, K. E. K., & Sheard, J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.016 · Cited by 36
Qualitative Methods for Computing Education
Tenenberg, J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.008 · Cited by 24
Measuring biology trainee teachers’ professional knowledge about evolution—introducing the Student Inventory
Fischer, J., Jansen, T., Møller, J., & Harms, U. (2021) · Evolution Education and Outreach · doi:10.1186/s12052-021-00144-0 · Cited by 25
Grading in Hungarian Primary Schools: Mechanisms of Ethnic Discrimination against Roma Students
Kisfalusi, D., Janky, B., & Takács, K. (2021) · European Sociological Review · doi:10.1093/esr/jcab023 · Cited by 24
Descriptive Statistics
Haden, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.006 · Cited by 28
Does Educational Handover Influence Subsequent Assessment?
Dory, V., Danoff, D. S., Plotnick, L. H., Cummings, B., Gomez-Garibello, C. A., Pal, N. E., Gumuchian, S. T., & Young, M. E. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003528 · Cited by 20
A large-scale examination of the effectiveness of anonymous marking in reducing group performance differences in higher education assessment
Hinton, D. P., & Higson, H. E. (2017) · PLoS ONE · doi:10.1371/journal.pone.0182711 · Cited by 20
Diversity and equality in honours and awards programs – steps towards a fair representation of membership
Holmes, M. A., Myles, L., & Schneider, B. B. (2020) · Advances in geosciences · doi:10.5194/adgeo-53-41-2020 · Cited by 20
Self‐reported academic performance and academic cheating: Exploring the role of the perceived classroom (in)justice mediators
Sabbagh, C. (2021) · British Journal of Educational Psychology · doi:10.1111/bjep.12433 · Cited by 21
Lifelong Learning and Higher Education
Bjursell, C. (2024) · doi:10.37852/oblu.254.c595 · Cited by 18
Tools and Environments
Malmi, L., Utting, I., & Ko, A. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.022 · Cited by 18
Learning Outside the Classroom
Begel, A., & Ko, A. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.027 · Cited by 18
Implementation of an unconscious bias course for the National Research Mentoring Network
Javier, D., Solis, L. G., Paul, M. F., Thompson, E. L., Maynard, G., Latif, Z., Stinson, K., Ahmed, T., & Vishwanatha, J. K. (2022) · BMC Medical Education · doi:10.1186/s12909-022-03466-9 · Cited by 22
Technology and Feedback Design
Dawson, P., Henderson, M., Ryan, T., Mahoney, P., Boud, D., Phillips, M., & Molloy, E. (2023) · Learning, Design, and Technology · doi:10.1007/978-3-319-17461-7_124 · Cited by 16
Narratives of Joy and Failure in Antiracist Assessment: Exploring Collaborative Writing Assessments
(2024) · The WAC Clearinghouse; University Press of Colorado eBooks · doi:10.37514/pra-b.2024.2227 · Cited by 16
Computing for Other Disciplines
Guzdial, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.020 · Cited by 20
Analytic or Holistic: A Study of Agreement Between Different Grading Models
Jönsson, A., & Balan, A. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/mg59-xq60 · Cited by 15
Engineering Education Research
Loui, M. C., & Borrego, M. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.012 · Cited by 17
Non-communicated judgements of, versus feedback on, students’ essays: Is feedback inflation larger for students with a migration background?
Nishen, A. K., & Kessels, U. (2021) · Social Psychology of Education · doi:10.1007/s11218-021-09674-3 · Cited by 12
Leveraging the Integrated Development Environment for Learning Analytics
Carter, A., Hundhausen, C. D., & Olivares, D. M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.024 · Cited by 13
The Brilliance–Belonging Model: How Cultural Beliefs About Intellectual Ability Undermine Educational Equity
Bauer, C. A., Poddar, A., Brummelman, E., & Cimpian, A. (2025) · Educational Psychology Review · doi:10.1007/s10648-025-10034-2 · Cited by 16
Students with Emotional and Behavioral Disorder and Teachers’ Stereotypes – Effects on Teacher Judgments
Krämer, S., & Zimmermann, F. (2021) · The Journal of Experimental Education · doi:10.1080/00220973.2021.1934809 · Cited by 13
Modeling essay grading with pre-trained BERT features
Sharma, A., & Jayagopi, D. B. (2024) · Applied Intelligence · doi:10.1007/s10489-024-05410-4 · Cited by 17
Scaling anti‐plagiarism efforts to meet the needs of large online computer science classes: Challenges, solutions, and recommendations
Adkins, K. L., & Joyner, D. A. (2022) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12710 · Cited by 12
Teacher Knowledge for Inclusive Computing Learning
Goode, J., & Ryoo, J. J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.025 · Cited by 12
Off the mark: Repetitive marking undermines essay evaluations due to boredom
Erturk, S., van Tilburg, W. A. P., & Igou, E. R. (2022) · Motivation and Emotion · doi:10.1007/s11031-022-09929-2 · Cited by 11
School grades and educational attainments of adolescents and young adults born preterm
Alenius, S., Kajantie, E., Sund, R., Nurhonen, M., Haaramo, P., Näsänen-Gilmore, P. K., Lemola, S., Räikkönen, K., Schnitzlein, D. D., Dieter Wolke, C., et al. (2023) · Scientific Reports · doi:10.1038/s41598-022-27295-4 · Cited by 11
School tutoring and academic performance: A too close relationship?
López-Agudo, L. A., Gutiérrez, Ó. D. M., & Marfil, J. A. M. (2020) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2020.100903 · Cited by 11
When ethnic minority students are judged as more suitable for the highest school track: a shifting standards experiment
Nishen, A. K., Corcoran, K., Holder, K., & Kessels, U. (2022) · European Journal of Psychology of Education · doi:10.1007/s10212-021-00595-5 · Cited by 10
Common-sense teaching for the 2020s: Ungrading in response to covid-19 and beyond
Johanesen, K., Claiborne, L. L., Falk, E. S., Parsons‐Hubbard, K., Kohfeld, K. E., Nadin, E., & Schmidt, A. H. (2023) · Journal of Geoscience Education · doi:10.1080/10899995.2023.2259784 · Cited by 12
Discrepancy between performance and feedback affects mathematics student teachers’ self-efficacy but not their self-assessment accuracy
Ernst, H. M., Prinz‐Weiß, A., Wittwer, J., & Voss, T. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1391093 · Cited by 14
Innovative assessment and grading practices in higher education: a critical exploration for management educators
Mesny, A., Roberge‐Maltais, I., & Galy, A. (2025) · The International Journal of Management Education · doi:10.1016/j.ijme.2025.101307 · Cited by 18
Schools (K–12)
Vahrenhold, J., Cutts, Q. I., & Falkner, K. E. K. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.019 · Cited by 11
Creating an Inclusive Learning Community to Better Serve Minority Students
Lin, P. S., & Kennette, L. N. (2022) · Journal of Effective Teaching in Higher Education · doi:10.36021/jethe.v4i3.250 · Cited by 9
Assessment and Plagiarism
Lancaster, T., Robins, A. V., & Fincher, S. A. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.015 · Cited by 11
Academic Achievement After Violence Exposure: The Indirect Effects of School Attachment and Motivation to Succeed
Sonsteng-Person, M. A., Jaggers, J. W., & Loomis, A. M. (2023) · Journal of Child & Adolescent Trauma · doi:10.1007/s40653-023-00546-w · Cited by 8
Experimental evidence of disparities in biology teachers’ responses to student writing
Sedlacek, Q. C. (2021) · International Journal of Science Education · doi:10.1080/09500693.2021.1963499 · Cited by 10
Inferential Statistics
Haden, P. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.007 · Cited by 10
Computing Education Research Today
Fincher, S. A., Tenenberg, J., Dorn, B., Hundhausen, C., McCartney, R., & Murphy, L. (2019) · The Cambridge Handbook of Computing Education Research · doi:10.1017/9781108654555.003 · Cited by 7
A decade of grade inflation boosted by the COVID ‐19 pandemic—An empirical analysis of a top European university
François, M., & Witte, K. D. (2025) · British Educational Research Journal · doi:10.1002/berj.4172 · Cited by 7
Investigating how the accuracy of teacher expectations of pupil performance relate to socioeconomic and genetic factors
Barry, C.-J. S., Davies, N. M., & Morris, T. (2022) · Scientific Reports · doi:10.1038/s41598-022-11347-w · Cited by 7
Higher Education Pedagogy
Shephard, K. L. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.011 · Cited by 8
Student Knowledge and Misconceptions
Lewis, C. M., Clancy, M. J., & Vahrenhold, J. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.028 · Cited by 7
New Programming Paradigms
Shapiro, R. B., & Tissenbaum, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.021 · Cited by 9
A case for co-construction with teachers in curricular reform: Introducing computer science in primary school
El‐Hamamsy, L., Bruno, B., Kovacs, H., Chevalier, M., Zufferey, J. D., & Francesco Mondada, C. (2022) · Australasian Computing Education Conference · doi:10.1145/3511861.3511883 · Cited by 7
Objective Tests in Automated Grading of Computer Science Courses: An Overview
Lujak, M., Slavkovik, M., Lebis, A., Vermeulen, M., & Doniec, A. (2022) · Learning and analytics in intelligent systems · doi:10.1007/978-3-031-04662-9_12 · Cited by 7
A Study of Ungrading in Upper-level Political Theory Courses
Kehlenbach, E. S. (2022) · Journal of Political Science Education · doi:10.1080/15512169.2022.2160336 · Cited by 10
Best Practices in Summative Assessment
Tienson-Tseng, H. L. (2019) · ACS symposium series · doi:10.1021/bk-2019-1337.ch010 · Cited by 7
Adoption of Internal Medicine Milestone Ratings and Changes in Bias Against Black, Latino, and Asian Internal Medicine Residents
Gray, B. M., Lipner, R. S., Roswell, R. O., Fernández, A., Vandergrift, J. L., & Alsan, M. M. (2023) · Annals of Internal Medicine · doi:10.7326/m23-1588 · Cited by 6
A Study Design Process
Ko, A. J., & Fincher, S. A. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.005 · Cited by 7
Successful in Sports but Worse in School? Adolescent Student-Athletes’ Development of Scholastic Performances
Niehues, M., Gerlach, E., Wendeborn, T., & Sallen, J. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.946284 · Cited by 6
Old habits die hard? School guidance interventions and the persistence of inequalities
Borgna, C., Contini, D., Pintor, S. P., Ricucci, R., & Vigna, N. (2022) · Research in Social Stratification and Mobility · doi:10.1016/j.rssm.2022.100728 · Cited by 9
Students As Teachers and Communicators
Simon, B., Hundhausen, C. D., McDowell, C., Werner, L., Hu, H. H., & Kussmaul, C. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.030 · Cited by 6
Perceptions of Physical Therapy Students on their Psychomotor Examinations: a Qualitative Study
Macauley, K., Laprino, S., & Brudvig, T. J. (2022) · Medical Science Educator · doi:10.1007/s40670-022-01514-z · Cited by 6
Definitions of Formative Assessment Need to Make a Distinction Between a Psychometric Understanding of Assessment and “Evaluative Judgment”
Jönsson, A. (2020) · Frontiers in Education · doi:10.3389/feduc.2020.00002 · Cited by 7
An Important and Timely Field
Fincher, S. A., & Robins, A. V. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.001 · Cited by 9
A literature review of Black and Latiné youth’s experience of inequitable feedback: How can middle school educators provide motivationally-supportive feedback?
Nicolai, K. D., Koenka, A. C., & Braxton, D. (2023) · Middle School Journal · doi:10.1080/00940771.2023.2232264 · Cited by 6
A Mixed Method Study of Nursing Students' Experiences of Discrimination Within Their Programs
Dhari, S., Slemon, A., & Handlovsky, I. (2025) · Journal of Advanced Nursing · doi:10.1111/jan.16772 · Cited by 5
Making Sense of Consensus: Disagreement in Student Survey Reports Can Help Identify Instructional Microclimates within Classrooms
Schweig, J. D., Martínez, J. F., & Schnittka, J. (2022) · American Journal of Education · doi:10.1086/720539 · Cited by 5
Online or Face-to-Face Learning? College Students’ Perceptions in the Aftermath of the COVID-19 Pandemic
Quesada, G. M., Gabuardi, V. M. F., Vargas, R. H., Quirós, O. E., & Chaverri, G. (2023) · European Journal of Education and Pedagogy · doi:10.24018/ejedu.2023.4.3.645 · Cited by 5
Attempts at anti-racist teaching by white English teachers of black students
Schuman, J., & Reynolds, D. (2023) · English Teaching Practice & Critique · doi:10.1108/etpc-05-2022-0071 · Cited by 5
A Case Study of Qualitative Methods
Lewis, C. M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108654555.032 · Cited by 14
Well-Being in International Large-Scale Assessments
Borgonovi, F. (2022) · Springer international handbooks of education · doi:10.1007/978-3-030-38298-8_45-1 · Cited by 6
Gender differences between teachers’ assessments and test based assessments. Evidence from Spain
Gutiérrez, Ó. D. M., Prieto-Latorre, C., & Sánchez‐Rodríguez, M. I. (2023) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2023.2251715 · Cited by 5
Risk of impaired school performance in children hospitalized with concussion: a population-based matched cohort study
Lystad, R. P., McMaugh, A. L., Herkes, G., Browne, G. J., Badgery‐Parker, T., Cameron, C. M., & Mitchell, R. J. (2023) · Concussion · doi:10.2217/cnc-2022-0012 · Cited by 5

Authors: Malouff, J. M., & Thorsteinsson, E. B.
Affiliations: University of New England (AU)
Corresponding author: Malouff, John M
ORCID: Malouff, John M
Thorsteinsson, Einar B
Venue: Australian Journal of Education
Publisher: SAGE Publications
Published: 2016-09-21
Volume: 60
Issue: 3
Pages: 245-256
ISSN: 0004-9441 (ISSN-L)
2050-5884
DOI: 10.1177/0004944116664618
OpenAlex: W2512722101
Cited by: 222
References: 43
Citations by year: 2026: 22 · 2025: 29 · 2024: 44 · 2023: 21 · 2022: 26 · 2021: 15 · 2020: 13 · 2019: 42 · 2018: 6 · 2017: 3
FWCI: 6.60
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Australian Journal of Education (publishedVersion)
EPubDev Repository (submittedVersion)
RUNE (Research UNE) (submittedVersion)
Topics: Social Sciences › Education › Student Assessment and Feedback
Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
Keywords: grading bias, subjective grading, essay writing, student assessment, race and ethnicity, physical attractiveness, prior performance

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Bias in grading: A meta-analysis of experimental research findings

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks