Cited by 127Educational Technology and AssessmentPsychometric Methodologies and TestingStudent Assessment and Feedback

The DOI matches its Crossref record; 67 of the 70 references it cites were found in a registry or an index.

Automated essay scoring: Psychometric guidelines and practices

Ramineni, Chaitanya, Williamson, David M.·2013·Assessing Writing

DOI 10.1016/j.asw.2012.10.004

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1016/j.asw.2012.10.004

Cites

67 of 67 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Statistical Power Analysis for the Behavioral Sciences
Muller, K. E., & Cohen, J. (1989) · Technometrics · doi:10.2307/1270020 · Cited by 99,603
Statistical power analysis for the behavioral sciences
Cohen, J. (1990) · Computers Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,417
The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability
Fleiss, J. L., & Cohen, J. (1973) · Educational and Psychological Measurement · doi:10.1177/001316447303300309 · Cited by 3,354
Handbook of Writing Research
MacArthur, C. A., Graham, S. W., & Fitzgerald, J. (2005) · Cited by 2,327
Common Core State Standards
Shanahan, C. R. (2011) · Cited by 866
AUTOMATED ESSAY SCORING WITH E‐RATER® V.2.0
Attali, Y., & Burstein, J. C. (2004) · ETS Research Report Series · doi:10.1002/j.2333-8504.2004.tb01972.x · Cited by 641
Rating the ratings: Assessing the psychometric quality of rating data.
Saal, F. E., Downey, R. G., & Lahey, M. A. (1980) · Psychological Bulletin · doi:10.1037/0033-2909.88.2.413 · Cited by 545
Automated Essay Scoring
Shermis, M. D., & Burstein, J. C. (2003) · Routledge eBooks · doi:10.4324/9781410606860 · Cited by 512
Common Core State Standards
Shanahan, T. (2015) · The Elementary School Journal · doi:10.1086/681130 · Cited by 469
Untitled work
(1966) · Phi Delta Kappan · Cited by 449

Show all 70 references

Research works printed but not linked: 3

Pearson (2009, March). PTE academic automated scoring. Retrieved from http://www.pearsonpte.com/SiteCollectionDocuments/AutomatedScoringUS.pdf
Stalnaker, 1936, The problem of the English examination, Educational Record, 17, 35
Williamson, 2010, Automated Scoring for the Assessment of Common Core Standards

Sorted by citations

Algorithmic bias in education
Baker, R. S., & Hawn, A. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-021-00285-9 · Cited by 993
A hierarchical classification approach to automated essay scoring
McNamara, D. S., Crossley, S. A., Roscoe, R. D., Allen, L. K., & Dai, J. (2014) · Assessing Writing · doi:10.1016/j.asw.2014.09.002 · Cited by 243
State-of-the-art automated essay scoring: Competition, results, and future directions from a United States demonstration
Shermis, M. D. (2014) · Assessing Writing · doi:10.1016/j.asw.2013.04.001 · Cited by 227
Stop! Grammar time: University students’ perceptions of the automated feedback program Grammarly
ONeill, R., & Russell, A. (2019) · Australasian Journal of Educational Technology · doi:10.14742/ajet.3795 · Cited by 180
Graduate Theses and Dissertations
Davis, M., Davis, K. J., & Dunagan, M. M. (2012) · Elsevier eBooks · doi:10.1016/b978-0-12-384727-0.00006-9 · Cited by 165
Initial investigation into computer scoring of candidate essays for personnel selection.
Campion, M. C., Campion, M. A., Campion, E. D., & Reider, M. H. (2016) · Journal of Applied Psychology · doi:10.1037/apl0000108 · Cited by 130
ChatGPT as an automated essay scoring tool in the writing classrooms: how it compares with human scoring
Bui, N. M., & Barrot, J. S. (2025) · Education and Information Technologies · doi:10.1007/s10639-024-12891-w · Cited by 113
Large-scale assessment, locally-developed measures, and automated scoring of essays: Fishing for red herrings?
Condon, W. (2012) · Assessing Writing · doi:10.1016/j.asw.2012.11.001 · Cited by 113
The role of automated writing evaluation holistic scores in the ESL classroom
Li, Z., Link, S., Ma, H., Yang, H., & Hegelheimer, V. H. (2014) · System · doi:10.1016/j.system.2014.02.007 · Cited by 119
Beyond single-word measures: L2 writing assessment, lexical richness and formulaic competence
Bestgen, Y. (2017) · System · doi:10.1016/j.system.2017.08.004 · Cited by 107
A systematic review of automated writing evaluation systems
Shi, H., & Aryadoust, V. (2022) · Education and Information Technologies · doi:10.1007/s10639-022-11200-7 · Cited by 111
Appropriating automated feedback in L2 writing: experiences of Chinese EFL student writers
Jiang, L. G., & Yu, S. (2020) · Computer Assisted Language Learning · doi:10.1080/09588221.2020.1799824 · Cited by 88
Automated Scoring of Nonnative Speech Using the SpeechRaterSMv. 5.0 Engine
Chen, L., Zechner, K., Yoon, S., Evanini, K., Wang, X., Loukina, A., Tao, J., Davis, L., Lee, C., Ma, M., et al. (2018) · ETS Research Report Series · doi:10.1002/ets2.12198 · Cited by 69
The many dimensions of algorithmic fairness in educational applications
Loukina, A., Madnani, N., & Zechner, K. (2019) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/w19-4401 · Cited by 64
What has been assessed in writing and how? Empirical evidence from Assessing Writing (2000–2018)
Zheng, Y., & Yu, S. (2019) · Assessing Writing · doi:10.1016/j.asw.2019.100421 · Cited by 60
Automated Evaluation of Writing – 50 Years and Counting
Klebanov, B. B., & Madnani, N. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.697 · Cited by 60
Feature selection for automated speech scoring
Loukina, A., Zechner, K., Chen, L., & Heilman, M. (2015) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.3115/v1/w15-0602 · Cited by 52
Advances in the Field of Automated Essay Evaluation
Zupanc, K., & Bosnić, Z. (2016) · Informatica · Cited by 46
Building Better Open-Source Tools to Support Fairness in Automated Scoring
Madnani, N., Loukina, A., von Davier, A. A., Burstein, J. C., & Cahill, A. (2017) · doi:10.18653/v1/w17-1605 · Cited by 45
Deep Learning in Employee Selection: Evaluation of Algorithms to Automate the Scoring of Open-Ended Assessments
Thompson, I. B., Koenig, N., Mracek, D. L., & Tonidandel, S. (2023) · Journal of Business and Psychology · doi:10.1007/s10869-023-09874-y · Cited by 48
AI-assisted automated scoring of picture-cued writing tasks for language assessment
Zhao, R., Zhuang, Y., Zou, D., Xie, Q., & Yu, P. L. H. (2023) · Education and Information Technologies · doi:10.1007/s10639-022-11473-y · Cited by 40
Proceedings of the First ACL Workshop on Ethics in Natural Language Processing
(2017) · doi:10.18653/v1/w17-16 · Cited by 42
Building e‐rater® Scoring Models Using Machine Learning Methods
Chen, J., Fife, J. H., Bejar, I. I., & Rupp, A. A. (2016) · ETS Research Report Series · doi:10.1002/ets2.12094 · Cited by 35
A Fairness Evaluation of Automated Methods for Scoring Text Evidence Usage in Writing
Litman, D. J., Zhang, H., Correnti, R. J., Matsumura, L. C., & Wang, E. L. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-78292-4_21 · Cited by 33
Validating automated essay scoring for online writing placement
Ramineni, C. (2012) · Assessing Writing · doi:10.1016/j.asw.2012.10.005 · Cited by 31
Self-citation
Automated Writing Analysis for Writing Pedagogy
Cotos, E. (2015) · Writing & Pedagogy · doi:10.1558/wap.v7i2-3.26381 · Cited by 37
Evaluating China’s Automated Essay Scoring System iWrite
Qian, L., Zhao, Y., & Cheng, Y. (2019) · Journal of Educational Computing Research · doi:10.1177/0735633119881472 · Cited by 31
Understanding Mean Score Differences Between the e‐rater® Automated Scoring Engine and Humans for Demographically Based Groups in the GRE® General Test
Ramineni, C., & Williamson, D. M. (2018) · ETS Research Report Series · doi:10.1002/ets2.12192 · Cited by 29
Self-citation
An NCME Instructional Module on Data Mining Methods for Classification and Regression
Sinharay, S. (2016) · Educational Measurement Issues and Practice · doi:10.1111/emip.12115 · Cited by 30
Automated Essay Scoring in Innovative Assessments of Writing from Sources
Deane, P., Williams, F., Weng, V. Z., & Trapani, C. S. (2013) · eScholarship (California Digital Library) · Cited by 28
Automated scoring in context: Rapid assessment for placed students
Klobucar, A., Elliot, N., Deess, P., Rudniy, O., & Joshi, K. (2012) · Assessing Writing · doi:10.1016/j.asw.2012.10.001 · Cited by 28
Validity of automated essay scores for elementary-age English language learners: Evidence of bias?
Wilson, J., & Huang, Y. (2024) · Assessing Writing · doi:10.1016/j.asw.2024.100815 · Cited by 27
Automated Essay Scoring Systems
Ifenthaler, D. (2022) · Handbook of Open, Distance and Digital Education · doi:10.1007/978-981-19-0351-9_59-1 · Cited by 36
Automated Scoring with Validity in Mind
Bejar, I. I., Mislevy, R. J., & Zhang, M. (2016) · John Wiley & Sons, Inc. eBooks · doi:10.1002/9781118956588.ch10 · Cited by 25
Automated Writing Instruction and Feedback: Instructional Mode, Attitudes, and Revising
Roscoe, R. D., Allen, L. K., Johnson, A. C., & McNamara, D. S. (2018) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931218621471 · Cited by 28
Combining machine translation and automated scoring in international large-scale assessments
Jung, J. Y., Tyack, L., & von Davier, M. (2024) · Large-scale Assessments in Education · doi:10.1186/s40536-024-00199-7 · Cited by 21
An exploration of automated narrative analysis via machine learning
Jones, S., Fox, C., Gillam, S., & Gillam, R. B. (2019) · PLOS ONE · doi:10.1371/journal.pone.0224634 · Cited by 20
“I must impress the raters!” An investigation of Chinese test-takers’ strategies to manage rater impressions
Xie, Q. (2015) · Assessing Writing · doi:10.1016/j.asw.2015.05.001 · Cited by 20
Human scoring versus automated scoring for english learners in a statewide evidence-based writing assessment
Vo, Y., Rickels, H., Welch, C., & Dunbar, S. (2023) · Assessing Writing: An International Journal · doi:10.1016/j.asw.2023.100719 · Cited by 21
Impact of AWE Rubrics and Automated Assessment on EFL Writing Instruction
Tang, J., & Wu, Y. (2017) · International Journal of Computer-Assisted Language Learning and Teaching · doi:10.4018/ijcallt.2017040104 · Cited by 15
Appraising the scoring performance of automated essay scoring systems—Some additional considerations: Which essays? Which human raters? Which scores?
Raczynski, K. R., & Cohen, A. S. (2018) · Applied Measurement in Education · doi:10.1080/08957347.2018.1464449 · Cited by 14
Evaluación automatizada y semiautomatizada de la calidad de textos escritos: una revisión sistemática
Lillo-Fuentes, F., René Venegas, V., & Lobos, I. (2023) · Perspectiva educacional · doi:10.4151/07189729-vol.62-iss.2-art.1420 · Cited by 19
A comparative study of the human, automated scoring model, and GPT-4 ratings of young EFL students’ writing
Suhan, M., & Wolf, M. K. (2025) · Language Testing · doi:10.1177/02655322251346860 · Cited by 10
Text Mining and Automated Scoring
Flor, M., & Hao, J. (2021) · Methodology of educational measurement and assessment · doi:10.1007/978-3-030-74394-9_14 · Cited by 11
Evaluating the Construct Validity of an Automated Writing Evaluation System with a Randomization Algorithm
Myers, M. C., & Wilson, J. (2022) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-022-00301-6 · Cited by 9
Evaluation of e‐rater® for the Praxis I® Writing Test
Ramineni, C., Trapani, C. S., & Williamson, D. M. (2015) · ETS Research Report Series · doi:10.1002/ets2.12047 · Cited by 9
Self-citation
Unveiling the Scoring Validity of Two Chinese Automated Writing Evaluation Systems: A Quantitative Study
Wang, J., & Bai, L. (2021) · International Journal of English Linguistics · doi:10.5539/ijel.v11n2p68 · Cited by 9
Automated Essay Scoring Systems
Ifenthaler, D. (2023) · Handbook of Open, Distance and Digital Education · doi:10.1007/978-981-19-2080-6_59 · Cited by 12
Linguistic predictors of L2 writing performance: Variations across genres
Yang, W., Cushing, S. T., & Yu, G. (2025) · Assessing Writing · doi:10.1016/j.asw.2025.100985 · Cited by 12
Automated evaluation of the quality of ideas in compositions based on concept maps
Yang, L., Xin, T., Luo, F., Zhang, S., & Tian, X. (2021) · Natural Language Engineering · doi:10.1017/s1351324921000103 · Cited by 8
Human Versus Automated Essay Scoring: A Critical Review
Journal, A. W. E., & Sevcikova, B. L. (2018) · Arab World English Journal · doi:10.2139/ssrn.3201916 · Cited by 8
PENERAPAN MODEL EXPLICIT INSTRUCTION DALAM PEMBELAJARAN MATEMATIKA MATERI BILANGAN ROMAWI PADA SISWA KELAS IV SD INPRES KAPASA MAKASSAR
Makassar, U. M., Syamsuddin, A., Jannah, M., & Kristiawati, K. (2019) · MaPan · doi:10.24252/mapan.2019v7n1a11 · Cited by 8
Human Systems Engineering and Educational Technology
Roscoe, R. D., Branaghan, R. J., Cooke, N. J., & Craig, S. D. (2017) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-2639-1.ch001 · Cited by 8
Can generative AI figure out figurative language? The influence of idioms on essay scoring by ChatGPT, Gemini, and Deepseek
Oğuz, E. (2025) · Assessing Writing · doi:10.1016/j.asw.2025.100981 · Cited by 12
Intelligent Tutoring Systems for Literacy: Existing Technologies and Continuing Challenges.
Jacovina, M. E., & McNamara, D. S. (2016) · Grantee Submission · Cited by 7
Automated Essay Scoring
Klebanov, B. B., & Madnani, N. (2021) · Synthesis lectures on human language technologies · doi:10.2200/s01121ed1v01y202108hlt052 · Cited by 7
Automatic Medical Case Study Essay Scoring by Support Vector Machine and Genetic Algorithms
Yenaeng, S., Saelee, S., & Samai, W. (2013) · International Journal of Information and Education Technology · doi:10.7763/ijiet.2014.v4.384 · Cited by 7
Reproducing Monolingual, Multilingual and Cross-Lingual CEFR Predictions
Bestgen, Y. (2020) · Digital Access to Libraries (Université catholique de Louvain (UCL), l'Université de Namur (UNamur) and the Université Saint-Louis (USL-B)) · Cited by 7
How Reliable Is It to Automatically Score Open-Ended Items? An Application in the Turkish Language
UYSAL, İ., & Doğan, N. (2021) · Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi · doi:10.21031/epod.817396 · Cited by 8
Transformer-LSTM Models for Automatic Scoring and Feedback in English Writing Assessment
Xuan, Y. (2025) · IEEE Access · doi:10.1109/access.2025.3562493 · Cited by 6
Student Engagement With AI Feedback: Evidence From Ethnic Minority Students in China
Yang, F., Li, K., & Qian, L. (2025) · International Journal of Applied Linguistics · doi:10.1111/ijal.70066 · Cited by 5
Évaluation de textes en anglais langue étrangère et séries phraséologiques : comparaison de deux procédures automatiques librement accessibles
Bestgen, Y. (2019) · Revue française de linguistique appliquée · doi:10.3917/rfla.241.0081 · Cited by 5
Computer Scoring of Emotional Awareness in a Nonclinical Population of Young Adults
Barchard, K. A., & Picker, C. J. (2017) · Journal of Personality Assessment · doi:10.1080/00223891.2017.1282866 · Cited by 5
A Study for the Development of Automated Essay Scoring (AES) in Malaysian English Test Environment
Wong, W. S., & Bong, C. H. (2019) · International Journal of Innovative Computing · doi:10.11113/ijic.v9n1.220 · Cited by 5
Assessing writing ability in primary education : on the evaluation of text quality and text complexity
Feenstra, H. (2014) · doi:10.3990/1.9789036537254 · Cited by 5
Can Legal and Professional Personnel Selection Principles be Met With Machine Learning (Artificial Intelligence)?
Campion, M. A. (2025) · Human Resource Management · doi:10.1002/hrm.70025 · Cited by 19
Unveiling Patterns of Interaction With Automated Feedback in Writing Mentor and Their Relationships With Use Goals and Writing Outcomes
Jiang, Y., Klebanov, B. B., Hao, J., Deane, P., & Livne, O. E. (2025) · Journal of Computer Assisted Learning · doi:10.1111/jcal.70014 · Cited by 5
Predicting Evaluations of Essay by Computational Graph-Based Features
Yang, L., Xin, T., & Cao, C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.531262 · Cited by 4
Adapting for Scalability: Automating the Video Assessment of Instructional Learning
Roberts, A., LoCasale‐Crouch, J., Hamre, B. K., & Buckrop, J. (2017) · Online Learning · doi:10.24059/olj.v21i1.961 · Cited by 5
Automated written corrective feedback: fostering writing accuracy, self-regulation, and motivational dynamics in EFL learners
Zhai, Y. (2025) · BMC Psychology · doi:10.1186/s40359-025-03765-y · Cited by 7
Human Systems Engineering and Educational Technology
Roscoe, R. D., Branaghan, R. J., Cooke, N. J., & Craig, S. D. (2018) · IGI Global eBooks · doi:10.4018/978-1-5225-5472-1.ch104 · Cited by 3
Predicting Second Language Learner Successes and Mistakes by Means of Conjunctive Features
Bestgen, Y. (2018) · Workshop on Innovative Use of NLP for Building Educational Applications · doi:10.18653/v1/w18-0542 · Cited by 3
Answer-based and reference-based BERT models for automatic scoring of Turkish short answers: The decisive role of task complexity
Kara, A., Kara, Z. A., & Yıldırım, S. (2025) · International Journal of Assessment Tools in Education · doi:10.21449/ijate.1687429 · Cited by 2
Source integration in source-based writing: From theoretical modeling to predictive analytics
Potter, A., Tian, Y., Balyan, R., Goldshtein, M., Allen, L. K., & McNamara, D. S. (2026) · Assessing Writing · doi:10.1016/j.asw.2026.101081 · Cited by 3
Enhancing the Detection of Social Desirability Bias Using Machine Learning: A Novel Application of Person-Fit Indices
Nazari, S., Leite, W. L., & Huggins‐Manley, A. C. (2024) · Educational and Psychological Measurement · doi:10.1177/00131644241255109 · Cited by 2
Modeling Directional Testlet Effects on Multiple Open‐Ended Questions
Jin, K., & Siu, W. (2024) · Journal of Educational Measurement · doi:10.1111/jedm.12422 · Cited by 2
Context-aware Argument Mining and Its Applications in Education
Nguyen, H. V. (2018) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 2
User-centered & Robust NLP OSS: Lessons Learned from Developing & Maintaining RSMTool
Madnani, N., & Loukina, A. (2020) · Workshop for NLP Open Source Software (NLP-OSS) · doi:10.18653/v1/2020.nlposs-1.20 · Cited by 2
Enhancing Rubric Development in Science Education through Topic Modeling Techniques
Hong, M., & You, H. S. (2024) · The Journal of Experimental Education · doi:10.1080/00220973.2024.2329094 · Cited by 2
An Evaluation of China’s Automated Scoring System Bingo English
Gao, J., Li, X., Gu, P., & Liu, Z. (2020) · International Journal of English Linguistics · doi:10.5539/ijel.v10n6p30 · Cited by 2
Improvement of GAN-LCS Performance with Synonym Recognition
Saskia, L., Hidayah, I., & Kusumawardani, S. S. (2022) · International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE) · doi:10.1109/icitisee57756.2022.10057648 · Cited by 1
Kekurangan Aplikasi Grammarly dalam Mendeteksi Kesalahan pada Karya Tulis Mahasiswa
Tambunsaribu, G., & Galingging, Y. (2023) · DIALEKTIKA JURNAL BAHASA SASTRA DAN BUDAYA · doi:10.33541/dia.v10i1.4838 · Cited by 1
Effects of Prompts and Time on the Automated Scoring of English Argumentative Essays by ChatGPT 4
Lin, D., & Pu, X. (2024) · International Symposium on Artificial Intelligence for Education (ISAIE) · doi:10.1145/3700297.3700350 · Cited by 3
Enhancing transparency in high‐stakes English language assessment: A mixed‐methods synthesis of empirical evidence and stakeholder perspectives
Owen, N., & Senel, A. (2025) · Review of Education · doi:10.1002/rev3.70096 · Cited by 4
Validating Automated Feedback in an AI-Based Interactive Learning Environment for Dance: Agreement Between Expert Choreographers and the ReAL-T
Johari, M. R., & Mukherjee, S. (2026) · Education Sciences · doi:10.3390/educsci16020211 · Cited by 1
Has Automated Essay Scoring Reached Sufficient Accuracy? Deriving Achievable QWK Ceilings from Classical Test Theory
Uto, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-29744-0_37 · Cited by 1
Semiautomatic Grading of Short Texts for Open Answers in Higher Education
de‐la‐Fuente‐Valentín, L., Verdú, E., Padilla-Zea, N., Villalonga, C., Valencia, X. P. B., & Baldiris, S. (2022) · Communications in computer and information science · doi:10.1007/978-3-030-96060-5_4 · Cited by 1
Keyword-Based Processing for Assessing Short Answers in the Educational Field
Sanz-Fayos, J., de‐la‐Fuente‐Valentín, L., & Verdú, E. (2022) · Communications in computer and information science · doi:10.1007/978-3-031-19647-8_10 · Cited by 1
Retrospective. From Isolation to Integration: Technical Issues in the Assessment of Writing
Slomp, D. (2024) · The WAC Clearinghouse; University Press of Colorado eBooks · doi:10.37514/per-b.2024.2166.2.21 · Cited by 1
Chapter 8. Validity of Automated Scoring: Prologue for a Continuing Discussion of Machine Scoring Student Writing
Williamson, M. T. (2024) · The WAC Clearinghouse; University Press of Colorado eBooks · doi:10.37514/per-b.2024.2166.2.08 · Cited by 1
Chapter 10. Globalizing Plagiarism and Writing Assessment: A Case Study of Turnitin
Canzonetta, J., & Kannan, V. (2024) · The WAC Clearinghouse; University Press of Colorado eBooks · doi:10.37514/per-b.2024.2166.2.10 · Cited by 1
Responsible Implementation of AI in Higher Education: Ethical Factors Guiding Dutch IT Teachers
van Meerten, J., Smit, K., van Steenbergen, M., & Berkhout, M. (2024) · Resilience Through Digital Innovation: Enabling the Twin Transition · doi:10.18690/um.fov.4.2024.19
Exploring Learner Engagement with the AWE-Peer-Teacher Feedback Mode in L2 Writing
Zhou, S., Liu, Q., & Zhang, Y. (2024) · Lecture notes in computer science · doi:10.1007/978-981-97-4246-2_3 · Cited by 2
Navigating the Ethical Frontier
Öztürk, H. İ., Doğuş, M., Şahin, V., Çakmak, M., & Gürses, İ. (2025) · Advances in computational intelligence and robotics book series · doi:10.4018/979-8-3373-0122-8.ch011 · Cited by 1
A Study on the Effectiveness of Automated Essay Marking in the Context of a Blended Learning Course Design
Yu, W., & Barker, T. (2020) · Education Language and Sociology Research · doi:10.22158/elsr.v1n1p20 · Cited by 1
L1 feedback in automated writing evaluation: From learners' perspectives
Wilken, J. L. (2013) · doi:10.31274/etd-180810-3388 · Cited by 1
Contribution à l'évaluation de l'apprenant et l'adaptation pédagogique dans les plateformes d'apprentissage : une approche fondée sur les traces
Chachoua, S. (2019) · doi:10.70675/4787fd00zc89bz4965za129z9b71ae83f225 · Cited by 1
No Right Answer: A Feasibility Study of Essay Assessment with LDA
Roberts, T. (2013)
The system evaluation for report writing skills of summary by HGA-SVM with Ontology: Medical case study in problem based learning
Yenaeng, S., Saelee, S., & Samai, W. (2018) · AIP conference proceedings · doi:10.1063/1.5019548
채점 자질 설계를 통한 지도 학습 기반 작문 자동 채점의 타당도 확보 방안 탐색
Ju, K. S. (2019) · Journal of CheongRam Korean Language Education · doi:10.26589/jockle..69.201903.265

Authors: Ramineni, C., & Williamson, D. M.
Affiliations: Educational Testing Service (US)
Corresponding author: Ramineni, Chaitanya
Venue: Assessing Writing
Publisher: Elsevier BV
Published: 2013-01
Volume: 18
Issue: 1
Pages: 25-39
ISSN: 1075-2935 (ISSN-L)
DOI: 10.1016/j.asw.2012.10.004
OpenAlex: W2088070094
Cited by: 127
References: 70
Citations by year: 2026: 11 · 2025: 15 · 2024: 26 · 2023: 6 · 2022: 7 · 2021: 7 · 2020: 7 · 2019: 9 · 2018: 10 · 2017: 7 · 2016: 6 · 2015: 4 · 2014: 4 · 2013: 4
FWCI: 13.89
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Assessing Writing (publishedVersion)
Funders: Educational Testing Service
Topics: Physical Sciences › Computer Science › Information Systems › Educational Technology and Assessment
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Social Sciences › Education › Student Assessment and Feedback
Keywords: automated essay scoring, e-rater, psychometric assessment, writing assessment, large-scale assessment, performance expectations, Educational Testing Service

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Automated essay scoring: Psychometric guidelines and practices

Overview

Integrity signals

Verification

Claims the paper makes

Citations

Cites

Cited by

Related

Metadata

Record

About these checks