The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
On the relation between automated essay scoring and modern views of the writing construct
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Common European Framework of Reference for Languages: learning, teaching, assessment
Verhelst, N. D., Avermaet, P. V., Takala, S., Figueras, N., & North, B. (2009) · Ghent University Academic Bibliography (Ghent University) · Cited by 6,120
Educational measurement, 3rd ed.
Linn, R. L. (1989) · Cited by 2,883
The Psychology of Written Composition
Cumming, A., Bereiter, C., & Scardamalia, M. (1989) · The Modern Language Journal · doi:10.2307/327270 · Cited by 2,807
Advances in Neural Information Processing Systems 37
(2024) · doi:10.52202/079017 · Cited by 2,791
MacArthur, C. A., Graham, S. W., & Fitzgerald, J. (2005) · Cited by 2,327
Douglas, O. B., & Holland, B. F. (2015) · Fundamentals of educational psychology. · doi:10.1037/14910-020 · Cited by 2,272
Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Isabelle, P. (2002) · Cited by 1,633
Modeling and remodeling writing
Hayes, J. R. (2012) · Written Communication · doi:10.1177/0741088312451260 · Cited by 893
Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics
Gimpel, K., Schneider, N., O’Connor, B., Das, D., Mills, D. Q., Eisenstein, J., Heilman, M., Yogatama, D., Flanigan, J., & Smith, N. A. (2011) · The Association for Computational Linguistics · Cited by 890
A capacity theory of writing: Working memory in composition
McCutchen, D. (1996) · Educational Psychology Review · doi:10.1007/bf01464076 · Cited by 654
AUTOMATED ESSAY SCORING WITH E‐RATER® V.2.0
Attali, Y., & Burstein, J. (2004) · ETS Research Report Series · doi:10.1002/j.2333-8504.2004.tb01972.x · Cited by 622
Implications of Evidence‐Centered Design for Educational Testing
Mislevy, R. J., & Haertel, G. D. (2006) · Educational Measurement: Issues and Practice · doi:10.1111/j.1745-3992.2006.00075.x · Cited by 543
Fluency in Writing: Generating Text in L1 and L2
CHENOWETH, N. A., & HAYES, J. R. (2001) · Written Communication · doi:10.1177/0741088301018001004 · Cited by 518
Automated Essay Scoring: A Cross-disciplinary Perspective
(2003) · Routledge eBooks · doi:10.4324/9781410606860 · Cited by 501
Handbook of Automated Essay Evaluation
(2013) · Routledge eBooks · doi:10.4324/9780203122761 · Cited by 463
Knowledge, Processing, and Working Memory: Implications for a Theory of Writing
McCutchen, D. (2000) · Educational Psychologist · doi:10.1207/s15326985ep3501_3 · Cited by 426
The Construction of Negotiated Meaning: A Social Cognitive Theory of Writing
Flower, L. (1995) · College Composition and Communication · doi:10.2307/358881 · Cited by 412
Educational Measurement (4th ed.)
Borsboom, D. (2009) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510903206097 · Cited by 387
Assessing the Portfolio: Principles for Practice, Theory, and Research
Hamp‐Lyons, L., & Condon, W. (2000) · University of Bedfordshire Repository (University of Bedfordshire) · Cited by 283
Improving the writing skills of college students
Kellogg, R. T., & Raulerson, B. A. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194058 · Cited by 270
Evaluating Writing: Describing, Measuring, Judging
Bridwell, L., Cooper, C. R., & Odell, L. (1978) · The English Journal · doi:10.2307/815139 · Cited by 262
The Oxford Handbook of Applied Linguistics
(2010) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195384253.001.0001 · Cited by 253
Attentional overload and writing performance: Effects of rough draft and outline strategies.
Kellogg, R. T. (1988) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037//0278-7393.14.2.355 · Cited by 251
The SAGE Handbook of Writing Development
Beard, R., Myhill, D., Nystrand, M., & Riley, J. L. (2009) · SAGE Publications Ltd eBooks · doi:10.4135/9780857021069 · Cited by 236
Automated Scoring of Complex Tasks in Computer-Based Testing
(2006) · Routledge eBooks · doi:10.4324/9780415963572 · Cited by 227
Portfolios: Process and Product
White, E. M., Belanoff, P., & Dickson, M. (1992) · College Composition and Communication · doi:10.2307/358657 · Cited by 213
The processing demands of writing
Torrance, M., & Galbraith, D. (2006) · Cited by 202
Handbook of automated essay evaluation current applications and new directions
Shermis, M. D. (2013) · Cited by 196
Finding the WRITE stuff: automatic identification of discourse structure in student essays
Burstein, J., Marcu, D., & Knight, K. (2003) · IEEE Intelligent Systems · doi:10.1109/mis.2003.1179191 · Cited by 189
English language learners and automated scoring of essays: Critical considerations
Weigle, S. C. (2012) · Assessing Writing · doi:10.1016/j.asw.2012.10.006 · Cited by 182
Individual differences in writing: Implications of translating fluency.
McCutchen, D., Covill, A. E., Hoyne, S. H., & Mildes, K. (1994) · Journal of Educational Psychology · doi:10.1037//0022-0663.86.2.256 · Cited by 182
The measurement of writing ability
Godshalk, F. I. (1966) · Cited by 179
International Encyclopedia of Education, 3rd ed
(2011) · Choice Reviews Online · doi:10.5860/choice.48-5455 · Cited by 179
Classifying arguments by scheme
Feng, V. W., & Hirst, G. (2011) · Cited by 178
Comparison of Human and Machine Scoring of Essays: Differences by Gender, Ethnicity, and Country
Bridgeman, B., Trapani, C. S., & Attali, Y. (2012) · Applied Measurement in Education · doi:10.1080/08957347.2012.635502 · Cited by 160
On a Scale: A Social History of Writing Assessment in America
Elliot, N. (2005) · Cited by 135
Evaluating Multiple Aspects of Coherence in Student Essays
Higgins, D., Burstein, J. C., Marcu, D., & Gentile, C. (2004) · North American Chapter of the Association for Computational Linguistics · Cited by 127
Automated Essay Scoring: Writing Assessment and Instruction
Shermis, M. D., Burstein, J. C., Higgins, D., & Zechner, K. (2010) · Elsevier eBooks · doi:10.1016/b978-0-08-044894-7.00233-5 · Cited by 124
Criterion SM Online Essay Evaluation: An Application for Automated Evaluation of Student Essays
Burstein, J. C., Chodorow, M. S., & Leacock, C. (2003) · Cited by 123
Mislevy, R. J. (2007) · Educational Researcher · doi:10.3102/0013189x07311660 · Cited by 115
Chodorow, M. S., Gamon, M., & Tetreault, J. (2010) · Language Testing · doi:10.1177/0265532210364391 · Cited by 115
Learning Human-like Knowledge by Singular Value Decomposition: A Progress Report
Landauer, T. K., Laham, D., & Foltz, P. W. (1997) · Cited by 114
A System to Assess the Semantic Content of Student Essays
Lemaire, B., & Dessus, P. (2001) · Journal of Educational Computing Research · doi:10.2190/g649-0r9c-c021-p6x3 · Cited by 102
Davis, M. T. (1988) · The Journal of Higher Education · doi:10.1080/00221546.1988.11778315 · Cited by 94
Electronic portfolios 2.0 : emergent research on implementation and impact
Cambridge, D., Cambridge, B. L., & Yancey, K. B. (2009) · Cited by 88
Machine Scoring of Student Essays: Truth and Consequences
Ericsson, P. F., & Haswell, R. H. (2006) · Digital Commons - USU (Utah State University) · Cited by 86
Using Entity-Based Features to Model Coherence in Student Essays
Burstein, J. C., Tetreault, J., & Andreyev, S. (2010) · Cited by 81
International Advances in Writing Research: Cultures, Places, Measures
(2012) · The WAC Clearinghouse; Parlor Press eBooks · doi:10.37514/per-b.2012.0452 · Cited by 81
Genres of high-stakes writing assessments and the construct of writing competence
Beck, S. W., & Jeffery, J. V. (2007) · Assessing Writing · doi:10.1016/j.asw.2007.05.001 · Cited by 80
Futagi, Y., Deane, P., Chodorow, M. S., & Tetreault, J. (2008) · Computer Assisted Language Learning · doi:10.1080/09588220802343561 · Cited by 76
Self-citationAutomated Scoring Technologies and the Rising Influence of Error
Cheville, J. (2004) · The English Journal · doi:10.2307/4128980 · Cited by 72
Contrasting State-of-the-Art Automated Scoring of Essays
Shermis, M. D., & Hamner, B. (2015) · Routledge eBooks · doi:10.4324/9780203122761.ch19 · Cited by 63
Toward More Substantively Meaningful Automated Essay Scoring
Ben-Simon, A., & Bennett, R. E. (2007) · Open Access Journals at BC (Boston College) · Cited by 62
Towards automatic classification of discourse elements in essays
Burstein, J. C., Marcu, D., Andreyev, S., & Chodorow, M. S. (2001) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1073012.1073026 · Cited by 62
Performance of a Generic Approach in Automated Essay Scoring
Attali, Y., Bridgeman, B., & Trapani, C. S. (2010) · The Journal of Technology, Learning and Assessment (Boston College) · Cited by 57
What automated analyses of corpora can tell us about students’ writing skills
Deane, P., & Quinlan, T. (2010) · Journal of Writing Research · doi:10.17239/jowr-2010.02.02.4 · Cited by 52
Self-citationCCCC Position Statement on Teaching, Learning, and Assessing Writing in Digital Environments
(2004) · College Composition and Communication · doi:10.58680/ccc20042788 · Cited by 46
A validity-based approach to quality control and assurance of automated scoring
Bejar, I. I. (2011) · Assessment in Education Principles Policy and Practice · doi:10.1080/0969594x.2011.555329 · Cited by 45
STUMPING E‐RATER: CHALLENGING THE VALIDITY OF AUTOMATED ESSAY SCORING
Powers, D. E., Burstein, J. C., Chodorow, M. S., Fowles, M. E., & Kukich, K. (2001) · ETS Research Report Series · doi:10.1002/j.2333-8504.2001.tb01845.x · Cited by 41
Hayes, J. R. (2009) · SAGE Publications Ltd eBooks · doi:10.4135/9780857021069.n5 · Cited by 39
Chodorow, M. S., & Burstein, J. C. (2004) · TOEFL iBT research reports · Cited by 38
CBAL: RESULTS FROM PILOTING INNOVATIVE K–12 ASSESSMENTS
Bennett, R. E. (2011) · ETS Research Report Series · doi:10.1002/j.2333-8504.2011.tb02259.x · Cited by 37
Organic Writing Assessment: Dynamic Criteria Mapping in Action
Estrem, H. (2009) · Scholar Works (Boise State University) · Cited by 34
Moving the Field Forward: Some Thoughts on Validity and Automated Scoring
(2006) · Routledge eBooks · doi:10.4324/9780415963572-15 · Cited by 28
Closed Systems and Standardized Writing Tests
Anson, C. M. (2016) · Cited by 23
Symposium: On the Framework for Success in Postsecondary Writing
O’Neill, P., Adler-Kassner, L., Fleischer, C., Hall, A., Severino, C., McComiskey, B., Hansen, K., Summerfield, J., Philip, M. A., & Sullivan, P. J. (2012) · College English · doi:10.58680/ce201220310 · Cited by 23
Evaluating the Construct-Coverage of the e-rater[R] Scoring Engine. Research Report. ETS RR-09-01.
Quinlan, T., Higgins, D., & Wolff, S. (2009) · TOEFL iBT research reports · Cited by 22
Automated Scoring of Constructed-Response Literacy and Mathematics Items
Elliot, R. (2011) · Cited by 20
The Effect of Specific Language Features on the Complexity of Systems for Automated Essay Scoring.
Cohen, Y., Ben-Simon, A., & Hovav, M. (2003) · Cited by 16
Automated Evaluation of Discourse Structure in Student Essays
Shermis, M. D., & Burstein, J. C. (2003) · Routledge eBooks · doi:10.4324/9781410606860-24 · Cited by 5
On Issues of Feature Extraction in Chinese Automatic Essay Scoring System
Chang, T.-H., Lee, C.-H., & Tam, H.-P. (2007) · Cited by 4
Cited by
Guo, L., Crossley, S. A., & McNamara, D. S. (2013) · Assessing Writing · doi:10.1016/j.asw.2013.05.002 · Cited by 278
Automated Writing Evaluation and Feedback: Multiple Metrics of Efficacy
Wilson, J., & Roscoe, R. D. (2020) · Journal of Educational Computing Research · doi:10.1177/0735633119830764 · Cited by 176
Automated essay scoring: Psychometric guidelines and practices
Ramineni, C., & Williamson, D. M. (2013) · Assessing Writing · doi:10.1016/j.asw.2012.10.004 · Cited by 127
Ding, L., & Zou, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12402-3 · Cited by 122
Palermo, C., & Thomson, M. M. (2018) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2018.07.002 · Cited by 107
Metadata
- Authors
- Deane, P.
- Venue
- Assessing Writing
- Publisher
- Elsevier BV
- Published
- 2013-01
- Volume
- 18
- Issue
- 1
- Pages
- 7-24
- ISSN
- 1075-2935 (ISSN-L)
- OpenAlex
- W2067895686
- Cited by
- 265
- References
- 71
- FWCI
- 28.83
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.