CoChat

Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications

Open access
· 2017
Cited by 116

The DOI matches its Crossref record; 28 of the 28 references it cites were found in a registry or an index.

Abstract

Since the first workshop in 1997, BEA has become the leading venue for sharing and publishing innovative work that uses NLP to develop educational applications.The consistent interest and growth of the workshop has clear ties to challenges in education.The research presented at the workshop highlights advances in the technology and the maturity of the field of NLP in education.The capabilities serve as a response to educational challenges and are poised to support the needs of a variety of stakeholders, including educators, learners, parents, and administrators.NLP capabilities now support an array of learning domains, including writing, speaking, reading, and mathematics.In the writing and speech domains, automated writing evaluation (AWE) and speech assessment applications, respectively, are commercially deployed in high-stakes assessment and instructional settings, including Massive Open Online Courses (MOOCs).We also see widelyused commercial applications for plagiarism detection and peer review and explosive growth of mobile applications for game-based applications for instruction and assessment.The current educational and assessment landscape continues to foster a strong interest and high demand that pushes the state of the art in AWE capabilities to expand the analysis of written responses to writing genres other than those traditionally found in standardized assessments, especially writing tasks requiring use of sources and argumentative discourse.Steady growth in the development of NLP-based applications for education has prompted an increased number of workshops that typically focus on a single subfield.In BEA, we make an effort to have papers from many subfields, for example, tools for automated scoring, automated test-item generation, curriculum development, evaluation of text, dialogue, evaluation of genres beyond essays, feedback studies, and grammatical error correction.This year we received a record 62 submissions, and accepted 9 papers as oral presentations and 25 as poster presentation and/or demos, for an overall acceptance rate of 55 percent.Each paper was reviewed by three members of the Program Committee who were believed to be most appropriate for each paper.We continue to have a very strong policy to deal with conflicts of interest.First, we made a concerted effort to not assign papers to reviewers to evaluate if the paper had an author from their institution.Second, with respect to the organizing committee, authors of papers for which there was a conflict of interest recused themselves from the discussions.While the field is growing, we do recognize that there is a core group of institutions and researchers who work in this area.With a higher acceptance rate, we were able to include papers from a wider variety of topics and institutions.The papers accepted were selected on the basis of several factors, including the relevance to a core educational problem space, the novelty of the approach or domain, and the strength of the research.The accepted papers were highly diverse -an indicator of the growing variety of foci in this field.We continue to believe that the workshop framework designed to introduce work in progress and new ideas needs to be revived, and we hope that we have achieved this with the breadth and variety of research accepted for this workshop, a brief description of which is presented below.The BEA12 workshop has presentations on Automated Writing Evaluation (AWE), item generation, 1 https://www.aclweb.org/adminwiki/index.php?title=2017Q3_Reports:_SIGEDU iv readability, dialogue and annotation/database schemas, among others: AWE Written Assessments: Whereas much work in scoring at BEA focuses on learner language, Horbach et al. score essays written by proficient native German speakers in a complex writing task.Madnani et al. look at scoring for content in science, math, language arts and social studies.Rei looks at detecting off-topic essay responses to visual prompts.Riordan et al. examine neural architectures for scoring responses to short answer questions.Finally, looking at the bigger picture, Burstein et al. explore the relations between AWE and broader educational outcomes.Domain-Specific AWE: Three papers look at assessments in specific subject domains.For language learning, Tolmachev and Kurohashi extract exemplar sentences to accompany flash cards.Tack et al. investigate the feasibility of automated learner English assessment in the CEFR (European) framework.In the science domain, Nadeem and Ostendorf look at language-based mapping of science assessment items to skills.Error Detection and Correction: Rei and Yannakoudakis use a neural sequence labeling approach to grammatical error detection.Napoles and Callison-Burch adapt Machine Translation (MT) to grammatical error correction.In another use for machine translation, Rei et al. use MT to generate artificial errors for training machine learning systems.Chollampatt and Ng augment an MT approach with neural ne

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.18653/v1/w17-50

Cites

28 of 28 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 28 references

Cited by

See all 116

Metadata

Published
2017
OpenAlex
W2981849035
Cited by
116
References
28
Type
paratext
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications. https://app.cochat.ai/papers/10.18653/v1/w17-50
The paper
Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications. (2017). https://doi.org/10.18653/v1/w17-50

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.