Proceedings of the 12th Workshop on Innovative Use of NLP for Building Educational Applications
Open accessThe DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.
Abstract
Since the first workshop in 1997, BEA has become the leading venue for sharing and publishing innovative work that uses NLP to develop educational applications.The consistent interest and growth of the workshop has clear ties to challenges in education.The research presented at the workshop highlights advances in the technology and the maturity of the field of NLP in education.The capabilities serve as a response to educational challenges and are poised to support the needs of a variety of stakeholders, including educators, learners, parents, and administrators.NLP capabilities now support an array of learning domains, including writing, speaking, reading, and mathematics.In the writing and speech domains, automated writing evaluation (AWE) and speech assessment applications, respectively, are commercially deployed in high-stakes assessment and instructional settings, including Massive Open Online Courses (MOOCs).We also see widelyused commercial applications for plagiarism detection and peer review and explosive growth of mobile applications for game-based applications for instruction and assessment.The current educational and assessment landscape continues to foster a strong interest and high demand that pushes the state of the art in AWE capabilities to expand the analysis of written responses to writing genres other than those traditionally found in standardized assessments, especially writing tasks requiring use of sources and argumentative discourse.Steady growth in the development of NLP-based applications for education has prompted an increased number of workshops that typically focus on a single subfield.In BEA, we make an effort to have papers from many subfields, for example, tools for automated scoring, automated test-item generation, curriculum development, evaluation of text, dialogue, evaluation of genres beyond essays, feedback studies, and grammatical error correction.This year we received a record 62 submissions, and accepted 9 papers as oral presentations and 25 as poster presentation and/or demos, for an overall acceptance rate of 55 percent.Each paper was reviewed by three members of the Program Committee who were believed to be most appropriate for each paper.We continue to have a very strong policy to deal with conflicts of interest.First, we made a concerted effort to not assign papers to reviewers to evaluate if the paper had an author from their institution.Second, with respect to the organizing committee, authors of papers for which there was a conflict of interest recused themselves from the discussions.While the field is growing, we do recognize that there is a core group of institutions and researchers who work in this area.With a higher acceptance rate, we were able to include papers from a wider variety of topics and institutions.The papers accepted were selected on the basis of several factors, including the relevance to a core educational problem space, the novelty of the approach or domain, and the strength of the research.The accepted papers were highly diverse -an indicator of the growing variety of foci in this field.We continue to believe that the workshop framework designed to introduce work in progress and new ideas needs to be revived, and we hope that we have achieved this with the breadth and variety of research accepted for this workshop, a brief description of which is presented below.The BEA12 workshop has presentations on Automated Writing Evaluation (AWE), item generation, 1 https://www.aclweb.org/adminwiki/index.php?title=2017Q3_Reports:_SIGEDU iv readability, dialogue and annotation/database schemas, among others: AWE Written Assessments: Whereas much work in scoring at BEA focuses on learner language, Horbach et al. score essays written by proficient native German speakers in a complex writing task.Madnani et al. look at scoring for content in science, math, language arts and social studies.Rei looks at detecting off-topic essay responses to visual prompts.Riordan et al. examine neural architectures for scoring responses to short answer questions.Finally, looking at the bigger picture, Burstein et al. explore the relations between AWE and broader educational outcomes.Domain-Specific AWE: Three papers look at assessments in specific subject domains.For language learning, Tolmachev and Kurohashi extract exemplar sentences to accompany flash cards.Tack et al. investigate the feasibility of automated learner English assessment in the CEFR (European) framework.In the science domain, Nadeem and Ostendorf look at language-based mapping of science assessment items to skills.Error Detection and Correction: Rei and Yannakoudakis use a neural sequence labeling approach to grammatical error detection.Napoles and Callison-Burch adapt Machine Translation (MT) to grammatical error correction.In another use for machine translation, Rei et al. use MT to generate artificial errors for training machine learning systems.Chollampatt and Ng augment an MT approach with neural ne
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Variation across Speech and Writing
Biber, D. (1988) · doi:10.1017/cbo9780511621024 · Cited by 5,227
A theory of reading: From eye fixations to comprehension.
Just, M. A., & Carpenter, P. A. (1980) · Psychological Review · doi:10.1037/0033-295x.87.4.329 · Cited by 5,220
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
Bag of Tricks for Efficient Text Classification
Joulin, A., Grave, E., Bojanowski, P., & Mikolov, T. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers · doi:10.18653/v1/e17-2068 · Cited by 4,545
Bag of Tricks for Efficient Text Classification
Joulin, A., Grave, E., Bojanowski, P., & Mikolov, T. (2016) · arXiv · doi:10.48550/arxiv.1607.01759 · Cited by 4,542
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Tai, K. S., Socher, R., & Manning, C. D. (2015) · Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.3115/v1/p15-1150 · Cited by 3,081
An empirical comparison of supervised learning algorithms
Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 23rd international conference on Machine learning - ICML '06 · doi:10.1145/1143844.1143865 · Cited by 2,780
Learning Strategies in Second Language Acquisition
O'Malley, J. M., & Chamot, A. U. (1990) · doi:10.1017/cbo9781139524490 · Cited by 2,771
Cronbach's Alpha: A Tool for Assessing the Reliability of Scales
Santos, J. R. A. (1999) · Journal of Extension · doi:10.66752/1077-5315.7392 · Cited by 1,554
Character-Aware Neural Language Models
Kim, Y., Jernite, Y., Sontag, D., & Rush, A. M. (2015) · arXiv · doi:10.48550/arxiv.1508.06615 · Cited by 1,530
How Large a Vocabulary is Needed For Reading and Listening?
Nation, I. (2006) · The Canadian Modern Language Review · doi:10.3138/cmlr.63.1.59 · Cited by 1,436
Language Transfer: Cross-Linguistic Influence in Language Learning
Odlin, T. (1989) · doi:10.1017/cbo9781139524537 · Cited by 1,429
Vocabulary size and use: Lexical richness in l2 written production
LAUFER, B., & NATION, P. (1995) · Applied Linguistics · doi:10.1093/applin/16.3.307 · Cited by 1,316
The Autism Diagnostic Observation Schedule: Revised Algorithms for Improved Diagnostic Validity
Gotham, K., Risi, S., Pickles, A., & Lord, C. (2007) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-006-0280-1 · Cited by 1,161
A probabilistic earley parser as a psycholinguistic model
Hale, J. (2001) · Second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies 2001 - NAACL '01 · doi:10.3115/1073336.1073357 · Cited by 1,150
Very Deep Convolutional Networks for Text Classification
Conneau, A., Schwenk, H., Barrault, L., & Lecun, Y. (2017) · Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers · doi:10.18653/v1/e17-1104 · Cited by 1,046
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R., Haddow, B., & Birch, A. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1162 · Cited by 974
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R., Haddow, B., & Birch, A. (2015) · arXiv · doi:10.48550/arxiv.1508.07909 · Cited by 950
Applebee, A. N., Langer, J. A., Nystrand, M., & Gamoran, A. (2003) · American Educational Research Journal · doi:10.3102/00028312040003685 · Cited by 812
Hovy, E., Marcus, M., Palmer, M., Ramshaw, L., & Weischedel, R. (2006) · Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers on XX - NAACL '06 · doi:10.3115/1614049.1614064 · Cited by 806
Attending to Form and Content in the Input: An Experiment in Consciousness
VanPatten, B. (1990) · Studies in Second Language Acquisition · doi:10.1017/s0272263100009177 · Cited by 629
Performing high‐powered studies efficiently with sequential analyses
Lakens, D. (2014) · European Journal of Social Psychology · doi:10.1002/ejsp.2023 · Cited by 414
INCIDENTAL FOCUS ON FORM AND SECOND LANGUAGE LEARNING
Loewen, S. (2005) · Studies in Second Language Acquisition · doi:10.1017/s0272263105050163 · Cited by 381
A computer-aided environment for generating multiple-choice test items
MITKOV, R., AN HA, L., & KARAMANIS, N. (2006) · Natural Language Engineering · doi:10.1017/s1351324906004177 · Cited by 229
A statistical model for scientific readability
Si, L., & Callan, J. (2001) · Proceedings of the tenth international conference on Information and knowledge management · doi:10.1145/502585.502695 · Cited by 197
Multi-column Deep Neural Networks for Image Classification
Cireşan, D., Meier, U., & Schmidhuber, J. (2012) · arXiv · doi:10.48550/arxiv.1202.2745 · Cited by 53
Infusing NLU into Automatic Question Generation
Mazidi, K., & Tarau, P. (2016) · Proceedings of the 9th International Natural Language Generation conference · doi:10.18653/v1/w16-6609 · Cited by 36
Cited by
How many words do we read per minute? A review and meta-analysis of reading rate
Brysbaert, M. (2019) · Journal of Memory and Language · doi:10.1016/j.jml.2019.104047 · Cited by 553
Assessment in the age of artificial intelligence
Swiecki, Z., Khosravi, H., Chen, G., Martinez-Maldonado, R., Lodge, J. M., Milligan, S., Selwyn, N., & Gašević, D. (2022) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100075 · Cited by 409
Survey of conversational agents in health
Montenegro, J. L. Z., da Costa, C. A., & da Rosa Righi, R. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.054 · Cited by 322
Bauer, E., Greisel, M., Kuznetsov, I., Berndt, M., Kollar, I., Dresel, M., Fischer, M. R., & Fischer, F. (2023) · British Journal of Educational Technology · doi:10.1111/bjet.13336 · Cited by 130
Using learning analytics to understand student perceptions of peer feedback
Misiejuk, K., Wasson, B., & Egelandsdal, K. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106658 · Cited by 98
Metadata
- Published
- 2017
- OpenAlex
- W2981849035
- Cited by
- 116
- References
- 29
- Type
- paratext
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.