CoChat

Construction of an Error-Tagged Evaluation Corpus for Japanese Grammatical Error Correction

Koyama, Aomi, Kiyuna, Tomoshige, Kobayashi, Kenji, Arai, Mio, Mita, Masato, Oka, Teruaki, Komachi, Mamoru · 2023 · Journal of Natural Language Processing
Cited by 1

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.5715/jnlp.30.330

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 138

  1. 浅原正幸,金山博,宮尾祐介,田中貴秋,大村舞,村脇有吾,松本裕治 (2019). Universal Dependencies 日本語コーパス. 自然言語処理, 26 (1), pp. 3–36. [M. Asahara et al. (2019). Japanese Universal Dependencies Corpora. Journal of Natural Language Processing, 26 (1), pp. 3–36.]. · doi:10.5715/jnlp.26.3
  2. 浅野広樹,水本智也,乾健太郎 (2018). 文法性・流暢性・意味保存性に基づく文法誤り訂正の参照無し評価. 自然言語処理, 25 (5), pp. 555–576. [H. Asano et al. (2018). A Reference-less Evaluation Metric Based on Grammaticality, Fluency, and Meaning Preservation in Grammatical Error Correction. Journal of Natural Language Processing, 25 (5), pp. 555–576.]. · DOI
  3. Bahdanau, D., Cho, K., and Bengio, Y. (2015). “Neural Machine Translation by Jointly Learning to Align and Translate.” In Proceedings of the 3rd International Conference on Learning Representations.
  4. Boyd, A. (2018). “Using Wikipedia Edits in Low Resource Grammatical Error Correction.” In Proceedings of the 4th Workshop on Noisy User-generated Text, pp. 79–84. · DOI · Paper page
  5. Brockett, C., Dolan, W. B., and Gamon, M. (2006). “Correcting ESL Errors Using Phrasal SMT Techniques.” In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pp. 249–256. · doi:10.3115/1220175.1220207
  6. Bryant, C., Felice, M., Andersen, Ø. E., and Briscoe, T. (2019). “The BEA-2019 Shared Task on Grammatical Error Correction.” In Proceedings of the 14th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 52–75. · DOI · Paper page
  7. Bryant, C., Felice, M., and Briscoe, T. (2017). “Automatic Annotation and Evaluation of Error Types for Grammatical Error Correction.” In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, pp. 793–805. · DOI · Paper page
  8. Bryant, C. and Ng, H. T. (2015). “How Far are We from Fully Automatic High Quality Grammatical Error Correction?” In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, pp. 697–707. · DOI · Paper page
  9. Cahill, A., Madnani, N., Tetreault, J., and Napolitano, D. (2013). “Robust Systems for Preposition Error Correction Using Wikipedia Revisions.” In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 507–517.
  10. Choe, Y. J., Ham, J., Park, K., and Yoon, Y. (2019). “A Neural Grammatical Error Correction System Built On Better Pre-training and Sequential Transfer Learning.” In Proceedings of the 14th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 213–227. · DOI
  11. Chollampatt, S. and Ng, H. T. (2018). “A Multilayer Convolutional Encoder-Decoder Neural Network for Grammatical Error Correction.” In Proceedings of the 32nd AAAI Conference on Artificial Intelligence, pp. 5755–5762. · DOI · Paper page
  12. Chollampatt, S., Wang, W., and Ng, H. T. (2019). “Cross-Sentence Grammatical Error Correction.” In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 435–445. · DOI
  13. Cohen, J. (1960). “A Coefficient of Agreement for Nominal Scales.” Educational and Psychological Measurement, 20 (1), pp. 37–46. · DOI · Paper page
  14. Dagneaux, E., Denness, S., and Granger, S. (1998). “Computer-aided Error Analysis.” System, 26 (2), pp. 163–174. · DOI · Paper page
  15. Dahlmeier, D. and Ng, H. T. (2011). “Grammatical Error Correction with Alternating Structure Optimization.” In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pp. 915–923.
  16. Dahlmeier, D. and Ng, H. T. (2012). “Better Evaluation for Grammatical Error Correction.” In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 568–572.
  17. Dahlmeier, D., Ng, H. T., and Wu, S. M. (2013). “Building a Large Annotated Corpus of Learner English: The NUS Corpus of Learner English.” In Proceedings of the 8th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 22–31.
  18. De Felice, R. and Pulman, S. G. (2008). “A Classifier-Based Approach to Preposition and Determiner Error Correction in L2 English.” In Proceedings of the 22nd International Conference on Computational Linguistics, pp. 169–176. · doi:10.3115/1599081.1599103
  19. de Marneffe, M.-C., Manning, C. D., Nivre, J., and Zeman, D. (2021). “Universal Dependencies.” Computational Linguistics, 47 (2), pp. 255–308. · DOI · Paper page
  20. Felice, M. and Briscoe, T. (2015). “Towards a Standard Evaluation Method for Grammatical Error Detection and Correction.” In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 578–587. · DOI
  21. Felice, M., Bryant, C., and Briscoe, T. (2016). “Automatic Extraction of Learner Errors in ESL Sentences Using Linguistically Enhanced Alignments.” In Proceedings of the 26th International Conference on Computational Linguistics: Technical Papers, pp. 825–835.
  22. Flachs, S., Stahlberg, F., and Kumar, S. (2021). “Data Strategies for Low-Resource Grammatical Error Correction.” In Proceedings of the 16th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 117–122.
  23. 藤野拓也,水本智也,小町守,永田昌明,松本裕治 (2012). 日本語学習者の作文の誤り訂正に向けた単語分割. 言語処理学会第18回年次大会発表論文集, pp. 26–29. [T. Fujino et al. (2012). Nihongo Gakushu-Sha no Sakubun no Ayamari Teisei ni Muketa Tango Bunkatsu. In Proceedings of the 18th Annual Meeting of the Association for Natural Language Processing, pp. 26–29.].
  24. Gamon, M. (2010). “Using Mostly Native Data to Correct Errors in Learners’ Writing.” In Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 163–171.
  25. Gamon, M., Gao, J., Brockett, C., Klementiev, A., Dolan, W. B., Belenko, D., and Vanderwende, L. (2008). “Using Contextual Speller Techniques and Language Modeling for ESL Error Correction.” In Proceedings of the 3rd International Joint Conference on Natural Language Processing, pp. 449–456.
  26. Ge, T., Wei, F., and Zhou, M. (2018a). “Fluency Boost Learning and Inference for Neural Grammatical Error Correction.” In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp. 1055–1065. · DOI
  27. Ge, T., Wei, F., and Zhou, M. (2018b). “Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Study.” arXiv preprint arXiv:1807.01270 [cs.CL]. · arXiv
  28. Gehring, J., Auli, M., Grangier, D., Yarats, D., and Dauphin, Y. N. (2017). “Convolutional Sequence to Sequence Learning.” In Proceedings of the 34th International Conference on Machine Learning, pp. 1243–1252.
  29. Gotou, T., Nagata, R., Mita, M., and Hanawa, K. (2020). “Taking the Correction Difficulty into Account in Grammatical Error Correction Evaluation.” In Proceedings of the 28th International Conference on Computational Linguistics, pp. 2085–2095. · doi:10.18653/v1/2020.coling-main.188
  30. Granger, S. (1998). “The Computerized Learner Corpus: A Versatile New Source of Data for SLA Research.” In Learner English on Computer, pp. 3–18. · DOI
  31. Grundkiewicz, R. and Junczys-Dowmunt, M. (2018). “Near Human-Level Performance in Grammatical Error Correction with Hybrid Machine Translation.” In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 284–290. · DOI
  32. Grundkiewicz, R. and Junczys-Dowmunt, M. (2019). “Minimally-Augmented Grammatical Error Correction.” In Proceedings of the 5th Workshop on Noisy User-generated Text, pp. 357–363. · DOI
  33. Grundkiewicz, R., Junczys-Dowmunt, M., and Gillian, E. (2015). “Human Evaluation of Grammatical Error Correction Systems.” In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 461–470. · DOI
  34. Grundkiewicz, R., Junczys-Dowmunt, M., and Heafield, K. (2019). “Neural Grammatical Error Correction Systems with Unsupervised Pre-training on Synthetic Data.” In Proceedings of the 14th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 252–263. · DOI · Paper page
  35. Gu, J., Wang, C., and Zhao, J. (2019). “Levenshtein Transformer.” In Advances in Neural Information Processing Systems 32, pp. 11181–11191. · DOI
  36. Guo, M., Dai, Z., Vrandečić, D., and Al-Rfou, R. (2020). “Wiki-40B: Multilingual Language Model Dataset.” In Proceedings of the 12th Language Resources and Evaluation Conference, pp. 2440–2452.
  37. Heafield, K. (2011). “KenLM: Faster and Smaller Language Model Queries.” In Proceedings of the 6th Workshop on Statistical Machine Translation, pp. 187–197.
  38. 本間広樹,小町守 (2022). 高速な文法誤り訂正機能を持つ日本語ライティング支援システムの構築. 人工知能学会論文誌, 37 (1), pp. 1–14. [H. Homma, and M. Komachi (2022). Japanese Writing Support System with Fast Grammatical Error Correction. Transactions of the Japanese Society for Artificial Intelligence, 37 (1), pp. 1–14.].
  39. 今枝恒治,河合敦夫,石川裕司,永田亮,桝井文人 (2003). 日本語学習者の作文における格助詞の誤り検出と訂正. 情報処理学会研究報告, コンピュータと教育研究会, 2003 (13), pp. 39–46. [K. Imaeda et al. (2003). Error Detection and Correction of Case Particles in Japanese Learner’s Composition. The Special Interest Group Technical Reports of IPSJ, IPSJ Special Interest Groups on Computers in Education, 2003 (13), pp. 39–46.].
  40. 今村賢治,齋藤邦子,貞光九月,西川仁 (2012). 小規模誤りデータからの日本語学習者作文の助詞誤り訂正. 自然言語処理, 19 (5), pp. 381–400. [K. Imamura et al. (2012). Particle Error Correction of Japanese Learners from Small Error Data. Journal of Natural Language Processing, 19 (5), pp. 381–400.]. · doi:10.5715/jnlp.19.381
  41. Ji, J., Wang, Q., Toutanova, K., Gong, Y., Truong, S., and Gao, J. (2017). “A Nested Attention Neural Hybrid Model for Grammatical Error Correction.” In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, pp. 753–762. · DOI
  42. Junczys-Dowmunt, M. and Grundkiewicz, R. (2016). “Phrase-based Machine Translation is State-of-the-Art for Automatic Grammatical Error Correction.” In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 1546–1556. · doi:10.18653/v1/d16-1161
  43. Junczys-Dowmunt, M., Grundkiewicz, R., Guha, S., and Heafield, K. (2018). “Approaching Neural Grammatical Error Correction as a Low-Resource Machine Translation Task.” In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 595–606. · DOI
  44. Kaneko, M., Mita, M., Kiyono, S., Suzuki, J., and Inui, K. (2020). “Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correction.” In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 4248–4254. · DOI
  45. Kantor, Y., Katz, Y., Choshen, L., Cohen-Karlik, E., Liberman, N., Toledo, A., Menczel, A., and Slonim, N. (2019). “Learning to Combine Grammatical Error Corrections.” In Proceedings of the 14th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 139–148. · DOI
  46. 笠原誠司,藤野拓也,小町守,永田昌明,松本裕治 (2012). 日本語学習者の誤り傾向を反映した格助詞訂正. 言語処理学会第18回年次大会発表論文集, pp. 14–17. [S. Kasahara et al. (2012). Nihongo Gakushu-Sha no Ayamari Keiko o Hanei Shita Kakujoshi Teisei. In Proceedings of the 18th Annual Meeting of the Association for Natural Language Processing, pp. 14–17.].
  47. Katsumata, S. and Komachi, M. (2020). “Stronger Baselines for Grammatical Error Correction Using a Pretrained Encoder-Decoder Model.” In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, pp. 827–832. · DOI
  48. 木山朔,上坂奏人,佐藤郁子,佐藤京也,米田悠人,小山碧海,三田雅人,岡照晃,小町守 (2022). 日本語文法誤り訂正の流暢性評価に向けたデータ作成. 言語処理学会第28回年次大会発表論文集, pp. 1704–1709. [H. Kiyama et al. (2022). Nihongo Bumpo Ayamari Teisei no Ryucho-Sei Hyoka ni Muketa Deta Sakusei. In Proceedings of the 28th Annual Meeting of the Association for Natural Language Processing, pp. 1704–1709.].
  49. Kiyono, S., Suzuki, J., Mizumoto, T., and Inui, K. (2020). “Massive Exploration of Pseudo Data for Grammatical Error Correction.” IEEE/ACM Transactions on Audio, Speech, and Language Processing, 28, pp. 2134–2145. · DOI
  50. Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., Dyer, C., Bojar, O., Constantin, A., and Herbst, E. (2007). “Moses: Open Source Toolkit for Statistical Machine Translation.” In Proceedings of the 45th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pp. 177–180. · DOI · Paper page
  51. Koehn, P. and Knowles, R. (2017). “Six Challenges for Neural Machine Translation.” In Proceedings of the 1st Workshop on Neural Machine Translation, pp. 28–39. · DOI · Paper page
  52. Koehn, P., Och, F. J., and Marcu, D. (2003). “Statistical Phrase-Based Translation.” In Proceedings of the 2003 Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics, pp. 127–133. · DOI · Paper page
  53. 小山碧海,喜友名朝視顕,小林賢治,新井美桜,小町守 (2020). 日本語学習者の文法誤り訂正のための評価コーパス構築. 言語処理学会第26回年次大会発表論文集, pp. 145–148. [A. Koyama et al. (2020). Nihongo Gakushu-Sha no Bumpo Ayamari Teisei no Tame no Hyoka Kopasu Kochiku. In Proceedings of the 26th Annual Meeting of the Association for Natural Language Processing, pp. 145–148.].
  54. Koyama, A., Kiyuna, T., Kobayashi, K., Arai, M., and Komachi, M. (2020). “Construction of an Evaluation Corpus for Grammatical Error Correction for Learners of Japanese as a Second Language.” In Proceedings of the 12th Language Resources and Evaluation Conference, pp. 204–211.
  55. 小山碧海,喜友名朝視顕,三田雅人,岡照晃,小町守 (2022). 日本語文法誤り訂正評価コーパスへの誤用タグ付け. 情報処理学会研究報告, 自然言語処理研究会, 2022-NL-253 (17), pp. 1–9. [A. Koyama et al. (2022). Nihongo Bumpo Ayamari Teisei Hyoka Kopasu he no Goyo Tagu Zuke. The Special Interest Group Technical Reports of IPSJ, IPSJ Special Interest Groups on Natural Language, 2022-NL-253 (17), pp. 1–9.].
  56. 古山翔太,高村大也,岡崎直観 (2022). 多様な規則を活用した文法誤り訂正のデータ拡張に関する分析. 自然言語処理, 29 (2), pp. 542–586. [S. Koyama et al. (2022). Analysis of Data Augmentation for Grammatical Error Correction Based on Various Rules. Journal of Natural Language Processing, 29 (2), pp. 542–586.]. · DOI
  57. Kudo, T. (2018). “Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates.” In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp. 66–75. · DOI · Paper page
  58. Kudo, T. and Richardson, J. (2018). “SentencePiece: A Simple and Language Independent Subword Tokenizer and Detokenizer for Neural Text Processing.” In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp. 66–71. · DOI · Paper page
  59. Kudo, T., Yamamoto, K., and Matsumoto, Y. (2004). “Applying Conditional Random Fields to Japanese Morphological Analysis.” In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, pp. 230–237.
  60. Lai, S., Zhou, Q., Zeng, J., Li, Z., Li, C., Cao, Y., and Su, J. (2022). “Type-Driven Multi-Turn Corrections for Grammatical Error Correction.” In Findings of the Association for Computational Linguistics: ACL 2022, pp. 3225–3236. · doi:10.18653/v1/2022.findings-acl.254
  61. Landis, J. R. and Koch, G. G. (1977). “The Measurement of Observer Agreement for Categorical Data.” Biometrics, 33 (1), pp. 159–174. · DOI · Paper page
  62. Levenshtein, V. I. (1966). “Binary Codes Capable of Correcting Deletions, Insertions and Reversals.” Soviet Physics Doklady, 10 (8), pp. 707–710.
  63. Li, X. and He, J. (2021). “Data Augmentation of Incorporating Real Error Patterns and Linguistic Knowledge for Grammatical Error Correction.” In Proceedings of the 25th Conference on Computational Natural Language Learning, pp. 223–233. · DOI
  64. Lichtarge, J., Alberti, C., and Kumar, S. (2020). “Data Weighted Training Strategies for Grammatical Error Correction.” Transactions of the Association for Computational Linguistics, 8, pp. 634–646. · DOI
  65. Lichtarge, J., Alberti, C., Kumar, S., Shazeer, N., Parmar, N., and Tong, S. (2019). “Corpora Generation for Grammatical Error Correction.” In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 3291–3301. · DOI
  66. Liu, J., Cheng, F., Wang, Y., Shindo, H., and Matsumoto, Y. (2018). “Automatic Error Correction on Japanese Functional Expressions Using Character-based Neural Machine Translation.” In Proceedings of the 32nd Pacific Asia Conference on Language, Information and Computation, pp. 394–403.
  67. Luong, T., Pham, H., and Manning, C. D. (2015). “Effective Approaches to Attention-based Neural Machine Translation.” In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 1412–1421. · DOI · Paper page
  68. 三田雅人,水本智也,金子正弘,永田亮,乾健太郎 (2021). 文法誤り訂正モデルの横断評価. 自然言語処理, 28 (1), pp. 160–182. [M. Mita et al. (2021). Cross-Sectional Evaluation of Grammatical Error Correction Models. Journal of Natural Language Processing, 28 (1), pp. 160–182.]. · DOI
  69. Mita, M., Kiyono, S., Kaneko, M., Suzuki, J., and Inui, K. (2020). “A Self-Refinement Strategy for Noise Reduction in Grammatical Error Correction.” In Findings of the Association for Computational Linguistics: EMNLP 2020, pp. 267–280. · DOI
  70. Mita, M., Mizumoto, T., Kaneko, M., Nagata, R., and Inui, K. (2019). “Cross-Corpora Evaluation and Analysis of Grammatical Error Correction Models — Is Single-Corpus Evaluation Enough?” In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1309–1314. · DOI
  71. Mita, M. and Yanaka, H. (2021). “Do Grammatical Error Correction Models Realize Grammatical Generalization?” In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pp. 4554–4561. · DOI
  72. 水本智也 (2020). 日本語文法誤り訂正における最適な分割単位の調査. 言語処理学会第26回年次大会発表論文集, pp. 1336–1339. [T. Mizumoto (2020). Nihongo Bumpo Ayamari Teisei ni Okeru Saiteki na Bunkatsu Tani no Chosa. In Proceedings of the 26th Annual Meeting of the Association for Natural Language Processing, pp. 1336–1339.].
  73. Mizumoto, T., Hayashibe, Y., Komachi, M., Nagata, M., and Matsumoto, Y. (2012). “The Effect of Learner Corpus Size in Grammatical Error Correction of ESL Writings.” In Proceedings of the 24th International Conference on Computational Linguistics: Posters, pp. 863–872.
  74. 水本智也,小町守,永田昌明,松本裕治 (2013). 日本語学習者の作文自動誤り訂正のための語学学習SNSの添削ログからの知識獲得. 人工知能学会論文誌, 28 (5), pp. 420–432. [T. Mizumoto et al. (2013). Mining Revision Log of Language Learning SNS for Automated Japanese Error Correction. Transactions of the Japanese Society for Artificial Intelligence, 28 (5), pp. 420–432.].
  75. Morishita, M., Chousa, K., Suzuki, J., and Nagata, M. (2022). “JParaCrawl v3.0: A Large-scale English-Japanese Parallel Corpus.” In Proceedings of the 13th Language Resources and Evaluation Conference, pp. 6704–6710.
  76. Morishita, M., Suzuki, J., and Nagata, M. (2020). “JParaCrawl: A Large Scale Web-Based English-Japanese Parallel Corpus.” In Proceedings of the 12th Language Resources and Evaluation Conference, pp. 3603–3609.
  77. Morita, H., Kawahara, D., and Kurohashi, S. (2015). “Morphological Analysis for Unsegmented Languages using Recurrent Neural Network Language Model.” In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 2292–2297. · DOI
  78. Nagata, R. and Nakatani, K. (2010). “Evaluating Performance of Grammatical Error Detection to Maximize Learning Effect.” In Proceedings of the 23rd International Conference on Computational Linguistics: Posters, pp. 894–900.
  79. 南保亮太,乙武北斗,荒木健治 (2007). 文節内の特徴を用いた日本語助詞誤りの自動検出・校正. 情報処理学会研究報告, 自然言語処理研究会, 2007 (94), pp. 107–112. [R. Nampo et al. (2007). Automatic Error Detection and Correction of Japanese Particles Using Features within Bunsetsu. The Special Interest Group Technical Reports of IPSJ, IPSJ Special Interest Groups on Natural Language, 2007 (94), pp. 107–112.].
  80. Náplava, J. and Straka, M. (2019). “Grammatical Error Correction in Low-Resource Scenarios.” In Proceedings of the 5th Workshop on Noisy User-generated Text, pp. 346–356. · DOI
  81. Náplava, J., Straka, M., Straková, J., and Rosen, A. (2022). “Czech Grammar Error Correction with a Large and Diverse Corpus.” Transactions of the Association for Computational Linguistics, 10, pp. 452–467. · DOI
  82. Napoles, C., Nădejde, M., and Tetreault, J. (2019). “Enabling Robust Grammatical Error Correction in New Domains: Data Sets, Metrics, and Analyses.” Transactions of the Association for Computational Linguistics, 7, pp. 551–566. · DOI
  83. Napoles, C., Sakaguchi, K., Post, M., and Tetreault, J. (2015). “Ground Truth for Grammatical Error Correction Metrics.” In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, pp. 588–593. · DOI
  84. Napoles, C., Sakaguchi, K., Post, M., and Tetreault, J. (2016). “GLEU Without Tuning.” arXiv preprint arXiv:1605.02592 [cs.CL]. · arXiv
  85. Napoles, C., Sakaguchi, K., and Tetreault, J. (2017). “JFLEG: A Fluency Corpus and Benchmark for Grammatical Error Correction.” In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, pp. 229–234. · DOI · Paper page
  86. Ng, H. T., Wu, S. M., Briscoe, T., Hadiwinoto, C., Susanto, R. H., and Bryant, C. (2014). “The CoNLL-2014 Shared Task on Grammatical Error Correction.” In Proceedings of the Eighteenth Conference on Computational Natural Language Learning: Shared Task, pp. 1–14. · DOI · Paper page
  87. Ng, H. T., Wu, S. M., Wu, Y., Hadiwinoto, C., and Tetreault, J. (2013). “The CoNLL-2013 Shared Task on Grammatical Error Correction.” In Proceedings of the 17th Conference on Computational Natural Language Learning: Shared Task, pp. 1–12. · DOI · Paper page
  88. Nivre, J., de Marneffe, M.-C., Ginter, F., Goldberg, Y., Hajič, J., Manning, C. D., McDonald, R., Petrov, S., Pyysalo, S., Silveira, N., Tsarfaty, R., and Zeman, D. (2016). “Universal Dependencies v1: A Multilingual Treebank Collection.” In Proceedings of the 10th Language Resources and Evaluation Conference, pp. 1659–1666.
  89. Nivre, J., de Marneffe, M.-C., Ginter, F., Hajič, J., Manning, C. D., Pyysalo, S., Schuster, S., Tyers, F., and Zeman, D. (2020). “Universal Dependencies v2: An Evergrowing Multilingual Treebank Collection.” In Proceedings of the 12th Language Resources and Evaluation Conference, pp. 4034–4043.
  90. Och, F. J. (2003). “Minimum Error Rate Training in Statistical Machine Translation.” In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, pp. 160–167. · DOI · Paper page
  91. Och, F. J. and Ney, H. (2003). “A Systematic Comparison of Various Statistical Alignment Models.” Computational Linguistics, 29 (1), pp. 19–51. · DOI · Paper page
  92. 小川耀一朗,山本和英 (2020). 日本語文法誤り訂正における誤り傾向を考慮した擬似誤り生成. 言語処理学会第26回年次大会発表論文集, pp. 505–508. [Y. Ogawa and K. Yamamoto (2020). Nihongo Bumpo Ayamari Teisei ni Okeru Ayamari Keiko o Koryo Shita Giji Ayamari Seisei. In Proceedings of the 26th Annual Meeting of the Association for Natural Language Processing, pp. 505–508.].
  93. 岡照晃 (2019). 言語研究のための電子化辞書. コーパスと辞書, 講座 日本語コーパス 7, pp. 1–28. 朝倉書店. [T. Oka (2019). Gengo Kenkyu no Tame no Denshi-Ka Jisho. Kopasu to Jisho, Koza Nihongo Kopasu 7, pp. 1–28. Asakura Shoten.].
  94. Ott, M., Edunov, S., Baevski, A., Fan, A., Gross, S., Ng, N., Grangier, D., and Auli, M. (2019). “fairseq: A Fast, Extensible Toolkit for Sequence Modeling.” In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: System Demonstrations, pp. 48–53. · DOI · Paper page
  95. 大山浩美,小町守,松本裕治 (2016). 日本語学習者の作文における誤用タイプの階層的アノテーションに基づく機械学習による自動分類. 自然言語処理, 23 (2), pp. 195–225. [H. Oyama et al. (2016). Hierarchical Annotation and Automatic Error-Type Classification of Japanese Language Learners’ Writing. Journal of Natural Language Processing, 23 (2), pp. 195–225.]. · doi:10.5715/jnlp.23.195
  96. Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. (2002). “BLEU: A Method for Automatic Evaluation of Machine Translation.” In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp. 311–318. · DOI · Paper page
  97. Pereira, L., Manguilimotan, E., and Matsumoto, Y. (2016). “Leveraging a Large Learner Corpus for Automatic Suggestion of Collocations for Learners of Japanese as a Second Language.” CALICO Journal, 33 (3), pp. 311–333. · DOI
  98. Qorib, M., Na, S.-H., and Ng, H. T. (2022). “Frustratingly Easy System Combination for Grammatical Error Correction.” In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 1964–1974. · doi:10.18653/v1/2022.naacl-main.143
  99. Reimers, N. and Gurevych, I. (2019). “Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks.” In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp. 3982–3992. · DOI · Paper page
  100. Rothe, S., Mallinson, J., Malmi, E., Krause, S., and Severyn, A. (2021). “A Simple Recipe for Multilingual Grammatical Error Correction.” In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, pp. 702–707. · DOI
  101. Rozovskaya, A. and Roth, D. (2010a). “Generating Confusion Sets for Context-Sensitive Error Correction.” In Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, pp. 961–970.
  102. Rozovskaya, A. and Roth, D. (2010b). “Training Paradigms for Correcting Errors in Grammar and Usage.” In Proceedings of Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics, pp. 154–162.
  103. Rozovskaya, A. and Roth, D. (2011). “Algorithm Selection and Model Adaptation for ESL Correction Tasks.” In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pp. 924–933.
  104. Rozovskaya, A. and Roth, D. (2019). “Grammar Error Correction in Morphologically Rich Languages: The Case of Russian.” Transactions of the Association for Computational Linguistics, 7, pp. 1–17. · DOI
  105. Sakaguchi, K., Napoles, C., Post, M., and Tetreault, J. (2016). “Reassessing the Goals of Grammatical Error Correction: Fluency Instead of Grammaticality.” Transactions of the Association for Computational Linguistics, 4, pp. 169–182. · doi:10.1162/tacl_a_00091
  106. Sakaguchi, K., Post, M., and Van Durme, B. (2017). “Grammatical Error Correction with Neural Reinforcement Learning.” In Proceedings of the 8th International Joint Conference on Natural Language Processing, pp. 366–372.
  107. Schneider, D. and McCoy, K. F. (1998). “Recognizing Syntactic Errors in the Writing of Second Language Learners.” In Proceedings of the 36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, pp. 1198–1204. · DOI
  108. Sennrich, R., Haddow, B., and Birch, A. (2016). “Improving Neural Machine Translation Models with Monolingual Data.” In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pp. 86–96. · DOI · Paper page
  109. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R. (2014). “Dropout: A Simple Way to Prevent Neural Networks from Overfitting.” Journal of Machine Learning Research, 15 (56), pp. 1929–1958.
  110. Stahlberg, F., Kulikov, I., and Kumar, S. (2022). “Uncertainty Determines the Adequacy of the Mode and the Tractability of Decoding in Sequence-to-Sequence Models.” In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, pp. 8634–8645. · DOI
  111. Stahlberg, F. and Kumar, S. (2021). “Synthetic Data Generation for Grammatical Error Correction with Tagged Corruption Models.” In Proceedings of the 16th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 37–47.
  112. Straka, M., Náplava, J., and Straková, J. (2021). “Character Transformations for Non-Autoregressive GEC Tagging.” In Proceedings of the 7th Workshop on Noisy User-generated Text, pp. 417–422. · DOI
  113. Sun, X. and Wang, H. (2022). “Adjusting the Precision-Recall Trade-Off with Align-and-Predict Decoding for Grammatical Error Correction.” In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, pp. 686–693. · DOI
  114. Sutskever, I., Vinyals, O., and Le, Q. V. (2014). “Sequence to Sequence Learning with Neural Networks.” In Advances in Neural Information Processing Systems 27, pp. 3104–3112.
  115. Suzuki, D., Takahashi, Y., Yamashita, I., Aida, T., Hirasawa, T., Nakatsuji, M., Mita, M., and Komachi, M. (2022). “Construction of a Quality Estimation Dataset for Automatic Evaluation of Japanese Grammatical Error Correction.” In Proceedings of the 13th Language Resources and Evaluation Conference, pp. 5565–5572.
  116. Suzuki, H. and Toutanova, K. (2006). “Learning to Predict Case Markers in Japanese.” In Proceedings of the 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics, pp. 1049–1056. · doi:10.3115/1220175.1220307
  117. Swanson, B. and Yamangil, E. (2012). “Correction Detection and Error Type Selection as an ESL Educational Aid.” In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 357–361.
  118. Tajiri, T., Komachi, M., and Matsumoto, Y. (2012). “Tense and Aspect Error Correction for ESL Learners Using Global Context.” In Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, pp. 198–202.
  119. 田中佑,村脇有吾,河原大輔,黒橋禎夫 (2021). 日本語 Wikipedia の編集履歴に基づく入力誤りデータセットと訂正システムの構築. 自然言語処理, 28 (4), pp. 995–1033. [Y. Tanaka et al. (2021). Building a Japanese Typo Dataset and Typo Correction System Based on Wikipedia’s Revision History. Journal of Natural Language Processing, 28 (4), pp. 995–1033.]. · DOI
  120. 塘優旗,小町守 (2015). 部分的アノテーションを利用した CRF による日本語学習者文の単語分割. 情報処理学会研究報告, 自然言語処理研究会, 2015-NL-223 (2), pp. 1–9. [Y. Tomo, and M. Komachi (2015). Bubun-Teki Anoteshon o Riyo Shita CRF niyoru Nihongo Gakushu-Sha Bun no Tango Bunkatsu. The Special Interest Group Technical Reports of IPSJ, IPSJ Special Interest Groups on Natural Language, 2015-NL-223 (2), pp. 1–9.].
  121. Trinh, V. A. and Rozovskaya, A. (2021). “New Dataset and Strong Baselines for the Grammatical Error Correction of Russian.” In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pp. 4103–4111. · DOI
  122. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, Ƚ., and Polosukhin, I. (2017). “Attention is All you Need.” In Advances in Neural Information Processing Systems 30, pp. 5998–6008.
  123. Wan, Z., Wan, X., and Wang, W. (2020). “Improving Grammatical Error Correction with Data Augmentation by Editing Latent Representation.” In Proceedings of the 28th International Conference on Computational Linguistics, pp. 2202–2212. · DOI
  124. Wang, L. and Zheng, X. (2020). “Improving Grammatical Error Correction Models with Purpose-Built Adversarial Examples.” In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pp. 2858–2869. · DOI
  125. White, M. and Rozovskaya, A. (2020). “A Comparative Study of Synthetic Data Generation Methods for Grammatical Error Correction.” In Proceedings of the 15th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 198–208. · doi:10.18653/v1/2020.bea-1.21
  126. Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Le Scao, T., Gugger, S., Drame, M., Lhoest, Q., and Rush, A. (2020). “Transformers: State-of-the-Art Natural Language Processing.” In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp. 38–45. · DOI · Paper page
  127. Xie, Z., Genthial, G., Xie, S., Ng, A., and Jurafsky, D. (2018). “Noising and Denoising Natural Language: Diverse Backtranslation for Grammar Correction.” In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 619–628. · DOI
  128. Xue, L., Constant, N., Roberts, A., Kale, M., Al-Rfou, R., Siddhant, A., Barua, A., and Raffel, C. (2021). “mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer.” In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 483–498. · DOI · Paper page
  129. 山下郁海,金子正弘,三田雅人,勝又智,Aizhan Imankulova,小町守 (2022). 言語間での転移学習のための事前学習モデルと多言語の学習者データを用いた文法誤り訂正. 自然言語処理, 29 (2), pp. 314–343. [I. Yamashita et al. (2022). Grammatical Error Correction with Pre-trained Model and Multilingual Learner Corpus for Cross-lingual Transfer Learning. Journal of Natural Language Processing, 29 (2), pp. 314–343.]. · DOI
  130. Yannakoudakis, H., Andersen, Ø. E., Geranpayeh, A., Briscoe, T., and Nicholls, D. (2018). “Developing an Automated Writing Placement System for ESL Learners.” Applied Measurement in Education, 31 (3), pp. 251–267. · DOI · Paper page
  131. Yannakoudakis, H., Briscoe, T., and Medlock, B. (2011). “A New Dataset and Method for Automatically Grading ESOL Texts.” In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pp. 180–189.
  132. Yasunaga, M., Leskovec, J., and Liang, P. (2021). “LM-Critic: Language Models for Unsupervised Grammatical Error Correction.” In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 7752–7763. · DOI
  133. Yuan, Z. and Briscoe, T. (2016). “Grammatical Error Correction using Neural Machine Translation.” In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 380–386. · DOI · Paper page
  134. Yuan, Z. and Bryant, C. (2021). “Document-level Grammatical Error Correction.” In Proceedings of the 16th Workshop on Innovative Use of NLP for Building Educational Applications, pp. 75–84.
  135. Yuan, Z., Taslimipoor, S., Davis, C., and Bryant, C. (2021). “Multi-Class Grammatical Error Detection for Correction: A Tale of Two Systems.” In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 8722–8736. · DOI
  136. Zhang, Y., Li, Z., Bao, Z., Li, J., Zhang, B., Li, C., Huang, F., and Zhang, M. (2022). “MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correction.” In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 3118–3130. · DOI
  137. Zhao, W., Wang, L., Shen, K., Jia, R., and Liu, J. (2019). “Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data.” In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 156–165. · DOI · Paper page
  138. Zhou, W., Ge, T., Mu, C., Xu, K., Wei, F., and Zhou, M. (2020). “Improving Grammatical Error Correction with Machine Translation Pairs.” In Findings of the Association for Computational Linguistics: EMNLP 2020, pp. 318–328. · DOI

Cited by

See all 1

Metadata

Authors
Koyama, A., Kiyuna, T., Kobayashi, K., Arai, M., Mita, M., Oka, T., & Komachi, M.
Affiliations
Tokyo Metropolitan University
Venue
Journal of Natural Language Processing
Published
2023
Volume
30
Issue
2
Pages
330-371
ISSN
  • 1340-7619
  • 2185-8314
Cited by
0
References
3
Language
en

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.