The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP
Open accessAbstract
Although the Indonesian language is spoken by almost 200 million people and the 10th mostspoken language in the world, 1 it is under-represented in NLP research.Previous work on Indonesian has been hampered by a lack of annotated datasets, a sparsity of language resources, and a lack of resource standardization.In this work, we release the INDOLEM dataset comprising seven tasks for the Indonesian language, spanning morpho-syntax, semantics, and discourse.We additionally release INDOBERT, a new pre-trained language model for Indonesian, and evaluate it over INDOLEM, in addition to benchmarking it against existing resources.Our experiments show that INDOBERT achieves state-of-the-art performance over most of the tasks in INDOLEM.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017) · arXiv · doi:10.48550/arxiv.1706.03762 · Cited by 120,404
Exploiting Generative AI to Scale up Intelligent Tutoring Systems
Jakubův, J., Chvalovský, K., Goertzel, Z., Kaliszyk, C., Olšák, M., Piotrowski, B., Schulz, S., Suda, M., & Urban, J. (2023) · DROPS (Schloss Dagstuhl – Leibniz Center for Informatics) · doi:10.4230/lipics.itp.2023.19 · Cited by 76,658
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 54,325
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1910.10683 · Cited by 10,929
(2004) · Cited by 9,718
Enriching Word Vectors with Subword Information
Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00051 · Cited by 9,645
XLNet: Generalized Autoregressive Pretraining for Language Understanding
Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. V. (2019) · arXiv · doi:10.48550/arxiv.1906.08237 · Cited by 6,687
Neural Architectures for Named Entity Recognition
Lample, G., Ballesteros, M., Subramanian, S., Kawakami, K., & Dyer, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1030 · Cited by 4,401
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
Get To The Point: Summarization with Pointer-Generator Networks
See, A., Liu, P. J., & Manning, C. D. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1099 · Cited by 3,775
A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference
Williams, A., Nangia, N., & Bowman, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1101 · Cited by 3,342
Incorporating non-local information into information extraction systems by Gibbs sampling
Finkel, J. R., Grenager, T., & Manning, C. (2005) · Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics - ACL '05 · doi:10.3115/1219840.1219885 · Cited by 3,008
A Neural Attention Model for Abstractive Sentence Summarization
Rush, A. M., Chopra, S., & Weston, J. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1044 · Cited by 2,656
Teaching Machines to Read and Comprehend
Hermann, K. M., Kočiský, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1506.03340 · Cited by 2,521
Know What You Don't Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · arXiv · doi:10.48550/arxiv.1806.03822 · Cited by 2,242
Know What You Don’t Know: Unanswerable Questions for SQuAD
Rajpurkar, P., Jia, R., & Liang, P. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2124 · Cited by 2,240
(2018) · International Conference on Learning Representations · Cited by 1,621
Cross-lingual Language Model Pretraining
Lample, G., & Conneau, A. (2019) · arXiv · doi:10.48550/arxiv.1901.07291 · Cited by 1,586
Text Summarization with Pretrained Encoders
Liu, Y., & Lapata, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1387 · Cited by 1,553
(2019) · doi:10.18653/v1/p19-1356 · Cited by 1,291
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
Zhang, J., Zhao, Y., Saleh, M., & Liu, P. J. (2019) · arXiv · doi:10.48550/arxiv.1912.08777 · Cited by 1,206
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems
Wang, A., Pruksachatkun, Y., Nangia, N., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. R. (2019) · arXiv · doi:10.48550/arxiv.1905.00537 · Cited by 1,051
MaltParser: A language-independent system for data-driven dependency parsing
NIVRE, J., HALL, J., NILSSON, J., CHANEV, A., ERYİGİT, G., KÜBLER, S., MARINOV, S., & MARSI, E. (2007) · Natural Language Engineering · doi:10.1017/s1351324906004505 · Cited by 801
Neural Summarization by Extracting Sentences and Words
Cheng, J., & Lapata, M. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1046 · Cited by 790
Stanford typed dependencies manual
de Marnee, M.-C., & Manning, C. D. (2010) · Cited by 717
Universal Dependency Annotation for Multilingual Parsing
McDonald, R., Nivre, J., Quirmbach-Brundage, Y., Goldberg, Y., Das, D., Ganchev, K., Hall, K., Petrov, S., Zhang, H., Täckström, O., et al. (2013) · Cited by 716
Deep Biaffine Attention for Neural Dependency Parsing
Atmani, M., & Lafourcade, M. (2016) · arXiv (Cornell University) · doi:10.4230/oasics.ldk.2021.24 · Cited by 693
Modeling Local Coherence: An Entity-Based Approach
Barzilay, R., & Lapata, M. (2008) · Computational Linguistics · doi:10.1162/coli.2008.34.1.1 · Cited by 671
Building a discourse-tagged corpus in the framework of Rhetorical Structure Theory
Carlson, L., Marcu, D., & Okurowski, M. E. (2001) · Proceedings of the Second SIGdial Workshop on Discourse and Dialogue - · doi:10.3115/1118078.1118083 · Cited by 584
Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT
Wu, S., & Dredze, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1077 · Cited by 558
SemEval-2016 Task 1: Semantic Textual Similarity, Monolingual and Cross-Lingual Evaluation
Agirre, E., Banea, C., Cer, D., Diab, M., Gonzalez-Agirre, A., Mihalcea, R., Rigau, G., & Wiebe, J. (2016) · Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016) · doi:10.18653/v1/s16-1081 · Cited by 519
Deep Biaffine Attention for Neural Dependency ParsingPreprint
Dozat, T., & Manning, C. D. (2016) · arXiv (Cornell University) · Cited by 515
PhoBERT: Pre-trained language models for Vietnamese
Nguyen, D. Q., & Tuan Nguyen, A. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.92 · Cited by 456
MLQA: Evaluating Cross-lingual Extractive Question Answering
Lewis, P., Oguz, B., Rinott, R., Riedel, S., & Schwenk, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.653 · Cited by 387
CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies
Zeman, D., Popel, M., Straka, M., Hajic, J., Nivre, J., Ginter, F., Luotolahti, J., Pyysalo, S., Petrov, S., Potthast, M., et al. (2017) · Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies · doi:10.18653/v1/k17-3001 · Cited by 367
Achieving Open Vocabulary Neural Machine Translation with Hybrid Word-Character Models
Luong, M.-T., & Manning, C. D. (2016) · Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p16-1100 · Cited by 345
Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence
Sun, C. C., Huang, L., & Qiu, X. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1903.09588 · Cited by 340
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization
Zhang, J., Zhao, Y., Saleh, M., & Liu, P. X. (2020) · International Conference on Machine Learning · Cited by 325
Building a Discourse-Tagged Corpus in the Framework of Rhetorical Structure Theory
Carlson, L., Marcu, D., & Okurowski, M. E. (2003) · Text, Speech and Language Technology · doi:10.1007/978-94-010-0019-2_5 · Cited by 298
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization
Hu, J., Ruder, S., Siddhant, A., Neubig, G., Fırat, O., & Johnson, M. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.11080 · Cited by 278
Sun, C., Huang, L., & Qiu, X. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1035 · Cited by 235
75 Languages, 1 Model: Parsing Universal Dependencies Universally
Kondratyuk, D., & Straka, M. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1279 · Cited by 225
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and Generation
Liang, Y., Duan, N., Gong, Y., Wu, N., Guo, F., Qi, W., Gong, M., Shou, L., Jiang, D., Cao, G., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.484 · Cited by 221
Multilingual Constituency Parsing with Self-Attention and Pre-Training
Kitaev, N., Cao, S., & Klein, D. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1340 · Cited by 200
IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding
Wilie, B., Vincentio, K., Winata, G. I., Cahyawijaya, S., Li, X., Lim, Z. Y., Soleman, S., Mahendra, R., Fung, P., Bahar, S., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2009.05387 · Cited by 187
CoNLL 2018 Shared Task : Multilingual Parsing from Raw Text to Universal Dependencies
Zeman, D., Hajič, J., Popel, M., Potthast, M., Straka, M., Ginter, F., Nivre, J., & Petrov, S. (2018) · Conference on Computational Natural Language Learning · Cited by 166
Stock price prediction using linear regression based on sentiment analysis
Cakra, Y. E., & Trisedya, B. D. (2015) · International Conference on Advanced Computer Science and Information Systems · doi:10.1109/icacsis.2015.7415179 · Cited by 157
Inset lexicon: Evaluation of a word list for Indonesian sentiment analysis in microblogs
Koto, F., & Rahmaningtyas, G. Y. (2017) · International Conference on Asian Language Processing · doi:10.1109/ialp.2017.8300625 · Cited by 153
Self-citationDisSent: Learning Sentence Representations from Explicit Discourse Relations
Nie, A., Bennett, E., & Goodman, N. D. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1442 · Cited by 121
Ibrahim, M., Abdillah, O., Wicaksono, A. F., & Adriani, M. (2015) · IEEE ... International Conference on Data Mining workshops · doi:10.1109/icdmw.2015.113 · Cited by 102
Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsing
Wang, Y., Che, W., Guo, J., Liu, Y., & Liu, T. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1575 · Cited by 101
Designing an Indonesian part of speech tagset and manually tagged Indonesian corpus
Dinakaramani, A., Fam, R., Luthfi, A., & Manurung, H. (2014) · International Conference on Asian Language Processing · doi:10.1109/ialp.2014.6973519 · Cited by 98
Indosum: A New Benchmark Dataset for Indonesian Text Summarization
Kurniawan, K., & Louvan, S. (2018) · International Conference on Asian Language Processing · doi:10.1109/ialp.2018.8629109 · Cited by 86
Probabilistic Part Of Speech Tagging for Bahasa Indonesia
Manurung, H. (2009) · Cited by 72
XGLUE: A New Benchmark Dataset for Cross-lingual Pre-training, Understanding and GenerationPreprint
Liang, Y., Duan, N., Gong, Y., Wu, N., Guo, F., Qi, W., Gong, M., Shou, L., Jiang, D., Cao, G., et al. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.01401 · Cited by 65
Liputan6: A Large-scale Indonesian Dataset for Text Summarization
Koto, F., Lau, J. H., & Baldwin, T. (2020) · Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing (AACL-IJCNLP) · doi:10.18653/v1/2020.aacl-main.60 · Cited by 56
Self-citationToward a Standardized and More Accurate Indonesian Part-of-Speech Tagging
Kurniawan, K., & Aji, A. F. (2018) · International Conference on Asian Language Processing · doi:10.1109/ialp.2018.8629236 · Cited by 30
Named entity recognition on Indonesian Twitter posts using long short-term memory networks
Rachman, V., Savitri, S., Augustianti, F., & Mahendra, R. (2017) · International Conference on Advanced Computer Science and Information Systems · doi:10.1109/icacsis.2017.8355038 · Cited by 19
Indonesian Dependency Treebank: Annotation and Parsing
Green, N., Larasati, S. D., & Žabokrtský, Z. (2012) · Institutional Repositories DataBase (IRDB) · Cited by 18
Automatic open domain information extraction from Indonesian text
Gultom, Y., & Wibowo, W. C. (2017) · International Workshop on Big Data and Information Security (IWBIS) · doi:10.1109/iwbis.2017.8275098 · Cited by 12
Cited by
QASiNa: Religious Domain Question Answering Using Sirah Nabawiyah
Rizqullah, M. R., Purwarianti, A., & Aji, A. F. (2023) · 2023 10th International Conference on Advanced Informatics: Concept, Theory and Application (ICAICTA) · doi:10.1109/icaicta59291.2023.10390123 · Cited by 14
Metadata
- Authors
- Koto, F., Rahimi, A., Lau, J. H., & Baldwin, T.
- Venue
- Proceedings of the 28th International Conference on Computational Linguistics
- Published
- 2020
- Pages
- 757-770
- ISSN
- 1525-2477 (ISSN-L)
- OpenAlex
- W3116295307
- Cited by
- 343
- References
- 61
- FWCI
- 12.60
- Type
- conference paper
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.