Beltagy, Iz

SciBERT: A Pretrained Language Model for Scientific Text

Beltagy, I., Lo, K., & Cohan, A. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)

Topic ModelingMultimodal Machine Learning Applications

Cited by 3,218

Longformer: The Long-Document Transformer

Beltagy, I., Peters, M. E., & Cohan, A. (2020) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 2,281

Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks

Gururangan, S., Marasović, A., Swayamdipta, S., Lo, K., Beltagy, I., Downey, D., & Smith, N. A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 2,103

Construction of the Literature Graph in Semantic Scholar

Ammar, W., Groeneveld, D., Bhagavatula, C., Beltagy, I., Crawford, M., Downey, D., Dunkelberger, J., Elgohary, A., Feldman, S., Ha, V., et al. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3 (Industry Papers)

scientometrics and bibliometrics researchTopic Modeling

Cited by 358

SciREX: A Challenge Dataset for Document-Level Information Extraction

Jain, S., van Zuylen, M., Hajishirzi, H., & Beltagy, I. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics

Topic ModelingBiomedical Text Mining and Ontologies

Cited by 159

A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers

Dasigi, P., Lo, K., Beltagy, I., Cohan, A., Smith, N. A., & Gardner, M. (2021) · Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies

Topic ModelingInformation Retrieval and Search Behavior

Cited by 138

OLMo: Accelerating the Science of Language Models

Groeneveld, D., Beltagy, I., Walsh, E., Bhagia, A., Kinney, R., Tafjord, O., Jha, A., Ivison, H., Magnusson, I., Wang, Y., et al. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 70

The Semantic Scholar Open Data Platform

Kinney, R., Anastasiades, C., Authur, R., Beltagy, I., Bragg, J., Buraczynski, A., Cachola, I., Candra, S., Chandrasekhar, Y., Cohan, A., et al. (2023) · arXiv

scientometrics and bibliometrics researchSemantic Web and Ontologies

Cited by 64

MultiVerS: Improving scientific claim verification with weak supervision and full-document context

Wadden, D., Lo, K., Wang, L., Cohan, A., Beltagy, I., & Hajishirzi, H. (2022) · Findings of the Association for Computational Linguistics: NAACL 2022

Misinformation and Its ImpactsTopic Modeling

Cited by 60

Dolma: an open corpus of three trillion tokens for language model pretraining research

Soldaini, L., Kinney, R., Bhagia, A., Schwenk, D., Atkinson, D., Authur, R., Bogin, B., Chandu, K., Dumas, J., Elazar, Y., et al. (2024) · Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Topic ModelingNatural Language Processing Techniques

Cited by 56

SciBERT: A Pretrained Language Model for Scientific Text

Beltagy, I., Lo, K., & Cohan, A. (2019) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 41

SciFact-Open: Towards open-domain scientific claim verification

Wadden, D., Lo, K., Kuehl, B., Cohan, A., Beltagy, I., Wang, L. L., & Hajishirzi, H. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022

Topic ModelingMisinformation and Its Impacts

Cited by 35

SciFact-Open: Towards open-domain scientific claim verification

Wadden, D., Lo, K., Kuehl, B., Cohan, A., Beltagy, I., Wang, L. L., & Hajishirzi, H. (2022) · arXiv

Topic ModelingMisinformation and Its Impacts

Cited by 35

What Language Model to Train if You Have One Million GPU Hours?

Le Scao, T., Wang, T., Hesslow, D., Bekman, S., Bari, M. S., Biderman, S., Elsahar, H., Muennighoff, N., Phang, J., Press, O., et al. (2022) · Findings of the Association for Computational Linguistics: EMNLP 2022

Topic ModelingNatural Language Processing Techniques

Cited by 33

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Soldaini, L., Kinney, R., Bhagia, A., Schwenk, D., Atkinson, D., Authur, R., Bogin, B., Chandu, K., Dumas, J., Elazar, Y., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 10

OLMo: Accelerating the Science of Language Models

Groeneveld, D., Beltagy, I., Walsh, P., Bhagia, A., Kinney, R., Tafjord, O., Jha, A. H., Ivison, H., Magnusson, I., Wang, Y., et al. (2024) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 10

MS2: Multi-Document Summarization of Medical Studies

DeYoung, J., Beltagy, I., van Zuylen, M., Kuehl, B., & Wang, L. L. (2021) · arXiv

Advanced Text Analysis TechniquesBiomedical Text Mining and Ontologies

Cited by 10

What Language Model to Train if You Have One Million GPU Hours?

Scao, T. L., Wang, T., Hesslow, D., Saulnier, L., Bekman, S., Bari, M. S., Biderman, S., Elsahar, H., Muennighoff, N., Phang, J., et al. (2022) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 9

Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2

Ivison, H., Wang, Y., Pyatkin, V., Lambert, N., Peters, M., Dasigi, P., Jang, J., Wadden, D., Smith, N. A., Beltagy, I., et al. (2023) · arXiv

Topic ModelingDomain Adaptation and Few-Shot Learning

Cited by 8

Paloma: A Benchmark for Evaluating Language Model Fit

Magnusson, I., Bhagia, A., Hofmann, V., Soldaini, L., Jha, A. H., Tafjord, O., Schwenk, D., Walsh, E. P., Elazar, Y., Lo, K., et al. (2023) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 1

Source-Aware Training Enables Knowledge Attribution in Language Models

Khalifa, M., Wadden, D., Strubell, E., Lee, H., Wang, L., Beltagy, I., & Peng, H. (2024) · arXiv

Topic ModelingExplainable Artificial Intelligence (XAI)

Cited by 1

A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers

Dasigi, P., Lo, K., Beltagy, I., Cohan, A., Smith, N. A., & Gardner, M. (2021) · arXiv

Topic ModelingInformation Retrieval and Search Behavior

Cited by 0