CoChat

Large Language Models versus Natural Language Understanding and Generation

Open access
Karanikolas, Nikitas, Manga, Eirini, Samaridi, Nikoletta, Tousidou, Eleni, Vassilakopoulos, Michael · 2023 · Proceedings of the 27th Pan-Hellenic Conference on Progress in Computing and Informatics

The DOI matches its Crossref record; the references it cites are not checked yet.

Abstract

In recent years, the process humans adopt to learn a foreign language has moved from the strict "Grammar –Translation" method, which is based mainly on grammar and syntax rules, to more innovative processes, resulting to the more modern "Communicative approach". As its name states, this approach focuses on the coherent communication with native speakers and the cultivation of oral skills, without taking into consideration, at least at the first stages, the rules that govern the language.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3635059.3635104

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

The citation lists are queued

They are fetched later and appear here then.

References 52 · Cited by 102

Research works printed but not linked: 28

  1. Samir Abdaljalil and Houda Bouamor. 2021. An Exploration of Automatic Text Summarization of Financial Reports. In Proceedings of the Third Workshop on Financial Technology and Natural Language Processing Chung-Chi Chen Hen-Hsen Huang Hiroya Takamura and Hsin-Hsi Chen (Eds.). Online 1–7. https://aclanthology.org/2021.finnlp-1.1
  2. Maram Almotairi and Fethi Fkih. 2022. Developing a Semantic Question Answering System for E-Learning Environments Using Linguistic Resources.Journal of Education and E-Learning Research 9, 4 (2022), 224–232.
  3. Dogu Araci. 2019. FinBERT: Financial Sentiment Analysis with Pre-trained Language Models. arxiv:1908.10063 [cs.CL] · arXiv
  4. 10.1093/oxfordhb/9780199573691.013.010 · doi:10.1093/oxfordhb/9780199573691.013.010
  5. Madeleine Bates. 1995. Models of natural language understanding.Proceedings of the National Academy of Sciences 92, 22 (1995), 9977–9982.
  6. Nivedita Bhirud, Subhash Tataale, Sayali Randive, and Shubham Nahar. 2019. A literature review on chatbots in healthcare domain. International journal of scientific & technology research 8, 7 (2019), 225–231.
  7. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin (Eds.). Vol. 33. Curran Associates, Inc., 1877–1901. https://proceedings.neurips.cc/paper_files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf
  8. Bertram Bruce. 1985. Deep case systems for language understanding. Technical Report. University of Illinois at Urbana-Champaign. http://hdl.handle.net/2142/17534
  9. Emad Elwany Dave Moore and Gaurav Oberoi. 2019. BERT Goes to Law School: Quantifying the Competitive Advantage of Access to Large Legal Corpora in Contract Understanding. arxiv:1911.00473 [cs.CL] · arXiv
  10. Charles J. Fillmore. 1968. The Case for Case. In Universals in Linguistic Theory, E. Bach and R.T. Harms (Eds.). Holt, Rinehart, and Winston, New York, 1–88.
  11. Weijing Huang, Xianfeng Liao, Zhiqiang Xie, Jiang Qian, Bojin Zhuang, Shaojun Wang, and Jing Xiao. 2021. Generating reasonable legal text through the combination of language modeling and question answering. In Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence. 3687–3693.
  12. Sohail Imran Khan, Shashikant V Athawale, Madhuri Pravin Borawake, and Makarand Y Naniwadekar. 2023. Sentiment Analysis of Customer Reviews using Pre-trained Language Models. International Journal of Intelligent Systems and Applications in Engineering 11, 7s (2023), 614–620. https://ijisae.org/index.php/IJISAE/article/view/2998
  13. Tom Kocmi and Christian Federmann. 2023. Large Language Models Are State-of-the-Art Evaluators of Translation Quality. arxiv:2302.14520 [cs.CL] · arXiv
  14. 10.18653/V1/2020.ACL-DEMOS.43 · DOI
  15. Junyi Li Tianyi Tang Wayne Xin Zhao Jian-Yun Nie and Ji-Rong Wen. 2022. Pretrained Language Models for Text Generation: A Survey. arxiv:2201.05273 [cs.CL] · arXiv
  16. Andrew L. Maas, Raymond E. Daly, Peter T. Pham, Dan Huang, Andrew Y. Ng, and Christopher Potts. 2011. Learning Word Vectors for Sentiment Analysis. In The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, 19-24 June, 2011, Portland, Oregon, USA, Dekang Lin, Yuji Matsumoto, and Rada Mihalcea (Eds.). The Association for Computer Linguistics, 142–150.
  17. OpenAI. 2023. GPT-4 Technical Report. arxiv:2303.08774 [cs.CL] · arXiv
  18. 10.18653/V1/N18-1202 · DOI · Paper page
  19. 10.5555/265013 · doi:10.5555/265013
  20. Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. J. Mach. Learn. Res. 21 (2020), 140:1–140:67. http://jmlr.org/papers/v21/20-074.html
  21. Ehud Reiter. 1996. Building Natural-Language Generation Systems. arxiv:cmp-lg/9605002 [cmp-lg] · arXiv
  22. Murray Shanahan. 2023. Talking About Large Language Models. arxiv:2212.03551 [cs.CL] · arXiv
  23. Octavia-Maria Sulea Marcos Zampieri Shervin Malmasi Mihaela Vela Liviu P. Dinu and Josef van Genabith. 2017. Exploring the Use of Text Classification in the Legal Domain. arxiv:1710.09306 [cs.CL] · arXiv
  24. Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Lukasz Kaiser and Illia Polosukhin. 2023. Attention Is All You Need. arxiv:1706.03762v7 [cs.CL] · arXiv
  25. Jason Wei, Maarten Bosma, Vincent Y. Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M. Dai, and Quoc V. Le. 2022. Finetuned Language Models are Zero-Shot Learners. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net. https://openreview.net/forum?id=gEZrGCozdqR
  26. Hu Xu Bing Liu Lei Shu and Philip S. Yu. 2019. BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis. arxiv:1904.02232 [cs.CL] · arXiv
  27. Linyi Yang, Eoin M. Kenny, Tin Lok James Ng, Yi Yang, Barry Smyth, and Ruihai Dong. 2020. Generating Plausible Counterfactual Explanations for Deep Transformers in Financial Text Classification. arxiv:2010.12512 [cs.CL] · arXiv
  28. Daniel M. Ziegler Nisan Stiennon Jeffrey Wu Tom B. Brown Alec Radford Dario Amodei Paul Christiano and Geoffrey Irving. 2020. Fine-Tuning Language Models from Human Preferences. arxiv:1909.08593 [cs.CL] · arXiv

Metadata

Authors
Karanikolas, N., Manga, E., Samaridi, N., Tousidou, E., & Vassilakopoulos, M.
Affiliations
  • University of West Attica (GR)
  • University of Thessaly (GR)
Venue
Proceedings of the 27th Pan-Hellenic Conference on Progress in Computing and Informatics
Publisher
ACM
Published
2023-11-24
Pages
278-290
OpenAlex
W4391828195
Cited by
102
References
52
Citations by year
2026: 37 · 2025: 36 · 2024: 29
FWCI
18.11
Type
conference paper
Language
en
Open access
Locations
Pan-Hellenic Conference on Progress in Computing and Informatics (PCI) (publishedVersion, cc-by)
Funders
University of West Attica
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
  • Social Sciences › Arts and Humanities › Language and Linguistics › EFL/ESL Teaching and Learning
  • Physical Sciences › Computer Science › Artificial Intelligence › Speech and dialogue systems
Keywords
large language models, natural language understanding, natural language generation, communicative language teaching, grammar-translation method, foreign language learning, speaking skills, second language acquisition

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Large Language Models versus Natural Language Understanding and Generation. https://app.cochat.ai/papers/10.1145/3635059.3635104
The paper
Karanikolas, N., Manga, E., Samaridi, N., Tousidou, E., & Vassilakopoulos, M. (2023). Large Language Models versus Natural Language Understanding and Generation. Proceedings of the 27th Pan-Hellenic Conference on Progress in Computing and Informatics. https://doi.org/10.1145/3635059.3635104

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.