The DOI matches its Crossref record; 77 of the 77 references it cites were found in a registry or an index.
Jumping NLP Curves: A Review of Natural Language Processing Research [Review Article]
Abstract
Natural language processing (NLP) is a theory-motivated range of computational techniques for the automatic analysis and representation of human language. NLP research has evolved from the era of punch cards and batch processing (in which the analysis of a sentence could take up to 7 minutes) to the era of Google and the likes of it (in which millions of webpages can be processed in less than a second). This review paper draws on recent developments in NLP research to look at the past, present, and future of NLP technology in a new light. Borrowing the paradigm of `jumping curves' from the field of business management and marketing prediction, this survey article reinterprets the evolution of NLP research as the intersection of three overlapping curves-namely Syntactics, Semantics, and Pragmatics Curveswhich will eventually lead NLP research to evolve into natural language understanding.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Genetic algorithms in search, optimization, and machine learning
(1989) · Choice Reviews Online · doi:10.5860/choice.27-0936 · Cited by 49,010
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data
Lafferty, J., McCallum, A., & Pereira, F. C. N. (2001) · ScholarlyCommons (University of Pennsylvania) · Cited by 12,935
(1999) · Cited by 12,854
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Machine learning in automated text categorization
Sebastiani, F. (2002) · ACM Computing Surveys · doi:10.1145/505282.505283 · Cited by 7,926
(1967) · Medical Entomology and Zoology · Cited by 7,532
Building a Large Annotated Corpus of English: The Penn Treebank
Marcus, M. (1993) · doi:10.21236/ada273556 · Cited by 7,405
The Cognitive Structure of Emotions
Ortony, A., Clore, G. L., & Collins, A. (1988) · doi:10.1017/cbo9780511571299 · Cited by 6,208
Natural Language Processing (almost) from Scratch
Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. P. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.0398 · Cited by 4,962
WordNet: An Electronic Lexical Database
(1998) · The MIT Press eBooks · doi:10.7551/mitpress/7287.001.0001 · Cited by 4,857
Freebase: a collaboratively created graph database for structuring human knowledge
Bollacker, K., Evans, C., Paritosh, P., Sturge, T., & Taylor, J. (2008) · Proceedings of the 2008 ACM SIGMOD international conference on Management of data · doi:10.1145/1376616.1376746 · Cited by 4,852
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Probabilistic latent semantic indexing
Hofmann, T. (1999) · Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval · doi:10.1145/312624.312649 · Cited by 3,976
Reiter, R. (1980) · Artificial Intelligence · doi:10.1016/0004-3702(80)90014-4 · Cited by 3,892
OWL Web ontology language overview
McGuinness, D. L. (2004) · Medical Entomology and Zoology · Cited by 3,757
TextRank: Bringing Order into Text
Mihalcea, R. F., & Tarau, P. (2004) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · Cited by 3,631
Automatic acquisition of hyponyms from large text corpora
Hearst, M. A. (1992) · Proceedings of the 14th conference on Computational linguistics - · doi:10.3115/992133.992154 · Cited by 3,253
A maximum entropy approach to natural language processing
Berger, A. L., Pietra, V. J. D., & Pietra, S. A. D. (1996) · doi:10.5555/234285.234289 · Cited by 3,065
Three models for the description of language
Chomsky, N. (1956) · IEEE Transactions on Information Theory · doi:10.1109/tit.1956.1056813 · Cited by 2,796
Text classification from labeled and unlabeled documents using EM
Nigam, K., Mccallum, A. K., Thrun, S., & Mitchell, T. (2000) · Machine Learning · doi:10.1023/a:1007692713085 · Cited by 2,736
Yago: a core of semantic knowledge
Suchanek, F. M., Kasneci, G., & Weikum, G. (2007) · Proceedings of the 16th international conference on World Wide Web · doi:10.1145/1242572.1242667 · Cited by 2,512
Unsupervised Learning by Probabilistic Latent Semantic Analysis
Hofmann, T. (2001) · Machine Learning · doi:10.1023/a:1007617005950 · Cited by 2,456
Semantic Information Processing
Minsky, M. (1968) · Virtual Defense Library (Ministerio de Defensa) · Cited by 2,193
SWITCHBOARD: telephone speech corpus for research and development
Godfrey, J. J., Holliman, E. C., & McDaniel, J. (1992) · [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing · doi:10.1109/icassp.1992.225858 · Cited by 2,134 · cited 1×
“In particular, subsumptive knowledge representations build upon IsA relationships, which are usually extracted through syntactic patterns for automatic hypernym discovery (Hearst, 1992) able to infer tr iples such as <Pablo Picasso-IsA-ar tist> from stretches of text like “...artists such as Pablo…”
BackgroundToward an architecture for never-ending language learning
Carlson, A., Betteridge, J., Kisiel, B., Settles, B., Hruschka, E., & Mitchell, T. (2010) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v24i1.7519 · Cited by 2,000
Constructions: A new theoretical approach to language
Goldberg, A. E. (2003) · Trends in Cognitive Sciences · doi:10.1016/s1364-6613(03)00080-9 · Cited by 1,812
LexRank: Graph-based Lexical Centrality as Salience in Text Summarization
Erkan, G., & Radev, D. R. (2004) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1523 · Cited by 1,700
Support vector machines for spam categorization
Drucker, H., Wu, D., & Vapnik, V. N. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788645 · Cited by 1,471
Learning to Classify Text Using Support Vector Machines
Joachims, T. (2002) · Springer eBooks · doi:10.1007/978-1-4615-0907-3 · Cited by 1,366
Conceptual Information Processing
(1975) · Elsevier eBooks · doi:10.1016/c2013-0-12220-9 · Cited by 1,225
Input space versus feature space in kernel-based methods
Scholkopf, B., Mika, S., Burges, C. J. C., Knirsch, P., Muller, K.-R., Ratsch, G., & Smola, A. J. (1999) · IEEE Transactions on Neural Networks · doi:10.1109/72.788641 · Cited by 1,164
Word association norms, mutual information, and lexicography
Church, K. W., & Hanks, P. (1989) · Proceedings of the 27th annual meeting on Association for Computational Linguistics - · doi:10.3115/981623.981633 · Cited by 1,094
O'Neill, M., & Ryan, C. (2001) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.942529 · Cited by 951
Better Word Representations with Recursive Neural Networks for Morphology
Luong, M.-T., Socher, R., & Manning, C. D. (2013) · Conference on Computational Natural Language Learning · Cited by 786
Probase: a probabilistic taxonomy for text understanding
Wu, W., Li, H., Wang, H., & Zhu, K. Q. (2012) · Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data · doi:10.1145/2213836.2213891 · Cited by 763
SKOS Simple Knowledge Organization System Reference
Miles, A., & Bechhofer, S. (2009) · Research Explorer (The University of Manchester) · Cited by 681
The effect of usage on degrees of constituency: the reduction of don't in English
Bybee, J., & Scheibman, J. (1999) · Linguistics · doi:10.1515/ling.37.4.575 · Cited by 661
Bayesian Networks : a Model of Self-Activated Memory for Evidential Reasoning
Pearl, J. (1985) · Conference Cognitive Science · Cited by 634
TextRank: Bringing Order into Texts
Mihalcea, R., & Tarau, P. (2004) · University of North Texas Digital Library (University of North Texas) · Cited by 632
Fast collapsed gibbs sampling for latent dirichlet allocation
Porteous, I., Newman, D., Ihler, A., Asuncion, A., Smyth, P., & Welling, M. (2008) · Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1401890.1401960 · Cited by 560
A model of textual affect sensing using real-world knowledge
Liu, H., Lieberman, H., & Selker, T. (2003) · Proceedings of the 8th international conference on Intelligent user interfaces · doi:10.1145/604045.604067 · Cited by 531
Barnden, J. A. (1998) · Cited by 445
Deriving a large scale taxonomy from Wikipedia
Ponzetto, S. P., & Strube, M. (2007) · MADOC (University of Mannheim) · Cited by 443
Annotea: an open RDF infrastructure for shared Web annotations
Kahan, J., Koivunen, M.-R., Prud'Hommeaux, E., & Swick, R. R. (2002) · Computer Networks · doi:10.1016/s1389-1286(02)00220-7 · Cited by 412
Context-sensitive learning methods for text categorization
Cohen, W. W., & Singer, Y. (1999) · ACM Transactions on Information Systems · doi:10.1145/306686.306688 · Cited by 360
Affect analysis of text using fuzzy semantic typing
Subasic, P., & Huettner, A. (2001) · IEEE Transactions on Fuzzy Systems · doi:10.1109/91.940962 · Cited by 292
Learning deep physiological models of affect
Martinez, H. P., Bengio, Y., & Yannakakis, G. N. (2013) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2013.2247823 · Cited by 287
Enhanced SenticNet with Affective Labels for Concept-Based Opinion Mining
Poria, S., Gelbukh, A., Hussain, A., Howard, N., Das, D., & Bandyopadhyay, S. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.4 · Cited by 253
Characterization of the Affective Norms for English Words by discrete emotional categories
Stevenson, R. A., Mikels, J. A., & James, T. W. (2007) · Behavior Research Methods · doi:10.3758/bf03192999 · Cited by 251
Towards Semantically-Interlinked Online Communities
Breslin, J. G., Harth, A., Bojars, U., & Decker, S. (2005) · Lecture Notes in Computer Science · doi:10.1007/11431053_34 · Cited by 244
Kacprzyk, J., & Zadrozny, S. (2010) · IEEE Transactions on Fuzzy Systems · doi:10.1109/tfuzz.2010.2040480 · Cited by 184
Sentic Computing: Techniques, Tools, and Applications
Cambria, E., & Hussain, A. (2012) · SpringerBriefs in Cognitive Computation · doi:10.1007/978-94-007-5070-8 · Cited by 181
Self-citationFeature Ensemble Plus Sample Selection: Domain Adaptation for Sentiment Classification
Xia, R., Zong, C., Hu, X., & Cambria, E. (2013) · IEEE Intelligent Systems · doi:10.1109/mis.2013.27 · Cited by 172
Self-citationKrug, M. (1998) · Journal of English Linguistics · doi:10.1177/007542429802600402 · Cited by 172
Natural language grammatical inference with recurrent neural networks
Lawrence, S., Giles, C. L., & Fong, S. (2000) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.842255 · Cited by 168
Language Evolution: The Hardest Problem in Science?
Christiansen, M. H., & Kirby, S. (2003) · Language Evolution · doi:10.1093/acprof:oso/9780199244843.003.0001 · Cited by 167
NATURAL LANGUAGE UNDERSTANDING
(2021) · The Myth of Artificial Intelligence · doi:10.2307/j.ctv322v43j.8 · Cited by 159
Connectionist Natural Language Processing: The State of the Art
Christiansen, M. H., & Chater, N. (1999) · Cognitive Science · doi:10.1207/s15516709cog2304_2 · Cited by 143
Frame-Based Detection of Opinion Holders and Topics: A Model and a Tool
Gangemi, A., Presutti, V., & Recupero, D. R. (2014) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2013.2291688 · Cited by 124
An ELM-based model for affective analogical reasoning
Cambria, E., Gastaldo, P., Bisio, F., & Zunino, R. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.01.064 · Cited by 121
Self-citationIntention awareness: improving upon situation awareness in human-centric environments
Howard, N., & Cambria, E. (2013) · Human-centric Computing and Information Sciences · doi:10.1186/2192-1962-3-9 · Cited by 110
Self-citationCambria, E., Rajagopal, D., Olsher, D. J., & Das, D. (2013) · Chapman & Hall/CRC eBooks · doi:10.1201/b16014-19 · Cited by 96
Self-citationAn Intelligent Self-Organization Scheme for the Internet of Things
Ding, Y., Jin, Y., Ren, L., & Hao, K. (2013) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2013.2264251 · Cited by 92
Davidson, D. (1997) · Royal Institute of Philosophy Supplement · doi:10.1017/s135824610001016x · Cited by 91
A Probabilistic Generative Model for Mining Cybercriminal Networks from Online Social Media
Lau, R. Y. K., Xia, Y., & Ye, Y. (2014) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2013.2291689 · Cited by 90
The Strong Story Hypothesis and the Directed Perception Hypothesis
Winston, P. H. (2011) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 89
Story and discourse: A bipartite model of narrative generation in virtual worlds
Young, R. M. (2007) · Interaction Studies Social Behaviour and Communication in Biological and Artificial Systems · doi:10.1075/is.8.2.02you · Cited by 70
Computational Intelligence for Evolving Trading Rules
Ghandar, A., Michalewicz, Z., Schmidt, M. U., Tô, T., & Zurbrugg, R. (2008) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2008.915992 · Cited by 68
Modelling Space and Time in Narratives about Restaurants
Mueller, E. T. (2006) · Literary and Linguistic Computing · doi:10.1093/llc/fql014 · Cited by 48
Fuzzy Logic Models for the Meaning of Emotion Words
Kazemzadeh, A., Lee, S., & Narayanan, S. S. (2013) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2013.2247824 · Cited by 44
HMM-based Passage Models for Document Classification and Ranking
Denoyer, L., Gallinari, P., & Zaragoza, H. (2001) · Cited by 40
Text categorization for multi-page documents
Frasconi, P., Soda, G., & Vullo, A. (2001) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/379437.379440 · Cited by 33
A critical survey on the use of Fuzzy Sets in Speech and Natural Language Processing
Carvalho, J. P., Batista, F., & Coheur, L. (2012) · IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) · doi:10.1109/fuzz-ieee.2012.6250803 · Cited by 29
Connectionist Natural Language Processing: A Status Report
Dyer, M. G. (2007) · Springer eBooks · doi:10.1007/978-0-585-29599-2_12 · Cited by 23
Symbolic connectionism in natural language disambiguation
Chan, S. W. K., & Franklin, J. (1998) · IEEE Transactions on Neural Networks · doi:10.1109/72.712149 · Cited by 20
Olsher, D. J. (2013) · IEEE Symposium on Computational Intelligence for Human-like Intelligence (CIHLI) · doi:10.1109/cihli.2013.6613269 · Cited by 17
Evolutionary and Swarm Computing for the Semantic Web
Guéret, C., Schlobach, S., Dentler, K., Schut, M. C., & Eiben, G. (2012) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2012.2188583 · Cited by 12
Cited by
Recent Trends in Deep Learning Based Natural Language Processing [Review Article]
Young, T., Hazarika, D., Poria, S., & Cambria, E. (2018) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2018.2840738 · Cited by 2,921
Self-citationA review of affective computing: From unimodal analysis to multimodal fusion
Poria, S., Cambria, E., Bajpai, R., & Hussain, A. (2017) · Information Fusion · doi:10.1016/j.inffus.2017.02.003 · Cited by 1,644
Self-citationDeep Learning Enabled Semantic Communication Systems
Xie, H., Qin, Z., Li, G. Y., & Juang, B.-H. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3071210 · Cited by 1,602
Affective Computing and Sentiment Analysis
Cambria, E. (2016) · IEEE Intelligent Systems · doi:10.1109/mis.2016.31 · Cited by 1,204
Self-citationMachine learning in materials science
Wei, J., Chu, X., Sun, X., Xu, K., Deng, H., Chen, J., Wei, Z., & Lei, M. (2019) · InfoMat · doi:10.1002/inf2.12028 · Cited by 1,069
Metadata
- Authors
- Cambria, E., & White, B.
- Venue
- IEEE Computational Intelligence Magazine
- Published
- 2014-05
- Volume
- 9
- Issue
- 2
- Pages
- 48-57
- ISSN
- 1556-603X (ISSN-L)
- OpenAlex
- W2028140375
- Cited by
- 1,102
- References
- 77
- FWCI
- 61.07
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.