The DOI matches its Crossref record; 108 of the 108 references it cites were found in a registry or an index.
Neural Network Methods for Natural Language Processing
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The text we found for this paper looks like another document, so the self-check wasn’t run.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
(2014) · Cited by 33,419
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Advances in neural information processing systems 7
Cios, K. J., & Shields, M. E. (1997) · Neurocomputing · doi:10.1016/s0925-2312(97)90018-7 · Cited by 22,093
Multilayer feedforward networks are universal approximators
Hornik, K., Stinchcombe, M., & White, H. (1989) · Neural Networks · doi:10.1016/0893-6080(89)90020-8 · Cited by 21,728
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.123 · Cited by 19,741
Approximation by superpositions of a sigmoidal function
Cybenko, G. (1989) · Mathematics of Control, Signals, and Systems · doi:10.1007/bf02551274 · Cited by 13,883
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
A training algorithm for optimal margin classifiers
Boser, B. E., Guyon, I. M., & Vapnik, V. N. (1992) · Proceedings of the fifth annual workshop on Computational learning theory · doi:10.1145/130385.130401 · Cited by 11,992
Introduction to Information Retrieval
Manning, C. D., Raghavan, P., & Schütze, H. (2008) · doi:10.1017/cbo9780511809071 · Cited by 11,288
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Bidirectional recurrent neural networks
Schuster, M., & Paliwal, K. K. (1997) · IEEE Transactions on Signal Processing · doi:10.1109/78.650093 · Cited by 10,172
Foundations of statistical natural language processing
Manning, C. D., & Schütze, H. (1999) · Cited by 9,816
Advances in Neural Information Processing Systems 14
(2002) · The MIT Press eBooks · doi:10.7551/mitpress/1120.001.0001 · Cited by 9,187
Greff, K., Srivastava, R. K., Koutnik, J., Steunebrink, B. R., & Schmidhuber, J. (2017) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2016.2582924 · Cited by 6,955
Opinion mining and sentiment analysis
Pang, B., & Lee, L. (2008) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000011 · Cited by 6,372
Show and tell: A neural image caption generator
Vinyals, O., Toshev, A., Bengio, S., & Erhan, D. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298935 · Cited by 6,318
Bengio, Y., Louradour, J., Collobert, R., & Weston, J. (2009) · Proceedings of the 26th Annual International Conference on Machine Learning · doi:10.1145/1553374.1553380 · Cited by 5,366
A unified architecture for natural language processing: deep neural networks with multitask learning
Collobert, R., & Weston, J. (2008) · Proceedings of the 25th international conference on Machine learning - ICML '08 · doi:10.1145/1390156.1390177 · Cited by 5,058
(1998) · The MIT Press eBooks · doi:10.7551/mitpress/7287.001.0001 · Cited by 5,002
Deep visual-semantic alignments for generating image descriptions
Karpathy, A., & Fei-Fei, L. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298932 · Cited by 4,902
Backpropagation through time: what it does and how to do it
Werbos, P. J. (1990) · Proceedings of the IEEE · doi:10.1109/5.58337 · Cited by 4,879
Harris, Z. S. (1954) · WORD · doi:10.1080/00437956.1954.11659520 · Cited by 4,807
Convolutional networks for images, speech, and time series
LeCun, Y., & Bengio, Y. (1998) · HAL · doi:10.5555/303568.303704 · Cited by 4,646
The approximation of one matrix by another of lower rank
Eckart, C., & Young, G. (1936) · Psychometrika · doi:10.1007/bf02288367 · Cited by 4,497
Regression Shrinkage and Selection via The Lasso: A Retrospective
Tibshirani, R. J. (2011) · Journal of the Royal Statistical Society Series B (Statistical Methodology) · doi:10.1111/j.1467-9868.2011.00771.x · Cited by 3,601
Speech and language processing
Politt, R., Pollock, J., & Waller, E. (2010) · Taylor & Francis eBooks · doi:10.4324/9780203461891_chapter_3 · Cited by 3,594
Supervised Sequence Labelling with Recurrent Neural Networks
Graves, A. (2012) · Studies in Computational Intelligence · doi:10.1007/978-3-642-24797-2 · Cited by 3,120
Understanding Machine Learning: From Theory to Algorithms
Shalev-Shwartz, S., & Ben-David, S. (2014) · doi:10.1017/cbo9781107298019 · Cited by 3,115
Some methods of speeding up the convergence of iteration methods
Polyak, B. T. (1964) · USSR Computational Mathematics and Mathematical Physics · doi:10.1016/0041-5553(64)90137-5 · Cited by 3,069
From Frequency to Meaning: Vector Space Models of Semantics
Turney, P. D., & Pantel, P. (2010) · Journal of Artificial Intelligence Research · doi:10.1613/jair.2934 · Cited by 2,949
Introductory Lectures on Convex Optimization
Nesterov, Y. E. (2004) · Applied optimization · doi:10.1007/978-1-4419-8853-9 · Cited by 2,734
Advances in Neural Information Processing Systems 20
Bonilla, E. V., Chai, K. M. A., & Williams, C. K. I. (2008) · neural information processing systems · Cited by 2,701
Practical Recommendations for Gradient-Based Training of Deep Architectures
Bengio, Y. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-35289-8_26 · Cited by 2,259
Stochastic Gradient Descent Tricks
Bottou, L. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-35289-8_25 · Cited by 2,168
Leshno, M., Lin, V. Y., Pinkus, A., & Schocken, S. (1993) · Neural Networks · doi:10.1016/s0893-6080(05)80131-5 · Cited by 2,121
An empirical study of smoothing techniques for language modeling
Chen, S. F., & Goodman, J. (1999) · Computer Speech & Language · doi:10.1006/csla.1999.0128 · Cited by 2,100
Discriminative training methods for hidden Markov models
Collins, M. (2002) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1118693.1118694 · Cited by 1,881
The PASCAL Recognising Textual Entailment Challenge
Dagan, I., Glickman, O., & Magnini, B. (2006) · Lecture notes in computer science · doi:10.1007/11736790_9 · Cited by 1,674
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Černocký, J., & Khudanpur, S. P. (2011) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2011.5947611 · Cited by 1,622
Design challenges and misconceptions in named entity recognition
Ratinov, L., & Roth, D. (2009) · Conference on Computational Natural Language Learning · doi:10.3115/1596374.1596399 · Cited by 1,473
Improved backing-off for M-gram language modeling
Kneser, R., & Ney, H. (2002) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.1995.479394 · Cited by 1,471
Improving Distributional Similarity with Lessons Learned from Word Embeddings
Levy, O., Goldberg, Y., & Dagan, I. (2015) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00134 · Cited by 1,344
Self-citationA Primer on Neural Network Models for Natural Language Processing
Goldberg, Y. (2016) · Journal of Artificial Intelligence Research · doi:10.1613/jair.4992 · Cited by 1,316
Self-citationImproving deep neural networks for LVCSR using rectified linear units and dropout
Dahl, G. E., Sainath, T. N., & Hinton, G. E. (2013) · 2013 IEEE International Conference on Acoustics, Speech and Signal Processing · doi:10.1109/icassp.2013.6639346 · Cited by 1,310
Mining the Web for Synonyms: PMI-IR versus LSA on TOEFL
Turney, P. D. (2001) · Lecture notes in computer science · doi:10.1007/3-540-44795-4_42 · Cited by 1,305
Foundations of Machine Learning
(2012) · The MIT Press eBooks · doi:10.7551/mitpress/8291.003.0006 · Cited by 1,151
Word association norms, mutual information, and lexicography
Church, K. W., & Hanks, P. (1989) · Proceedings of the 27th annual meeting on Association for Computational Linguistics - · doi:10.3115/981623.981633 · Cited by 1,094
Feature hashing for large scale multitask learning
Weinberger, K. Q., Dasgupta, A., Langford, J. C., Smola, A. J., & Attenberg, J. (2009) · International Conference on Machine Learning · doi:10.1145/1553374.1553516 · Cited by 928
LeCun, Y., Bottou, L., Orr, G., & Müller, K. R. (1998) · Lecture notes in computer science · doi:10.1007/3-540-49430-8_2 · Cited by 920
Coarse-to-fine n -best parsing and MaxEnt discriminative reranking
Eugene Charniak, D., & Johnson, M. (2005) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1219840.1219862 · Cited by 878
Statistical Machine Translation
Koehn, P. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815829 · Cited by 874
Recursive distributed representations
Pollack, J. B. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90005-k · Cited by 848
Extracting semantic representations from word co-occurrence statistics: A computational study
Bullinaria, J. A., & Levy, J. P. (2007) · Behavior Research Methods · doi:10.3758/bf03193020 · Cited by 823
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies
Linzen, T., Emmanuel Dupoux, A., & Goldberg, Y. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00115 · Cited by 820
Self-citationOnline large-margin training of dependency parsers
McDonald, R., Crammer, K., & Pereira, F. M. B. (2005) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1219840.1219852 · Cited by 795
A bit of progress in language modeling
Goodman, J. (2001) · Computer Speech and Language · doi:10.1006/csla.2001.0174 · Cited by 744
Discriminative Reranking for Natural Language Parsing
Collins, M., & Koo, T. (2005) · Computational Linguistics · doi:10.1162/0891201053630273 · Cited by 711
Distributional Memory: A General Framework for Corpus-Based Semantics
Baroni, M., & Lenci, A. (2010) · Computational Linguistics · doi:10.1162/coli_a_00016 · Cited by 660
Purely Functional Data Structures
Okasaki, C. (1998) · Cambridge University Press eBooks · doi:10.1017/cbo9780511530104 · Cited by 635
Bakir, G. H., Hofmann, T., Schölkopf, B., Smola, A. J., Taskar, B., & Vishwanathan, S. V. N. (2007) · The MIT Press eBooks · doi:10.7551/mitpress/7443.001.0001 · Cited by 579
Caruana, R. (1998) · Learning to Learn · doi:10.1007/978-1-4615-5529-2_5 · Cited by 577
Neural Probabilistic Language Models
Bengio, Y., Schwenk, H., Senécal, J.-S., Morin, F., & Gauvain, J. (2006) · Springer eBooks · doi:10.1007/3-540-33486-6_6 · Cited by 557
A maximum entropy approach to adaptive statistical language modelling
Rosenfeld, R. (1996) · Computer Speech & Language · doi:10.1006/csla.1996.0011 · Cited by 546
Dropout improves Recurrent Neural Networks for Handwriting RecognitionPreprint
(2016) · Cited by 533
Computational methods in authorship attribution
Koppel, M., Schler, J., & Argamon, S. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20961 · Cited by 528
Search-based structured prediction
Daumé, H., Langford, J. C., & Marcu, D. (2009) · Machine Learning · doi:10.1007/s10994-009-5106-x · Cited by 495
Sahlgren, M. (2008) · KTH Publication Database DiVA (KTH Royal Institute of Technology) · Cited by 459
Algorithms for Deterministic Incremental Dependency Parsing
Nivre, J. (2008) · Computational Linguistics · doi:10.1162/coli.07-056-r1-07-027 · Cited by 440
Neural Machine Translation in Linear Time
Kalchbrenner, N., Espeholt, L., Simonyan, K., Oord, A. V. D., Graves, A., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1610.10099 · Cited by 414
Italian Journal of Linguistics
Cennamo, M. (2006) · Cited by 351
Unsupervised models for morpheme segmentation and morphology learning
Creutz, M., & Lagus, K. (2007) · ACM Transactions on Speech and Language Processing · doi:10.1145/1187415.1187418 · Cited by 340
Factored language models and generalized parallel backoff
Bilmes, J., & Kirchhoff, K. (2003) · doi:10.3115/1073483.1073485 · Cited by 287
Introduction to Automatic Differentiation and MATLAB Object-Oriented Programming
Neidinger, R. D. (2010) · SIAM Review · doi:10.1137/080743627 · Cited by 277
Transcending Boundaries: Improvisation and Disability in Dance
Whatley, S. (2019) · Pure (Coventry University) · doi:10.1093/oxfordhb · Cited by 265
Structures, Not Strings: Linguistics as Part of the Cognitive Sciences
Everaert, M. B. H., Huybregts, M. A. C., Chomsky, N., Berwick, R. C., & Bolhuis, J. J. (2015) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2015.09.008 · Cited by 260
Firth, J. R. (1935) · Transactions of the Philological Society · doi:10.1111/j.1467-968x.1935.tb01254.x · Cited by 251
A high-performance semi-supervised learning method for text chunking
Ando, R. K., & Zhang, T. (2005) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1219840.1219841 · Cited by 224
Recognizing textual entailment models and applications
Dagan, I. (2013) · Cited by 205
Fast methods for kernel-based text analysis
Kudo, T., & Matsumoto, Y. (2003) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/1075096.1075100 · Cited by 204
Kannan, A., Kurach, K., Ravi, S., Kaufmann, T., Tomkins, A., Miklos, B., Corrado, G. S., Lukacs, L., Ganea, M., Young, P., et al. (2016) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/2939672.2939801 · Cited by 200
Kübler, S., McDonald, R., & Nivre, J. (2009) · Synthesis lectures on human language technologies · doi:10.2200/s00169ed1v01y200901hlt002 · Cited by 181
8th Annual Conference of the International Speech Communication Association
Murray, G., & Renals, S. J. (2007) · Cited by 166
Efficient parsing for bilexical context-free grammars and head automaton grammars
Eisner, J. M., & Satta, G. (1999) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.3115/1034678.1034748 · Cited by 155
Disambiguation of super parts of speech (or supertags)
Joshi, A. K., & Srinivas, B. (1994) · International Conference on Computational Linguistics · doi:10.3115/991886.991912 · Cited by 134
Continuous space language models for statistical machine translation
Schwenk, H., Dchelotte, D., & Gauvain, J. (2006) · International Conference on Computational Linguistics and Annual Meeting of the Association for Computational Linguistics (COLING/ACL) · doi:10.3115/1273073.1273166 · Cited by 131
Similarity-based estimation of word cooccurrence probabilities
Dagan, I., Pereira, F. M. B., & Lee, L. (1994) · Annual Meeting of the Association for Computational Linguistics (ACL) · doi:10.3115/981732.981770 · Cited by 119
Training Deterministic Parsers with Non-Deterministic Oracles
Goldberg, Y., & Nivre, J. (2013) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00237 · Cited by 112
Self-citationRecursive hetero-associative memories for translation
Forcada, M. L., & Ñeco, R. P. (1997) · Lecture notes in computer science · doi:10.1007/bfb0032504 · Cited by 92
On the Alias Method for Generating Random Variables from a Discrete Distribution
Kronmal, R. A., & Peterson, A. V. (1979) · The American Statistician · doi:10.2307/2683739 · Cited by 88
Litkowski, K., & Hargraves, O. (2007) · doi:10.3115/1621474.1621479 · Cited by 76
Linguistic Fundamentals for Natural Language Processing
Bender, E. M. (2013) · Synthesis lectures on human language technologies · doi:10.2200/s00493ed1v01y201303hlt020 · Cited by 74
Long Short-Term Memory Over Tree StructuresPreprint
Zhu, X., Sobhani, P., & Guo, H. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1503.04881 · Cited by 68
Semi-Supervised Learning and Domain Adaptation in Natural Language Processing
Søgaard, A. (2013) · Synthesis lectures on human language technologies · doi:10.2200/s00497ed1v01y201304hlt021 · Cited by 49
Nivre, J. (2025) · HAL (Le Centre pour la Communication Scientifique Directe) · doi:10.57702/iv87i78q · Cited by 47
Facial Ethnicity Classification with Deep Convolutional Neural Networks
Wang, W., He, F., & Zhao, Q. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46654-5_20 · Cited by 41
Improved CCG Parsing with Semi-supervised Supertagging
Lewis, M., & Steedman, M. J. (2014) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00186 · Cited by 40
Linguistic Structure Prediction
Smith, N. A. (2011) · Synthesis lectures on human language technologies · doi:10.2200/s00361ed1v01y201105hlt013 · Cited by 35
Rule refinement with recurrent neural networks
Giles, C. L., & Omlin, C. W. P. (2002) · IEEE International Conference on Neural Networks/IEEE ... International Conference on Neural Networks · doi:10.1109/icnn.1993.298658 · Cited by 31
Lee, G., Flowers, M., & Dyer, M. G. (1992) · Springer eBooks · doi:10.1007/978-94-011-2624-3_11 · Cited by 22
A study of English word category prediction based on neural networks
Nakamura, M., & Shikano, K. (1988) · The Journal of the Acoustical Society of America · doi:10.1121/1.2026400 · Cited by 17
Syntax-based Statistical Machine Translation
Williams, P. J., Sennrich, R., Post, M., & Koehn, P. (2016) · Synthesis lectures on human language technologies · doi:10.2200/s00716ed1v04y201604hlt033 · Cited by 12
A short floating-point type in C++
Smith, W. (1994) · C/C++ users journal · Cited by 9
Sparse Non-negative Matrix Language Modeling
Pelemans, J., Shazeer, N., & Chelba, C. I. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00102 · Cited by 5
Cristianini, N., Shawe-Taylor, J. S., & Saunders, C. J. (2011) · IGI Global eBooks · doi:10.4018/9781599040424.ch001 · Cited by 1
Cited by
Sorted by citations
A survey of deep learning techniques for autonomous driving
Grigorescu, S., Trasnea, B., Cocias, T., & Macesanu, G. (2020) · Journal of Field Robotics · doi:10.1002/rob.21918 · Cited by 1,809
Natural language processing: state of the art, current trends and challenges
Khurana, D., Koli, A., Khatter, K., & Singh, S. (2023) · Multimedia Tools and Applications · doi:10.1007/s11042-022-13428-4 · Cited by 1,823
A Survey of the Usages of Deep Learning for Natural Language Processing
Otter, D. W., Medina, J. R., & Kalita, J. K. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2979670 · Cited by 1,836
Attention in Natural Language Processing
Galassi, A., Lippi, M., & Torroni, P. (2020) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.3019893 · Cited by 726
“What this survey does not offer is a comprehensive account of all the neural architectures for NLP (for an excellent overview, see [131]) or of all the neural architectures for NLP that uses an attention mechanism.”
Yang, F., Wang, W., Wang, F., Fang, Y., Tang, D., Huang, J., Lu, H., & Yao, J. (2021) · doi:10.1101/2021.12.05.471261 · Cited by 617
Metadata
- Authors
- Goldberg, Y.
- Affiliations
- Bar-Ilan University (IL)
- Corresponding author
- Goldberg, Yoav
- ORCID
- Goldberg, Yoav
- Venue
- Synthesis Lectures on Human Language Technologies
- Publisher
- Springer International Publishing
- Published
- 2017
- ISSN
- 1947-4040 (ISSN-L)
- 1947-4059
- OpenAlex
- W2606089314
- Semantic Scholar
- 6c27d9844fcb94dfcd6decab7df559134d6d4fd7
- Cited by
- 821
- References
- 75
- Citations by year
- 2026: 38 · 2025: 72 · 2024: 60 · 2023: 101 · 2022: 111 · 2021: 134 · 2020: 142 · 2019: 92 · 2018: 64 · 2017: 6
- FWCI
- 37.46
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Synthesis lectures on human language technologies (publishedVersion)
- CERN Document Server (European Organization for Nuclear Research) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Speech Recognition and Synthesis
- Keywords
- artificial neural networks, natural language processing, machine learning models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
