The DOI matches its Crossref record; 170 of the 170 references it cites were found in a registry or an index.
Analysis Methods in Neural Language Processing: A Survey
Open accessAbstract
The field of natural language processing has seen impressive progress in recent years, with neural network models replacing many of the traditional systems. A plethora of new models have been proposed, many of which are thought to be opaque compared to their feature-rich counterparts. This has led researchers to analyze, interpret, and evaluate neural networks in novel and more fine-grained ways. In this survey paper, we review analysis methods in neural language processing, categorize them according to prominent research trends, highlight existing limitations, and point to potential directions for future work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
GAN(Generative Adversarial Nets)
(2017) · Journal of Japan Society for Fuzzy Theory and Intelligent Informatics · doi:10.3156/jsoft.29.5_177_2 · Cited by 19,270
Sequence to Sequence Learning with Neural Networks
Sutskever, I., Vinyals, O., & Le, Q. V. (2014) · arXiv · doi:10.48550/arxiv.1409.3215 · Cited by 17,766
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213
Elman, J. L. (1990) · Cognitive Science · doi:10.1207/s15516709cog1402_1 · Cited by 11,212
Lipton, Z. C. (2018) · Queue · doi:10.1145/3236386.3241340 · Cited by 5,427
Recurrent neural network based language model
Mikolov, T., Karafiát, M., Burget, L., Černocký, J., & Khudanpur, S. (2010) · Interspeech 2010 · doi:10.21437/interspeech.2010-343 · Cited by 5,390
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding
Wang, A., Singh, A., Michael, J., Hill, F., Levy, O., & Bowman, S. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5446 · Cited by 4,222
Axiomatic attribution for deep networks
Sundararajan, M., Taly, A., & Yan, Q. (2017) · arXiv · doi:10.48550/arxiv.1703.01365 · Cited by 4,087
Practical Black-Box Attacks against Machine Learning
Papernot, N., McDaniel, P., Goodfellow, I., Jha, S., Celik, Z. B., & Swami, A. (2017) · Proceedings of the 2017 ACM on Asia Conference on Computer and Communications Security · doi:10.1145/3052973.3053009 · Cited by 3,495
A large annotated corpus for learning natural language inference
Bowman, S. R., Angeli, G., Potts, C., & Manning, C. D. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1075 · Cited by 3,377
Towards A Rigorous Science of Interpretable Machine Learning
Doshi-Velez, F., & Kim, B. (2017) · arXiv · doi:10.48550/arxiv.1702.08608 · Cited by 3,121
Methods for interpreting and understanding deep neural networks
Montavon, G., Samek, W., & Müller, K.-R. (2018) · Digital Signal Processing · doi:10.1016/j.dsp.2017.10.011 · Cited by 2,665
A Neural Attention Model for Abstractive Sentence Summarization
Rush, A. M., Chopra, S., & Weston, J. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1044 · Cited by 2,656
(2009) · Cited by 1,900
Adversarial Examples: Attacks and Defenses for Deep Learning
Yuan, X., He, P., Zhu, Q., & Li, X. (2019) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2018.2886017 · Cited by 1,733
Extensions of recurrent neural network language model
Mikolov, T., Kombrink, S., Burget, L., Cernocky, J., & Khudanpur, S. (2011) · 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) · doi:10.1109/icassp.2011.5947611 · Cited by 1,568
SemEval-2017 Task 1: Semantic Textual Similarity Multilingual and Crosslingual Focused Evaluation
Cer, D., Diab, M., Agirre, E., Lopez-Gazpio, I., & Specia, L. (2017) · Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) · doi:10.18653/v1/s17-2001 · Cited by 1,562
Adversarial Examples for Evaluating Reading Comprehension Systems
Jia, R., & Liang, P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1215 · Cited by 1,410
Distributed representations, simple recurrent networks, and grammatical structure
Elman, J. L. (1991) · Machine Learning · doi:10.1007/bf00114844 · Cited by 1,354
Transferability in Machine Learning: from Phenomena to Black-Box Attacks using Adversarial Samples
Papernot, N., McDaniel, P., & Goodfellow, I. (2016) · arXiv · doi:10.48550/arxiv.1605.07277 · Cited by 1,326
Delving into Transferable Adversarial Examples and Black-box Attacks
Liu, Y., Chen, X., Liu, C., & Song, D. (2016) · arXiv · doi:10.48550/arxiv.1611.02770 · Cited by 1,310
SimLex-999: Evaluating Semantic Models With (Genuine) Similarity Estimation
Hill, F., Reichart, R., & Korhonen, A. (2015) · Computational Linguistics · doi:10.1162/coli_a_00237 · Cited by 1,175
Placing search in context: the concept revisited.
Finkelstein, L., Gabrilovich, E., Matias, Y., Rivlin, E., Solan, Z., Wolfman, G., & Ruppin, E. (2002) · Cited by 961
Visual interpretability for deep learning: a survey
Zhang, Q.-S., & Zhu, S.-C. (2018) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1700808 · Cited by 950
ABCNN: Attention-Based Convolutional Neural Network for Modeling Sentence Pairs
Yin, W., Schütze, H., Xiang, B., & Zhou, B. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00097 · Cited by 924
HotFlip: White-Box Adversarial Examples for Text Classification
Ebrahimi, J., Rao, A., Lowd, D., & Dou, D. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2006 · Cited by 922
Annotation Artifacts in Natural Language Inference Data
Gururangan, S., Swayamdipta, S., Levy, O., Schwartz, R., Bowman, S., & Smith, N. A. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2017 · Cited by 907
Recursive distributed representations
Pollack, J. B. (1990) · Artificial Intelligence · doi:10.1016/0004-3702(90)90005-k · Cited by 852
Visualizing and Understanding Recurrent Networks
Karpathy, A., Johnson, J., & Fei-Fei, L. (2015) · arXiv · doi:10.48550/arxiv.1506.02078 · Cited by 845
Exploring the Limits of Language Modeling
Józefowicz, R., Vinyals, O., Schuster, M., Shazeer, N., & Wu, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1602.02410 · Cited by 823
Neural Network Methods for Natural Language Processing
Goldberg, Y. (2017) · Synthesis Lectures on Human Language Technologies · doi:10.1007/978-3-031-02165-7 · Cited by 821
Generating Natural Language Adversarial Examples
Alzantot, M., Sharma, Y., Elgohary, A., Ho, B.-J., Srivastava, M., & Chang, K.-W. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1316 · Cited by 787
Better Word Representations with Recursive Neural Networks for Morphology
Luong, M.-T., Socher, R., & Manning, C. D. (2013) · Conference on Computational Natural Language Learning · Cited by 786
Rationalizing Neural Predictions
Lei, T., Barzilay, R., & Jaakkola, T. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1011 · Cited by 777
Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies
Linzen, T., Dupoux, E., & Goldberg, Y. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00115 · Cited by 737
LSTM recurrent networks learn simple context-free and context-sensitive languages
Gers, F. A., & Schmidhuber, E. (2001) · IEEE Transactions on Neural Networks · doi:10.1109/72.963769 · Cited by 722
Black-Box Generation of Adversarial Text Sequences to Evade Deep Learning Classifiers
Gao, J., Lanchantin, J., Soffa, M. L., & Qi, Y. (2018) · 2018 IEEE Security and Privacy Workshops (SPW) · doi:10.1109/spw.2018.00016 · Cited by 693
Gender bias in coreference resolution: Evaluation and debiasing methods
Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K.-W. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2003 · Cited by 684
What you can cram into a single $&!#* vector: Probing sentence embeddings for linguistic properties
Conneau, A., Kruszewski, G., Lample, G., Barrault, L., & Baroni, M. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1198 · Cited by 657
Visualizing and Understanding Neural Models in NLP
Li, J., Chen, X., Hovy, E., & Jurafsky, D. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.18653/v1/n16-1082 · Cited by 625
Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature Representations
Kiperwasser, E., & Goldberg, Y. (2016) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00101 · Cited by 615
Adversarial Example Generation with Syntactically Controlled Paraphrase Networks
Iyyer, M., Wieting, J., Gimpel, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1170 · Cited by 615
Explainable Prediction of Medical Codes from Clinical Text
Mullenbach, J., Wiegreffe, S., Duke, J., Sun, J., & Eisenstein, J. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1100 · Cited by 597
Reasoning about Entailment with Neural Attention
Rocktäschel, T., Grefenstette, E., Hermann, K. M., Kočiský, T., & Blunsom, P. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1509.06664 · Cited by 582
Generating Natural Adversarial Examples
Zhao, Z., Dua, D., & Singh, S. (2017) · arXiv · doi:10.48550/arxiv.1710.11342 · Cited by 508
Hypothesis Only Baselines in Natural Language Inference
Poliak, A., Naradowsky, J., Haldar, A., Rudinger, R., & Van Durme, B. (2018) · Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics · doi:10.18653/v1/s18-2023 · Cited by 480
Colorless Green Recurrent Networks Dream Hierarchically
Gulordava, K., Bojanowski, P., Grave, E., Linzen, T., & Baroni, M. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1108 · Cited by 465
Accountability of AI Under the Law: The Role of Explanation
Doshi-Velez, F., Kortz, M., Budish, R., Bavitz, C., Gershman, S. J., O'Brien, D., Scott, K., Shieber, S., Waldo, J., Weinberger, D., et al. (2017) · doi:10.2139/ssrn.3064761 · Cited by 457 · cited 3×
“With the increasing public demand for explaining algorithmic choices in machine learning systems (Doshi-Velez and Kim, 2017; Doshi-Velez et al., 2017), there is pressing need for progress in this direction.”
BackgroundGender Bias in Coreference Resolution
Rudinger, R., Naradowsky, J., Leonard, B., & Van Durme, B. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2002 · Cited by 443
Dissecting Contextual Word Embeddings: Architecture and Representation
Peters, M., Neumann, M., Zettlemoyer, L., & Yih, W.-T. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1179 · Cited by 434
Semantically Equivalent Adversarial Rules for Debugging NLP models
Ribeiro, M. T., Singh, S., & Guestrin, C. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1079 · Cited by 432
Placing search in context: the concept revisited
(2002) · ACM Transactions on Information Systems · doi:10.1145/503104.503110 · Cited by 425
Crafting adversarial input sequences for recurrent neural networks
Papernot, N., McDaniel, P., Swami, A., & Harang, R. (2016) · MILCOM 2016 - 2016 IEEE Military Communications Conference · doi:10.1109/milcom.2016.7795300 · Cited by 419
Multimodal Explanations: Justifying Decisions and Pointing to the Evidence
Park, D. H., Hendricks, L. A., Akata, Z., Rohrbach, A., Schiele, B., Darrell, T., & Rohrbach, M. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00915 · Cited by 418
Understanding Neural Networks through Representation Erasure
Li, J., Monroe, W., & Jurafsky, D. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.08220 · Cited by 412
Marelli, M., Bentivogli, L., Baroni, M., Bernardi, R., Menini, S., & Zamparelli, R. (2014) · Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014) · doi:10.3115/v1/s14-2001 · Cited by 378
LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks
Strobelt, H., Gehrmann, S., Pfister, H., & Rush, A. M. (2018) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2017.2744158 · Cited by 371
Deep Text Classification Can be Fooled
Liang, B., Li, H., Su, M., Bian, P., Li, X., & Shi, W. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/585 · Cited by 370
Explaining Recurrent Neural Network Predictions in Sentiment Analysis
Arras, L., Montavon, G., Müller, K.-R., & Samek, W. (2017) · Proceedings of the 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis · doi:10.18653/v1/w17-5221 · Cited by 361
Evaluating Discourse Phenomena in Neural Machine Translation
Bawden, R., Sennrich, R., Birch, A., & Haddow, B. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1118 · Cited by 341
Distributional Semantics in Technicolor
Bruni, E., Boleda, G., Baroni, M., & Tran, N. K. (2012) · Iris (University of Trento) · Cited by 332
Simple Black-Box Adversarial Attacks on Deep Neural Networks
Narodytska, N., & Kasiviswanathan, S. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2017.172 · Cited by 320
Breaking NLI Systems with Sentences that Require Simple Lexical Inferences
Glockner, M., Shwartz, V., & Goldberg, Y. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2103 · Cited by 319
What do Neural Machine Translation Models Learn about Morphology?
Belinkov, Y., Durrani, N., Dalvi, F., Sajjad, H., & Glass, J. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1080 · Cited by 307
Self-citationSharp nearby, fuzzy far away: How neural language models use context
Khandelwal, U., He, H., Qi, P., & Jurafsky, D. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1027 · Cited by 303
Stress Test Evaluation for Natural Language InferencePreprint
Naik, A., Ravichander, A., Sadeh, N., Rosé, C. P., & Neubig, G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.00692 · Cited by 303
Does String-Based Neural MT Learn Source Syntax?
Shi, X., Padhi, I., & Knight, K. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1159 · Cited by 300
(2018) · International Conference on Learning Representations · Cited by 285
Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks
Adi, Y., Kermany, E., Belinkov, Y., Lavi, O., & Goldberg, Y. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1608.04207 · Cited by 283
Self-citationContext-Aware Neural Machine Translation Learns Anaphora Resolution
Voita, E., Serdyukov, P., Sennrich, R., & Titov, I. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1117 · Cited by 279
Adversarial Diversity and Hard Positive Generation
Rozsa, A., Rudd, E. M., & Boult, T. E. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · doi:10.1109/cvprw.2016.58 · Cited by 258
"What is relevant in a text document?": An interpretable machine learning approach
Arras, L., Horn, F., Montavon, G., Müller, K.-R., & Samek, W. (2017) · PLOS ONE · doi:10.1371/journal.pone.0181142 · Cited by 257
Using “annotator rationales” to improve machine learning for text categorization
Zaidan, O. F., Eisner, J. M., & Piatko, C. (2007) · Cited by 252
Rationale-Augmented Convolutional Neural Networks for Text Classification
Zhang, Y., Marshall, I., & Wallace, B. C. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1076 · Cited by 249
Problems With Evaluation of Word Embeddings Using Word Similarity Tasks
Faruqui, M., Tsvetkov, Y., Rastogi, P., & Dyer, C. (2016) · Proceedings of the 1st Workshop on Evaluating Vector-Space Representations for NLP · doi:10.18653/v1/w16-2506 · Cited by 246
Pathologies of Neural Models Make Interpretations Difficult
Feng, S., Wallace, E., Grissom II, A., Iyyer, M., Rodriguez, P., & Boyd-Graber, J. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1407 · Cited by 245
Seq2seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Models
Strobelt, H., Gehrmann, S., Behrisch, M., Perer, A., Pfister, H., & Rush, A. M. (2019) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2018.2865044 · Cited by 239
Towards Crafting Text Adversarial SamplesPreprint
Samanta, S., & Mehta, S. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1707.02812 · Cited by 229
On the Practical Computational Power of Finite Precision RNNs for Language Recognition
Weiss, G., Goldberg, Y., & Yahav, E. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · doi:10.18653/v1/p18-2117 · Cited by 226
Understanding Convolutional Neural Networks for Text Classification
Jacovi, A., Sar Shalom, O., & Goldberg, Y. (2018) · Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP · doi:10.18653/v1/w18-5408 · Cited by 226
SimVerb-3500: A Large-Scale Evaluation Set of Verb Similarity
Gerz, D., Vulić, I., Hill, F., Reichart, R., & Korhonen, A. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1235 · Cited by 218
Seq2Sick: Evaluating the Robustness of Sequence-to-Sequence Models with Adversarial Examples
Cheng, M., Yi, J., Chen, P.-Y., Zhang, H., & Hsieh, C.-J. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i04.5767 · Cited by 217
Adversarial Examples: Attacks and Defenses for Deep Learning
Yuan, X., He, P. L., Zhu, Q., & Li, X. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1712.07107 · Cited by 213
Understanding Hidden Memories of Recurrent Neural Networks
Ming, Y., Cao, S., Zhang, R., Li, Z., Chen, Y., Song, Y., & Qu, H. (2017) · 2017 IEEE Conference on Visual Analytics Science and Technology (VAST) · doi:10.1109/vast.2017.8585721 · Cited by 207
Beyond Word Importance: Contextual Decomposition to Extract Interactions from LSTMsPreprint
Murdoch, W. J., Liu, P. J., & Yu, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.05453 · Cited by 192
On Adversarial Examples for Character-Level Neural Machine TranslationPreprint
Ebrahimi, J., Lowd, D., & Dou, D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.09030 · Cited by 190
Natural language processing with modular pdp networks and distributed lexicon
MIIKKULAINEN, R., & DYER, M. (1991) · Cognitive Science · doi:10.1016/0364-0213(91)80002-m · Cited by 183
A causal framework for explaining the predictions of black-box sequence-to-sequence models
Alvarez-Melis, D., & Jaakkola, T. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1042 · Cited by 178
Representation and Structure in Connectionist Models
Elman, J. L. (1989) · doi:10.21236/ada259504 · Cited by 176
Casey, M. (1996) · Neural Computation · doi:10.1162/neco.1996.8.6.1135 · Cited by 174
Visualizing and Understanding Neural Machine Translation
Ding, Y., Liu, Y., Luan, H., & Sun, M. (2017) · Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p17-1106 · Cited by 168
Chen, H., Zhang, H., Chen, P., Yi, J., & Hsieh, C. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1241 · Cited by 167
Did the Model Understand the Question?
Mudrakarta, P. K., Taly, A., Sundararajan, M., & Dhamdhere, K. (2018) · Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/p18-1176 · Cited by 166
Sparse Overcomplete Word Vector Representations
Faruqui, M., Tsvetkov, Y., Yogatama, D., Dyer, C., & Smith, N. A. (2015) · doi:10.3115/v1/p15-1144 · Cited by 166
Identifying and Controlling Important Neurons in Neural Machine TranslationPreprint
Bau, A., Belinkov, Y., Sajjad, H., Durrani, N., Dalvi, F., & Glass, J. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01157 · Cited by 165
Self-citationThe Importance of Being Recurrent for Modeling Hierarchical Structure
Tran, K., Bisazza, A., & Monz, C. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1503 · Cited by 164
Interpretable Adversarial Perturbation in Input Embedding Space for Text
Sato, M., Suzuki, J., Shindo, H., & Matsumoto, Y. (2018) · Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2018/601 · Cited by 164
A Challenge Set Approach to Evaluating Machine Translation
Isabelle, P., Cherry, C., & Foster, G. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1263 · Cited by 158
Belinkov, Y., Màrquez, L., Sajjad, H., Durrani, N., Dalvi, F., & Glass, J. R. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.07772 · Cited by 157
Self-citationRepresentation of Linguistic Form and Function in Recurrent Neural Networks
Kádár, Á., Chrupała, G., & Alishahi, A. (2017) · Computational Linguistics · doi:10.1162/coli_a_00300 · Cited by 148
Learning Effective and Interpretable Semantic Models using Non-Negative Sparse Embedding
Murphy, B., Talukdar, P. P., & Mitchell, T. M. (2012) · Research Portal (Queen's University Belfast) · Cited by 147
Probing for semantic evidence of composition by means of simple classification tasks
Ettinger, A., Elgohary, A., & Resnik, P. (2016) · Workshop on Evaluating Vector-Space Representations for NLP · doi:10.18653/v1/w16-2524 · Cited by 147
Investigating gated recurrent networks for speech synthesis
Wu, Z., & King, S. (2016) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2016.7472657 · Cited by 136
Morphological Inflection Generation with Hard Monotonic Attention
Aharoni, R., & Goldberg, Y. (2016) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p17-1183 · Cited by 134
Representations of language in a model of visually grounded speech signal
Chrupała, G., Gelderloos, L., & Alishahi, A. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1057 · Cited by 133
Evaluating Compositionality in Sentence EmbeddingsPreprint
Dasgupta, I., Guo, D., Stuhlmüller, A., Gershman, S. J., & Goodman, N. D. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.04302 · Cited by 131
Hierarchical interpretations for neural network predictionsPreprint
Singh, C., Murdoch, W. J., & Yu, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.05337 · Cited by 126
Deep RNNs Encode Soft Hierarchical Syntax
Blevins, T., Levy, O., & Zettlemoyer, L. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2003 · Cited by 123
Improving Word Sense Disambiguation in Neural Machine Translation with Sense Embeddings
Rios, A., Mascarell, L., & Sennrich, R. (2017) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w17-4702 · Cited by 122
Do latent tree learning models identify meaningful structure in sentences?
Williams, A., Drozdov, A., & Bowman, S. R. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00019 · Cited by 112
Learning Word-Like Units from Joint Audio-Visual Analysis
Harwath, D. F., & Glass, J. R. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1047 · Cited by 108
Self-citationCollecting Diverse Natural Language Inference Problems for Sentence Representation Evaluation
Poliak, A., Haldar, A., Rudinger, R., Hu, J. E., Pavlick, E., White, A. S., & Durme, B. V. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1007 · Cited by 105
Tang, G., Sennrich, R., & Nivre, J. (2018) · Conference on Machine Translation (WMT) · doi:10.18653/v1/w18-6304 · Cited by 99
Pulman, S. (1996) · Cited by 98
Robsut Wrod Reocginiton via Semi-Character Recurrent Neural Network
Sakaguchi, K., Duh, K., Post, M., & Durme, B. V. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.10970 · Cited by 97
Greedy Attack and Gumbel Attack: Generating Adversarial Examples for Discrete DataPreprint
Yang, P., Chen, J., Hsieh, C., Wang, J.-L., & Jordan, M. I. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1805.12316 · Cited by 93
Interpreting Recurrent and Attention-Based Neural Models: a Case Study on Natural Language Inference
Ghaeini, R., Fern, X., & Tadepalli, P. (2018) · Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1537 · Cited by 91
Exploring how deep neural networks form phonemic categories
Nagamine, T., Seltzer, M. L., & Mesgarani, N. (2015) · Interspeech (USB) · doi:10.21437/interspeech.2015-422 · Cited by 83
Separated by an Un-common Language: Towards Judgment Language Informed Vector Space ModelingPreprint
Leviant, I., & Reichart, R. (2015) · arXiv (Cornell University) · doi:10.48550/arxiv.1508.00106 · Cited by 82
Distributional vectors encode referential attributes
Gupta, A., Boleda, G., Baroni, M., & Padó, S. (2015) · Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d15-1002 · Cited by 79
Interpreting Neural Networks to Improve Politeness Comprehension
Aubakirova, M., & Bansal, M. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1216 · Cited by 79
Why Neural Translations are the Right Length
Shi, X., Knight, K. K., & Yüret, D. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1248 · Cited by 79
A Linguistic Evaluation of Rule-Based, Phrase-Based, and Neural MT Engines
Burchardt, A., Macketanz, V., Dehdari, J., Heigold, G., Peter, J.-T., & Williams, P. J. (2017) · The Prague Bulletin of Mathematical Linguistics · doi:10.1515/pralin-2017-0017 · Cited by 78
Adversarial Over-Sensitivity and Over-Stability Strategies for Dialogue Models
Niu, T., & Bansal, M. (2018) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k18-1047 · Cited by 75
Adversarial Examples for Natural Language Classification Problems
Kuleshov, V., Thakoor, S., Lau, T., & Ermon, S. (2018) · Cited by 72
What’s Going On in Neural Constituency Parsers? An Analysis
Gaddy, D., Stern, M., & Klein, D. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1091 · Cited by 72
McCoy, R. T., Frank, R., & Linzen, T. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.09091 · Cited by 70
What’s in an Embedding? Analyzing Word Embeddings through Multilingual Evaluation
Köhn, A. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1246 · Cited by 69
Rotated Word Vector Representations and their Interpretability
Park, S., Bak, J., & Oh, A. H. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1041 · Cited by 69
Analyzing Hidden Representations in End-to-End Automatic Speech Recognition SystemsPreprint
Belinkov, Y., & Glass, J. R. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1709.04482 · Cited by 68
Self-citationEncoding of phonology in a recurrent neural model of grounded speech
Alishahi, A., Barking, M., & Chrupała, G. (2017) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k17-1037 · Cited by 65
A Compositional and Interpretable Semantic Space
Fyshe, A., Wehbe, L., Talukdar, P. P., Murphy, B., & Mitchell, T. M. (2015) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.3115/v1/n15-1004 · Cited by 63
Artetxe, M., Labaka, G., López-Gazpio, I., & Agirre, E. (2018) · Conference on Computational Natural Language Learning · doi:10.18653/v1/k18-1028 · Cited by 60
Investigating Language Universal and Specific Properties in Word Embeddings
Qian, P., Qiu, X., & Huang, X. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1140 · Cited by 58
A Tree-based Decoder for Neural Machine Translation
Wang, X., Pham, H., Yin, P., & Neubig, G. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1509 · Cited by 56
Word Representation Models for Morphologically Rich Languages in Neural Machine Translation
Vylomova, E., Cohn, T., He, X., & Haffari, G. (2017) · Workshop on Subword and Character Level Models in NLP (SCLeM) · doi:10.18653/v1/w17-4115 · Cited by 53
Understanding and Improving Morphological Learning in the Neural Machine Translation Decoder
Dalvi, F., Durrani, N., Sajjad, H., Belinkov, Y., & Vogel, S. (2017) · International Joint Conference on Natural Language Processing · Cited by 52
Self-citationRecurrent Neural Networks as Weighted Language Recognizers
Chen, Y., Gilroy, S., Maletti, A., May, J., & Knight, K. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1205 · Cited by 49
Heigold, G., Neumann, G., & van Genabith, J. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.04441 · Cited by 45
Behavior Analysis of NLI Models: Uncovering the Influence of Three Factors on Robustness
Sanchez, I., Mitchell, J., & Riedel, S. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1179 · Cited by 42
Analyzing Linguistic Knowledge in Sequential Model of Sentence
Qian, P., Qiu, X., & Huang, X. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1079 · Cited by 40
Diagnostic Classifiers: Revealing how Neural Networks Process Hierarchical Structure
Veldhoen, S., Hupkes, D., & Zuidema, W. H. (2016) · UvA-DARE (University of Amsterdam) · Cited by 36
Wang, Y., Chung, C.-T., & Lee, H.-Y. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-877 · Cited by 36
NeuroX: A Toolkit for Analyzing Individual Neurons in Neural Networks
Dalvi, F., Nortonsmith, A., Bau, A., Belinkov, Y., Sajjad, H., Durrani, N., & Glass, J. (2019) · AAAI Publications (The Association for the Advancement of Artificial Intelligence (AAAI)) · doi:10.1609/aaai.v33i01.33019851 · Cited by 36
Self-citationSentence Modeling with Gated Recursive Neural Network
Chen, X., Qiu, X., Zhu, C., Wu, S., & Huang, X. (2015) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d15-1092 · Cited by 33
Gelderloos, L., & Chrupała, G. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1610.03342 · Cited by 31
CoupleNet: Paying Attention to Couples with Coupled Attention for Relationship Recommendation
Tay, Y., Tuan, L. A., & Hui, S. C. (2018) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v12i1.15007 · Cited by 31
Chalup, S. K., & Blair, A. (2003) · Neural Networks · doi:10.1016/s0893-6080(03)00054-6 · Cited by 28
Godin, F., Demuynck, K., Dambre, J., Neve, W. D., & Demeester, T. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1365 · Cited by 24
Belinkov, Y. (2018) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 24
Self-citationCan Recurrent Neural Networks Learn Nested Recursion?
Bernardy, J.-P. (2018) · Linguistic Issues in Language Technology · doi:10.33011/lilt.v16i.1417 · Cited by 23
The Lazy Encoder: A Fine-Grained Analysis of the Role of Morphology in Neural Machine Translation
Bisazza, A., & Tump, C. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1313 · Cited by 22
Analysis of sentence embedding models using prediction tasks in natural language processing
Adi, Y., Kermany, E., Belinkov, Y., Lavi, O., & Goldberg, Y. (2017) · IBM Journal of Research and Development · doi:10.1147/jrd.2017.2702858 · Cited by 21
Self-citationAnalyzing Learned Representations of a Deep ASR Performance Prediction Model
Elloumi, Z., Besacier, L., Galibert, O., & Lecouteux, B. (2018) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/w18-5402 · Cited by 21
The Acquisition of Anaphora by Simple Recurrent Networks
Frank, R., Mathis, D. W., & Badecker, W. (2013) · Language Acquisition · doi:10.1080/10489223.2013.796950 · Cited by 19
Latent Tree Learning with Differentiable Parsers: Shift-Reduce Parsing and Chart Parsing
Maillard, J., & Clark, S. C. (2018) · doi:10.18653/v1/w18-2903 · Cited by 18
LSTMs Exploit Linguistic Attributes of Data
Liu, N. F., Levy, O., Schwartz, R., Tan, C., & Smith, N. A. (2018) · Workshop on Representation Learning for NLP (RepL4NLP) · doi:10.18653/v1/w18-3024 · Cited by 18
Gupta, P., & Schütze, H. (2018) · BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP) · doi:10.18653/v1/w18-5418 · Cited by 18
A Challenge Set and Methods for Noun-Verb Ambiguity
El-Kahky, A., Webster, K., Andor, D., & Pitler, E. (2018) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d18-1277 · Cited by 18
What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Models
Dalvi, F., Durrani, N., Sajjad, H., Belinkov, Y., Bau, A., & Glass, J. R. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33016309 · Cited by 18
Self-citationConnectionism and Cognitive Linguistics
Caldwell‐Harris, C. L. (1992) · Springer eBooks · doi:10.1007/978-94-011-2624-3_1 · Cited by 16
Interpretation of Semantic Tweet Representations
Ganesh, J., Gupta, M., & Varma, V. (2017) · IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM) · doi:10.1145/3110025.3110083 · Cited by 14
Learning Weakly Supervised Multimodal Phoneme Embeddings
Chaabouni, R., Dunbar, E., Zeghidour, N., & Emmanuel Dupoux, A. (2017) · Interspeech (USB) · doi:10.21437/interspeech.2017-1689 · Cited by 14
Investigating ‘Aspect’ in NMT and SMT: Translating the English Simple Past and Present Perfect
Vanmassenhove, E., Du, J., & Way, A. (2017) · Computational Linguistics in the Netherlands Journal · Cited by 14
Connectionism and Cognitive Linguistics
Caldwell‐Harris, C. L. (1990) · Connection Science · doi:10.1080/09540099008915660 · Cited by 13
Are BLEU and Meaning Representation in Opposition?
Cífka, O., & Bojar, O. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-1126 · Cited by 12
The Emergence of Semantics in Neural Network Representations of Visual Information
Dharmaretnam, D., & Fyshe, A. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-2122 · Cited by 10
Natural Language Multitasking: Analyzing and Improving Syntactic Saliency of Hidden RepresentationsPreprint
Brunner, G., Wang, Y., Wattenhofer, R. P., & Weigelt, M. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1801.06024 · Cited by 8
Ahmad, W. U., Bai, X., Huang, Z., Jiang, C., Peng, N., & Chang, K.-W. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1804.07911 · Cited by 8
A Shared Attention Mechanism for Interpretation of Neural Automatic Post-Editing Systems
Unanue, I. J., Borzeshi, E. Z., & Piccardi, M. (2018) · doi:10.18653/v1/w18-2702 · Cited by 7
Cited by
A primer in BERTology: What we know about how BERT works
Rogers, A., Kovaleva, O., & Rumshisky, A. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00349 · Cited by 1,552
(2019) · doi:10.18653/v1/p19-1356 · Cited by 1,291
How Can We Know What Language Models Know?
Jiang, Z., Xu, F. F., Araki, J., & Neubig, G. (2020) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00324 · Cited by 1,002
Beyond accuracy: behavioral testing of NLP models with CheckList
Ribeiro, M. T., Wu, T., Guestrin, C., & Singh, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.442 · Cited by 890
Linguistic Knowledge and Transferability of Contextual Representations
Liu, N. F., Gardner, M., Belinkov, Y., Peters, M. E., & Smith, N. A. (2019) · Proceedings of the 2019 Conference of the North · doi:10.18653/v1/n19-1112 · Cited by 621
Self-citation
Metadata
- Authors
- Belinkov, Y., & Glass, J.
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press
- Published
- 2019-04-01
- Volume
- 7
- Pages
- 49-72
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W2906152891
- Cited by
- 477
- References
- 170
- FWCI
- 36.84
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.