Can Rationalization Improve Robustness?
Open accessAbstract
Howard Chen, Jacqueline He, Karthik Narasimhan, Danqi Chen. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 2022.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Kilgarriff, A. (2000) · Language · doi:10.2307/417141 · Cited by 11,595 · see citing works
Transformers: State-of-the-Art Natural Language Processing
Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., et al. (2020) · Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations · doi:10.18653/v1/2020.emnlp-demos.6 · Cited by 8,741 · see citing works
“Why Should I Trust You?”: Explaining the Predictions of Any Classifier
Ribeiro, M., Singh, S., & Guestrin, C. (2016) · Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations · doi:10.18653/v1/n16-3020 · Cited by 6,682 · see citing works
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Rajpurkar, P., Zhang, J., Lopyrev, K., & Liang, P. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1264 · Cited by 6,208 · see citing works
Pointer Sentinel Mixture ModelsPreprint
Merity, S., Xiong, C., Bradbury, J., & Socher, R. (2016) · International Conference on Learning Representations · doi:10.48550/arxiv.1609.07843 · Cited by 5,051 · see citing works
Categorical Reparameterization with Gumbel-Softmax
Jang, E., Gu, S., & Poole, B. (2016) · arXiv · doi:10.48550/arxiv.1611.01144 · Cited by 3,616 · see citing works
Adversarial Examples for Evaluating Reading Comprehension Systems
Jia, R., & Liang, P. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1215 · Cited by 1,410 · see citing works
Deep Variational Information BottleneckPreprint
Alemi, A. A., Fischer, I., Dillon, J. V., & Murphy, K. P. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1612.00410 · Cited by 1,291 · see citing works
HotFlip: White-Box Adversarial Examples for Text Classification
Ebrahimi, J., Rao, A., Lowd, D., & Dou, D. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2006 · Cited by 948 · see citing works
Rationalizing Neural Predictions
Lei, T., Barzilay, R., & Jaakkola, T. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1011 · Cited by 777 · see citing works
Serrano, S., & Smith, N. A. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1282 · Cited by 690 · see citing works
Universal Adversarial Triggers for Attacking and Analyzing NLP
Wallace, E., Feng, S., Kandpal, N., Gardner, M., & Singh, S. (2019) · Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · doi:10.18653/v1/d19-1221 · Cited by 642 · see citing works
Adversarial Example Generation with Syntactically Controlled Paraphrase Networks
Iyyer, M., Wieting, J., Gimpel, K., & Zettlemoyer, L. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1170 · Cited by 636 · see citing works
ERASER: A Benchmark to Evaluate Rationalized NLP Models
DeYoung, J., Jain, S., Rajani, N. F., Lehman, E., Xiong, C., Socher, R., & Wallace, B. C. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.408 · Cited by 561 · see citing works
Synthetic and Natural Noise Both Break Neural Machine TranslationPreprint
Belinkov, Y., & Bisk, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.02173 · Cited by 533 · see citing works
Towards Faithfully Interpretable NLP Systems: How Should We Define and Evaluate Faithfulness?
Jacovi, A., & Goldberg, Y. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.386 · Cited by 503 · see citing works
Attention is not ExplanationPreprint
Jain, S., & Wallace, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.10186 · Cited by 468 · see citing works
Looking Beyond the Surface: A Challenge Set for Reading Comprehension over Multiple Sentences
Khashabi, D., Chaturvedi, S., Roth, M., Upadhyay, S., & Roth, D. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1023 · Cited by 372 · see citing works
Learning the Difference that Makes a Difference with Counterfactually-Augmented DataPreprint
Kaushik, D., Hovy, E. H., & Lipton, Z. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12434 · Cited by 346 · see citing works
On the Robustness of Interpretability Methods
Alvarez-Melis, D., & Jaakkola, T. S. (2018) · arXiv · doi:10.48550/arxiv.1806.08049 · Cited by 310 · see citing works
Learning Attitudes and Attributes from Multi-aspect Reviews
McAuley, J., Leskovec, J., & Jurafsky, D. (2012) · Proceedings · doi:10.1109/icdm.2012.110 · Cited by 242 · see citing works
Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation MethodsPreprint
Slack, D., Hilgard, S., Jia, E., Singh, S., & Lakkaraju, H. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.02508 · Cited by 203 · see citing works
A causal framework for explaining the predictions of black-box sequence-to-sequence models
Alvarez-Melis, D., & Jaakkola, T. (2017) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d17-1042 · Cited by 185 · see citing works
Learning to Faithfully Rationalize by Construction
Jain, S., Wiegreffe, S., Pinter, Y., & Wallace, B. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.409 · Cited by 152 · see citing works
WT5?! Training Text-to-Text Models to Explain their PredictionsPreprint
Narang, S., Raffel, C., Lee, K., Roberts, A., Fiedel, N., & Malkan, K. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.14546 · Cited by 141 · see citing works
Rethinking Cooperative Rationalization: Introspective Extraction and Complement Control
Yu, M., Chang, S., Zhang, Y., & Jaakkola, T. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1420 · Cited by 121 · see citing works
Measuring Association Between Labels and Free-Text Rationales
Wiegreffe, S., Marasović, A., & Smith, N. A. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.804 · Cited by 119 · see citing works
Do Feature Attribution Methods Correctly Attribute Features?
Zhou, Y., Booth, S., Ribeiro, M. T., & Shah, J. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i9.21196 · Cited by 112 · see citing works
An Information Bottleneck Approach for Controlling Conciseness in Rationale Extraction
Paranjape, B., Joshi, M., Thickstun, J., Hajishirzi, H., & Zettlemoyer, L. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.153 · Cited by 94 · see citing works
Invariant RationalizationPreprint
Chang, S., Zhang, Y., Yu, M., & Jaakkola, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2003.09772 · Cited by 65 · see citing works
Look at the First Sentence: Position Bias in Question Answering
Ko, M., Lee, J., Kim, H., Kim, G., & Kang, J. (2020) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2020.emnlp-main.84 · Cited by 60 · see citing works
Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transport
Swanson, K., Yu, L., & Lei, T. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.496 · Cited by 31 · see citing works
An Empirical Study on the Relation Between Network Interpretability and Adversarial Robustness
Noack, A., Ahern, I., Dou, D., & Li, B. (2021) · SN Computer Science · doi:10.1007/s42979-020-00390-x · Cited by 31 · see citing works
SPECTRA: Sparse Structured Text Rationalization
Guerreiro, N. M., & Martins, A. F. T. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.525 · Cited by 15 · see citing works
Rationales for Sequential Predictions
Vafa, K., Deng, Y., Blei, D., & Rush, A. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.807 · Cited by 14 · see citing works
LP-SparseMAP: Differentiable Relaxed Optimization for Sparse Structured PredictionPreprint
Niculae, V., & Martins, A. F. T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2001.04437 · Cited by 9 · see citing works
Learning from the Best: Rationalizing Prediction by Adversarial Information CalibrationPreprint
Sha, L., Camburu, O.-M., & Lukasiewicz, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2012.08884 · Cited by 4 · see citing works
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805
Flagged first, then by citations
2 of the 40 references couldn’t be matched to a known paper.
Research works printed but not linked: 7
- Jasmijn Bastings, Wilker Aziz, and Ivan Titov. 2019. Interpretable neural predictions with differentiable binary variables. In Association for Computational Linguistics (ACL), pages 2963-2977.
- Oana-Maria Camburu, Brendan Shillingford, Pasquale Minervini, Thomas Lukasiewicz, and Phil Blunsom. 2020. Make up your mind! adversarial generation of inconsistent natural language explanations. In As- sociation for Computational Linguistics (ACL).
- Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. 2017. Pointer sentinel mixture mod- els. In International Conference on Learning Repre- sentations (ICLR).
- Sofia Serrano and Noah A Smith. 2019. Is attention in- terpretable? In Association for Computational Lin- guistics (ACL), pages 2931-2951.
- Keyon Vafa, Yuntian Deng, David Blei, and Alexan- der M Rush. 2021. Rationales for sequential predic- tions. In Empirical Methods in Natural Language Processing (EMNLP), pages 10314-10332.
- Hongning Wang, Yue Lu, and Chengxiang Zhai. 2010. Latent aspect rating analysis on review text data: A rating regression approach. In ACM SIGKDD Inter- national Conference on Knowledge Discovery and Data Mining (KDD).
- Mo Yu, Shiyu Chang, Yang Zhang, and Tommi Jaakkola. 2019. Rethinking cooperative rationaliza- tion: Introspective extraction and complement con- trol. In Empirical Methods in Natural Language Processing (EMNLP), pages 4094-4103.
Cited by
Sorted by citations
Maieutic Prompting: Logically Consistent Reasoning with Recursive Explanations
Jung, J., Qin, L., Welleck, S., Brahman, F., Bhagavatula, C., Bras, R. J. L., & Choi, Y. (2022) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2022.emnlp-main.82 · Cited by 117 · see citing works
Turpin, M., Michael, J., Perez, E., & Bowman, S. R. (2023) · arXiv · doi:10.48550/arxiv.2305.04388 · Cited by 262 · see citing works
A Survey of Computer Vision Technologies in Urban and Controlled-environment Agriculture
Luo, J., Li, B., & Leung, C. (2023) · ACM Computing Surveys · doi:10.1145/3626186 · Cited by 36 · see citing works
Discovering Spatio-Temporal Rationales for Video Question Answering
Li, Y., Xiao, J., Feng, C., Wang, X., & Chua, T. (2023) · IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv51070.2023.01275 · Cited by 27 · see citing works
Out-of-Distribution Generalization in Natural Language Processing: Past, Present, and Future
Yang, L., Song, Y., Ren, X., Lyu, C., Wang, Y., Zhuo, J., Liu, L., Wang, J., Foster, J., & Zhang, Y. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.276 · Cited by 16 · see citing works
MCC-KD: Multi-CoT Consistent Knowledge Distillation
Chen, H., Wu, S., Quan, X., Wang, R., Yan, M., & Zhang, J. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.454 · Cited by 21 · see citing works
Self-citationRethinking Document-Level Relation Extraction: A Reality Check
Li, J., Wang, Y., Zhang, S., & Zhang, M. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.353 · Cited by 14 · see citing works
CREST: A Joint Framework for Rationalization and Counterfactual Text Generation
Treviso, M., Ross, A., Guerreiro, N. M., & Martins, A. F. T. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.842 · Cited by 10 · see citing works
MGR: Multi-generator Based Rationalization
Liu, W., Wang, H., Wang, J., Li, R., Li, X., Zhang, Y., & Qiu, Y. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.715 · Cited by 11 · see citing works
Human-annotated rationales and explainable text classification: a survey
Herrewijnen, E., Nguyen, D., Bex, F., & van Deemter, K. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1260952 · Cited by 8 · see citing works
Decoupled Rationalization with Asymmetric Learning Rates: A Flexible Lipschitz Restraint
Liu, W., Wang, J., Wang, H., Li, R., Qiu, Y., Zhang, Y., Han, J., & Zou, Y. (2023) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3580305.3599299 · Cited by 8 · see citing works
Yao, B., Jindal, I., Popa, L. C., Katsis, Y., Ghosh, S., He, L., Lu, Y., Srivastava, S., Li, Y., Hendler, J., et al. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.778 · Cited by 7 · see citing works
From outputs to insights: a survey of rationalization approaches for explainable text classification
Guzman, E. M., Schlegel, V., & Batista-Navarro, R. (2024) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2024.1363531 · Cited by 7 · see citing works
Kunz, J. (2024) · Linköping studies in science and technology. Dissertations · doi:10.3384/9789180754712 · Cited by 6 · see citing works
Enhancing the Rationale-Input Alignment for Self-explaining Rationalization
Liu, W., Wang, H., Wang, J., Deng, Z., Zhang, Y., Wang, C., & Li, R. (2024) · IEEE International Conference on Data Engineering (ICDE) · doi:10.1109/icde60146.2024.00176 · Cited by 6 · see citing works
Explanation-based Finetuning Makes Models More Robust to Spurious Cues
Ludan, J. M., Meng, Y., Nguyen, T. D., Shah, S. A., Lyu, Q., Apidianaki, M., & Callison-Burch, C. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.242 · Cited by 5 · see citing works
Rationale-Enhanced Language Models are Better Continual Relation Learners
Xiong, W., Song, Y., Wang, P., & Li, S. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.958 · Cited by 5 · see citing works
Yao, B., Sen, P., Popa, L. C., Hendler, J., & Wang, D. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.821 · Cited by 7 · see citing works
Kavumba, P., Brassard, A., Heinzerling, B., & Inui, K. (2023) · Findings of the Association for Computational Linguistics: EACL · doi:10.18653/v1/2023.findings-eacl.162 · Cited by 3 · see citing works
Complex Reasoning in Natural Languag
Zhao, W., Geva, M., Lin, B. Y., Yasunaga, M., Madaan, A., & Yu, T. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-tutorials.2 · Cited by 2 · see citing works
The Impacts of Unanswerable Questions on the Robustness of Machine Reading Comprehension Models
Tran, S. Q., Nguyen-Thuan, P., Le, U., & Kretchmar, M. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.113 · Cited by 3 · see citing works
Learning to Ignore Adversarial Attacks
Zhang, Y., Zhou, Y., Carton, S., & Tan, C. (2023) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.18653/v1/2023.eacl-main.216 · Cited by 2 · see citing works
Are Triggers Needed for Document-Level Event Extraction?
Shaar, S., Chen, W., Chatterjee, M., Wang, B., Zhao, W., & Cardie, C. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl.a.51 · Cited by 3 · see citing works
Regularization, Semi-supervision, and Supervision for a Plausible Attention-Based Explanation
Nguyen, D. H., Mallart, C., Gravier, G., & Sébillot, P. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-35320-8_20 · Cited by 1 · see citing works
Boosting Explainability through Selective Rationalization in Pre-trained Language Models
Yuan, L., Hu, S., Yu, K., & Wu, L. (2025) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3690624.3709212 · Cited by 2 · see citing works
Liu, W., Deng, Z., Niu, Z., Wang, J., Wang, H., & Li, R. (2025) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00758 · Cited by 1 · see citing works
Exploring Explanations Improves the Robustness of In-Context LearningPreprint
Honday, U., & Oka, T. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5277637
FedRNL: Federated Rationalization with Soft Parameter Sharing
Kong, L., Jiang, J., Wang, H., Wu, L., & Li, R. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-05981-9_21
Explaining Clinical Outcome Predictions with Compositional Rationale Extraction Model
Gao, W., Grossman, R., & Chen, Y. (2025) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata66926.2025.11400757
Nguyen, D. H. (2024) · theses.fr (ABES) · doi:10.70675/97b1b150zc009z4f96z9ec6z2790870387a0
Lu, J., Xu, W., Song, Y., Zhang, H., Zhang, C., Wu, K., Wei, X., & Wong, R. C.-W. (2026) · The VLDB Journal · doi:10.1007/s00778-026-00992-6
- Authors
- Chen, H., He, J., Narasimhan, K., & Chen, D.
- Affiliations
- Princeton University (US)
- Venue
- Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- Published
- 2022
- Pages
- 3792-3805
- OpenAlex
- W4224950688
- Cited by
- 31
- References
- 40
- Citations by year
- 2026: 1 · 2025: 6 · 2024: 5 · 2023: 18 · 2022: 1
- FWCI
- 4.15
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- Locations
- Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) (publishedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Physical Sciences › Computer Science › Artificial Intelligence › Topic Modeling
- Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- Keywords
- rationalization, robustness, adversarial examples, adversarial training, neural network robustness
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review