Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond
Open accessAbstract
A fundamental goal of scientific research is to learn about causal relationships. However, despite its critical role in the life and social sciences, causality has not had the same importance in Natural Language Processing (NLP), which has traditionally placed more emphasis on predictive tasks. This distinction is beginning to fade, with an emerging area of interdisciplinary research at the convergence of causal inference and language processing. Still, research on causality in NLP remains scattered across domains without unified definitions, benchmark datasets and clear articulations of the challenges and opportunities in the application of causal inference to the textual domain, with its unique properties. In this survey, we consolidate research across academic areas and situate it in the broader NLP landscape. We introduce the statistical challenge of estimating causal effects with text, encompassing settings where text is used as an outcome, treatment, or to address confounding. In addition, we explore potential uses of causal inference to improve the robustness, fairness, and interpretability of NLP models. We thus provide a unified overview of causal inference for the NLP community.1
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Causality-aware text representation is a hard research problem without a general solution.
“Causality-aware text representation is a hard research problem without a general solution(Veitch et al., 2020;Feder et al., 2022).”
From STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyond (2025) · cites this paper as Feder et al., 2022
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019) · Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · doi:10.18653/v1/n19-1423 · Cited by 48,293 · see citing works
(2003) · Journal of Machine Learning Research · doi:10.5555/944919.944937 · Cited by 32,337 · see citing works
A Unified Approach to Interpreting Model Predictions
Lundberg, S., & Lee, S.-I. (2017) · arXiv · doi:10.48550/arxiv.1705.07874 · Cited by 23,707 · see citing works
"Why Should I Trust You?": Explaining the Predictions of Any Classifier
Ribeiro, M. T., Singh, S., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939778 · Cited by 17,555 · see citing works
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019) · arXiv · doi:10.48550/arxiv.1907.11692 · Cited by 16,515 · see citing works
Neural Machine Translation by Jointly Learning to Align and Translate
Bahdanau, D., Cho, K., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1409.0473 · Cited by 16,213 · see citing works
Advances in Neural Information Processing Systems 29
Teymur, O., Zygalakis, K., & Calderhead, B. (2016) · Cited by 13,881 · see citing works
Deep Contextualized Word Representations
Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1202 · Cited by 11,983 · see citing works
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653 · see citing works
Distributed Representations of Sentences and DocumentsPreprint
Le, Q. V., & Mikolov, T. (2014) · International Conference on Machine Learning · doi:10.48550/arxiv.1405.4053 · Cited by 10,307 · see citing works
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · see citing works
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., & Bengio, Y. (2015) · arXiv · doi:10.48550/arxiv.1502.03044 · Cited by 8,248 · see citing works
CAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C., & Pearl, J. (2001) · The Philosophical Review · doi:10.2307/3182612 · Cited by 4,824 · see citing works
Proceedings of the 21st International Conference on Neural Information Processing Systems
Koller, D., Schuurmans, D., Bengio, Y., & Bottou, L. (2008) · Cited by 4,461 · see citing works
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210 · see citing works
A theory of learning from different domains
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., & Vaughan, J. W. (2010) · Machine Learning · doi:10.1007/s10994-009-5152-4 · Cited by 3,515 · see citing works
Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
Wager, S., & Athey, S. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1319839 · Cited by 2,917 · see citing works
Equality of Opportunity in Supervised Learning
Hardt, M., Price, E., & Srebro, N. (2016) · arXiv · doi:10.48550/arxiv.1610.02413 · Cited by 2,536 · see citing works
Attention-based LSTM for Aspect-level Sentiment Classification
Wang, Y., Huang, M., zhu, X., & Zhao, L. (2016) · Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d16-1058 · Cited by 2,450 · see citing works
Jain, S., & Wallace, B. C. (2019) · North American Chapter of the Association for Computational Linguistics · doi:10.18653/v1/n19-1357 · Cited by 2,287 · see citing works
Shortcut learning in deep neural networks
Geirhos, R., Jacobsen, J.-H., Michaelis, C., Zemel, R., Brendel, W., Bethge, M., & Wichmann, F. A. (2020) · Nature Machine Intelligence · doi:10.1038/s42256-020-00257-z · Cited by 2,224 · see citing works
Causal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin, D. B. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001880 · Cited by 2,173 · see citing works
Structural Topic Models for Open‐Ended Survey Responses
Roberts, M. E., Stewart, B., Tingley, D. H., Lucas, C., Leder-Luis, J., Gadarian, S. K., Albertson, B. L., & Rand, D. G. (2014) · American Journal of Political Science · doi:10.1111/ajps.12103 · Cited by 1,969 · see citing works
Self-citationSocial Pressure and Voter Turnout: Evidence from a Large-Scale Field Experiment
Gerber, A. S., GREEN, D. P., & Larimer, C. W. (2008) · American Political Science Review · doi:10.1017/s000305540808009x · Cited by 1,342 · see citing works
Kim, B., Wattenberg, M., Gilmer, J., Cai, C., Wexler, J., Viegas, F., & Sayres, R. (2017) · arXiv · doi:10.48550/arxiv.1711.11279 · Cited by 1,240 · see citing works
Explaining machine learning classifiers through diverse counterfactual explanations
Mothilal, R. K., Sharma, A., & Tan, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372850 · Cited by 1,233 · see citing works
Toward Causal Representation Learning
Scholkopf, B., Locatello, F., Bauer, S., Ke, N. R., Kalchbrenner, N., Goyal, A., & Bengio, Y. (2021) · Proceedings of the IEEE · doi:10.1109/jproc.2021.3058954 · Cited by 1,170 · see citing works
Counterfactual explanations without opening the black box: automated decisions and the GDPR
Wachter, S., Mittelstadt, B., & Russell, C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3063289 · Cited by 1,061 · see citing works
Language (Technology) is Power: A Critical Survey of “Bias” in NLP
Blodgett, S. L., Barocas, S., Daumé III, H., & Wallach, H. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.485 · Cited by 1,050 · cited 1× · see citing works
“NLP systems inherit and sometimes amplify undesirable biases encoded in text training data (Baro-cas et al., 2019; Blodgett et al., 2020).”
BackgroundCounterfactuals and Causal Inference: Methods and Principles for Social Research
Morgan, S. L., & Winship, C. (2014) · Cambridge University Press · doi:10.1017/cbo9781107587991 · Cited by 1,037 · see citing works
Kusner, M. J., Loftus, J. R., Russell, C., & Silva, R. (2017) · arXiv · doi:10.48550/arxiv.1703.06856 · Cited by 995 · see citing works
HotFlip: White-Box Adversarial Examples for Text Classification
Ebrahimi, J., Rao, A., Lowd, D., & Dou, D. (2018) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p18-2006 · Cited by 948 · see citing works
Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inference
McCoy, R. T., Pavlick, E., & Linzen, T. (2019) · Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p19-1334 · Cited by 944 · see citing works
Arjovsky, M., Bottou, L., Gulrajani, I., & Lopez-Paz, D. (2019) · arXiv · doi:10.48550/arxiv.1907.02893 · Cited by 927 · see citing works
Annotation Artifacts in Natural Language Inference Data
Gururangan, S., Swayamdipta, S., Levy, O., Schwartz, R., Bowman, S., & Smith, N. A. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2017 · Cited by 907 · see citing works
Beyond accuracy: behavioral testing of NLP models with CheckList
Ribeiro, M. T., Wu, T., Guestrin, C., & Singh, S. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.442 · Cited by 890 · see citing works
Ambati, B. R., Deoskar, T., Johnson, M., & Steedman, M. J. (2015) · The Association for Computational Linguistics · Cited by 860 · see citing works
Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraints
Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K.-W. (2017) · Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d17-1323 · Cited by 829 · see citing works
Domain Generalization via Invariant Feature Representation
Muandet, K., Balduzzi, D., & Schölkopf, B. (2013) · arXiv · doi:10.48550/arxiv.1301.2115 · Cited by 771 · see citing works
The Gender Citation Gap in International Relations
Maliniak, D., Powers, R., & Walter, B. F. (2013) · International Organization · doi:10.1017/s0020818313000209 · Cited by 726 · see citing works
Effective Self-Training for Parsing
Mcclosky, D., Charniak, E., & Johnson, M. (2006) · North American Chapter of the Association for Computational Linguistics · doi:10.3115/1220835.1220855 · Cited by 702 · see citing works
Hypothesis Only Baselines in Natural Language Inference
Poliak, A., Naradowsky, J., Haldar, A., Rudinger, R., & Durme, B. V. (2018) · International Workshop on Semantic Evaluation · doi:10.18653/v1/s18-2023 · Cited by 685 · see citing works
Gender bias in coreference resolution: Evaluation and debiasing methods
Zhao, J., Wang, T., Yatskar, M., Ordonez, V., & Chang, K.-W. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers) · doi:10.18653/v1/n18-2003 · Cited by 684 · see citing works
Kumar, K. (2016) · Bond University Research Portal (Bond University) · doi:10.1111/rssb.12167 · Cited by 680 · see citing works
Domain Generalization for Object Recognition with Multi-task Autoencoders
Ghifary, M., Kleijn, W. B., Zhang, M., & Balduzzi, D. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.293 · Cited by 664 · see citing works
A Survey of Methods for Explaining Black Box Models
Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., & Pedreschi, D. (2019) · ACM Computing Surveys · doi:10.1145/3236009 · Cited by 629 · see citing works
Formalizing Trust in Artificial Intelligence: Prerequisites, Causes and Goals of Human Trust in AI
Jacovi, A., Marasović, A., Miller, T., & Goldberg, Y. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445923 · Cited by 545 · see citing works
Towards Faithfully Interpretable NLP Systems: How Should We Define and Evaluate Faithfulness?
Jacovi, A., & Goldberg, Y. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.386 · Cited by 503 · see citing works
Thomas, M., Pang, B., & Lee, L. (2006) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.3115/1610075.1610122 · Cited by 480 · see citing works
Attention is not ExplanationPreprint
Jain, S., & Wallace, B. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1902.10186 · Cited by 468 · see citing works
Causality for Machine Learning
Schölkopf, B. (2022) · ACM eBooks · doi:10.1145/3501714.3501755 · Cited by 442 · see citing works
In Search of Lost Domain Generalization
Gulrajani, I., & Lopez-Paz, D. (2020) · arXiv · doi:10.48550/arxiv.2007.01434 · Cited by 440 · see citing works
Stress Test Evaluation for Natural Language InferencePreprint
Naik, A., Ravichander, A., Sadeh, N., Rosé, C., & Neubig, G. (2018) · International Conference on Computational Linguistics · doi:10.48550/arxiv.1806.00692 · Cited by 431 · see citing works
Liu, X., Gao, J., He, X., Deng, L., Duh, K., & Wang, Y.-Y. (2015) · Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · doi:10.3115/v1/n15-1092 · Cited by 395 · see citing works
Interference Between Units in Randomized Experiments
Rosenbaum, P. R. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001112 · Cited by 371 · see citing works
Learning Not to Learn: Training Deep Neural Networks With Biased Data
Kim, B., Kim, H., Kim, K., Kim, S.-J., & Kim, J. (2019) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr.2019.00922 · Cited by 360 · see citing works
Avoiding Discrimination through Causal Reasoning
Kilbertus, N., Rojas-Carulla, M., Parascandolo, G., Hardt, M., Janzing, D., & Schölkopf, B. (2017) · arXiv · doi:10.48550/arxiv.1706.02744 · Cited by 358 · see citing works
Learning the Difference that Makes a Difference with Counterfactually-Augmented DataPreprint
Kaushik, D., Hovy, E. H., & Lipton, Z. C. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1909.12434 · Cited by 346 · see citing works
Nuanced Metrics for Measuring Unintended Bias with Real Data for Text Classification
Borkan, D., Dixon, L., Sorensen, J. S., Thain, N., & Vasserman, L. (2019) · International World Wide Web Conference (WWW) · doi:10.1145/3308560.3317593 · Cited by 335 · see citing works
Towards a critical race methodology in algorithmic fairness
Hanna, A., Denton, R., Smart, A., & Smith-Loud, J. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372826 · Cited by 295 · cited 1× · see citing works
“However, there are important questions about the legitimacy of treating attributes like race as variables subject to intervention (e.g., Kohler-Hausmann, 2018; Hanna et al., 2020), and Kilbertus et al.”
BackgroundNull It Out: Guarding Protected Attributes by Iterative Nullspace Projection
Ravfogel, S., Elazar, Y., Gonen, H., Twiton, M., & Goldberg, Y. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2020.acl-main.647 · Cited by 287 · see citing works
Algorithmic recourse: From counterfactual explanations to interventions
Karimi, A.-H., Schölkopf, B., & Valera, I. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445899 · Cited by 274 · see citing works
Online Harassment and Content Moderation: The Case of Blocklists
Jhaver, S., Ghoshal, S., Bruckman, A., & Gilbert, E. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3185593 · Cited by 270 · see citing works
Evaluating Models’ Local Decision Boundaries via Contrast Sets
Gardner, M., Artzi, Y., Basmov, V., Berant, J., Bogin, B., Chen, S., Dasigi, P., Dua, D., Elazar, Y., Gottumukkala, A., et al. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.117 · Cited by 265 · see citing works
Counterfactual Data Augmentation for Mitigating Gender Stereotypes in Languages with Rich Morphology
Zmigrod, R., Mielke, S. J., Wallach, H., & Cotterell, R. (2019) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p19-1161 · Cited by 241 · see citing works
Does water kill? A call for less casual causal inferences
Hernán, M. Á. (2016) · Annals of Epidemiology · doi:10.1016/j.annepidem.2016.08.016 · Cited by 221 · see citing works
Globally Coherent Text Generation with Neural Checklist Models
Kiddon, C., Zettlemoyer, L., & Choi, Y. (2016) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d16-1032 · Cited by 219 · see citing works
Inherent Disagreements in Human Textual Inferences
Pavlick, E., & Kwiatkowski, T. (2019) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00293 · Cited by 214 · see citing works
On causal and anticausal learning
Janzing, D., Peters, J., Sgouritsa, E., Zhang, K., Mooij, J. M., & Schölkopf, B. (2012) · International Conference on Machine Learning · Cited by 214 · see citing works
Polyjuice: Generating Counterfactuals for Explaining, Evaluating, and Improving Models
Wu, T., Ribeiro, M. T., Heer, J., & Weld, D. S. (2021) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/2021.acl-long.523 · Cited by 210 · see citing works
Counterfactual Fairness in Text Classification through Robustness
Garg, S., Perot, V., Limtiaco, N., Taly, A., Ed, H., & Beutel, A. (2019) · Proceedings of the AAAI/ACM Conference on AI Ethics and Society · doi:10.1145/3306618.3317950 · Cited by 200 · see citing works
Polite Dialogue Generation Without Parallel Data
Niu, T., & Bansal, M. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00027 · Cited by 158 · see citing works
Overlap in observational studies with high-dimensional covariates
D’Amour, A., Ding, P., Feller, A., Lei, L., & Sekhon, J. S. (2020) · Journal of Econometrics · doi:10.1016/j.jeconom.2019.10.014 · Cited by 155 · see citing works
Bootstrapping statistical parsers from small datasets
Steedman, M. J., Osborne, M., Sarkar, A., Clark, S., Hwa, R., Hockenmaier, J., Ruhlen, P., Baker, S., & Crim, J. (2003) · Conference of the European Chapter of the Association for Computational Linguistics · doi:10.3115/1067807.1067851 · Cited by 147 · see citing works
Learning Structured Text Representations
Liu, Y., & Lapata, M. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00005 · Cited by 146 · see citing works
(2020) · neural information processing systems · Cited by 142 · see citing works
Competency Problems: On Finding and Removing Artifacts in Language Data
Gardner, M., Merrill, W., Dodge, J., Peters, M. E., Ross, A., Singh, S., & Smith, N. A. (2021) · Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.135 · Cited by 129 · see citing works
Invariance, Causality and Robustness
Bühlmann, P. (2020) · Statistical Science · doi:10.1214/19-sts721 · Cited by 127 · see citing works
Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals
Elazar, Y., Ravfogel, S., Jacovi, A., & Goldberg, Y. (2021) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00359 · Cited by 126 · see citing works
Reducing Sentiment Bias in Language Models via Counterfactual Evaluation
Huang, P.-S., Zhang, H., Jiang, R., Stanforth, R., Welbl, J., Rae, J., Maini, V., Yogatama, D., & Kohli, P. (2020) · Findings of the Association for Computational Linguistics: EMNLP 2020 · doi:10.18653/v1/2020.findings-emnlp.7 · Cited by 124 · see citing works
Deep neural networks detect suicide risk from textual facebook posts
Ophir, Y., Tikochinski, R., Asterhan, C., Sisso, I., & Reichart, R. (2020) · Scientific Reports · doi:10.1038/s41598-020-73917-0 · Cited by 115 · see citing works
Self-citationFOIL it! Find One mismatch between Image and Language caption
Shekhar, R., Pezzelle, S., Klimovich, Y., Herbelot, A., Nabi, M., Sangineto, E., & Raffaella Bernardi, B. (2017) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p17-1024 · Cited by 111 · see citing works
Text and Causal Inference: A Review of Using Text to Remove Confounding from Causal Estimates
Keith, K. A., Jensen, D. D., & O’Connor, B. (2020) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2020.acl-main.474 · Cited by 110 · see citing works
Self-citationOn Causal and Anticausal LearningPreprint
Schölkopf, B., Janzing, D., Peters, J., Sgouritsa, E., Zhang, K., & Mooij, J. M. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6471 · Cited by 109 · see citing works
It’s All in the Name: Mitigating Gender Bias with Name-Based Counterfactual Data Substitution
Maudslay, R. H., Gonen, H., Cotterell, R., & Teufel, S. (2019) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d19-1530 · Cited by 107 · see citing works
A Probabilistic Calculus of Actions
Pearl, J. (1994) · Elsevier eBooks · doi:10.1016/b978-1-55860-332-5.50062-6 · Cited by 106 · see citing works
CausaLM: Causal Model Explanation Through Counterfactual Language Models
Feder, A., Oved, N., Shalit, U., & Reichart, R. (2021) · Computational Linguistics · doi:10.1162/coli_a_00404 · Cited by 105 · see citing works
Self-citationThe Risks of Invariant Risk MinimizationPreprint
Rosenfeld, E., Ravikumar, P., & Risteski, A. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.05761 · Cited by 103 · see citing works
Entity-Based Knowledge Conflicts in Question Answering
Longpre, S., Perisetla, K., Chen, A., Ramesh, N., DuBois, C., & Singh, S. (2021) · Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2021.emnlp-main.565 · Cited by 101 · see citing works
Content preserving text generation with attribute controlsPreprint
Logeswaran, L., Lee, H., & Bengio, S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.01135 · Cited by 97 · see citing works
Self-Training for Enhancement and Domain Adaptation of Statistical Parsers Trained on Small Datasets
Reichart, R., & Rappoport, A. (2007) · Cited by 94 · see citing works
Self-citationAdjusting for Confounding with Text Matching
Roberts, M. E., Stewart, B., & Nielsen, R. A. (2020) · American Journal of Political Science · doi:10.1111/ajps.12526 · Cited by 91 · see citing works
Self-citationComparing Bayesian Models of Annotation
Paun, S., Carpenter, B., Chamberlain, J., Hovy, D., Kruschwitz, U., & Poesio, M. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00040 · Cited by 86 · see citing works
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.2307/2289069 · Cited by 83 · see citing works
Adapting Text Embeddings for Causal InferencePreprint
Veitch, V., Sridhar, D., & Blei, D. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1905.12741 · Cited by 81 · see citing works
Self-citationA Causal Lens for Controllable Text GenerationPreprint
Hu, Z., & Li, E. L. (2022) · Neural Information Processing Systems · doi:10.48550/arxiv.2201.09119 · Cited by 78 · see citing works
Mozer, R., Miratrix, L., Kaufman, A., & Anastasopoulos, L. (2018) · Political Analysis · doi:10.1017/pan.2020.1 · Cited by 73 · see citing works
An Introduction to Proximal Causal LearningPreprint
Tchetgen, E. J. T., Ying, A., Cui, Y., Shi, X., & Miao, W. (2020) · medRxiv · doi:10.1101/2020.09.21.20198762 · Cited by 72 · see citing works
Identifying Spurious Correlations for Robust Text Classification
Wang, Z., & Culotta, A. (2020) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2020.findings-emnlp.308 · Cited by 64 · see citing works
Replicability Analysis for Natural Language Processing: Testing Significance with Multiple Datasets
Dror, R., Baumer, G., Bogomolov, M., & Reichart, R. (2017) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00074 · Cited by 63 · see citing works
Self-citationChallenges of Using Text Classifiers for Causal Inference
Wood-Doughty, Z., Shpitser, I., & Dredze, M. H. (2018) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/d18-1488 · Cited by 60 · see citing works
Self-citationDeconfounded Lexicon Induction for Interpretable Social Science
Pryzant, R., Shen, K., Jurafsky, D., & Wagner, S. (2018) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/n18-1146 · Cited by 59 · see citing works
Self-citationOn Calibration and Out-of-domain GeneralizationPreprint
Wald, Y., Feder, A., Greenfeld, D., & Shalit, U. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.10395 · Cited by 59 · see citing works
Self-citationCausal Inference with Latent Treatments
Fong, C., & Grimmer, J. (2021) · American Journal of Political Science · doi:10.1111/ajps.12649 · Cited by 58 · see citing works
Self-citationHow to Make Causal Inferences Using TextsPreprint
Egami, N., Fong, C., Grimmer, J., Roberts, M. E., & Stewart, B. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1802.02163 · Cited by 53 · see citing works
Self-citationCausal Analysis of Syntactic Agreement Mechanisms in Neural Language Models
Finlayson, M., Mueller, A., Gehrmann, S., Shieber, S. M., Linzen, T., & Belinkov, Y. (2021) · doi:10.18653/v1/2021.acl-long.144 · Cited by 52 · see citing works
Counterfactual Invariance to Spurious Correlations: Why and How to Pass Stress TestsPreprint
Veitch, V., D’Amour, A., Yadlowsky, S., & Eisenstein, J. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2106.00545 · Cited by 52 · see citing works
Self-citation(2021) · doi:10.18653/v1/2021.conll-1.15 · Cited by 51 · see citing works
Reducing Sentiment Bias in Language Models via Counterfactual EvaluationPreprint
Huang, P.-S., Zhang, H., Jiang, R., Stanforth, R., Welbl, J., Rae, J. W., Maini, V., Yogatama, D., & Kohli, P. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1911.03064 · Cited by 50 · see citing works
Bad Seeds: Evaluating Lexical Methods for Bias Measurement
Antoniak, M., & Mimno, D. (2021) · doi:10.18653/v1/2021.acl-long.148 · Cited by 50 · see citing works
Semi-Supervised Learning and Domain Adaptation in Natural Language Processing
Søgaard, A. (2013) · Synthesis lectures on human language technologies · doi:10.2200/s00497ed1v01y201304hlt021 · Cited by 49 · see citing works
Discovery of Treatments from Text Corpora
Fong, C., & Grimmer, J. (2016) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/p16-1151 · Cited by 49 · see citing works
Self-citationCausal abstractions of neural networks
Geiger, A., Lu, H., Icard, T., & Potts, C. (2021) · arXiv · doi:10.48550/arxiv.2106.02997 · Cited by 45 · see citing works
Explaining The Efficacy of Counterfactually Augmented DataPreprint
Kaushik, D., Setlur, A., Hovy, E. H., & Lipton, Z. C. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.02114 · Cited by 44 · see citing works
Tailor: Generating and Perturbing Text with Semantic Controls
Ross, A., Wu, T., Peng, H. M., Peters, M., & Gardner, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.228 · Cited by 41 · see citing works
Rubin, J. D., Blackwell, L., & Conley, T. D. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376645 · Cited by 40 · see citing works
Causal Effects of Linguistic Properties
Pryzant, R., Card, D., Jurafsky, D., Veitch, V., & Sridhar, D. (2021) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2021.naacl-main.323 · Cited by 35 · see citing works
Self-citationTextSETTR: Few-Shot Text Style Extraction and Tunable Targeted Restyling
Riley, P., Constant, N., Guo, M., Kumar, G., Uthus, D., & Parekh, Z. (2021) · doi:10.18653/v1/2021.acl-long.293 · Cited by 35 · see citing works
An Investigation of the (In)effectiveness of Counterfactually Augmented Data
Joshi, N., & He, H. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.256 · Cited by 34 · see citing works
Self-training Avoids Using Spurious Features Under Domain ShiftPreprint
Chen, Y., Wei, C., Kumar, A., & Ma, T. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.10032 · Cited by 33 · see citing works
An Introduction to Proximal Causal Inference
Tchetgen, E. J. T., Ying, A., Cui, Y., Shi, X., & Miao, W. (2024) · Statistical Science · doi:10.1214/23-sts911 · Cited by 33 · see citing works
Intrinsic bias metrics do not correlate with application bias
Goldfarb-Tarrant, S., Marchant, R., Muñoz Sánchez, R., Pandya, M., & Lopez, A. (2021) · Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · doi:10.18653/v1/2021.acl-long.150 · Cited by 33 · see citing works
Predicting Sales from the Language of Product Descriptions.
Pryzant, R., Chung, Y., & Jurafsky, D. (2017) · Cited by 30 · see citing works
Self-citationFairness and Robustness in Invariant Learning: A Case Study in Toxicity ClassificationPreprint
Adragna, R., Creager, E., Madras, D., & Zemel, R. S. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2011.06485 · Cited by 30 · see citing works
Estimating Causal Effects of Tone in Online Debates
Sridhar, D., & Getoor, L. C. (2019) · International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2019/259 · Cited by 27 · see citing works
Self-citationDoCoGen: Domain Counterfactual Generation for Low Resource Domain Adaptation
Calderon, N., Ben-David, E., Feder, A., & Reichart, R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.533 · Cited by 27 · see citing works
Self-citationQuantifying the Causal Effects of Conversational Tendencies
Zhang, J., Mullainathan, S., & Danescu-Niculescu-Mizil, C. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415202 · Cited by 23 · see citing works
Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP
Jin, Z., von Kügelgen, J., Ni, J., Vaidhya, T., Kaushal, A., Sachan, M., & Schölkopf, B. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.748 · Cited by 21 · see citing works
Robust Text Classification under Confounding Shift
Landeiro, V., & Culotta, A. (2018) · Journal of Artificial Intelligence Research · doi:10.1613/jair.1.11248 · Cited by 20 · see citing works
Weld, G., West, P., Glenski, M., Arbour, D. T., Rossi, R. A., & Althoff, T. (2022) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v16i1.19362 · Cited by 20 · see citing works
Polyjuice: Automated, General-purpose Counterfactual Generation.Preprint
Wu, T., Ribeiro, M. T., Heer, J., & Weld, D. S. (2021) · arXiv (Cornell University) · Cited by 18 · see citing works
Does Data Augmentation Improve Generalization in NLP?Preprint
Jha, R., Lovering, C., & Pavlick, E. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2004.15012 · Cited by 12 · see citing works
The Dangers of Counterfactual Causal Thinking about Detecting Racial Discrimination
Kohler-Hausmann, I. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3050650 · Cited by 9 · see citing works
Are VQA Systems RAD? Measuring Robustness to Augmented Data with Focused Interventions
Rosenberg, D., Gat, I., Feder, A., & Reichart, R. (2021) · doi:10.18653/v1/2021.acl-short.10 · Cited by 8 · see citing works
Self-citationTextSETTR: Label-Free Text Style Extraction and Tunable Targeted RestylingPreprint
Riley, P., Constant, N., Guo, M., Kumar, G., Uthus, D., & Parekh, Z. (2021) · arXiv (Cornell University) · Cited by 8 · see citing works
Generating Synthetic Text Data to Evaluate Causal Inference MethodsPreprint
Wood-Doughty, Z., Shpitser, I., & Dredze, M. H. (2021) · arXiv (Cornell University) · doi:10.48550/arxiv.2102.05638 · Cited by 7 · see citing works
Self-citationTextSETTR: Few-Shot Text Style Extraction and Tunable Targeted RestylingPreprint
Riley, P., Constant, N., Guo, M., Kumar, G., Uthus, D., & Parekh, Z. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2010.03802 · Cited by 7 · see citing works
Flagged first, then by citations
7 of the 146 references couldn’t be matched to a known paper.
Research works printed but not linked: 6
- PMLR.
- Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov. 2022. Locating and edit- ing factual knowledge in GPT. arXiv preprint arXiv:2202.05262. · arXiv
- Judea Pearl. 2009. Causality. Cambridge Uni- versity Press.
- Tongshuang Wu, Marco Tulio Ribeiro, Jeffrey Heer, and Daniel S. Weld. 2021. Polyjuice: Au- tomated, general-purpose counterfactual gener- ation. arXiv preprint arXiv:2101.00288. · arXiv
- PMLR.
- Yi-Fan Zhang, Hanlin Zhang, Zachary C. Lipton, Li Erran Li, and Eric P. Xing. 2022. Can transformers be strong treatment effect estimators? arXiv preprint arXiv:2202.01336. · arXiv
Cited by
Sorted by citations
Natural Language Processing for Smart Healthcare
Zhou, B., Yang, G., Shi, Z., & Ma, S. (2022) · IEEE Reviews in Biomedical Engineering · doi:10.1109/rbme.2022.3210270 · Cited by 253 · see citing works
Reasoning with Language Model Prompting: A Survey
Qiao, S., Ou, Y., Zhang, N., Chen, X., Yao, Y., Deng, S., Tan, C., Huang, F., & Chen, H. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.294 · Cited by 218 · see citing works
Deep Learning for Intelligent Human–Computer Interaction
Lv, Z., Poiesi, F., Dong, Q., Lloret, J., & Song, H. (2022) · Applied Sciences · doi:10.3390/app122211457 · Cited by 189 · see citing works
Towards Faithful Model Explanation in NLP: A Survey
Lyu, Q., Apidianaki, M., & Callison-Burch, C. (2024) · Computational Linguistics · doi:10.1162/coli_a_00511 · Cited by 143 · see citing works
Using natural language processing to analyse text data in behavioural science
Feuerriegel, S., Maarouf, A., Bär, D., Geissler, D., Schweisthal, J., Pröllochs, N., Robertson, C. E., Rathje, S., Hartmann, J., Mohammad, S. M., et al. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-024-00392-z · Cited by 140 · see citing works
Causal Inference Meets Deep Learning: A Comprehensive Survey
Jiao, L., Wang, Y., Liu, X., Li, L., Liu, F., Ma, W., Guo, Y., Chen, P., Yang, S., & Hou, B. (2024) · Research · doi:10.34133/research.0467 · Cited by 122 · see citing works
CIRS: Bursting Filter Bubbles by Counterfactual Interactive Recommender System
Gao, C., Wang, S., Li, S., Chen, J., He, X., Lei, W., Li, B., Zhang, Y., & Jiang, P. (2023) · ACM Transactions on Information Systems · doi:10.1145/3594871 · Cited by 109 · see citing works
Huang, G., Li, Y., Jameel, S., Long, Y., & Papanastasiou, G. (2024) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2024.05.004 · Cited by 74 · see citing works
Local Interpretations for Explainable Natural Language Processing: A Survey
Luo, S., Ivison, H., Han, S. C., & Poon, J. (2024) · ACM Computing Surveys · doi:10.1145/3649450 · Cited by 60 · see citing works
Luangrath, A. W., Xu, Y., & Wang, T. (2022) · Journal of Marketing Research · doi:10.1177/00222437221116058 · Cited by 59 · see citing works
Learning consistent representations with temporal and causal enhancement for knowledge tracing
Huang, C., Wei, H.-W., Huang, Q., Jiang, F., Han, Z., & Huang, X. (2024) · Expert Systems with Applications · doi:10.1016/j.eswa.2023.123128 · Cited by 57 · see citing works
Towards Robust and Adaptive Motion Forecasting: A Causal Representation Perspective
Liu, Y., Cadei, R., Schweizer, J., Bahmani, S., & Alahi, A. (2022) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52688.2022.01657 · Cited by 49 · see citing works
Alvero, A. J., Lee, J., Regla-Vargas, A., Kizilcec, R. F., Joachims, T., & Antonio, A. L. (2024) · Journal of Big Data · doi:10.1186/s40537-024-00986-7 · Cited by 48 · see citing works
Explainable depression symptom detection in social media
Bao, E., Pérez, A., & Parapar, J. (2024) · Health Information Science and Systems · doi:10.1007/s13755-024-00303-9 · Cited by 46 · see citing works
DISCO: Distilling Counterfactuals with Large Language Models
Chen, Z., Gao, Q., Bosselut, A., Sabharwal, A., & Richardson, K. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.302 · Cited by 44 · see citing works
Challenges in Applying Explainability Methods to Improve the Fairness of NLP Models
Balkır, E., Kiritchenko, S., Nejadgholi, I., & Fraser, K. (2022) · Workshop on Trustworthy Natural Language Processing (TrustNLP) · doi:10.18653/v1/2022.trustnlp-1.8 · Cited by 43 · see citing works
Towards Effective Causal Partitioning by Edge Cutting of Adjoint Graph
Zhang, H., Ren, Y., Xia, Y., Zhou, S., & Guan, J. (2024) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2024.3435503 · Cited by 35 · see citing works
How Pre-trained Language Models Capture Factual Knowledge? A Causal-Inspired Analysis
Li, S., Li, X., Shang, L., Dong, Z., Sun, C., Liu, B., Ji, Z., Jiang, X., & Liu, Q. (2022) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2022.findings-acl.136 · Cited by 34 · see citing works
Debiasing NLU Models via Causal Intervention and Counterfactual Reasoning
Tian, B., Cao, Y., Zhang, Y., & Xing, C. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21389 · Cited by 34 · see citing works
The language of opinion change on social media under the lens of communicative action
Monti, C., Aiello, L. M., De Francisci Morales, G., & Bonchi, F. (2022) · Scientific Reports · doi:10.1038/s41598-022-21720-4 · Cited by 32 · see citing works
Conciatori, M., Valletta, A., & Segalini, A. (2024) · Computers & Geosciences · doi:10.1016/j.cageo.2024.105531 · Cited by 32 · see citing works
Natural language processing for social science research: A comprehensive review
Hou, Y., & Huang, J. (2025) · Chinese Journal of Sociology · doi:10.1177/2057150x241306780 · Cited by 30 · see citing works
Counterfactual Learning on Graphs: A Survey
Guo, Z., Wu, Z., Xiao, T., Aggarwal, C. C., Liu, H., & Wang, S. (2025) · Machine Intelligence Research · doi:10.1007/s11633-024-1519-z · Cited by 28 · see citing works
DoCoGen: Domain Counterfactual Generation for Low Resource Domain Adaptation
Calderon, N., Ben-David, E., Feder, A., & Reichart, R. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.533 · Cited by 27 · see citing works
Self-citationModifying AI, Enhancing Essays: How Active Engagement with Generative AI Boosts Writing Quality
Yang, K., Raković, M., Liang, Z., Yan, L., Zeng, Z., Fan, Y., Gašević, D., & Chen, G. (2025) · Proceedings of the 15th International Learning Analytics and Knowledge Conference · doi:10.1145/3706468.3706544 · Cited by 26 · see citing works
Neural Architecture Search with Progressive Evaluation and Subpopulation Preservation
Xue, Y., Zha, J., Pelusi, D., Chen, P., Luo, T., Zhen, L., Wang, Y., & Wahib, M. (2024) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2024.3393304 · Cited by 25 · see citing works
Slangvolution: A Causal Analysis of Semantic Change and Frequency Dynamics in Slang
Keidar, D., Opedal, A., Jin, Z., & Sachan, M. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.101 · Cited by 24 · see citing works
Causal Artificial Intelligence in Legal Language Processing: A Systematic Review
Tritto, P. P., & Ponce-Espinosa, H. (2025) · Entropy · doi:10.3390/e27040351 · Cited by 22 · see citing works
The Sweet Danger of Sugar: Debunking Representation Learning for Encrypted Traffic Classification
Zhao, Y., Dettori, G., Boffa, M., Vassio, L., & Mellia, M. (2025) · ACM SIGCOMM Conference (SIGCOMM) · doi:10.1145/3718958.3750498 · Cited by 22 · see citing works
Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View
Cao, B., Lin, H., Han, X., Liu, F., & Sun, L. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.398 · Cited by 22 · see citing works
CRAB: Assessing the Strength of Causal Relationships Between Real-world Events
Romanou, A., Montariol, S., Paul, D., Laugier, L., Aberer, K., & Bosselut, A. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.940 · Cited by 22 · see citing works
Counterfactually Augmented Data and Unintended Bias: The Case of Sexism and Hate Speech Detection
Sen, I., Samory, M., Wagner, C., & Augenstein, I. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.347 · Cited by 21 · see citing works
Affection: Learning Affective Explanations for Real-World Visual Data
Achlioptas, P., Ovsjanikov, M., Guibas, L. J., & Tulyakov, S. (2023) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr52729.2023.00642 · Cited by 21 · see citing works
Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP
Jin, Z., von Kügelgen, J., Ni, J., Vaidhya, T., Kaushal, A., Sachan, M., & Schölkopf, B. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.748 · Cited by 21 · see citing works
Interact with the Explanations: Causal Debiased Explainable Recommendation System
Liu, X., Yu, T., Xie, K., Wu, J., & Li, S. (2024) · ACM International Conference on Web Search and Data Mining (WSDM) · doi:10.1145/3616855.3635855 · Cited by 20 · see citing works
FaiRR: Faithful and Robust Deductive Reasoning over Natural Language
Sanyal, S., Singh, H., & Ren, X. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.77 · Cited by 20 · see citing works
From text to model: Leveraging natural language processing for system dynamics model development
Veldhuis, G. A., Blok, D., de Boer, M., Kalkman, G. J., Bakker, R. M., & van Waas, R. P. M. (2024) · System Dynamics Review · doi:10.1002/sdr.1780 · Cited by 20 · see citing works
Gabler, P., Geiger, B. C., Schuppler, B., & Kern, R. (2023) · Information · doi:10.3390/info14020137 · Cited by 19 · see citing works
The Life Cycle of Knowledge in Big Language Models: A Survey
Cao, B., Lin, H., Han, X., & Sun, L. (2023) · arXiv · doi:10.48550/arxiv.2303.07616 · Cited by 18
The Life Cycle of Knowledge in Big Language Models: A Survey
Cao, B., Lin, H., Han, X., & Sun, L. (2024) · Machine Intelligence Research · doi:10.1007/s11633-023-1416-x · Cited by 18 · see citing works
Informativeness and Invariance: Two Perspectives on Spurious Correlations in Natural Language
Eisenstein, J. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.321 · Cited by 18 · see citing works
Self-citationJassal, N. (2023) · American Political Science Review · doi:10.1017/s0003055423000916 · Cited by 18 · see citing works
A Causal View of Entity Bias in (Large) Language Models
Wang, F., Mo, W., Wang, Y., Zhou, W., & Chen, M. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.1013 · Cited by 18 · see citing works
A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models
Stolfo, A., Jin, Z., Shridhar, K., Schoelkopf, B., & Sachan, M. (2023) · Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · doi:10.18653/v1/2023.acl-long.32 · Cited by 17 · see citing works
NeuroCounterfactuals: Beyond Minimal-Edit Counterfactuals for Richer Data Augmentation
Howard, P., Singer, G., Lal, V., Choi, Y., & Swayamdipta, S. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.371 · Cited by 17 · see citing works
XLTime: A Cross-Lingual Knowledge Transfer Framework for Temporal Expression Extraction
Cao, Y., Groves, W., Saha, T. K., Tetreault, J., Jaimes, A., Peng, H. M., & Yu, P. S. (2022) · Findings of the Association for Computational Linguistics: NAACL · doi:10.18653/v1/2022.findings-naacl.148 · Cited by 16 · see citing works
DNA of learning behaviors: A novel approach of learning performance prediction by NLP
Lin, C.-C., Cheng, E., Huang, A. Y. Q., & Yang, S. J. H. (2024) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2024.100227 · Cited by 16 · see citing works
Quantum causal inference with extremely light touch
Liu, X., Qiu, Y., Dahlsten, O., & Vedral, V. (2025) · npj Quantum Information · doi:10.1038/s41534-024-00956-0 · Cited by 15 · see citing works
Prognosis of exploration on Chat GPT with artificial intelligence ethics
Vidhya, N. G., Devi, D. M. R., Nithya, A., & Manju, T. (2023) · Brazilian Journal of Science · doi:10.14295/bjs.v2i9.372 · Cited by 14 · see citing works
Neural architecture search via similarity adaptive guidance
Xue, Y., Zha, J., Wahib, M., Ouyang, T., & Wang, X. (2024) · Applied Soft Computing · doi:10.1016/j.asoc.2024.111821 · Cited by 14 · see citing works
Interpreting Low-Level Vision Models With Causal Effect Maps
Hu, J., Gu, J., Yu, S., Yu, F., Li, Z., You, Z., Lu, C., & Dong, C. (2025) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2025.3557149 · Cited by 14 · see citing works
Unsupervised Editing for Counterfactual Stories
Chen, J., Gan, C., Cheng, S., Zhou, H., Xiao, Y., & Li, L. (2022) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v36i10.21290 · Cited by 14 · see citing works
An Empirical Study on Explanations in Out-of-Domain Settings
Chrysostomou, G., & Αλέτρας, Ν. (2022) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2022.acl-long.477 · Cited by 14 · see citing works
COLA: Contextualized Commonsense Causal Reasoning from the Causal Inference Perspective
Wang, Z., Do, Q. V., Zhang, H., Zhang, J., Wang, W., Fang, T., Song, Y., Wong, G. Y., & See, S. C. W. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.288 · Cited by 14 · see citing works
IfQA: A Dataset for Open-domain Question Answering under Counterfactual Presuppositions
Yu, W., Jiang, M., Clark, P., & Sabharwal, A. (2023) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2023.emnlp-main.515 · Cited by 12 · see citing works
A Primer on Deep Learning for Causal Inference
Koch, B., Sainburg, T., Geraldo, P., Jiang, S., Sun, Y., & Foster, J. G. (2024) · Sociological Methods & Research · doi:10.1177/00491241241234866 · Cited by 12 · see citing works
Causality from bottom to top: a survey
Weinberg, A. I., Premebida, C., & Faria, D. R. (2025) · Machine Learning · doi:10.1007/s10994-025-06855-5 · Cited by 11 · see citing works
An exploration of mutual information based on emotion–cause pair extraction
Hu, G., Zhao, Y., Lu, G., Yin, F., & Chen, J. (2022) · Knowledge-Based Systems · doi:10.1016/j.knosys.2022.109822 · Cited by 11 · see citing works
An empirical study of counterfactual visualization to support visual causal inference
Wang, A. Z., Borland, D., & Gotz, D. (2024) · Information Visualization · doi:10.1177/14738716241229437 · Cited by 11 · see citing works
Mykhaylenko, V., Safonova, N. V., Ilchenko, R., Іващук, А., & Babik, I. (2024) · Data & Metadata · doi:10.56294/dm2024.241 · Cited by 11 · see citing works
Bodell, M. H., Magnusson, M., & Keuschnigg, M. (2024) · Sociological Methods & Research · doi:10.1177/00491241241268453 · Cited by 10 · see citing works
Causality-aware Concept Extraction based on Knowledge-guided Prompting
Yuan, S., Yang, D., Liu, J., Tian, S., Liang, J., Xiao, Y., & Xie, R. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.514 · Cited by 10 · see citing works
Self-citationHuman-machine interactions based on hand gesture recognition using deep learning methods
Zholshiyeva, L., Манбетова, Ж., Kaibassova, D., Kassymova, А., Tashenova, Z., Байжуманов, С., Yerzhanova, A., & Aikhynbay, K. (2023) · International Journal of Power Electronics and Drive Systems/International Journal of Electrical and Computer Engineering · doi:10.11591/ijece.v14i1.pp741-748 · Cited by 10 · see citing works
Automatic Rule Induction for Efficient Semi-Supervised Learning
Pryzant, R., Yang, Z., Yi‐chong, X., Zhu, C., & Zeng, M. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.3 · Cited by 10 · see citing works
Self-citationUsing Sociolinguistic Variables to Reveal Changing Attitudes Towards Sexuality and Gender
CH-Wang, S., & Jurgens, D. (2021) · Conference on Empirical Methods in Natural Language Processing (EMNLP) · doi:10.18653/v1/2021.emnlp-main.782 · Cited by 9 · see citing works
Deconfounded Visual Question Generation with Causal Inference
Chen, J., Guo, Z., Xie, J., Cai, Y., & Li, Q. (2023) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3581783.3612536 · Cited by 9 · see citing works
Label-aware debiased causal reasoning for Natural Language Inference
Zhang, K., Zhang, D., Wu, L., Hong, R., Zhao, Y., & Wang, M. (2024) · AI Open · doi:10.1016/j.aiopen.2024.02.001 · Cited by 9 · see citing works
Probabilistic Machine Learning: New Frontiers for Modeling Consumers and their Choices
Dew, R., Padilla, N., Luo, L., Oblander, S., Ansari, A., Boughanmi, K., Braun, M. I., Feinberg, F. M., Liu, J., Otter, T., et al. (2024) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2024.11.002 · Cited by 9 · see citing works
Disentangled Representation Learning for Causal Inference With Instruments
Cheng, D., Li, J., Liu, L., Xu, Z., Zhang, W., Liu, J., & Le, T. D. (2024) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2024.3512790 · Cited by 9 · see citing works
Is anisotropy really the cause of BERT embeddings not being semantic?
Baggetto, A. F., & Fresno, V. (2022) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2022.findings-emnlp.314 · Cited by 9 · see citing works
Rating Sentiment Analysis Systems for Bias Through a Causal Lens
Lakkaraju, K., Srivastava, B., & Valtorta, M. (2024) · IEEE Transactions on Technology and Society · doi:10.1109/tts.2024.3375519 · Cited by 9 · see citing works
Mitigating Biases in Hate Speech Detection from A Causal Perspective
Zhang, Z., Chen, J., & Yang, D. (2023) · Findings of the Association for Computational Linguistics: EMNLP (Findings of EMNLP) · doi:10.18653/v1/2023.findings-emnlp.440 · Cited by 8 · see citing works
Self-citationZhu, E., Wang, J., Zhou, G., Li, C., Chen, F., Ju, K., Chen, L., Yin, Y., Chen, Y., Zhang, Y., et al. (2025) · BMC Medicine · doi:10.1186/s12916-025-04150-7 · Cited by 8 · see citing works
Volkova, S., Arendt, D., Saldanha, E., Glenski, M., Ayton, E., Cottam, J. A., Aksoy, S. G., Jefferson, B. A., & Shrivaram, K. (2021) · Computational and Mathematical Organization Theory · doi:10.1007/s10588-021-09351-y · Cited by 8 · see citing works
Is ChatGPT the Future of Causal Text Mining? A Comprehensive Evaluation and Analysis
Takayanagi, T., Suzuki, M., Kobayashi, R., Sakaji, H., & Izumi, K. (2024) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata62323.2024.10825555 · Cited by 8 · see citing works
Németh, R., & Koltai, J. (2023) · Intersections · doi:10.17356/ieejsp.v9i1.871 · Cited by 8 · see citing works
Biomedical event causal relation extraction based on a knowledge-guided hierarchical graph network
Zhang, B., Li, L., Song, D., & Zhao, Y. S. (2023) · Soft Computing · doi:10.1007/s00500-023-08882-7 · Cited by 8 · see citing works
Rost, M., Resch, K., & Lembens, A. (2025) · Journal of Science Education and Technology · doi:10.1007/s10956-025-10236-x · Cited by 7 · see citing works
Li, D., Guo, Z., Liu, Q., Jin, L., Zhang, Z., Wei, K., & Li, F. (2023) · Electronics · doi:10.3390/electronics12194173 · Cited by 7 · see citing works
Advances in automatically rating the trustworthiness of text processing services
Srivastava, B., Lakkaraju, K., Bernagozzi, M., & Valtorta, M. (2023) · AI and Ethics · doi:10.1007/s43681-023-00391-5 · Cited by 7 · see citing works
Zhao, J., Li, Y., Zhou, Y. Z., Du, W.-L., Li, X., Yao, R., & Saddik, A. E. (2025) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2025.3553094 · Cited by 7 · see citing works
Conceptualizing Treatment Leakage in Text-based Causal Inference
Daoud, A., Jerzak, C., & Johansson, R. (2022) · Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) · doi:10.18653/v1/2022.naacl-main.413 · Cited by 7 · see citing works
Improving long-tail relation extraction via adaptive adjustment and causal inference
Tang, J., Li, L., Lu, H., Zhang, B., & Wu, H. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126563 · Cited by 7 · see citing works
The Effect of Scaling, Retrieval Augmentation and Form on the Factual Consistency of Language Models
Hagström, L., Saynova, D., Norlund, T., Johansson, M., & Johansson, R. (2023) · Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2023.emnlp-main.332 · Cited by 6 · see citing works
Cardoso, M. M. D. A., Rúgolo, J. R. M., Thabane, L., da Rocha, N. C., Barbosa, A. M. P., Komoda, D. S., de Almeida, J. T. C., Curado, D. D. S. P., Weber, S. A. T., & de Andrade, L. G. M. (2024) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462324000163 · Cited by 6 · see citing works
Visual Comparison of Text Sequences Generated by Large Language Models
Sevastjanova, R., Vogelbacher, S., Spitz, A., Keim, D. A., & El‐Assady, M. (2023) · IEEE Visualization in Data Science (VDS) · doi:10.1109/vds60365.2023.00007 · Cited by 6 · see citing works
Causal Intervention for Mitigating Name Bias in Machine Reading Comprehension
Zhu, J., Wu, S., Zhang, X., Hou, Y., & Feng, Z. (2023) · Findings of the Association for Computational Linguistics: ACL (Findings of ACL) · doi:10.18653/v1/2023.findings-acl.812 · Cited by 6 · see citing works
Fajčík, M., Singh, M., Zuluaga-gomez, J. P., Villatoro-Tello, E., Burdisso, S., Motlíček, P., & Smrž, P. (2022) · Workshop on Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE) · doi:10.18653/v1/2022.case-1.10 · Cited by 6 · see citing works
Future Directions for Quantitative Systems Pharmacology
Schoeberl, B., Musante, C. J., & Ramanujan, S. (2024) · Handbook of experimental pharmacology · doi:10.1007/164_2024_737 · Cited by 5 · see citing works
Causal Inferences from Digital Behavioral Data
Leitgöb, H., & Keusch, F. (2026) · KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie · doi:10.1007/s11577-026-01050-3 · Cited by 5 · see citing works
Causal Machine Learning: A Deductive–Inductive Framework for Sociological Research
Jeon, N., & Brand, J. E. (2026) · KZfSS Kölner Zeitschrift für Soziologie und Sozialpsychologie · doi:10.1007/s11577-026-01053-0 · Cited by 5 · see citing works
Deconfounded Emotion Guidance Sticker Selection with Causal Inference
Chen, J., Cai, Y., Xu, R., Wang, J., Xie, J., & Li, Q. (2024) · ACM International Conference on Multimedia (ACM MM) · doi:10.1145/3664647.3681522 · Cited by 5 · see citing works
Evaluating Causal AI Techniques for Health Misinformation Detection
Clark, O., & Joshi, K. P. (2025) · IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) · doi:10.1109/percomworkshops65533.2025.00040 · Cited by 5 · see citing works
Pseudo dense counterfactual augmentation for aspect-based sentiment analysis
Ouyang, J., Feng, S., Wang, B., & Yang, Z. (2023) · Neurocomputing · doi:10.1016/j.neucom.2023.126869 · Cited by 5 · see citing works
Farahani, M., & Johansson, R. (2024) · Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/2024.emnlp-main.943 · Cited by 5 · see citing works
Graphing the Truth: Harnessing Causal Insights for Advanced Multimodal Fake News Detection
Ma, Z., Luo, M., Zeng, Z., Wan, H., Li, Y., & Zhao, X. H. (2025) · IEEE Transactions on Information Forensics and Security · doi:10.1109/tifs.2025.3637696 · Cited by 4 · see citing works
Conformal Counterfactual Inference under Hidden Confounding
Chen, Z., Guo, R., Ton, J.-F., & Liu, Y. (2024) · ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) · doi:10.1145/3637528.3671976 · Cited by 4 · see citing works
Darkness can not drive out darkness: Investigating Bias in Hate SpeechDetection Models
Elsafoury, F. (2022) · Annual Meeting of the Association for Computational Linguistics: Student Research Workshop (ACL SRW) · doi:10.18653/v1/2022.acl-srw.4 · Cited by 4 · see citing works
- Authors
- Feder, A., Keith, K. A., Manzoor, E., Pryzant, R., Sridhar, D., Wood-Doughty, Z., Eisenstein, J., Grimmer, J., Reichart, R., Roberts, M. E., Stewart, B. M., Veitch, V., & Yang, D.
- Affiliations
- Technion – Israel Institute of Technology (IL)
- Williams College (US)
- University of Wisconsin–Madison (US)
- Microsoft (United States) (US)
- Columbia University (US)
- Northwestern University (US)
- Google (United States) (US)
- Stanford University (US)
- University of California San Diego (US)
- Princeton University (US)
- Georgia Institute of Technology (US)
- ORCID
- Venue
- Transactions of the Association for Computational Linguistics
- Publisher
- MIT Press
- Published
- 2022
- Volume
- 10
- Pages
- 1138-1158
- ISSN
- 2307-387X (ISSN-L)
- OpenAlex
- W4312516176
- Cited by
- 220
- References
- 146
- Citations by year
- 2026: 42 · 2025: 36 · 2024: 51 · 2023: 50 · 2022: 37 · 2021: 4
- FWCI
- 30.78
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Transactions of the Association for Computational Linguistics (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Physical Sciences › Computer Science › Artificial Intelligence › Natural Language Processing Techniques
- Keywords
- causal inference, natural language processing, causal effect estimation, confounding, interpretability, robustness, fairness, benchmark dataset
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review