Beyond prediction: Using big data for policy problems
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Machine-learning prediction methods have been extremely productive in applications ranging from medicine to allocating fire and health inspectors in cities. However, there are a number of gaps between making a prediction and making a decision, and underlying assumptions need to be understood in order to optimize data-driven decision-making.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and help predict prices and availability of key resources for production [90,91].”
From Exploring the relationship between big data analytics capability and competitive performance: The mediating roles of dynamic and operational capabilities (2020) · cites this paper as [90]
In the citing paper
“ML can play a role in causal inference [41,340,619], including in the context of policy problems [40,453] and in climate-relevant scenarios such as estimating the effects of temperature on human mortality [356] and the effects of World Bank projects on vegetative cover [883].”
From Tackling climate change with machine learning (2023) · cites this paper as [40]
Citations
Cites
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297
Inference on Treatment Effects after Selection among High-Dimensional Controls
Belloni, A., Chernozhukov, V., & Hansen, C. (2014) · The Review of Economic Studies · doi:10.1093/restud/rdt044 · Cited by 1,508
Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain
(2012) · Econometrica · doi:10.3982/ecta9626 · Cited by 889
Predicting poverty and wealth from mobile phone metadata
Blumenstock, J., Cadamuro, G., & On, R. (2015) · Science · doi:10.1126/science.aac4420 · Cited by 698
Fairness-Aware Classifier with Prejudice Remover Regularizer
Kamishima, T., Akaho, S., Asoh, H., & Sakuma, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33486-3_3 · Cited by 694 · cited 1×
“These issues have received recent attention in the literature on SML [e.g., ( 21 )].”
BackgroundKleinberg, J., Ludwig, J., Mullainathan, S., & Obermeyer, Z. (2015) · American Economic Review · doi:10.1257/aer.p20151023 · Cited by 584
Doubly Robust Policy Evaluation and Learning
Dudı́k, M., Langford, J. C., & Li, L. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.4601 · Cited by 375
Consumer Heterogeneity and Paid Search Effectiveness: A Large-Scale Field Experiment
Blake, T., Nosko, C., & Tadelis, S. (2015) · Econometrica · doi:10.3982/ecta12423 · Cited by 354
Research works printed but not linked: 3
- S. Athey G. Imbens S. Wager Approximate residual balancing: De-biased inference of average treatment effects in high dimensions; https://arxiv.org/abs/1604.07125 (2016). · arXiv
- S. Athey J. Tibshirani S. Wager Solving heterogeneous estimating equations with gradient forests; https://arxiv.org/abs/1610.01271 (2016). · arXiv
- A. Agarwal et al . A multiworld testing decision service; https://arxiv.org/abs/1606.03966 (2016). · arXiv
Cited by
Mikalef, P., Krogstie, J., Pappas, I. O., & Pavlou, P. (2020) · Information & Management · doi:10.1016/j.im.2019.05.004 · Cited by 1,373
“With regards to external process sensing, BDACs can contribute toward identifying bottlenecks or other potential hazards in supply chains [87], detect market disturbances and monitor the financial environment [88,89], and help predict prices and availability of key resources for production [90,91].”
BackgroundExplaining machine learning classifiers through diverse counterfactual explanations
Mothilal, R. K., Sharma, A., & Tan, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372850 · Cited by 1,233
“ument is valid for a range of scenarios involving decision-making on an individual’s outcome, such as deciding admission to a university [40], screening job applicants [33], disbursing government aid [3, 5], and identifying people at high risk of a future disease [11]. In all these cases, knowing reasons for a bad out…”
BackgroundMachine Learning Methods That Economists Should Know About
Athey, S., & Imbens, G. W. (2019) · Annual Review of Economics · doi:10.1146/annurev-economics-080217-053433 · Cited by 1,163
“, Athey and Imbens [2016], Wager and Athey [2017]) and orthogonalization (e.”
BackgroundMethodResultInfluentialSelf-citationTyralis, H., Papacharalampous, G., & Langousis, A. (2019) · Water · doi:10.3390/w11050910 · Cited by 771
“An additional important issue frequently neglected is that causal inference is different from prediction, although there is increasing research regarding causal inference, interpretability, and reliability of machine learning methods [55].”
BackgroundArtificial Intelligence and Black‐Box Medical Decisions: Accuracy versus Explainability
London, A. J. (2019) · Hastings Center Report · doi:10.1002/hast.973 · Cited by 801
Quasi-oracle estimation of heterogeneous treatment effects
Nie, X., & Wager, S. (2021) · Biometrika · doi:10.1093/biomet/asaa076 · Cited by 545
“Chernozhukov et al. (2017) discusses how Robinson’s approach to the partially linear model generalizes naturally to this case, and Athey, Tibshirani, and Wager (2018) adapt their causal forest to work with instruments.”
BackgroundInfluentialArtificial intelligence and illusions of understanding in scientific research
Messeri, L., & Crockett, M. J. (2024) · Nature · doi:10.1038/s41586-024-07146-0 · Cited by 707
“However, others have highlighted epistemic risks inherent to predictive science 17,33,113,141,142 .”
Del Río Castro, G., González Fernández, M. C., & Uruburu Colsa, Á. (2021) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.122204 · Cited by 569
Explainable machine learning in deployment
Bhatt, U., Xiang, A., Sharma, S., Weller, A., Taly, A., Jia, Y., Ghosh, J., Puri, R., Moura, J. M. F., & Eckersley, P. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3375624 · Cited by 633
“The relationship between causality and explainability in MLrelatestoabroaderdichotomy.IndistinguishingMLtechniquesfrom those in econometrics or statistics, a key component is prediction vs. inference [10, 11, 33]. ML focuses on prediction, such that understandingtheunderlyingprocessisgenerallyconsideredlessimportant t…”
BackgroundLiengaard, B. D., Sharma, P. N., Hult, G. T. M., Jensen, M. B., Sarstedt, M., Hair, J. F., & Ringle, C. M. (2021) · Decision Sciences · doi:10.1111/deci.12445 · Cited by 500
Co-Production and Co-Creation: Engaging Citizens in Public Services
Brandsen, T., Steen, T., & Verschuere, B. (2018) · Routledge eBooks · doi:10.4324/9781315204956 · Cited by 450
Impacts of climate change on global agriculture accounting for adaptation
Hultgren, A., Carleton, T., Delgado, M., Gergel, D. R., Greenstone, M., Houser, T., Hsiang, S., Jina, A., Kopp, R. E., Malevich, S. B., et al. (2025) · Nature · doi:10.1038/s41586-025-09085-w · Cited by 354
Zhao, X., Yan, X., Yu, A., & Van Hentenryck, P. (2020) · Travel Behaviour and Society · doi:10.1016/j.tbs.2020.02.003 · Cited by 405
“…with recent development in inter-pretable/explainable machine learning, a wide range of machine learning interpretation tools have been invented and applied to extract knowledge from the black-box models to facilitate decision-making (Athey, 2017; Doshi-Velez and Kim, 2017; Molnar, 2018).”
BackgroundDurán, J. M., & Jongsma, K. R. (2021) · Journal of Medical Ethics · doi:10.1136/medethics-2020-106820 · Cited by 446
The potential impacts of digital technologies on co-production and co-creation
Lember, V., Brandsen, T., & Tõnurist, P. (2019) · Public Management Review · doi:10.1080/14719037.2019.1619807 · Cited by 354
“The mere presence of citizens in public spaces provides the governments potentially valuable feedback (Cardullo and Kitchin 2018) and makes it possible to build predictive governance models based on the actual behaviour of citizens, without actively engaging them (Athey 2017).”
BackgroundGuo, L., & Xu, L. (2021) · Sustainability · doi:10.3390/su132212844 · Cited by 321
“This is not only about the reduction of labor intensity resulting from automation [45], or the support to dynamic decision-making driven by data [46], but about the overall improvement of work efficiency brought about by organizational structure optimization [47].”
BackgroundRacial Bias in Hate Speech and Abusive Language Detection Datasets
Davidson, T., Bhattacharya, D., & Weber, I. (2019) · Proceedings of the Third Workshop on Abusive Language Online · doi:10.18653/v1/w19-3504 · Cited by 414
“Scholars and practitioners have recently been de-voting more attention to bias in machine learning models, particularly as these models are becoming involved in more and more consequential decisions ( Athey, 2017).”
BackgroundIntegrating explanation and prediction in computational social science
Hofman, J. M., Watts, D. J., Athey, S., Garip, F., Griffiths, T. L., Kleinberg, J., Margetts, H., Mullainathan, S., Salganik, M. J., Vazire, S., et al. (2021) · Nature · doi:10.1038/s41586-021-03659-0 · Cited by 371
Self-citationEngin, Z., & Treleaven, P. (2019) · The Computer Journal · doi:10.1093/comjnl/bxy082 · Cited by 284
“Closely related to big data is behavioral and predictive analytics that focuses on providing insight into the actions of people [41].”
BackgroundTackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336
Measuring the predictability of life outcomes with a scientific mass collaboration
Salganik, M. J., Lundberg, I., Kindel, A. T., Ahearn, C. E., Al-Ghoneim, K., Almaatouq, A., Altschul, D. M., Brand, J. E., Carnegie, N. B., Compton, R. J., et al. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1915006117 · Cited by 322
“First, accurate predictions can be used to target assistance to children and families at risk (1, 2).”
BackgroundRetention Futility: Targeting High-Risk Customers Might be Ineffective
Ascarza, E. (2018) · Journal of Marketing Research · doi:10.1509/jmr.16.0163 · Cited by 295
Machine Learning for Sociology
Molina, M., & Garip, F. (2019) · Annual Review of Sociology · doi:10.1146/annurev-soc-073117-041106 · Cited by 295
Causality-based Feature Selection: Methods and Evaluations
Yu, K., Guo, X., Liu, L., Li, J., Wang, H., Ling, Z., & Wu, X. (2021) · ACM Computing Surveys · doi:10.1145/3409382 · Cited by 201
“• Causal features can improve the robustness of predictive models [9, 82].”
Algorithmic governance: A modes of governance approach
Gritsenko, D., & Wood, M. (2022) · Regulation & Governance · doi:10.1111/rego.12367 · Cited by 183
“…by algorithm-driven technologies, for example, in making quick decisions that can improve economic productivity and facilitate social interaction (Athey 2017) and even solving pressing social issues, such as low-carbon energy transition (Zhou & Yang 2016) or preventing physical checks on goods…”
BackgroundUnsupervised machine learning in urban studies: A systematic review of applications
Wang, J., & Biljecki, F. (2022) · Cities · doi:10.1016/j.cities.2022.103925 · Cited by 208
“…availability of urban data and machine learning techniques that enable automatic pattern recognition from massive datasets have gained momentum in serving researchers to untangle the complexity of cities, thereby informing urban interventions and giving rise to data-driven planning (Athey, 2017).”
BackgroundHow Algorithms Discriminate Based on Data They Lack: Challenges, Solutions, and Policy Implications
Williams, B. A., Brooks, C., & Shmargad, Y. (2018) · Journal of Information Policy · doi:10.5325/jinfopoli.8.1.0078 · Cited by 197
Artificial intelligence and systemic risk
Daníelsson, J., Macrae, R., & Uthemann, A. (2022) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2021.106290 · Cited by 165
Selecting Directors Using Machine Learning
Erel, I., Stern, L. H., Tan, C., & Weisbach, M. S. (2021) · The Review of Financial Studies · doi:10.1093/rfs/hhab050 · Cited by 210
Machine learning for environmental monitoring
Hino, M., Benami, E., & Brooks, N. (2018) · Nature Sustainability · doi:10.1038/s41893-018-0142-9 · Cited by 201
“(2) Aggressive, state: inspections are allocated to the highest-risk facilities, but cannot be reassigned from one state to another.”
BackgroundMethodInfluentialOffline Multi-Action Policy Learning: Generalization and Optimization
Zhou, Z., Athey, S. C., & Wager, S. (2022) · Operations Research · doi:10.1287/opre.2022.2271 · Cited by 286
Self-citationAssessing the regulatory challenges of emerging disruptive technologies
Taeihagh, A., Ramesh, M., & Howlett, M. (2021) · Regulation & Governance · doi:10.1111/rego.12392 · Cited by 146
“The recent wave of disruptive technologies have been affected by the development of various decision technologies such as Crowdsourcing and Big Data Analytics (Prpi c et al. 2015; Athey 2017; Taeihagh 2017b) that create both new problems and opportunities for governments.”
MethodMachine learning, artificial neural networks and social research
Di Franco, G., & Santurro, M. (2021) · Quality & Quantity · doi:10.1007/s11135-020-01037-y · Cited by 158
“…2016; Baldassarri and Abascal 2017), communication science (Hopkins and King 2010; Grimmer and Stewart 2013; Bail 2014), etc., ML has started to be applied both in academic research and in areas related to the management of services provided by the public administration (Athey 2017; Berk et al.”
BackgroundA Generalizable and Accessible Approach to Machine Learning with Global Satellite Imagery
Rolf, E., Proctor, J., Carleton, T. A., Bolliger, I. W., Shankar, V., Ishihara, M., Recht, B., & Hsiang, S. (2020) · Nature Communications · doi:10.2139/ssrn.3727121 · Cited by 258
Machine learning for geographically differentiated climate change mitigation in urban areas
Milojevic-Dupont, N., & Creutzig, F. (2021) · Sustainable Cities and Society · doi:10.1016/j.scs.2020.102526 · Cited by 158
“To best allocate limited resources to certain mitigation efforts, beyond pinpointing where problems are, one needs to ponder how effective possible interventions are likely to be – i.e. inferring their causal effect (Athey, 2017).”
BackgroundA Latent Factor Analysis-Based Approach to Online Sparse Streaming Feature Selection
Wu, D., He, Y., Luo, X., & Zhou, M. (2022) · IEEE Transactions on Systems, Man, and Cybernetics: Systems · doi:10.1109/tsmc.2021.3096065 · Cited by 158
“use has become a great challenge [1], [2], [6].”
BackgroundCitizens and cities: Leveraging citizen science and big data for sustainable urban development
Cappa, F., Franco, S., & Rosso, F. (2021) · Business Strategy and the Environment · doi:10.1002/bse.2942 · Cited by 171
Poverty from Space: Using High-Resolution Satellite Imagery for Estimating Economic Well-Being
Engstrom, R. N., Hersh, J. S., & Newhouse, D. (2017) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-8284 · Cited by 152
“These findings raise a host of questions for further work, and contribute to an ongoing discussion regarding the use of predictive methods in public policy (Athey, 2017).”
BackgroundPredicting entrepreneurial success is hard: Evidence from a business plan competition in Nigeria
McKenzie, D. J., & Sansone, D. (2019) · Journal of Development Economics · doi:10.1016/j.jdeveco.2019.07.002 · Cited by 154
“In contrast, such predictions are usually inappropriate for a policy maker aiming to optimally allocate resources (Athey, 2017), who would instead be most interested in allocating funds to firms that would benefit most from the grants, not to those firms which would be successful anyway.”
BackgroundPredicting neighborhoods’ socioeconomic attributes using restaurant data
Dong, L., Ratti, C., & Zheng, S. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1903064116 · Cited by 142
“However, “there are a number of gaps between making a prediction and making a decision” (25).”
BackgroundCaetano, G. H. D. O., Chapple, D. G., Grenyer, R., Raz, T., Rosenblatt, J., Tingley, R., Böhm, M., Meiri, S., & Roll, U. (2022) · PLoS Biology · doi:10.1371/journal.pbio.3001544 · Cited by 147
“Machine learning methods, such as XGBoost, are geared primarily toward prediction not inference [33].”
Techno-optimism and policy-pessimism in the public sector big data debate
Vydra, S., & Klievink, B. (2019) · Government Information Quarterly · doi:10.1016/j.giq.2019.05.010 · Cited by 104
“Prediction problems essentially require pre-existing knowledge about the causal link between policy intervention and outcomes, including how these outcomes depend on the occurrence of a specific event (Athey, 2017).”
BackgroundMachine Learning as a Tool for Hypothesis Generation
Ludwig, J., & Mullainathan, S. (2024) · The Quarterly Journal of Economics · doi:10.1093/qje/qjad055 · Cited by 186
Emerging approaches applied to maritime transport research: past and future
Yan, R., Wang, S., Zhen, L., & Laporte, G. (2021) · Communications in Transportation Research · doi:10.1016/j.commtr.2021.100011 · Cited by 111
Batayneh, R. M. A., Taleb, N., Said, R. A., Alshurideh, M. T., Ghazal, T. M., & Alzoubi, H. M. (2021) · Advances in intelligent systems and computing · doi:10.1007/978-3-030-76346-6_22 · Cited by 108
Block, P., Koskinen, J. H., Hollway, J., Steglich, C., & Stadtfeld, C. (2017) · Social Networks · doi:10.1016/j.socnet.2017.08.001 · Cited by 118
Valverde, S. C., Solas, P. J. C., & Fernández, F. R. (2020) · PLoS ONE · doi:10.1371/journal.pone.0240362 · Cited by 125
“Over the last few years, different causal machine learning algorithms have been developed, combining the advances from machine learning with the theory of causal inference [94].”
BackgroundFairness issues, current approaches, and challenges in machine learning models
Jui, T. D., & Rivas, P. (2024) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-023-02083-2 · Cited by 131
Poverty from Space: Using High Resolution Satellite Imagery for Estimating Economic Well-being
Engstrom, R. N., Hersh, J. S., & Newhouse, D. (2021) · The World Bank Economic Review · doi:10.1093/wber/lhab015 · Cited by 108
Erasmus, A., Brunet, T. D. P., & Fisher, E. (2021) · Philosophy & Technology · doi:10.1007/s13347-020-00435-2 · Cited by 80
“These problems have led to calls for MAIS, and ANNs in general, to be explainable—that is, if an ANN makes a recommendation, there should be an explanation for its decision (Athey 2017; Aler Tubella et al. 2019).”
BackgroundAssessing the Economic Value of Clinical Artificial Intelligence: Challenges and Opportunities
Hendrix, N., Veenstra, D. L., Cheng, M., Anderson, N. C., & Verguet, S. (2022) · Value in Health · doi:10.1016/j.jval.2021.08.015 · Cited by 83
Targeting with machine learning: An application to a tax rebate program in Italy
Andini, M., Ciani, ., de Blasio, G., D’Ignazio, A., & Salvestrini, V. (2018) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2018.09.010 · Cited by 150
The Technological Elements of Artificial Intelligence
Taddy, M. A. (2018) · National Bureau of Economic Research · doi:10.3386/w24301 · Cited by 120
Beyond Early Warning Indicators: High School Dropout and Machine Learning
Sansone, D. (2019) · Oxford Bulletin of Economics and Statistics · doi:10.1111/obes.12277 · Cited by 76
Foundations and Future Directions for Causal Inference in Ecological Research
Siegel, K., & Dee, L. E. (2025) · Ecology Letters · doi:10.1111/ele.70053 · Cited by 95
Does public concern over haze pollution matter? Evidence from Beijing-Tianjin-Hebei region, China
Li, C., Ma, X., Fu, T., & Guan, S. (2020) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2020.142397 · Cited by 88
Wang, A., Kapoor, S., Barocas, S., & Narayanan, A. (2024) · ACM Journal on Responsible Computing · doi:10.1145/3636509 · Cited by 57
“While there are methods being developed to use machine learning to model this gap through techniques like causal modeling [12, 48, 51, 93, 123, 131, 204], they would require additional assumptions compared to off-the-shelf ML tools and/or additional data collection.”
MethodMachine Learning from Schools about Energy Efficiency
Burlig, F., Knittel, C., Rapson, D., Reguant, M., & Wolfram, C. (2020) · Journal of the Association of Environmental and Resource Economists · doi:10.1086/710606 · Cited by 73
A Double machine learning trend model for citizen science data
Fink, D., Johnston, A., Strimas‐Mackey, M., Auer, T., Hochachka, W. M., Ligocki, S., Jaromczyk, L., Robinson, O. J., Wood, C., Kelling, S., et al. (2023) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.14186 · Cited by 93
“The DLM framework was developed specifically to estimate heterogenous treatment effects with large, feature-rich observational datasets, an important problem in many disciplines where confounding is a central concern, from economics (Athey, 2017) to personalized medicine (Obermeyer & Emanuel, 2016).”
London, A. J. (2022) · Cell Reports Medicine · doi:10.1016/j.xcrm.2022.100622 · Cited by 76
“22 For example, instrumental variables can be used to distinguish the relative causal contributions of variables that are associated with an outcome, 23 but treating a variable as instrumental requires that we understand its relationship to the other variables in question.”
Data-driven anticipatory governance. Emerging scenarios in data for policy practices
Maffei, S., Leoni, F., & Villari, B. (2020) · Policy Design and Practice · doi:10.1080/25741292.2020.1763896 · Cited by 96
“In this scenario, what appears particularly intriguing is the use of predictive analytics (Athey 2017; Engin & Treleaven 2019).”
BackgroundHow effective is carbon pricing?—A machine learning approach to policy evaluation
Abrell, J., Kosch, M., & Rausch, S. (2021) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2021.102589 · Cited by 90
A Unified Survey of Treatment Effect Heterogeneity Modelling and Uplift Modelling
Zhang, W., Li, J., & Liu, L. (2021) · ACM Computing Surveys · doi:10.1145/3466818 · Cited by 123
An invitation to market design
Kominers, S. D., Teytelboym, A., & Crawford, V. P. (2017) · Oxford Review of Economic Policy · doi:10.1093/oxrep/grx063 · Cited by 86
“reduced costs of communication and coordination across space and time (Moore, 1965), • vast data sets (Einav and Levin, 2014; Athey, 2017) including digitised media (books, maps, and historical archives), information about social networks (Pentland, 2014), and high-resolution imagery data (Naik et…”
BackgroundCzyz, E. K., Koo, H. J., Al‐Dajani, N., King, C. A., & Nahum-Shani, I. (2021) · Psychological Medicine · doi:10.1017/s0033291721005006 · Cited by 78
“These methods have the important advantage of handling large volumes of predictors and combining them in interactive and non-linear ways (Athey, 2017), yielding algorithmically optimized prediction models.”
MethodResultFinance, technology and disruption
An, J., & Rau, P. R. (2019) · European Journal of Finance · doi:10.1080/1351847x.2019.1703024 · Cited by 75
The future of the future city? The new urban sciences and a PEAK Urban interdisciplinary disposition
Keith, M., O’Clery, N., Parnell, S., & Revi, A. (2020) · Cities · doi:10.1016/j.cities.2020.102820 · Cited by 75
“There is much work to be done, however, to adapt these methods to policy needs, largely due to the difficulty in estimating size effects for individual variables within these frameworks (Athey, 2017).”
BackgroundMachine learning in the service of policy targeting: The case of public credit guarantees
Andini, M., Boldrini, M., Ciani, ., de Blasio, G., D’Ignazio, A., & Paladini, A. (2022) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2022.04.004 · Cited by 73
Reliability of electric vehicle charging infrastructure: A cross-lingual deep learning approach
Liu, Y., Francis, A., Hollauer, C., Lawson, M. C., Shaikh, O., Cotsman, A., Bhardwaj, K., Banboukian, A., Li, M., Webb, A., et al. (2023) · Communications in Transportation Research · doi:10.1016/j.commtr.2023.100095 · Cited by 77
Learning Objectives for Treatment Effect EstimationPreprint
Nie, X., & Wager, S. (2017) · arXiv (Cornell University) · Cited by 67
Data-driven multiple criteria decision making for diagnosis of thyroid cancer
Fu, C., Liu, W., & Chang, W. (2018) · Annals of Operations Research · doi:10.1007/s10479-018-3093-7 · Cited by 67
“…2014), education (Datnow and Hubbard 2016; Dunn et al. 2013; Gullo 2013), energy (Haluetal.2016;Hu2015;Jainetal.2017),traffic(Liuetal.2015),patternrecognition(Wong andWang2003),business(Hedgebeth2007),operationalmanagement(Levietal.2015;Huh etal.2011;Shietal.2016;Yanetal.2016),andpolicy(Athey2017).”
Backgroundde Marcellis-Warin, N., Marty, F. M., Thelisson, E., & Warin, T. (2022) · AI and Ethics · doi:10.1007/s43681-022-00149-5 · Cited by 77
“A.I. is a predictive analytics tool based on data modeling [2, 3].”
MethodEnhancing the adoption of digital public services: Evidence from a large-scale field experiment
Hyytinen, A., Tuimala, J., & Hammar, M. (2022) · Government Information Quarterly · doi:10.1016/j.giq.2022.101687 · Cited by 75
Machine Learning Methods Economists Should Know AboutPreprint
Athey, S. C., & Imbens, G. W. (2019) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1903.10075 · Cited by 86
“, Athey and Imbens [2016], Wager and Athey [2017]) and orthogonalization (e.”
BackgroundMethodResultInfluentialSelf-citationBridging the gap: Towards an expanded toolkit for AI-driven decision-making in the public sector
Fischer-Abaigar, U., Kern, C. A., Barda, N., & Kreuter, F. (2024) · Government Information Quarterly · doi:10.1016/j.giq.2024.101976 · Cited by 80
Multivariate Neural Connectivity Patterns in Early Infancy Predict Later Autism Symptoms
Dickinson, A. H., Daniel, M., Marin, A., Gaonkar, B., Dapretto, M., McDonald, N. M., & Jeste, S. (2020) · Biological Psychiatry Cognitive Neuroscience and Neuroimaging · doi:10.1016/j.bpsc.2020.06.003 · Cited by 76
The informal economy at times of COVID-19 pandemic
Guo, F., Huang, Y., Wang, J., & Wang, X. (2022) · China Economic Review · doi:10.1016/j.chieco.2021.101722 · Cited by 61
“4 We first predict the counterfactuals using a machine learning technique and further interpret the difference between the realized and counterfactual results as the causal impact of the pandemic (Athey, 2017).”
Martinis, V. D., & Corman, F. (2018) · Transportation Research Part C Emerging Technologies · doi:10.1016/j.trc.2018.08.008 · Cited by 66
The Great Regression: Machine Learning, Econometrics, and the Future of Quantitative Social Sciences
Boelaert, J., & Ollion, É. (2018) · Revue Française de Sociologie · doi:10.3917/e.rfs.593.0475 · Cited by 75
Deconfounded Lexicon Induction for Interpretable Social Science
Pryzant, R., Shen, K., Jurafsky, D., & Wagner, S. (2018) · Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers) · doi:10.18653/v1/n18-1146 · Cited by 57
“Athey (2017) has a recent survey of machine learning problems where causal modeling is important.”
BackgroundLe moment big data des sciences sociales
Bastin, G., & Tubaro, P. (2018) · Revue Française de Sociologie · doi:10.3917/rfs.593.0375 · Cited by 76
Miao, R., & Khanna, M. (2020) · Annual Review of Resource Economics · doi:10.1146/annurev-resource-110319-115428 · Cited by 66
Classification of hospital admissions into emergency and elective care: a machine learning approach
Krämer, J., Schreyögg, J., & Busse, R. (2017) · Health Care Management Science · doi:10.1007/s10729-017-9423-5 · Cited by 68
“A broad range of future applications in health care has recently been discussed [59, 60].”
BackgroundHave Housing Prices Gone with the Smelly Wind? Big Data Analysis on Landfill in Hong Kong
Li, R. Y. M., & Li, H. (2018) · Sustainability · doi:10.3390/su10020341 · Cited by 59
“This has also led to the development of various large-data statistical methods [31].”
MethodKim, E. S. (2020) · Technology in Society · doi:10.1016/j.techsoc.2020.101378 · Cited by 67
Digital transformation and financing constraints of SMEs: evidence from China
Guo, L., Xu, L., Wang, J., & Li, J. (2023) · Asia-Pacific Journal of Accounting & Economics · doi:10.1080/16081625.2023.2257235 · Cited by 71
“This will provide managers of SMEs with data-driven dynamic decision support for risk aversion (Athey 2017).”
Sharma, P. N., Sarstedt, M., Ringle, C. M., Cheah, J., Herfurth, A., & Hair, J. F. (2024) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2024.102805 · Cited by 63
Machine Learning in Policy Evaluation: New Tools for Causal Inference
Kreif, N., & DiazOrdaz, K. (2019) · Oxford Research Encyclopedia of Economics and Finance · doi:10.1093/acrefore/9780190625979.013.256 · Cited by 57
Improving Regulatory Effectiveness Through Better Targeting: Evidence from OSHA
Johnson, M. S., Levine, D. I., & Toffel, M. W. (2019) · American Economic Journal Applied Economics · doi:10.1257/app.20200659 · Cited by 80
Zhang, Y., Porter, A. L., Cunningham, S. W., Chiavetta, D., & Newman, N. C. (2020) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2020.2974761 · Cited by 64
“Based on the investigation, as well as the discussion given by Athey [6], one highlight for enhancing the involvement of data science in policy analysis moving forward is identified.”
BackgroundMethodInfluentialCausal Machine Learning and its use for public policy
Lechner, M. (2023) · Zeitschrift für schweizerische Statistik und Volkswirtschaft/Schweizerische Zeitschrift für Volkswirtschaft und Statistik/Swiss journal of economics and statistics · doi:10.1186/s41937-023-00113-y · Cited by 70
“Causal Machine Learning unites these trends: it adapts Machine Learning methods to answer well identified causal questions using large and informative data (e.g. Athey, 2017; Athey & Imbens, 2019).”
A Unified Framework for Marketing Budget Allocation
Zhao, K., Hua, J.-H., Yan, L., Zhang, Q., Xu, H., & Yang, C. (2019) · Knowledge Discovery and Data Mining · doi:10.1145/3292500.3330700 · Cited by 66
“Although black-box forecasting methods, such as neural networks, have been widely used in many applications [21, 33, 35], there are several gaps between forecasting and decision making [2].”
BackgroundBrandt, T., Wagner, S., & Neumann, D. (2020) · European Journal of Operational Research · doi:10.1016/j.ejor.2020.09.034 · Cited by 64
“For instance, Athey (2017) and Glaeser, Hillis, Kominers and Luca (2016) point out how cities can use analytical systems to more efficiently allocate building and health inspectors based on predicted probabilities of violations occurring, improving day-to-day operations and contributing to public…”
Open Humans: a platform for participant-centered research and personal data exploration
Greshake Tzovaras, B., Angrist, M., Arvai, K., Dulaney, M., Estrada-Galiñanes, V., Gunderson, B., Head, T., Lewis, D., Nov, O., Shaer, O., et al. (2019) · GigaScience · doi:10.1093/gigascience/giz076 · Cited by 56
“data from devices contribute to a sense that these collected data can change how research in these elds is performed [1, 2, 3, 4]”
Gaskin, J. E., Ogbeibu, S., & Lowry, P. B. (2023) · Springer eBooks · doi:10.1007/978-3-031-37772-3_8 · Cited by 69
Leveraging Big Data Tools and Technologies: Addressing the Challenges of the Water Quality Sector
Romero, J. P., Hallett, S. H., & Jude, S. (2017) · Sustainability · doi:10.3390/su9122160 · Cited by 60
“However, expert judgement is still needed to incorporate assumptions beyond those required for the prediction methods, usually not testable but influencing the results, and the verification of the outcomes [73].”
BackgroundSelecting Directors Using Machine Learning
Erel, I., Stern, L. H., Tan, C., & Weisbach, M. S. (2018) · National Bureau of Economic Research · doi:10.3386/w24435 · Cited by 71
“4 See Athey and Imbens (2017) and Mullainathan and Spiess (2017). algorithm’s predictions as a diagnostic tool to shed light on the decision-making process behind the selection of directors.”
BackgroundResultInfluentialRefining public policies with machine learning: The case of tax auditing
Battaglini, M., Guiso, L., Lacava, C., Miller, D. L., & Patacchini, E. (2024) · Journal of Econometrics · doi:10.1016/j.jeconom.2024.105847 · Cited by 71
Timing It Right: Balancing Inpatient Congestion vs. Readmission Risk at Discharge
Shi, P., Helm, J. E., Deglise‐Hawkinson, J., & Pan, J. (2018) · Operations Research · doi:10.1287/opre.2020.2044 · Cited by 53
Data Science for Economics and Finance: Methodologies and Applications
Consoli, S., Recupero, D. R., & Saisana, M. (2021) · Springer eBooks · doi:10.1007/978-3-030-66891-4 · Cited by 67
Metadata
- Authors
- Athey, S.
- Affiliations
- Stanford University (US)
- Corresponding author
- Athey, Susan
- ORCID
- Athey, Susan
- Venue
- Science
- Published
- 2017-02-03
- Volume
- 355
- Issue
- 6324
- Pages
- 483-485
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2584924584
- Semantic Scholar
- 3b718eebc6f4469053dadb5737b67ee18b16722d
- Cited by
- 575
- References
- 20
- Citations by year
- 2026: 27 · 2025: 73 · 2024: 74 · 2023: 66 · 2022: 83 · 2021: 73 · 2020: 70 · 2019: 48 · 2018: 41 · 2017: 20
- FWCI
- 78.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Keywords
- big data, data-driven decision making, machine learning prediction, policy challenges, public policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.