Beyond prediction: Using big data for policy problems
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Machine-learning prediction methods have been extremely productive in applications ranging from medicine to allocating fire and health inspectors in cities. However, there are a number of gaps between making a prediction and making a decision, and underlying assumptions need to be understood in order to optimize data-driven decision-making.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and help predict prices and availability of key resources for production [90,91].”
From Exploring the relationship between big data analytics capability and competitive performance: The mediating roles of dynamic and operational capabilities (2020) · cites this paper as [90]
In the citing paper
“ML can play a role in causal inference [41,340,619], including in the context of policy problems [40,453] and in climate-relevant scenarios such as estimating the effects of temperature on human mortality [356] and the effects of World Bank projects on vegetative cover [883].”
From Tackling climate change with machine learning (2023) · cites this paper as [40]
Citations
Cites
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297
Inference on Treatment Effects after Selection among High-Dimensional Controls
Belloni, A., Chernozhukov, V., & Hansen, C. (2014) · The Review of Economic Studies · doi:10.1093/restud/rdt044 · Cited by 1,508
Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain
(2012) · Econometrica · doi:10.3982/ecta9626 · Cited by 889
Predicting poverty and wealth from mobile phone metadata
Blumenstock, J., Cadamuro, G., & On, R. (2015) · Science · doi:10.1126/science.aac4420 · Cited by 698
Fairness-Aware Classifier with Prejudice Remover Regularizer
Kamishima, T., Akaho, S., Asoh, H., & Sakuma, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33486-3_3 · Cited by 694 · cited 1×
“These issues have received recent attention in the literature on SML [e.g., ( 21 )].”
BackgroundKleinberg, J., Ludwig, J., Mullainathan, S., & Obermeyer, Z. (2015) · American Economic Review · doi:10.1257/aer.p20151023 · Cited by 584
Doubly Robust Policy Evaluation and Learning
Dudı́k, M., Langford, J. C., & Li, L. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.4601 · Cited by 375
Consumer Heterogeneity and Paid Search Effectiveness: A Large-Scale Field Experiment
Blake, T., Nosko, C., & Tadelis, S. (2015) · Econometrica · doi:10.3982/ecta12423 · Cited by 354
Research works printed but not linked: 3
- S. Athey G. Imbens S. Wager Approximate residual balancing: De-biased inference of average treatment effects in high dimensions; https://arxiv.org/abs/1604.07125 (2016). · arXiv
- S. Athey J. Tibshirani S. Wager Solving heterogeneous estimating equations with gradient forests; https://arxiv.org/abs/1610.01271 (2016). · arXiv
- A. Agarwal et al . A multiworld testing decision service; https://arxiv.org/abs/1606.03966 (2016). · arXiv
Cited by
Items 501–584 of 584
Priming human-computer interactions: Experimental evidence from economic development mobile surveysPreprint
Opoku-Agyemang, K. A. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/h4p23
Why Can We Obtain Such an Analysis?
Abe, A. (2022) · Intelligent systems reference library · doi:10.1007/978-3-031-11593-6_8
Wu, D. (2022) · SpringerBriefs in computer science · doi:10.1007/978-981-19-8140-1_1
Horse Racing Decision and Analysis Based on Data Mining and Big Data Analysis
Zhang, S., & Liu, M. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-981-19-4132-0_30
Souto, C. M. (2023) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.91.2023.tde-21032023-161121
Cohort bias in predictive risk assessments of future criminal justice system involvement
Ludwig, J., Kleinberg, J. M., & Mullainathan, S. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2307285120 · Cited by 2
“As many have argued, there are enormous opportunities for algorithms to positively impact social conditions (2).”
BackgroundFACTORS AFFECTING ENTERPRISE’S DIGITAL TRANSFORMATION
Cao, X. T., & The, T. D. (2023) · International Journal of Social Science and Economic Research · doi:10.46609/ijsser.2023.v08i07.007
“Digital transformation increases labor productivity because automation reduces labor intensity (Brynjolfsson & Mitchell, 2017), supports dynamic decision-making based on data(Athey, 2017) and overall improvement due to optimization of organizational restructuring(Li et al., 2018).”
BackgroundDigital economy innovation, technological progress and Chinese industrial structure upgrading
Feng, S. (2023) · Advances in economics, business and management research/Advances in Economics, Business and Management Research · doi:10.2991/978-94-6463-268-2_42
张, 悦. (2023) · Operations Research and Fuzziology · doi:10.12677/orf.2023.135478
Ribeiro, I. C., & Maruyama, J. M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4585604
Adaptive Shrink and Shard Architecture Design for Blockchain Storage Efficiency
Soesanto, D., Ardiyanto, I., & Adji, T. B. (2024) · IET Computers & Digital Techniques · doi:10.1049/2024/2280828
Intelligence artificielle et santé publique : normes, savoirs et appropriations
Duchemann, B. (2021) · theses.fr (ABES) · doi:10.70675/e294cf77ze40ez445dzb419z869a67902709 · Cited by 1
Can Gender-Blind Algorithmic Pricing Eliminate the Gender Gap?Preprint
Demirci, O. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4780217
Novel Mathematical Optimization Models for Explainable and Fair Machine Learning
Kurishchenko, K. (2024) · OpenArchive@CBS (Copenhagen Business School) · doi:10.22439/phd.21.2024
Explainable AI for Time Series Analysis in Real - Time Supply Chain Optimization
Desani, N. R. (2023) · International Journal of Science and Research (IJSR) · doi:10.21275/es23110104518 · Cited by 1
Theory-Regularized Deep Learning for Demand-Curve Estimation and Prediction
Kim, C., Kim, D. S., Joo, M., & Che, H. (2024) · Artificial Intelligence for Business (AIxB) · doi:10.1109/aixb62249.2024.00008
“These methods are scalable to high dimensions and large datasets, making them useful for large-scale marketing decisions like consumer targeting [1], [8], [13], [17].”
Testing and interpreting the effectiveness of causal machine learning---an economic theory approachPreprint
Bauer, K., Grunewald, A., Hett, F., Jagow, J., & Speicher, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5013225 · Cited by 2
Impacts of international transport infrastructure: Evidence from Laotian households
Andersson, M., Hayakawa, K., Keola, S., & Yamanouchi, K. (2025) · Journal of Asian Economics · doi:10.1016/j.asieco.2024.101876
“Athey (2017) contends that the potential of machine learning is beyond prediction problems, particularly in the evaluation of treatment effects.”
Conceptual, Theoretical-Methodological, and Empirical Analysis of Digital Economic oOganization
Vargas-Hernández, J. G., González-Ávila, F. J., Vargas-González, O. C., & Rodríguez-Maillard, C. A. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-9435-9.ch003
A Taxonomy for the Digital, Environmental, and Socially Just Transition
Castro, G. D. R. (2025) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.88337
Conceptual, Theoretical-Methodological, and Empirical Analysis of Digital Economic Organization
Vargas-Hernández, J. G., Rodríguez-Maillard, C. A., Salmerón-Zapata, A. J., & Vargas-González, O. C. (2025) · IGI Global eBooks · doi:10.4018/979-8-3693-8166-3.ch001
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0015
Inference on heterogeneous effects
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0008
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0001
Generalization and methodology
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0005
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0014
High dimension and endogeneity
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0006
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0013
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0002
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.002.0004
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0007
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0010
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0012
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.002.0005
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0009
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0003
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0004
Gaillac, C., & L’Hour, J. (2025) · Oxford University Press eBooks · doi:10.1093/9780198918868.003.0011
Machine learning and infant mortality: predictive models for health policy in Brazil
da Frota, L. M., Hasegawa, M. M., & Jacinto, P. D. A. (2025) · Applied Economics · doi:10.1080/00036846.2025.2539532
“However, if the estimation of causal effects is the main focus, an empirical strategy that answers counterfactual questions is required (Athey 2017).”
“Development acupuncture:” mapping the network structure of multidimensional poverty
Stojkoski, V., López-Calva, L. F., Bolch, K. B., & Fernandez, A. (2025) · Journal of Economic Policy Reform · doi:10.1080/17487870.2025.2529195 · Cited by 2
“This feature is especially useful for policy prediction problems (Athey 2017; Kleinberg et al. 2015) and agent-based policy frameworks (Castañeda, Chávez-Juárez, and Guerrero 2018; Guerrero and Castañeda Ramos 2020; Guerrero, Guariso, and Castañeda 2023).”
Obeid, R. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5399923
Ayberkin, D., & Sebetçi, Ö. (2025) · Bitlis Eren Üniversitesi Fen Bilimleri Dergisi · doi:10.17798/bitlisfen.1646155
Lartey, V. C., Oteng, P. A., Amofa, A. K., Quaye, I., & Dumor, K. (2025) · SAGE Open · doi:10.1177/21582440251378795
Explainable AI in Credit Models: Balancing Predictive Power with Transparency
Udaru, B. R. (2025) · Journal of Information Systems Engineering & Management · doi:10.52783/jisem.v10i61s.13462
“…International Settlements reports that financial institutions have made an increment of about percent of investments in explainability technologies since 2019, and larger financial institutions have devoted an average of EUR4.7 million to explainable AI research and implementation specifically [9].”
Multimorbidity measurement strategies for predicting hospital visits
Neves, B. D., Moreira, J. M., Gonçalves, S., Cerejo, J., Mota, I., Silva, N. A., Leite, F., & Silva, M. J. (2025) · BMC Health Services Research · doi:10.1186/s12913-025-13817-z
Brooks, J. M., Chapman, C. G., Chen, B. K., Floyd, S. B., & Hikmet, N. (2024) · Figshare · doi:10.6084/m9.figshare.26692801
Guillen Rojas, J. Y. (2023) · renati
Averill, C. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4640667
Vogel, J., Cordier, J., & Filipovic, M. (2025) · RePEc: Research Papers in Economics · Cited by 1
Vite, I. P. Y. (2022) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Sahraoui, C., & Zari, T. (2025) · International Journal of Accounting, Finance, Auditing, Management and Economics · doi:10.5281/zenodo.17074352 · Cited by 1
Machine Learning in Public Health and the Prediction-Intervention Gap
Grote, T., & Buchholz, O. (2025) · Synthese Library/Synthese library · doi:10.1007/978-3-032-03083-2_22 · Cited by 2
Contrastive Scenarios: Enhancing ML Model Interpretability
Chaudhary, S. (2026) · Lecture notes in networks and systems · doi:10.1007/978-981-96-7140-3_22
Why Machine Learning Needs Theoretical Guidance To Support Future Theory Building
Xu, H., Zhang, N., & Wang, M. (2025) · MIS Quarterly · doi:10.25300/misq/2025/18900
Ruan, W., Liu, J., Tang, H., Zhu, J., & Liu, C. (2026) · Safety Science · doi:10.1016/j.ssci.2026.107151
Jacob, A., & Boyles, C. (2026) · Springer eBooks · doi:10.1007/978-3-032-05155-4_4
Analytical insights on economic transition: ranking key determinants using machine learning approach
Meitei, A. J., Rai, P., Pundir, V., & Gupta, P. (2026) · International Journal of Systems Assurance Engineering and Management · doi:10.1007/s13198-026-03152-9
サイトウ, ユ., Saitō, Y., & 齊藤, 勇. (2021) · Institutional Repositories DataBase (IRDB)
Yi, C.-D. (2026) · SN Computer Science · doi:10.1007/s42979-026-04822-y
Bodrato, G. (2022) · theses.fr (ABES) · doi:10.70675/b27a9681zfc5fz49a2z9f84ze8eb929097ca
Changes of representation for counter-factual inference
Lacombe, A. (2024) · theses.fr (ABES) · doi:10.70675/c86021eezffa8z488dz895ez86920c13b797
Carrizosa, E., Halskov, T., & Morales, D. R. (2026) · 4OR · doi:10.1007/s10288-025-00610-1
Lee, J., Lee, K., & Jung, O. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.106973
Lu, F., Lin, A., & Luo, Z. (2026) · Cognitive Computation · doi:10.1007/s12559-026-10577-8
Chen, P. F. (2026) · Quality & Quantity · doi:10.1007/s11135-026-02885-w
“The rise of digital data coupled with advances in machine learning and artificial intelligence offer new opportunities for generating more powerful analytical tools for social and economic research (Athey 2017 ; LeCun et al. 2015; Gentzkow et al. 2019).”
The Environment in the City and Social-Ecological Uncertainty
Cartaxo, T. D. M. (2026) · Springer eBooks · doi:10.1007/978-3-032-23840-5_2
Zhang, X., Qin, Y., & Hassink, R. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6950949
Predicting retirement and Social Security claiming decisions using machine learning
Kwon, A., & Maliar, L. (2026) · Labour Economics · doi:10.1016/j.labeco.2026.102915
‘Dead man working’: A place-based approach to occupational safety and health
Cerqua, A., Giannantoni, C., Letta, M., & Pinto, G. (2026) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2026.107672
Yanık, Ş. G. (2026) · Nazilli İktisadi ve İdari Bilimler Fakültesi Dergisi · doi:10.59113/niibfd.1950137
Diaz-Bone, R., Bisang, L., & Schwegler, G. (2026) · Springer eBooks · doi:10.1007/978-3-658-39745-6_25
Davidescu, A. A., Manta, E. M., & Agafiţei, M.-D. (2026) · Wiley eBooks · doi:10.1002/9781394315048.ch16
Machine Learning for Causal Inference: Opportunities and Pitfalls
Hatamyar, J., & Kreif, N. (2026) · Oxford University Press eBooks · doi:10.1093/9780197851418.003.0991
Foundations of prediction in the public sphere
Fischer-Abaigar, U. (2026) · Electronic Theses of LMU Munich (Ludwig-Maximilians-Universität München) · doi:10.5282/edoc.37518
Rivera, J. R. R. (2026) · LACCEI International Multi-Conference for Engineering, Education and Technology (LACCEI) · doi:10.18687/laccei2026.1.1.2337
Scarcity and Predictive Uncertainty: Implications for Societal Resource AllocationPreprint
Farabi, S., Fowler, P. J., & Das, S. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.04251
“More fundamentally, a question remains regarding the role of prediction in many high-stakes allocation domains: is it to better measure underlying states, estimate counterfactual outcome probabilities, allow for optimization of utilitarian metrics, or another strategy [2, 3, 9]?”
Lekbir, D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7257158
Lekbir, D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7261818
Wei, N., Xie, W.-J., & Zhou, W. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7380029
Zarei, A. R. (2026) · Journal of Hydrology Regional Studies · doi:10.1016/j.ejrh.2026.104011
Usluer, H. B., Çağlar, A. K. A. R., & Cerev, G. (2026) · Agricultural and Food Economics · doi:10.1186/s40100-026-00519-1
“A flexible model may rank future cases effectively without identifying a causal transmission parameter (Kleinberg et al. 2015; Mullainathan and Spiess 2017; Athey 2017).”
Il City Science Office come dispositivo per innovare gli uffici di pianificazione
Berni, F. (2026) · Contesti Città territori progetti · doi:10.36253/contest-17076
Butt, U. I. (2026) · Innovation Economics · doi:10.3934/innoecon.2026003
Multimorbidity Measurement Strategies for Predicting Hospital Visits
Neves, B., Moreira, J. M., Gonçalves, S., Cerejo, J., Mota, I., Silva, N. A., Leite, F., & Silva, M. J. (2025) · doi:10.21203/rs.3.rs-6515465/v1
Metadata
- Authors
- Athey, S.
- Affiliations
- Stanford University (US)
- Corresponding author
- Athey, Susan
- ORCID
- Athey, Susan
- Venue
- Science
- Published
- 2017-02-03
- Volume
- 355
- Issue
- 6324
- Pages
- 483-485
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2584924584
- Semantic Scholar
- 3b718eebc6f4469053dadb5737b67ee18b16722d
- Cited by
- 575
- References
- 20
- Citations by year
- 2026: 27 · 2025: 73 · 2024: 74 · 2023: 66 · 2022: 83 · 2021: 73 · 2020: 70 · 2019: 48 · 2018: 41 · 2017: 20
- FWCI
- 78.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Keywords
- big data, data-driven decision making, machine learning prediction, policy challenges, public policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.