Beyond prediction: Using big data for policy problems
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Machine-learning prediction methods have been extremely productive in applications ranging from medicine to allocating fire and health inspectors in cities. However, there are a number of gaps between making a prediction and making a decision, and underlying assumptions need to be understood in order to optimize data-driven decision-making.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and help predict prices and availability of key resources for production [90,91].”
From Exploring the relationship between big data analytics capability and competitive performance: The mediating roles of dynamic and operational capabilities (2020) · cites this paper as [90]
In the citing paper
“ML can play a role in causal inference [41,340,619], including in the context of policy problems [40,453] and in climate-relevant scenarios such as estimating the effects of temperature on human mortality [356] and the effects of World Bank projects on vegetative cover [883].”
From Tackling climate change with machine learning (2023) · cites this paper as [40]
Citations
Cites
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297
Inference on Treatment Effects after Selection among High-Dimensional Controls
Belloni, A., Chernozhukov, V., & Hansen, C. (2014) · The Review of Economic Studies · doi:10.1093/restud/rdt044 · Cited by 1,508
Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain
(2012) · Econometrica · doi:10.3982/ecta9626 · Cited by 889
Predicting poverty and wealth from mobile phone metadata
Blumenstock, J., Cadamuro, G., & On, R. (2015) · Science · doi:10.1126/science.aac4420 · Cited by 698
Fairness-Aware Classifier with Prejudice Remover Regularizer
Kamishima, T., Akaho, S., Asoh, H., & Sakuma, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33486-3_3 · Cited by 694 · cited 1×
“These issues have received recent attention in the literature on SML [e.g., ( 21 )].”
BackgroundKleinberg, J., Ludwig, J., Mullainathan, S., & Obermeyer, Z. (2015) · American Economic Review · doi:10.1257/aer.p20151023 · Cited by 584
Doubly Robust Policy Evaluation and Learning
Dudı́k, M., Langford, J. C., & Li, L. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.4601 · Cited by 375
Consumer Heterogeneity and Paid Search Effectiveness: A Large-Scale Field Experiment
Blake, T., Nosko, C., & Tadelis, S. (2015) · Econometrica · doi:10.3982/ecta12423 · Cited by 354
Retention Futility: Targeting High-Risk Customers Might be Ineffective
Ascarza, E. (2018) · Journal of Marketing Research · doi:10.1509/jmr.16.0163 · Cited by 295 · cited 1×
“Ascarza (12) documented firms following this type of practice, and then used methods from the causal inference literature to provide empirical evidence that allocating resources according to a simplistic predictive model is not optimal.”
MethodConsumer Heterogeneity and Paid Search Effectiveness: A Large Scale Field Experiment
Blake, T., Nosko, C., & Tadelis, S. (2014) · National Bureau of Economic Research · doi:10.3386/w20171 · Cited by 217
Criminal Justice Forecasts of Risk: A Machine Learning Approach
Berk, R. A. (2012) · SpringerBriefs in computer science · doi:10.1007/978-1-4614-3085-8 · Cited by 192
Designing and deploying online field experiments
Bakshy, E., Eckles, D., & Bernstein, M. S. (2014) · Proceedings of the 23rd international conference on World wide web · doi:10.1145/2566486.2567967 · Cited by 178
Bayati, M., Braverman, M., Gillam, M., Mack, K. M., Ruiz, G., Smith, M. S., & Horvitz, E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109264 · Cited by 122
Multi‐armed bandit experiments in the online service economy
Scott, S. L. (2015) · Applied Stochastic Models in Business and Industry · doi:10.1002/asmb.2104 · Cited by 119
Cities Are Physical Too: Using Computer Vision to Measure the Quality and Impact of Urban Appearance
Naik, N., Raskar, R., & Hidalgo, C. A. (2016) · American Economic Review · doi:10.1257/aer.p20161030 · Cited by 104
Crowdsourcing City Government: Using Tournaments to Improve Inspection Accuracy
Glaeser, E. L., Hillis, A., Kominers, S. D., & Luca, M. (2016) · American Economic Review · doi:10.1257/aer.p20161027 · Cited by 95
Big Data and Big Cities: The Promises and Limitations of Improved Measures of Urban Life
Glaeser, E. L., Kominers, S. D., Luca, M., & Naik, N. (2015) · National Bureau of Economic Research · doi:10.3386/w21778 · Cited by 73
Where Not to Eat? Improving Public Policy by Predicting Hygiene Inspections Using Online Reviews
Kang, J. S., Kuznetsova, P., Luca, M., & Choi, Y. (2013) · Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing · doi:10.18653/v1/d13-1150 · Cited by 61
Retention Futility: Targeting High-Risk Customers Might Be IneffectivePreprint
Ascarza, E. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2759170 · Cited by 54
Research works printed but not linked: 3
- S. Athey G. Imbens S. Wager Approximate residual balancing: De-biased inference of average treatment effects in high dimensions; https://arxiv.org/abs/1604.07125 (2016). · arXiv
- S. Athey J. Tibshirani S. Wager Solving heterogeneous estimating equations with gradient forests; https://arxiv.org/abs/1610.01271 (2016). · arXiv
- A. Agarwal et al . A multiworld testing decision service; https://arxiv.org/abs/1606.03966 (2016). · arXiv
Cited by
Mikalef, P., Krogstie, J., Pappas, I. O., & Pavlou, P. (2020) · Information & Management · doi:10.1016/j.im.2019.05.004 · Cited by 1,373
“With regards to external process sensing, BDACs can contribute toward identifying bottlenecks or other potential hazards in supply chains [87], detect market disturbances and monitor the financial environment [88,89], and help predict prices and availability of key resources for production [90,91].”
BackgroundExplaining machine learning classifiers through diverse counterfactual explanations
Mothilal, R. K., Sharma, A., & Tan, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372850 · Cited by 1,233
“ument is valid for a range of scenarios involving decision-making on an individual’s outcome, such as deciding admission to a university [40], screening job applicants [33], disbursing government aid [3, 5], and identifying people at high risk of a future disease [11]. In all these cases, knowing reasons for a bad out…”
BackgroundMachine Learning Methods That Economists Should Know About
Athey, S., & Imbens, G. W. (2019) · Annual Review of Economics · doi:10.1146/annurev-economics-080217-053433 · Cited by 1,163
“, Athey and Imbens [2016], Wager and Athey [2017]) and orthogonalization (e.”
BackgroundMethodResultInfluentialSelf-citationTyralis, H., Papacharalampous, G., & Langousis, A. (2019) · Water · doi:10.3390/w11050910 · Cited by 771
“An additional important issue frequently neglected is that causal inference is different from prediction, although there is increasing research regarding causal inference, interpretability, and reliability of machine learning methods [55].”
BackgroundArtificial Intelligence and Black‐Box Medical Decisions: Accuracy versus Explainability
London, A. J. (2019) · Hastings Center Report · doi:10.1002/hast.973 · Cited by 801
Metadata
- Authors
- Athey, S.
- Affiliations
- Stanford University (US)
- Corresponding author
- Athey, Susan
- ORCID
- Athey, Susan
- Venue
- Science
- Published
- 2017-02-03
- Volume
- 355
- Issue
- 6324
- Pages
- 483-485
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2584924584
- Semantic Scholar
- 3b718eebc6f4469053dadb5737b67ee18b16722d
- Cited by
- 575
- References
- 20
- Citations by year
- 2026: 27 · 2025: 73 · 2024: 74 · 2023: 66 · 2022: 83 · 2021: 73 · 2020: 70 · 2019: 48 · 2018: 41 · 2017: 20
- FWCI
- 78.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Keywords
- big data, data-driven decision making, machine learning prediction, policy challenges, public policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.