Beyond prediction: Using big data for policy problems
The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Machine-learning prediction methods have been extremely productive in applications ranging from medicine to allocating fire and health inspectors in cities. However, there are a number of gaps between making a prediction and making a decision, and underlying assumptions need to be understood in order to optimize data-driven decision-making.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“and help predict prices and availability of key resources for production [90,91].”
From Exploring the relationship between big data analytics capability and competitive performance: The mediating roles of dynamic and operational capabilities (2020) · cites this paper as [90]
In the citing paper
“ML can play a role in causal inference [41,340,619], including in the context of policy problems [40,453] and in climate-relevant scenarios such as estimating the effects of temperature on human mortality [356] and the effects of World Bank projects on vegetative cover [883].”
From Tackling climate change with machine learning (2023) · cites this paper as [40]
Citations
Cites
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Predicting the future - big data, machine learning, and clinical medicine
Obermeyer, Z., & Emanuel, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmp1606181 · Cited by 3,652
Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297
Inference on Treatment Effects after Selection among High-Dimensional Controls
Belloni, A., Chernozhukov, V., & Hansen, C. (2014) · The Review of Economic Studies · doi:10.1093/restud/rdt044 · Cited by 1,508
Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain
(2012) · Econometrica · doi:10.3982/ecta9626 · Cited by 889
Predicting poverty and wealth from mobile phone metadata
Blumenstock, J., Cadamuro, G., & On, R. (2015) · Science · doi:10.1126/science.aac4420 · Cited by 698
Fairness-Aware Classifier with Prejudice Remover Regularizer
Kamishima, T., Akaho, S., Asoh, H., & Sakuma, J. (2012) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-33486-3_3 · Cited by 694 · cited 1×
“These issues have received recent attention in the literature on SML [e.g., ( 21 )].”
BackgroundKleinberg, J., Ludwig, J., Mullainathan, S., & Obermeyer, Z. (2015) · American Economic Review · doi:10.1257/aer.p20151023 · Cited by 584
Doubly Robust Policy Evaluation and Learning
Dudı́k, M., Langford, J. C., & Li, L. (2011) · arXiv (Cornell University) · doi:10.48550/arxiv.1103.4601 · Cited by 375
Consumer Heterogeneity and Paid Search Effectiveness: A Large-Scale Field Experiment
Blake, T., Nosko, C., & Tadelis, S. (2015) · Econometrica · doi:10.3982/ecta12423 · Cited by 354
Research works printed but not linked: 3
- S. Athey G. Imbens S. Wager Approximate residual balancing: De-biased inference of average treatment effects in high dimensions; https://arxiv.org/abs/1604.07125 (2016). · arXiv
- S. Athey J. Tibshirani S. Wager Solving heterogeneous estimating equations with gradient forests; https://arxiv.org/abs/1610.01271 (2016). · arXiv
- A. Agarwal et al . A multiworld testing decision service; https://arxiv.org/abs/1606.03966 (2016). · arXiv
Cited by
Mikalef, P., Krogstie, J., Pappas, I. O., & Pavlou, P. (2020) · Information & Management · doi:10.1016/j.im.2019.05.004 · Cited by 1,373
“With regards to external process sensing, BDACs can contribute toward identifying bottlenecks or other potential hazards in supply chains [87], detect market disturbances and monitor the financial environment [88,89], and help predict prices and availability of key resources for production [90,91].”
BackgroundExplaining machine learning classifiers through diverse counterfactual explanations
Mothilal, R. K., Sharma, A., & Tan, C. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372850 · Cited by 1,233
“ument is valid for a range of scenarios involving decision-making on an individual’s outcome, such as deciding admission to a university [40], screening job applicants [33], disbursing government aid [3, 5], and identifying people at high risk of a future disease [11]. In all these cases, knowing reasons for a bad out…”
BackgroundMachine Learning Methods That Economists Should Know About
Athey, S., & Imbens, G. W. (2019) · Annual Review of Economics · doi:10.1146/annurev-economics-080217-053433 · Cited by 1,163
“, Athey and Imbens [2016], Wager and Athey [2017]) and orthogonalization (e.”
BackgroundMethodResultInfluentialSelf-citationTyralis, H., Papacharalampous, G., & Langousis, A. (2019) · Water · doi:10.3390/w11050910 · Cited by 771
“An additional important issue frequently neglected is that causal inference is different from prediction, although there is increasing research regarding causal inference, interpretability, and reliability of machine learning methods [55].”
BackgroundArtificial Intelligence and Black‐Box Medical Decisions: Accuracy versus Explainability
London, A. J. (2019) · Hastings Center Report · doi:10.1002/hast.973 · Cited by 801
Metadata
- Authors
- Athey, S.
- Affiliations
- Stanford University (US)
- Corresponding author
- Athey, Susan
- ORCID
- Athey, Susan
- Venue
- Science
- Published
- 2017-02-03
- Volume
- 355
- Issue
- 6324
- Pages
- 483-485
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2584924584
- Semantic Scholar
- 3b718eebc6f4469053dadb5737b67ee18b16722d
- Cited by
- 575
- References
- 20
- Citations by year
- 2026: 27 · 2025: 73 · 2024: 74 · 2023: 66 · 2022: 83 · 2021: 73 · 2020: 70 · 2019: 48 · 2018: 41 · 2017: 20
- FWCI
- 78.81
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Physical Sciences › Computer Science › Information Systems › Data Mining and Machine Learning Applications
- Keywords
- big data, data-driven decision making, machine learning prediction, policy challenges, public policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.