Mapping of machine learning approaches for description, prediction, and causal inference in the social and health sciences
Open accessThe DOI matches its Crossref record; 34 of the 34 references it cites were found in a registry or an index.
Abstract
Machine learning (ML) methodology used in the social and health sciences needs to fit the intended research purposes of description, prediction, or causal inference. This paper provides a comprehensive, systematic meta-mapping of research questions in the social and health sciences to appropriate ML approaches by incorporating the necessary requirements to statistical analysis in these disciplines. We map the established classification into description, prediction, counterfactual prediction, and causal structural learning to common research goals, such as estimating prevalence of adverse social or health outcomes, predicting the risk of an event, and identifying risk factors or causes of adverse outcomes, and explain common ML performance metrics. Such mapping may help to fully exploit the benefits of ML while considering domain-specific aspects relevant to the social and health sciences and hopefully contribute to the acceleration of the uptake of ML applications to advance both basic and applied social and health sciences research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
SMOTE synthetic minority over-sampling technique
Chawla, N. V., Bowyer, K. W., Hall, L. O., & Kegelmeyer, W. P. (2002) · Journal of Artificial Intelligence Research · doi:10.1613/jair.953 · Cited by 32,865
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561 · cited 1×
“Instead of developing interpretable models separate from the original “black box” models, it has been suggested to only use interpretable models by design, as transparency and trustworthiness in the eyes of users can only be achieved with interpretable models ( 22 ).”
Intriguing properties of neural networks
Szegedy, C., Zaremba, W., Sutskever, I., Bruna, J., Erhan, D., Goodfellow, I., & Fergus, R. (2013) · arXiv · doi:10.48550/arxiv.1312.6199 · Cited by 8,143
Dissecting racial bias in an algorithm used to manage the health of populations
Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019) · Science · doi:10.1126/science.aax2342 · Cited by 7,137 · cited 1×
“We refer to other literature for examples related to fairness in ML at large ( 28 ) and a prominent example of racial bias in a health care algorithm in use ( 29 ).”
MethodKuhn, M., & Johnson, K. (2013) · doi:10.1007/978-1-4614-6849-3 · Cited by 6,788
Marginal Structural Models and Causal Inference in Epidemiology
Robins, J. M., Hernán, M. Á., & Brumback, B. (2000) · Epidemiology · doi:10.1097/00001648-200009000-00011 · Cited by 5,581
Probabilistic Principal Component Analysis
Tipping, M. E., & Bishop, C. M. (1999) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/1467-9868.00196 · Cited by 3,679
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326
Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
Wager, S., & Athey, S. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1319839 · Cited by 2,917 · cited 3×
“3) Causal forests: A forest-based method to estimate treatment effects with statistical inference ( 105 ).”
BackgroundMethodIshwaran, H., Kogalur, U. B., Blackstone, E. H., & Lauer, M. S. (2008) · The Annals of Applied Statistics · doi:10.1214/08-aoas169 · Cited by 2,714
Logistic regression and Artificial Neural Network Classification models: A methodology review
Dreiseitl, S., & Ohno-Machado, L. (2002) · Journal of Biomedical Informatics · doi:10.1016/s1532-0464(03)00034-0 · Cited by 2,177 · cited 1×
“Neural networks are identical to the traditional logistic regressions with no hidden layer if the logistic activation function is implemented, which is the most common case ( 64 ).”
BackgroundDefinitions, methods, and applications in interpretable machine learning
Murdoch, W. J., Singh, C., Kumbier, K., Abbasi-Asl, R., & Yu, B. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1900654116 · Cited by 2,167 · cited 2×
“…require more domain knowledge than others, particularly ML for causal inference, we argue that, in all research questions in the social and health sciences, substantial domain knowledge is necessary to meaningfully contribute to the field and that this is a prerequisite to interpretability ( 9 ).”
BackgroundChristodoulou, E., Ma, J., Collins, G. S., Steyerberg, E. W., Verbakel, J. Y., & Van Calster, B. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.02.004 · Cited by 2,119 · cited 1×
“A systematic review on clinical risk prediction with ML found little benefits of ML methods over regressions and criticized a number of short-comings in the literature up to that date, particularly the lack of calibration, i.e., testing the reliability of predictions ( 73 ).”
BackgroundExplainable machine-learning predictions for the prevention of hypoxaemia during surgery
Lundberg, S. M., Nair, B., Vavilala, M. S., Horibe, M., Eisses, M. J., Adams, T., Liston, D. E., Low, D. K.-W., Newman, S.-F., Kim, J., et al. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0304-0 · Cited by 1,967
Self-citationTweeting From Left to Right: Is Online Political Communication More Than an Echo Chamber?
Barberá, P., Jost, J. T., Nagler, J., Tucker, J. A., & Bonneau, R. (2015) · Psychological Science · doi:10.1177/0956797615594620 · Cited by 1,472
Machine learning and data mining methods in diabetes research
Kavakiotis, I., Tsave, O., Salifoglou, A., Maglaveras, N., Vlahavas, I., & Chouvarda, I. (2017) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2016.12.005 · Cited by 1,445
Consistent Individualized Feature Attribution for Tree Ensembles
Lundberg, S. M., Erion, G. G., & Lee, S.-I. (2018) · arXiv · doi:10.48550/arxiv.1802.03888 · Cited by 1,430
Ensuring fairness in machine learning to advance health equity.
Rajkomar, A., Hardt, M., Howell, M. D., Corrado, G., & Chin, M. H. (2018) · Annals of Internal Medicine · doi:10.7326/m18-1990 · Cited by 1,341
Machine Learning Methods That Economists Should Know About
Athey, S., & Imbens, G. W. (2019) · Annual Review of Economics · doi:10.1146/annurev-economics-080217-053433 · Cited by 1,163
Algorithmic Fairness: Choices, Assumptions, and Definitions
Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K. (2021) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-042720-125902 · Cited by 687 · cited 1×
“New proposals addressing the problems of producing fairness “within the data” suggest to define counterfactual fairness ( 30 ).”
BackgroundPrediction-Based Decisions and Fairness: A Catalogue of Choices, Assumptions, and Definitions
Mitchell, S., Potash, E., Barocas, S., D'Amour, A., & Lum, K. (2018) · arXiv · doi:10.48550/arxiv.1811.07867 · Cited by 687
Facebook language predicts depression in medical records
Eichstaedt, J. C., Smith, R. J., Merchant, R. M., Ungar, L. H., Crutchley, P., Preoţiuc-Pietro, D., Asch, D. A., & Schwartz, H. A. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1802331115 · Cited by 643
Improving the accuracy of medical diagnosis with causal machine learning
Richens, J. G., Lee, C. M., & Johri, S. (2020) · Nature Communications · doi:10.1038/s41467-020-17419-7 · Cited by 598
A Second Chance to Get Causal Inference Right: A Classification of Data Science Tasks
Hernán, M. A., Hsu, J., & Healy, B. (2019) · CHANCE · doi:10.1080/09332480.2019.1579578 · Cited by 495
Big Data in Public Health: Terminology, Machine Learning, and Privacy
Mooney, S. J., & Pejaver, V. (2018) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040617-014208 · Cited by 325
A data-driven model of biomarker changes in sporadic Alzheimer’s disease
Young, A. L., Oxtoby, N. P., Daga, P., Cash, D. M., Fox, N. C., Ourselin, S., Schott, J. M., & Alexander, D. C. (2014) · Brain · doi:10.1093/brain/awu176 · Cited by 308
Kessler, R. C., Hwang, I., Hoffmire, C. A., McCarthy, J. F., Petukhova, M. V., Rosellini, A. J., Sampson, N. A., Schneider, A. L., Bradley, P. A., Katz, I. R., et al. (2017) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1575 · Cited by 209
Mortality Risk Score Prediction in an Elderly Population Using Machine Learning
Rose, S. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kws241 · Cited by 193 · cited 1×
“Other research has used the SuperLearner for mortality risk prediction ( 72 ).”
MethodIdentifying incipient dementia individuals using machine learning and amyloid imaging
Mathotaarachchi, S., Pascoal, T. A., Shin, M., Benedet, A. L., Kang, M. S., Beaudry, T., Fonov, V. S., Gauthier, S., & Rosa-Neto, P. (2017) · Neurobiology of Aging · doi:10.1016/j.neurobiolaging.2017.06.027 · Cited by 118
A flexible, interpretable framework for assessing sensitivity to unmeasured confounding
Dorie, V., Harada, M., Carnegie, N. B., & Hill, J. (2016) · Statistics in Medicine · doi:10.1002/sim.6973 · Cited by 104
Reflection on modern methods: when worlds collide—prediction, machine learning and causal inference
Blakely, T., Lynch, J., Simons, K., Bentley, R., & Rose, S. (2021) · International Journal of Epidemiology · doi:10.1093/ije/dyz132 · Cited by 98 · cited 2×
“An overview of different papers that use ML for inverse probability weighting and propensity score matching is given in ( 102 ).”
MethodMarinescu, R. V., Oxtoby, N. P., Young, A. L., Bron, E. E., Toga, A. W., Weiner, M. W., Barkhof, F., Fox, N. C., Eshaghi, A., Toni, T., et al. (2021) · Machine Learning for Biomedical Imaging · doi:10.59275/j.melba.2021-2dcc · Cited by 68
Cited by
(2025) · doi:10.3390/electronics14071294 · Cited by 55
Artificial intelligence for dementia prevention
Newby, D., Orgeta, V., Marshall, C. R., Lourida, I., Albertyn, C. P., Tamburin, S., Raymont, V., Veldsman, M., Koychev, I., Bauermeister, S., et al. (2023) · Alzheimer's & Dementia · doi:10.1002/alz.13463 · Cited by 42
“121 Already known or new risk factors can then be evaluated with ML for causal inference, 122 andthereareexamplesofitsuseinprenatalandperinatal care.”
BackgroundSelf-citationIbanez, A., Maito, M., Botero-Rodríguez, F., Fittipaldi, S., Coronel, C., Migeot, J., Lacroix, A., Lawlor, B., Duran-Aniotz, C., Baez, S., et al. (2024) · Nature Aging · doi:10.1038/s43587-024-00648-6 · Cited by 30
Metadata
- Authors
- Leist, A. K., Klee, M., Kim, J. H., Rehkopf, D. H., Bordas, S. P. A., Muniz-Terrera, G., & Wade, S.
- Venue
- Science Advances
- Published
- 2022-10-21
- Volume
- 8
- Issue
- 42
- Pages
- eabk1942-eabk1942
- ISSN
- 2375-2548 (ISSN-L)
- OpenAlex
- W4306855755
- Cited by
- 127
- References
- 34
- FWCI
- 16.85
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.