CoChat

Understanding from Machine Learning Models

Sullivan, Emily · 2022 · The British Journal for the Philosophy of Science
Cited by 221

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Abstract

Simple idealized models seem to provide more understanding than opaque, complex, and hyper-realistic models. However, an increasing number of scientists are going in the opposite direction by utilizing opaque machine learning models to make predictions and draw inferences, suggesting that scientists are opting for models that have less potential for understanding. Are scientists trading understanding for some other epistemic or pragmatic good when they choose a machine learning model? Or are the assumptions behind why minimal models provide understanding misguided? In this article, using the case of deep neural networks, I argue that it is not the complexity or black box nature of a model that limits how much understanding the model provides. Instead, it is a lack of scientific and empirical evidence supporting the link that connects a model to the target phenomenon that primarily prohibits understanding.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/bjps/axz035

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 45

  1. Abelson H., [1996]: Structure and Interpretation of Computer Programs
  2. Bailer-Jones D. M., Simulated Annealing, and Genetic Algorithms, 65
  3. Baldi P., Advances in Neural Information Processing Systems, 2834
  4. 10.1086/676677 · DOI · Paper page
  5. Bobo L., 1996, Social Forces, 74, 883, 10.2307/2580385 · DOI
  6. Bokulich A., Reexamining the Quantum–Classical Relation, 10.1017/CBO9780511751813 · DOI
  7. Clark W. A. V., 1991, Demography, 28, 1, 10.2307/2061333 · DOI · Paper page
  8. Clark W. A. V., 1992, Demography, 29, 451, 10.2307/2061828 · DOI · Paper page
  9. Cristianini N., 2010, Neural Networks, 23, 466, 10.1016/j.neunet.2010.01.006 · doi:10.1016/j.neunet.2010.01.006
  10. De Regt H. W., Understanding Scientific Understanding, 10.1093/oso/9780190652913.001.0001 · DOI · Paper page
  11. Elliott K. C., 2013, Studies in History and Philosophy of Science Part A, 44, 375, 10.1016/j.shpsa.2013.06.003 · DOI
  12. Glorot X., 2011, Proceedings of Machine Learning Research, 15, 315
  13. Goodfellow I., [2016]: Deep Learning
  14. Grimm S., 2010, Studies in History and Philosophy of Science A, 41, 337, 10.1016/j.shpsa.2010.10.006 · DOI
  15. Grimm S., Virtue Epistemology Naturalized: Bridges between Virtue Epistemology and Philosophy of Science, 45
  16. Grüne-Yanoff T., 2009, Erkenntnis, 70, 81, 10.1007/s10670-008-9138-6 · DOI
  17. Hills A., 2016, Noûs, 50, 661, 10.1111/nous.12092 · DOI · Paper page
  18. Humphreys P., Extending Ourselves: Computational Science, Empiricism, and Scientific Method
  19. Khalifa K., Understanding, Explanation, and Scientific Knowledge, 10.1017/9781108164276 · DOI · Paper page
  20. Kuorikoski J., 2015, Synthese, 192, 3817, 10.1007/s11229-014-0591-2 · DOI · Paper page
  21. Lawler I., Synthese, 21
  22. LeVay S., Queer Science: The Use and Abuse of Research into Homosexuality, 10.7551/mitpress/5726.001.0001 · doi:10.7551/mitpress/5726.001.0001
  23. LeVay S., Gay, Straight, and the Reason Why: The Science of Sexual Orientation
  24. Lipton P., H. W. de Regt, 63
  25. Mäki U., 2009, Erkenntnis, 70, 29, 10.1007/s10670-008-9135-9 · DOI · Paper page
  26. Miller A. E., 2018, Psychology and Sexuality, 9, 188, 10.1080/19419899.2018.1468353 · DOI
  27. Mitchell T. M., Machine Learning, 10.1007/978-1-4613-2279-5 · DOI
  28. 10.1086/663236 · DOI
  29. Mustanski B. S., 2002, Annual Review of Sex Research, 13, 89
  30. Potochnik A., 2011, European Journal for Philosophy of Science, 1, 29, 10.1007/s13194-010-0002-6 · DOI
  31. Potochnik A., 2015, Studies in History and Philosophy of Science Part A, 53, 71, 10.1016/j.shpsa.2015.05.008 · DOI
  32. Reutlinger A., 2017, British Journal for the Philosophy of Science, 69, 1069, 10.1093/bjps/axx005 · DOI
  33. Ribeiro M. T., Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York: ACM, 44
  34. 10.1086/671399 · DOI
  35. Schelling T. C., 1971, The Journal of Mathematical Sociology, 1, 143, 10.1080/0022250X.1971.9989794 · DOI · Paper page
  36. Strevens M., Depth: An Account of Scientific Explanation, 10.2307/j.ctv1dv0tnw · doi:10.2307/j.ctv1dv0tnw
  37. Strevens M., Explanation and Integration in Mind and Brain Science
  38. Sullivan E., 2018, Philosophical Studies, 175, 221, 10.1007/s11098-017-0863-z · DOI
  39. Sullivan E., 2019, Australasian Journal of Philosophy, 97, 673, 10.1080/00048402.2018.1564337 · DOI
  40. Tishby N., Proceedings of the 37th Annual Allerton Conference on Communication, Control and Computing, Urbana-Champaign, IL: University of Illinois, 77
  41. Tishby N., 2015, IEEE Information Theory Workshop 2015
  42. Valentova J. V., 2014, Archives of Sexual Behavior, 43, 353, 10.1007/s10508-013-0194-x · DOI
  43. van Riel R., 2015, Synthese, 192, 3839, 10.1007/s11229-015-0728-y · DOI
  44. Wan L., 2013, Proceedings of Machine Learning Research, 28, 1058
  45. Winsberg E., 2012, Kennedy Institute of Ethics Journal, 22, 111, 10.1353/ken.2012.0008 · DOI · Paper page

Cited by

See all 221

Metadata

Authors
Sullivan, E.
Venue
The British Journal for the Philosophy of Science
Published
2022-03-01
Volume
73
Issue
1
Pages
109-133
ISSN
  • 0007-0882 (ISSN-L)
  • 1464-3537
OpenAlex
W2965860133
Cited by
221
References
13
FWCI
49.50
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.