Grounds for Trust: Essential Epistemic Opacity and Computational Reliabilism
Open accessThe DOI matches its Crossref record; 50 of the 58 references it cites were found in a registry or an index.
Abstract
Several philosophical issues in connection with computer simulations rely on the assumption that results of simulations are trustworthy. Examples of these include the debate on the experimental role of computer simulations (Parker in Synthese 169(3):483–496, 2009 ; Morrison in Philos Stud 143(1):33–57, 2009 ), the nature of computer data (Barberousse and Vorms, in: Durán, Arnold (eds) Computer simulations and the changing face of scientific experimentation, Cambridge Scholars Publishing, Barcelona, 2013 ; Humphreys, in: Durán, Arnold (eds) Computer simulations and the changing face of scientific experimentation, Cambridge Scholars Publishing, Barcelona, 2013 ), and the explanatory power of computer simulations (Krohs in Int Stud Philos Sci 22(3):277–292, 2008 ; Durán in Int Stud Philos Sci 31(1):27–45, 2017 ). The aim of this article is to show that these authors are right in assuming that results of computer simulations are to be trusted when computer simulations are reliable processes. After a short reconstruction of the problem of epistemic opacity , the article elaborates extensively on computational reliabilism , a specified form of process reliabilism with computer simulations located at the center. The article ends with a discussion of four sources for computational reliabilism, namely, verification and validation, robustness analysis for computer simulations, a history of (un)successful implementations, and the role of expert knowledge in simulations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The reader be warned: the term 'epistemic opacity' 21 does not actually have a univocal and well-defined meaning but refers to a multi-dimensional, plural and (epistemic) context-dependent problem”
From Experts or Authorities? The Strange Case of the Presumed Epistemic Superiority of Artificial Intelligence Systems (2024) · cites this paper as Durán & Formanek, 2018
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Image and logic: a material culture of microphysics
(1998) · Choice Reviews Online · doi:10.5860/choice.35-3932 · Cited by 2,186
Verification and Validation in Scientific Computing
Oberkampf, W. L., & Roy, C. J. (2010) · doi:10.1017/cbo9780511760396 · Cited by 1,556
Collins, H., & Evans, R. (2007) · doi:10.7208/chicago/9780226113623.001.0001 · Cited by 1,503
Goldman, A. I. (1979) · Justification and Knowledge · doi:10.1007/978-94-009-9493-5_1 · Cited by 1,468
Multiscale mobility networks and the spatial spreading of infectious diseases
Balcan, D., Colizza, V., Gonçalves, B., Hu, H., Ramasco, J. J., & Vespignani, A. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0906910106 · Cited by 1,380
Verification and validation in computational fluid dynamics
Oberkampf, W. L., & Trucano, T. G. (2002) · Progress in Aerospace Sciences · doi:10.1016/s0376-0421(02)00005-2 · Cited by 1,150
Simulation and Similarity: Using Models to Understand the World
Weisberg, M. (2013) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199933662.001.0001 · Cited by 746
(1979) · Springer eBooks · doi:10.1007/978-94-009-9493-5 · Cited by 731
Verification, validation, and predictive capability in computational engineering and physics
Oberkampf, W. L., Trucano, T. G., & Hirsch, C. (2004) · Applied Mechanics Reviews · doi:10.1115/1.1767847 · Cited by 719
Science in the Age of Computer Simulation
Winsberg, E. (2010) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226902050.001.0001 · Cited by 707
Extending Ourselves: Computational Science, Empiricism, and Scientific Method
Humphreys, P. (2004) · doi:10.1093/0195158709.001.0001 · Cited by 548
Extending ourselves: computational science, empiricism, and scientific method
(2005) · Choice Reviews Online · doi:10.5860/choice.43-0272 · Cited by 487
The philosophical novelty of computer simulation methods
Humphreys, P. (2009) · Synthese · doi:10.1007/s11229-008-9435-2 · Cited by 362
Simulated Experiments: Methodology for a Virtual World
Winsberg, E. (2003) · Philosophy of Science · doi:10.1086/367872 · Cited by 323
Ajelli, M., Gonçalves, B., Balcan, D., Colizza, V., Hu, H., Ramasco, J. J., Merler, S., & Vespignani, A. (2010) · BMC Infectious Diseases · doi:10.1186/1471-2334-10-190 · Cited by 302
Reconstructing Reality: Models, Mathematics, and Simulations
Morrison, M. (2015) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199380275.001.0001 · Cited by 241
Does matter really matter? Computer simulations, experiments, and materiality
Parker, W. S. (2009) · Synthese · doi:10.1007/s11229-008-9434-3 · Cited by 239
Verification and validation benchmarks
Oberkampf, W. L., & Trucano, T. G. (2008) · Nuclear Engineering and Design · doi:10.1016/j.nucengdes.2007.02.032 · Cited by 236
Reconstructing reality: models, mathematics, and simulations
(2015) · Choice Reviews Online · doi:10.5860/choice.190914 · Cited by 236
Detlefsen, M. E. (1986) · Springer eBooks · doi:10.1007/978-94-015-7731-1 · Cited by 215
Experiments versus models: New phenomena, inference and surprise
Morgan, M. S. (2005) · Journal of Economic Methodology · doi:10.1080/13501780500086313 · Cited by 212
Cirino, F., Webley, W. C., West, C. A., Croteau, N. L., Andrzejewski, C., & Stuart, E. S. (2006) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · Cited by 209
Holism, entrenchment, and the future of climate model pluralism
Lenhard, J., & Winsberg, E. (2010) · Studies in History and Philosophy of Science Part B: Studies in History and Philosophy of Modern Physics · doi:10.1016/j.shpsb.2010.07.001 · Cited by 193
Verification and validation benchmarks.
Oberkampf, W. L., & Trucano, T. G. (2007) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/901974 · Cited by 187
Verification and Validation in Computational Fluid Dynamics
Oberkampf, W. L., & Trucano, T. G. (2002) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/793406 · Cited by 170
The philosophy of simulation: hot new issues or same old stew?
Frigg, R., & Reiss, J. (2011) · Synthese · doi:10.1007/s11229-009-9577-x · Cited by 165
Models, measurement and computer simulation: the changing face of experimentation
Morrison, M. (2009) · Philosophical Studies · doi:10.1007/s11098-008-9317-y · Cited by 162
Abstraction in Computer Science
Colburn, T. R., & Shute, G. M. (2007) · Minds and Machines · doi:10.1007/s11023-007-9061-7 · Cited by 141
Bird, A. (1998) · Taylor & Francis eBooks · doi:10.4324/9780203165348 · Cited by 114
Morgan, M. S. (2017) · University of Pittsburgh Press eBooks · doi:10.2307/j.ctt5hjsnf.15 · Cited by 101
The philosophy of simulation: hot new issues or same old stew?
Frigg, R., & Reiss, J. (2008) · Synthese · doi:10.1007/s11229-008-9438-z · Cited by 94
Verification, validation, and predictive capability in computational engineering and physics.
Oberkampf, W. L., Hirsch, C. J., & Trucano, T. G. (2003) · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · doi:10.2172/918370 · Cited by 94
Alfa, M. J., DeGagne, P., Olson, N., & Fatima, I. (2010) · BMC Infectious Diseases · doi:10.1186/1471-2334-10-291 · Cited by 93
How can computer simulations produce new knowledge?
Beisbart, C. (2012) · European Journal for Philosophy of Science · doi:10.1007/s13194-012-0049-7 · Cited by 89
On the Stability of the Laboratory Sciences
Hacking, I. (1988) · The Journal of Philosophy · doi:10.5840/jphil1988851016 · Cited by 70
Computer Simulations in Science and Engineering: Concepts - Practices - Perspectives
Durán, J. M. (2018) · The Frontiers Collection · doi:10.1007/978-3-319-90882-3 · Cited by 60
Self-citationComputer simulations and experiments: The case of the Higgs boson
Massimi, M., & Bhimji, W. (2015) · Studies in History and Philosophy of Science Part B Studies in History and Philosophy of Modern Physics · doi:10.1016/j.shpsb.2015.06.003 · Cited by 53
Boon and Bane: On the Role of Adjustable Parameters in Simulation Models
Hasse, H., & Lenhard, J. (2017) · Boston studies in the philosophy of science · doi:10.1007/978-3-319-54469-4_6 · Cited by 50
How Digital Computer Simulations Explain Real‐World Processes
Krohs, U. (2008) · International Studies in the Philosophy of Science · doi:10.1080/02698590802567324 · Cited by 44
Symons, J., & Horner, J. K. (2014) · Philosophy & Technology · doi:10.1007/s13347-014-0163-x · Cited by 38
Are computer simulations experiments? And if not, how are they related to each other?
Beisbart, C. (2017) · European Journal for Philosophy of Science · doi:10.1007/s13194-017-0181-5 · Cited by 38
Newman, J. (2016) · IFIP advances in information and communication technology · doi:10.1007/978-3-319-47286-7_18 · Cited by 29
Computer Simulations and the Changing Face of Scientific Experimentation
Durán, J. M., & Arnold, E. (2013) · Cited by 28
Self-citationComputational Science and Its Effects
Humphreys, P. W. (2010) · Boston studies in the philosophy of science · doi:10.1007/978-90-481-9051-5_9 · Cited by 26
Varying the Explanatory Span: Scientific Explanation for Computer Simulations
Durán, J. M. (2017) · International Studies in the Philosophy of Science · doi:10.1080/02698595.2017.1370929 · Cited by 24
Self-citationThe Philosophical Novelty of Computer Simulation Methods
Humphreys, P. (2019) · Oxford University Press eBooks · doi:10.1093/oso/9780199334872.003.0004 · Cited by 16
Explaining simulated phenomena : a defense of the epistemic power of computer simulations
Durán, J. M. (2014) · OPUS Publication Server of the University of Stuttgart (University of Stuttgart) · doi:10.18419/opus-5392 · Cited by 11
Self-citationComputer simulations and empirical data
Barberousse, A., & Vorms, M. (2013) · BIROn (Birkbeck, University of London) · Cited by 11
Computer simulations in science and engineering - Concepts - Practices - PerspectivesPreprint
Durán, J. M. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1904.01053 · Cited by 10
Self-citationComputer Use to Computer Proof: A Rational Reconstruction
Tymoczko, T. (1981) · The Two-Year College Mathematics Journal · doi:10.2307/3027374 · Cited by 9
Research works printed but not linked: 5
- Goldman, A., & Beddor, B. (2016). Reliabilist epistemology. In E. N. Zalta (Ed.), The Stanford Encyclopedia of Philosophy., Wwinter 2016 edition Stanford: Metaphysics Research Lab, Stanford University.
- Kaminski, A., Resch, M., & Kster, U. (2017). Jahrbuch Technikphilosophie, chapter Mathematische Opazität. Über Rechtfertigung und Reproduziertbarkeit in ther Computersimulation, (pp. 257–281). Nomos Verlagsgesellschaft.
- Levins, R. (1966). The strategy of model building in population biology. American Scientist, 54(4), 421–431.
- simulation in the light of empirical software engineering. In F. Gadducci & M. Tavosanis (Eds.), History and Philosophy of Computing - Third International Conference, HaPoC 2015 (pp. 256-272). Springer.
- Pfleeger, S. L., & Atlee, J. M. (2009). Software engineering: theory and practice. New York: Prentice Hall.
Cited by
Durán, J. M., & Jongsma, K. R. (2021) · Journal of Medical Ethics · doi:10.1136/medethics-2020-106820 · Cited by 446
Self-citationSolving the Black Box Problem: A Normative Framework for Explainable Artificial Intelligence
Zednik, C. (2021) · Philosophy & Technology · doi:10.1007/s13347-019-00382-7 · Cited by 419
Amann, J., Vetter, D., Blomberg, S. N., Christensen, H. C., Coffee, M., Gerke, S., Gilbert, T. K., Hagendorff, T., Holm, S., Livne, M., et al. (2022) · PLOS Digital Health · doi:10.1371/journal.pdig.0000016 · Cited by 251
How Explainability Contributes to Trust in AI
Ferrario, A., & Loi, M. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533202 · Cited by 163
Alvarado, R. (2023) · Science and Engineering Ethics · doi:10.1007/s11948-023-00451-3 · Cited by 137
Metadata
- Authors
- Durán, J. M., & Formanek, N.
- Affiliations
- Delft University of Technology (NL)
- Corresponding author
- Durán, Juan M.
- ORCID
- Durán, Juan M.
- Venue
- Minds and Machines
- Published
- 2018-10-29
- Volume
- 28
- Issue
- 4
- Pages
- 645-666
- ISSN
- 0924-6495 (ISSN-L)
- 1572-8641
- OpenAlex
- W2898854870
- Cited by
- 138
- References
- 58
- Citations by year
- 2026: 16 · 2025: 40 · 2024: 18 · 2023: 23 · 2022: 16 · 2021: 12 · 2020: 7 · 2019: 6
- FWCI
- 30.62
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- Locations
- Minds and Machines (publishedVersion, cc-by)
- arXiv (Cornell University) (submittedVersion)
- Research Repository (Delft University of Technology) (submittedVersion, cc-by)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- arXiv (Cornell University)
- Funders
- Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg
- Universität Stuttgart
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Social Sciences › Arts and Humanities › Philosophy › Epistemology, Ethics, and Metaphysics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Simulation Techniques and Applications
- Keywords
- epistemic opacity, process reliabilism, computer simulation, verification and validation, robustness analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.