Model Evaluation: An Adequacy-for-Purpose View
Open accessThe DOI matches its Crossref record; 40 of the 43 references it cites were found in a registry or an index.
Abstract
According to an adequacy-for-purpose view, models should be assessed with respect to their adequacy or fitness for particular purposes. Such a view has been advocated by scientists and philosophers alike. Important details, however, have yet to be spelled out. This article attempts to make progress by addressing three key questions: What does it mean for a model to be adequate-for-purpose? What makes a model adequate-for-purpose? How does assessing a model’s adequacy-for-purpose differ from assessing its representational accuracy? In addition, responses are given to some objections that might be raised against an adequacy-for-purpose view.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“These build on tools and methods with proven track records in systems engineering and computer science, including model evaluation (Parker, 2020) and system verification (Luckcuck et al., 2019;Brundage et al., 2020;Thudi et al., 2021).”
From Auditing of AI: Legal, Ethical and Technical Approaches (2023) · cites this paper as Parker, 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences
Oreskes, N., Shrader-Frechette, K., & Belitz, K. (1994) · Science · doi:10.1126/science.263.5147.641 · Cited by 3,010
Explaining Science: A Cognitive Approach
Giere, R. N. (1988) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226292038.001.0001 · Cited by 1,766
Verification and Validation in Scientific Computing
Oberkampf, W. L., & Roy, C. J. (2010) · doi:10.1017/cbo9780511760396 · Cited by 1,556
Error and the Growth of Experimental Knowledge
Mayo, D. G. (1996) · doi:10.7208/chicago/9780226511993.001.0001 · Cited by 1,325
Testing ecological models: the meaning of validation
Rykiel, E. J. (1996) · Ecological Modelling · doi:10.1016/0304-3800(95)00152-2 · Cited by 1,279
Ten iterative steps in development and evaluation of environmental models
Jakeman, A. J., Letcher, R. A., & Norton, J. P. (2006) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2006.01.004 · Cited by 1,111 · cited 1×
“ts note the importance of features other than how a recent examples, see Jakeman et al. (2006), Mäki Elliott and McKaughan (2014), Bolinska (2016), current article provides a framework for thinking t this—in terms of constraints imposed by features ts on the representational features of models.”
BackgroundRe-Engineering Philosophy for Limited Beings: Piecewise Approximations to Reality
WIMSATT, W. C. (2007) · doi:10.2307/j.ctv1pncnrh · Cited by 871
How Models Are Used to Represent Reality
Giere, R. N. (2004) · Philosophy of Science · doi:10.1086/425063 · Cited by 802
Scientific Representation: Paradoxes of Perspective
van Fraassen, B. C. (2008) · doi:10.1093/acprof:oso/9780199278220.001.0001 · Cited by 754
Simulation and Similarity: Using Models to Understand the World
Weisberg, M. (2013) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199933662.001.0001 · Cited by 746
Research works printed but not linked: 6
- Levins, 1966, The Strategy of Model-Building in Population Biology, American Scientist, 54
- 2007, Models in Environmental Regulatory Decision Making
- Hilpinen, 2011, Stanford Encyclopedia of Philosophy
- Knuuttila, 2011, Modeling and Representing: An Artifactual Approach, Studies in History and Philosophy of Science, A 42
- 2013, Climate Change 2013: The Physical Science Basis
- 10.1207/s15516709cog1603_3 · doi:10.1207/s15516709cog1603_3 · Paper page
Cited by
(2023) · Climate Change 2021 – The Physical Science Basis · doi:10.1017/9781009157896.003 · Cited by 298
Auditing of AI: Legal, Ethical and Technical Approaches
Mökander, J. (2023) · Digital Society · doi:10.1007/s44206-023-00074-y · Cited by 152
“These build on tools and methods with proven track records in systems engineering and computer science, including model evaluation (Parker, 2020) and system verification (Luckcuck et al., 2019; Thudi et al., 2021).”
MethodData models, representation and adequacy-for-purpose
Bokulich, A., & Parker, W. S. (2021) · European Journal for Philosophy of Science · doi:10.1007/s13194-020-00345-2 · Cited by 158
“…theoretical models represent their targets that can determine whether they are adequate for purposes of interest, but also other features of such models, such as their adaptability, their intelligibility, how computationally-demanding they are, and so on (Elliott and McKaughan 2014; Parker 2020a).”
BackgroundMethodInfluentialSelf-citationModelling Nature: An Opinionated Introduction to Scientific Representation
Frigg, R., & Nguyen, J. (2020) · Synthese Library/Synthese library · doi:10.1007/978-3-030-45153-0 · Cited by 137
The Social Dimensions of Scientific Knowledge: Consensus, Controversy, and Coproduction
Miller, B. (2024) · Cambridge University Press eBooks · doi:10.1017/9781108588782 · Cited by 116
Metadata
- Authors
- Parker, W. S.
- Affiliations
- Durham University (GB)
- Corresponding author
- Parker, Wendy S.
- ORCID
- Parker, Wendy S.
- Venue
- Philosophy of Science
- Publisher
- Cambridge University Press (CUP)
- Published
- 2020-07
- Volume
- 87
- Issue
- 3
- Pages
- 457-477
- ISSN
- 0031-8248 (ISSN-L)
- 1539-767X
- OpenAlex
- W3007296464
- Cited by
- 310
- References
- 43
- Citations by year
- 2026: 38 · 2025: 64 · 2024: 79 · 2023: 48 · 2022: 38 · 2021: 34 · 2020: 8
- FWCI
- 119.99
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Philosophy of Science (publishedVersion, cc-by-nc)
- Durham Research Online (Durham University) (acceptedVersion, cc-by-nc)
- Durham Research Online (Durham University) (submittedVersion, cc-by-nc)
- Funders
- European Commission (HORIZON2020)
- H2020 European Research Council (667526)
- Topics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Logic and Philosophy of Science
- Social Sciences › Arts and Humanities › Philosophy › Epistemology, Ethics, and Metaphysics
- Keywords
- model adequacy, model evaluation, scientific models
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.