The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
How to build models for government: criteria driving model acceptance in policymaking
Open accessAbstract
Models are used to inform policymaking and underpin large amounts of government expenditure. Several authors have observed a discrepancy between the actual and potential use of models in government. While there have been several studies investigating model acceptance in government, it remains unclear under what conditions models are accepted. In this paper, we address the question “What criteria affect model acceptance in policymaking?”, the answer to which will contribute to the wider understanding of model use in government. We employ a thematic coding approach to identify the acceptance criteria for the eight models in our sample. Subsequently, we compare our findings with existing literature and use qualitative comparative analysis to explore what configurations of the criteria are observed in instances of model acceptance. We conclude that model acceptance is affected by a combination of the model’s characteristics, the supporting infrastructure and organizational factors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Uptake of models in government is as much a social process as it is a technical one [50].”
From Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making (2018) · cites this paper as [50]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1990) · Cited by 24,217
Technology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159 · cited 2×
“This idea is supported by findings on the adoption of information technology in general (Venkatesh and Bala 2008).”
ResultRules, Games, and Common-Pool Resources
Ostrom, E., Gardner, R., & Walker, J. (1994) · University of Michigan Press eBooks · doi:10.3998/mpub.9739 · Cited by 3,732 · cited 1×
“Such work could employ frameworks more suited for analysis of dynamic social processes, such as the institutional analysis and development framework (Ostrom et al. 1994), or the repositories of actor-network theory (Mol 2013).”
MethodSet Relations in Social Research: Evaluating Their Consistency and Coverage
Ragin, C. C. (2006) · Political Analysis · doi:10.1093/pan/mpj019 · Cited by 1,784 · cited 3×
“notion of significance and assesses the degree to which a solution or set of solutions agrees in showing the outcome in question (Ragin 2006).”
BackgroundInfluentialStandards of Good Practice in Qualitative Comparative Analysis (QCA) and Fuzzy-Sets
Schneider, C. Q., & Wagemann, C. (2010) · Comparative Sociology · doi:10.1163/156913210x12493538729793 · Cited by 1,473 · cited 1×
“Using the procedure put forward by Schneider and Wagemann (2010), we conducted a crisp set qualitative comparative analysis (QCA) on both the eleven criteria and the grouped criteria.”
MethodActor-Network Theory: sensitive terms and enduring tensions
MOL, A. P. J. (2010) · UvA-DARE (University of Amsterdam) · Cited by 859
Techniques and Procedures for Developing Grounded Theory
Straus, A. (1998) · Medical Entomology and Zoology · Cited by 841
The rules of the game called psychological science
Bakker, M., van Dijk, A., & Wicherts, J. M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459060 · Cited by 800
Reconsidering evidence-based policy: Key issues and challenges
Head, B. W. (2010) · Policy and Society · doi:10.1016/j.polsoc.2010.03.001 · Cited by 527
Rihoux, B. (2006) · International Sociology · doi:10.1177/0268580906067836 · Cited by 461
Research works printed but not linked: 1
- Treasury, H. M. (2013). Review of quality assurance of Government analytical models: Final Report.
Cited by
Veale, M., Van Kleek, M., & Binns, R. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174014 · Cited by 490
“Uptake of models in government is as much a social process as it is a technical one [50].”
BackgroundModel-based policymaking or policy-based modelling? How energy models and energy policy interact
Süsser, D., Ceglarz, A., Gaschnig, H., Stavrakas, V., Flamos, A., Giannakidis, G., & Lilliestam, J. (2021) · Energy Research & Social Science · doi:10.1016/j.erss.2021.101984 · Cited by 186
“These problems include the inability of models to answer specific questions that users need answered [22], low transparency of models [25], lack of trust in models by policymakers, inability of models to deliver timely support for decision-making, missing capacities in institutions to make use of complex modelling, th…”
BackgroundComputational Models That Matter During a Global Pandemic Outbreak: A Call to Action
Squazzoni, F., Polhill, G. J., Edmonds, B., Ahrweiler, P., Antosz, P., Scholz, G., Chappin, E. J. L., Borit, M., Verhagen, H., Giardini, F., et al. (2020) · Journal of Artificial Societies and Social Simulation · doi:10.18564/jasss.4298 · Cited by 156
“A danger is that a dominant coalition with an accepted model can use it to support their policy for long periods, simply updating the model over time, while leaving its basic assumptions unchanged (Kolkman et al. 2016).”
BackgroundSelf-citationA framework for characterising and evaluating the effectiveness of environmental modelling
Hamilton, S. H., Fu, B., Guillaume, J. H. A., Badham, J., Elsawah, S., Gober, P. A., Hunt, R. J., Iwanaga, T., Jakeman, A. J., Ames, D. P., et al. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.04.008 · Cited by 112
“Others have also found that the complexity of models may contribute to model rejection (Kolkman et al. 2016).”
BackgroundSüsser, D., Gaschnig, H., Ceglarz, A., Stavrakas, V., Flamos, A., & Lilliestam, J. (2021) · Energy · doi:10.1016/j.energy.2021.121909 · Cited by 85
Metadata
- Authors
- Kolkman, D. A., Campo, P., Balke-Visser, T., & Gilbert, N.
- Affiliations
- University of Surrey (GB)
- Venue
- Policy Sciences
- Published
- 2016-05-03
- Volume
- 49
- Issue
- 4
- Pages
- 489-504
- ISSN
- 0032-2687 (ISSN-L)
- 1573-0891
- OpenAlex
- W2346893305
- Cited by
- 39
- References
- 37
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 1 · 2023: 6 · 2022: 7 · 2021: 6 · 2020: 4 · 2019: 4 · 2018: 2 · 2016: 1
- FWCI
- 6.69
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Policy Sciences (publishedVersion, cc-by)
- Surrey Research Insight Open Access (The University of Surrey) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- University of Surrey (GB)
- Engineering and Physical Sciences Research Council (GB)
- Topics
- Social Sciences › Public Administration › Public Policy and Administration Research
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Decision Sciences › Management Science and Operations Research › Complex Systems and Decision Making
- Keywords
- model acceptance, policy making, government model, decision support, model characteristics, organizational factors, supporting infrastructure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How to build models for government: criteria driving model acceptance in policymaking. https://app.cochat.ai/papers/10.1007/s11077-016-9250-4
- The paper
- Kolkman, D. A., Campo, P., Balke-Visser, T., & Gilbert, N. (2016). How to build models for government: criteria driving model acceptance in policymaking. Policy Sciences. https://doi.org/10.1007/s11077-016-9250-4
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.