The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
A Scoping Review of Empirical Evidence on (Digital) Public Services Co-Creation
Open accessAbstract
The public sector is facing significant challenges regarding public services provision, including declination of users’ trust and limited resources. An alternative approach to traditional public service provision with the potential to address these challenges is the co-creation of public services. Co-creation promises to foster innovative solutions to provide high-quality services that respond to users’ needs. Considering this background, we aim at critically exploring public service co-creation via a scoping review, employing the PRISMA-ScR method. Our review focuses on 25 empirical studies out of 75 analyzed articles that examine the implementation of co-creation of (digital) public services and investigates how the empirical literature portrays the concept of public service co-creation. Our findings primarily suggest that co-creation can be implemented in a wide range of sectors and settings, to improve public services and to foster innovation, throughout the whole public service cycle, using a variety of digital, analog and hybrid co-creation tools and strategies. Yet, our review has also shown that there is still an implementation gap that needs to be bridged between knowing and doing in the context of public services co-creation in a digital setting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Several systematic reviews using ASReview have already been published. For some examples, see [56-60].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 15×
“While using a PRISMA-ScR method has allowed for a more systematic and transparent review of literature reinforced by the use of an AI tool, the screening process may suffer from the researchers’ subjectivity.”
BackgroundMethodInfluentialMunn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385 · cited 2×
“Considering these observations, the objective of this scoping review is to explore the implementation of public services Adm. Sci. 2021, 11, 130. https://doi.org/10.3390/admsci11040130 https://www.mdpi.com/journal/admsci co-creation in a digital context (Munn et al. 2018).”
BackgroundMethodInfluentialUpdating guidance for reporting systematic reviews: development of the PRISMA 2020 statement
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., & Moher, D. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.02.003 · Cited by 3,490
A Systematic Review of Co-Creation and Co-Production: Embarking on the social innovation journey
Voorberg, W. H., Bekkers, V. J. J. M., & Tummers, L. G. (2015) · Public Management Review · doi:10.1080/14719037.2014.930505 · Cited by 2,315
Beyond Engagement and Participation: User and Community Coproduction of Public Services
Bovaird, T. (2007) · Public Administration Review · doi:10.1111/j.1540-6210.2007.00773.x · Cited by 1,971 · cited 2×
“Co-creation processes can take place in all phases of the public service cycle (Linders 2012; McBride et al. 2019; Bovaird 2007; Rodriguez Müller 2021).”
BackgroundLinders, D. (2012) · Government Information Quarterly · doi:10.1016/j.giq.2012.06.003 · Cited by 1,333 · cited 18×
“We also differentiated between the tools based on the phase of public service co-creation, yet only two articles (Linders 2012; McBride et al. 2019) examined co-creation in the delivery phase.”
BackgroundMethodInfluentialAn open source machine learning framework for efficient and transparent systematic reviews
van de Schoot, R., de Bruin, J., Schram, R., Zahedi, P., de Boer, J., Weijdema, F., Kramer, B., Huijts, M., Hoogerwerf, M., Ferdinands, G., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-020-00287-7 · Cited by 1,157 · cited 1×
“This AI-aided and open-source tool allows for a more efficient and less error-prone screening process (see van de Schoot et al. 2021 for more information) when compared to a regular screening process.”
MethodCo-Production and the Co-Creation of Value in Public Services: A suitable case for treatment?
Osborne, S. P., Radnor, Z., & Strokosch, K. (2016) · Public Management Review · doi:10.1080/14719037.2015.1111927 · Cited by 1,126 · cited 1×
“…OR “tech*” OR “online” OR “m-gov*” OR “smart” OR “open govern*”) AND AB=(“public sector*” OR “public service*” OR “public administration*” OR “PSO*” OR “govern*” OR “public org*”)))))) Indexes= SSCI, ESCI Timespan=All years Language=English Type of document=Article, Early Access Notes 1…”
Varieties of Participation in Public Services: The Who, When, and What of Coproduction
Nabatchi, T., Sancino, A., & Sicilia, M. (2017) · Public Administration Review · doi:10.1111/puar.12765 · Cited by 848 · cited 5×
“Finally, the co-evaluation phase assesses the service after its delivery in an effort to learn from it or to adapt to it through possible prospective elements (Nabatchi et al. 2017).”
BackgroundInfluential
Research works printed but not linked: 2
- Moore, Mark Harrison (1995). Creating Public Value: Strategic Management in Government, Harvard University Press.
- Steen, Trui, Brandsen, Taco, and Verschuere, Bram (2018). The dark side of co-creation and co-production: Seven evils. Co-Production and Co-Creation, Routledge. · DOI · Paper page
Cited by
Understanding urban perception with visual data: A systematic review
Ito, K., Kang, Y., Zhang, Y., Zhang, F., & Biljecki, F. (2024) · Cities · doi:10.1016/j.cities.2024.105169 · Cited by 182
Ferdinands, G., Schram, R., de Bruin, J., Bagheri, A., Oberski, D. L., Tummers, L., Teijema, J. J., & van de Schoot, R. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02257-7 · Cited by 96
Utilizing ASReview in screening primary studies for meta-research in SLA: A step-by-step tutorial
Quan, Y., Tytko, T., & Hui, B. (2024) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2024.100101 · Cited by 64
Public values? A systematic literature review into the outcomes of public service co-creation
Acar, L., Steen, T. P. S., & Verschuere, B. (2023) · Public Management Review · doi:10.1080/14719037.2023.2288248 · Cited by 67
Self-citationHaug, N. (2023) · Public Administration · doi:10.1111/padm.12965 · Cited by 60
Metadata
- Authors
- Rodriguez Müller, A. P., Casiano Flores, C., Albrecht, V., Steen, T., & Crompvoets, J.
- Affiliations
- Public Governance Institute, KU Leuven, 3000 Leuven, Belgium
- Universität für Weiterbildung Krems (AT)
- KU Leuven (BE)
- Venue
- Administrative Sciences
- Publisher
- MDPI AG
- Published
- 2021-11-10
- Volume
- 11
- Issue
- 4
- Pages
- 130
- ISSN
- 2076-3387 (ISSN-L)
- OpenAlex
- W3211586922
- Cited by
- 65
- References
- 62
- Citations by year
- 2026: 15 · 2025: 16 · 2024: 11 · 2023: 19 · 2022: 4
- FWCI
- 7.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Administrative Sciences (publishedVersion, cc-by)
- Lirias (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Econstor (Econstor) (submittedVersion, cc-by)
- Funders
- European Union (962563)
- Topics
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Innovative Approaches in Technology and Social Development
- Social Sciences › Public Administration › Public Policy and Administration Research
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Keywords
- digital public services, public service innovation, implementation gap, public sector innovation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: A Scoping Review of Empirical Evidence on (Digital) Public Services Co-Creation. https://app.cochat.ai/papers/10.3390/admsci11040130
- The paper
- Rodriguez Müller, A. P., Casiano Flores, C., Albrecht, V., Steen, T., & Crompvoets, J. (2021). A Scoping Review of Empirical Evidence on (Digital) Public Services Co-Creation. Administrative Sciences. https://doi.org/10.3390/admsci11040130
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.