The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
A Scoping Review of Empirical Evidence on (Digital) Public Services Co-Creation
Open accessAbstract
The public sector is facing significant challenges regarding public services provision, including declination of users’ trust and limited resources. An alternative approach to traditional public service provision with the potential to address these challenges is the co-creation of public services. Co-creation promises to foster innovative solutions to provide high-quality services that respond to users’ needs. Considering this background, we aim at critically exploring public service co-creation via a scoping review, employing the PRISMA-ScR method. Our review focuses on 25 empirical studies out of 75 analyzed articles that examine the implementation of co-creation of (digital) public services and investigates how the empirical literature portrays the concept of public service co-creation. Our findings primarily suggest that co-creation can be implemented in a wide range of sectors and settings, to improve public services and to foster innovation, throughout the whole public service cycle, using a variety of digital, analog and hybrid co-creation tools and strategies. Yet, our review has also shown that there is still an implementation gap that needs to be bridged between knowing and doing in the context of public services co-creation in a digital setting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Several systematic reviews using ASReview have already been published. For some examples, see [56-60].”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · cited 15×
“While using a PRISMA-ScR method has allowed for a more systematic and transparent review of literature reinforced by the use of an AI tool, the screening process may suffer from the researchers’ subjectivity.”
BackgroundMethodInfluentialMunn, Z., Peters, M. D. J., Stern, C., Tufanaru, C., McArthur, A., & Aromataris, E. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0611-x · Cited by 11,385 · cited 2×
“Considering these observations, the objective of this scoping review is to explore the implementation of public services Adm. Sci. 2021, 11, 130. https://doi.org/10.3390/admsci11040130 https://www.mdpi.com/journal/admsci co-creation in a digital context (Munn et al. 2018).”
BackgroundMethodInfluentialUpdating guidance for reporting systematic reviews: development of the PRISMA 2020 statement
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., & Moher, D. (2021) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2021.02.003 · Cited by 3,490
A Systematic Review of Co-Creation and Co-Production: Embarking on the social innovation journey
Voorberg, W. H., Bekkers, V. J. J. M., & Tummers, L. G. (2015) · Public Management Review · doi:10.1080/14719037.2014.930505 · Cited by 2,315
Beyond Engagement and Participation: User and Community Coproduction of Public Services
Bovaird, T. (2007) · Public Administration Review · doi:10.1111/j.1540-6210.2007.00773.x · Cited by 1,971 · cited 2×
“Co-creation processes can take place in all phases of the public service cycle (Linders 2012; McBride et al. 2019; Bovaird 2007; Rodriguez Müller 2021).”
BackgroundLinders, D. (2012) · Government Information Quarterly · doi:10.1016/j.giq.2012.06.003 · Cited by 1,333 · cited 18×
“We also differentiated between the tools based on the phase of public service co-creation, yet only two articles (Linders 2012; McBride et al. 2019) examined co-creation in the delivery phase.”
BackgroundMethodInfluentialAn open source machine learning framework for efficient and transparent systematic reviews
van de Schoot, R., de Bruin, J., Schram, R., Zahedi, P., de Boer, J., Weijdema, F., Kramer, B., Huijts, M., Hoogerwerf, M., Ferdinands, G., et al. (2021) · Nature Machine Intelligence · doi:10.1038/s42256-020-00287-7 · Cited by 1,157 · cited 1×
“This AI-aided and open-source tool allows for a more efficient and less error-prone screening process (see van de Schoot et al. 2021 for more information) when compared to a regular screening process.”
MethodCo-Production and the Co-Creation of Value in Public Services: A suitable case for treatment?
Osborne, S. P., Radnor, Z., & Strokosch, K. (2016) · Public Management Review · doi:10.1080/14719037.2015.1111927 · Cited by 1,126 · cited 1×
“…OR “tech*” OR “online” OR “m-gov*” OR “smart” OR “open govern*”) AND AB=(“public sector*” OR “public service*” OR “public administration*” OR “PSO*” OR “govern*” OR “public org*”)))))) Indexes= SSCI, ESCI Timespan=All years Language=English Type of document=Article, Early Access Notes 1…”
Varieties of Participation in Public Services: The Who, When, and What of Coproduction
Nabatchi, T., Sancino, A., & Sicilia, M. (2017) · Public Administration Review · doi:10.1111/puar.12765 · Cited by 848 · cited 5×
“Finally, the co-evaluation phase assesses the service after its delivery in an effort to learn from it or to adapt to it through possible prospective elements (Nabatchi et al. 2017).”
BackgroundInfluential
Research works printed but not linked: 2
- Moore, Mark Harrison (1995). Creating Public Value: Strategic Management in Government, Harvard University Press.
- Steen, Trui, Brandsen, Taco, and Verschuere, Bram (2018). The dark side of co-creation and co-production: Seven evils. Co-Production and Co-Creation, Routledge. · DOI · Paper page
Cited by
Understanding urban perception with visual data: A systematic review
Ito, K., Kang, Y., Zhang, Y., Zhang, F., & Biljecki, F. (2024) · Cities · doi:10.1016/j.cities.2024.105169 · Cited by 182
Ferdinands, G., Schram, R., de Bruin, J., Bagheri, A., Oberski, D. L., Tummers, L., Teijema, J. J., & van de Schoot, R. (2023) · Systematic Reviews · doi:10.1186/s13643-023-02257-7 · Cited by 96
Utilizing ASReview in screening primary studies for meta-research in SLA: A step-by-step tutorial
Quan, Y., Tytko, T., & Hui, B. (2024) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2024.100101 · Cited by 64
Public values? A systematic literature review into the outcomes of public service co-creation
Acar, L., Steen, T. P. S., & Verschuere, B. (2023) · Public Management Review · doi:10.1080/14719037.2023.2288248 · Cited by 67
Self-citationHaug, N. (2023) · Public Administration · doi:10.1111/padm.12965 · Cited by 64
Design for inclusive digital co-production
Perikangas, S., & Tuurnas, S. (2023) · Public Management Review · doi:10.1080/14719037.2023.2224819 · Cited by 48
“There is also a need to understand the interaction in digital settings rather than focusing on the technologies (e.g. Kjellström, 2021; Rodriguez Müller et al. 2021).”
BackgroundBlom, R., Jaspers, E., Knies, E., & van der Lippe, T. (2025) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2025.104091 · Cited by 53
A Scoping Review of Landform Classification Using Geospatial Methods
Mashimbye, Z. E., & Loggenberg, K. (2023) · Geomatics · doi:10.3390/geomatics3010005 · Cited by 24
Pauluzzo, R., Fedele, P., Dokalskaya, I., & Garlatti, A. (2024) · Financial Accountability and Management · doi:10.1111/faam.12391 · Cited by 36
Müller, A. P. R., Lerusse, A., Steen, T. P. S., & de Walle, S. V. (2023) · Public Administration · doi:10.1111/padm.12946 · Cited by 23
Self-citationCo-creation experiences among adults in diverse contexts: A Health CASCADE scoping review
McCaffrey, L., McCann, B., Giné‐Garriga, M., An, Q., Cardon, G., CHASTIN, S. F. M., Chrifou, R., Lippke, S., Loisel, Q. E. A., Longworth, G. R., et al. (2024) · Public Health · doi:10.1016/j.puhe.2024.11.002 · Cited by 17
Vrbek, S., & Jukić, T. (2023) · Transforming Government People Process and Policy · doi:10.1108/tg-03-2023-0031 · Cited by 13
Sustainable Co-Creation in the Public Sector: A Case Study in the Lower Austrian Federal Government
Edelmann, N., Müller, A. P. R., Steen, T. P. S., Gerhardter, B., & Holzbauer, T. (2022) · International Conference on Theory and Practice of Electronic Governance · doi:10.1145/3560107.3560126 · Cited by 16
Self-citationBoone, A., Braeckman, L., Michels, N. R. M., Kindermans, H. P. J., Hoof, E. V., den Broeck, K. V., & Godderis, L. (2023) · International Journal of Qualitative Methods · doi:10.1177/16094069231180169 · Cited by 18
“In this regard, hybrid co-creation approaches, that combine online and of fl ine tools, should also be considered and further investigated, as they allow broad engagement of different target groups and might offer a solution for the ‘ digital divide ’ (Rodriguez Müller et al., 2021).”
BackgroundSun, J., Caputo, V., & Taylor, H. (2024) · Applied Economic Perspectives and Policy · doi:10.1002/aepp.13446 · Cited by 18
Uster, A. (2024) · Australian Journal of Public Administration · doi:10.1111/1467-8500.12657 · Cited by 27
McBride, K., Nikiforova, A., & Lněnička, M. (2023) · Information Polity · doi:10.3233/ip-220057 · Cited by 11
“While previous research has explored ideas relating to the use of digital technologies for the co-creation of services (Rodriguez Müller et al., 2021; Lember et al., 2019), such research did not directly explore how co-created services could be used as a crisis management tool.”
Júnior, E. F., & Silva, L. C. S. (2026) · Journal of the Knowledge Economy · doi:10.1007/s13132-026-03277-z · Cited by 30
Paths to citizens-controlled coproduction: The use of blockchain technology in digital coproduction
Tan, E., & Müller, A. P. R. (2023) · Public Management Review · doi:10.1080/14719037.2023.2218388 · Cited by 14
“Coproduction scholars tend to differ in the name and number of phases, yet they all agree that each phase of the public service cycle entails different roles from both the public service providers and the citizens (Loeffler 2021; Rodriguez Müller et al. 2021).”
InfluentialTechnology-enabled value co-creation in healthcare: a configurational approach
Marsilio, M., & Mastrodascio, M. (2024) · Public Management Review · doi:10.1080/14719037.2024.2329220 · Cited by 11
“Nevertheless, although the scholarly interest in exploring how digital technologies facilitate co-production in public services is expanding, ‘there is a lack of hard evidence on their actual impact’ (Lember, Brandsen, and Tõnurist 2019; Rodriguez Müller et al. 2021).”
Towards a co-creation approach in the European Interoperability Framework
Flores, C. A. C., Müller, A. P. R., Virkar, S., Temple, L., Steen, T. P. S., & Crompvoets, J. (2022) · Transforming Government People Process and Policy · doi:10.1108/tg-03-2022-0033 · Cited by 12
Self-citationMuhhina, K. (2023) · Government Information Quarterly · doi:10.1016/j.giq.2023.101905 · Cited by 8
Rizun, N., Revina, A., & Edelmann, N. (2025) · Artificial Intelligence Review · doi:10.1007/s10462-025-11112-1 · Cited by 13
“…understand further the role of citizens in the context of co-creation, how they interact with public services and PSO, and how they co-create value through text-based communication (Jacobs et al. 2018; Rodriguez Müller et al. 2021; Wood 2016) and AI-enabled function of public service (Yang 2023).”
InfluentialKnowledge Conditions in the Co-creation of Social Innovation: A Theory-driven Review
Centeno, J. P. (2025) · Administration & Society · doi:10.1177/00953997251334810 · Cited by 8
Attard, J., & Cortis, K. (2023) · Administrative Sciences · doi:10.3390/admsci13020029 · Cited by 11
Flores, C. A. C., Vanongeval, F., & Steenberghen, T. (2023) · Transactions on Transport Sciences · doi:10.5507/tots.2022.024 · Cited by 8
Assessing the effect of digitalisation on a public “self-servicing” service
Garlatti, A., Iacuzzi, S., Pauluzzo, R., & Pericolo, E. (2025) · Journal of Public Budgeting Accounting & Financial Management · doi:10.1108/jpbafm-09-2024-0186 · Cited by 10
El gobierno electrónico y su eficacia en la mejora de los servicios públicos: revisión sistemática
Risco, O. M. V., & Arias, J. A. L. (2023) · LATAM Revista Latinoamericana de Ciencias Sociales y Humanidades · doi:10.56712/latam.v4i1.319 · Cited by 29
Edelmann, N., & Pereira, J. V. (2024) · International Conference on Theory and Practice of Electronic Governance · doi:10.1145/3680127.3680157 · Cited by 4
Co-creation of digital public services through open-source and hybrid platforms: a systematic review
Cuillerier, M., Shiratori, K., Nakashima, M., Therrien, M., & Lawarée, J. (2026) · Asia Pacific Journal of Public Administration · doi:10.1080/23276665.2026.2645560 · Cited by 4
“…active actors, emphasising equality, joint action, distributed forms of interaction, and the idea that the public sector is merely one actor among others in the process (Bentzen, 2022), notably in innovative contexts (Aastvedt & Higdem, 2022) and through open data (Rodriguez Müller et al., 2021).”
InfluentialHržica, R. (2025) · Systems · doi:10.3390/systems13090806 · Cited by 5
Ali, M., Maratsi, M. I., Loukis, E., Alexopoulos, C., & Charalabidis, Y. K. (2022) · Panhellenic Conference on Informatics · doi:10.1145/3575879.3576008 · Cited by 2
“As this area of study is still in its infancy, it becomes apparent that there is In the context of the presented research, Müller et al. (2021) also invite for future studies to be conducted on the implementation of co-creation for public services in terms of strategies, actors and outcomes and, in…”
BackgroundStudy screening for meta-research: An overview of AI toolsPreprint
Quan, Y., & Hui, B. (2023) · doi:10.31219/osf.io/bd6fj · Cited by 2
Filatova, O. G., Bolgov, R., Arkatov, D., & Volkovskii, D. (2025) · Communications in computer and information science · doi:10.1007/978-3-032-04958-2_26 · Cited by 1
Blom, R., & Aarntzen, L. (2026) · Community Work & Family · doi:10.1080/13668803.2026.2625440 · Cited by 3
Designing inclusive co-creation: a conjoint analysis of citizen preferences
Reijnders, L., Verhoest, K., Dooren, W. V., & Coenen, L. (2026) · Public Management Review · doi:10.1080/14719037.2026.2633555 · Cited by 1
Centeno, J. P., Steen, T. P. S., & Müller, A. P. R. (2026) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2026.124705 · Cited by 1
Self-citationLarsson, O. S. (2023) · Journal of Public and Nonprofit Affairs · doi:10.20899/jpna.9.2.1-19 · Cited by 4
“…2006; Loeffler, 2021a; Pestoff, 2012) and similar concepts in the literature, such as co-creation (Brandsen et al., 2018; Loeffler, 2021b; Rodriguez Müller et al., 2021; Torfing et al., 2019; Voorberg et al., 2015), although some argue that for example coproduction and co-creation are conceptually…”
BackgroundInfluentialYuan, Q., Gascó‐Hernández, M., Gil-Garcia, J. R., Taneja, V., Doke, K., Bogdanov, P., & Zheleva, M. (2023) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2023.244 · Cited by 2
“The purposes of co-creation in the public sector are associated to improving public service provision, creating innovative public services, and user-driven co-creation (Rodriguez Müller et al., 2021).”
BackgroundInfluentialDeusdad, B. A., Djurdjevic, M., & Hall, K. A. E. (2024) · International Journal of Care and Caring · doi:10.1332/23978821y2024d000000036 · Cited by 1
Interoperability for Emerging Technologies: A Systematic Scoping Review
Müller, A. P. R., Bosch, J. M., & Tangi, L. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-70274-7_24 · Cited by 3
Public E-service Value Co-creation to Increase Citizen Well-being
Fathya, V. N., Nursanto, G. A., & Akbar, R. S. (2025) · Public Organization Review · doi:10.1007/s11115-025-00842-z · Cited by 3
Chiappini, L., & Coenen, F. H. J. M. (2025) · Urban Planning · doi:10.17645/up.9819 · Cited by 2
Democratizing co-production of sustainable public services
López–de–Ipiña, D., Brandsen, T., Steen, T. P. S., Misikangas, P., Funes, D. S., Müller, A. P. R., & Edelmann, N. (2022) · Annual International Conference on Digital Government Research · doi:10.1145/3543434.3543665 · Cited by 1
“Co-assessment is the monitoring or evaluation of public services after their delivery in an effort to learn from it and to rethink and improve future services ( [5, 6]).”
BackgroundSelf-citationKlip, M., van Kuijk, J., & Kleinsmann, M. S. (2023) · International Association of Societies of Design Research Congress (IASDR) · doi:10.21606/iasdr.2023.305 · Cited by 1
Flores, C. A. C., Müller, A. P. R., & Tan, E. (2025) · Urban Planning · doi:10.17645/up.10809 · Cited by 1
Rizun, N., Revina, A., & Edelmann, N. (2023) · Annual International Conference on Digital Government Research · doi:10.1145/3598469.3598471 · Cited by 10
“1 INTRODUCTION Given dramatic technology developments, the need to fulfil public values such as effective and efficient use of resources, citizens' lack of trust in governments, and satisfaction with public services [88, 96], public administrations are trying to find new ways of developing and delivery public services.”
BackgroundStetsko, E. V., & Meteleva, A. S. (2025) · Communication Strategies in Digital Society Seminar (ComSDS) · doi:10.1109/comsds65569.2025.10971285
“This is also the case of the evaluation of digital public services, described by a paper of scientists from Belgium and Austria «A Scoping Review of Empirical Evidence on (Digital) Public Services Co-Creation»[10].”
Hettiarachchi, N., & Wanigasekara, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5378651
Belabas, W., van Meerkerk, I., & van den Kieboom, T. (2025) · Local Government Studies · doi:10.1080/03003930.2025.2543808
“Nevertheless realising and consolidating inclusion in co-creative processes is considered to be one of the most challenging issues (Rodriguez Müller et al. 2021; Verschuere et al. 2018).”
Rizun, N., Bartashevska, Y., Ciesielska, M., & Bondarovych, H. (2025) · Lecture notes in computer science · doi:10.1007/978-3-032-02515-9_9
Generating and maintaining joint ownership across the collaborative interface in co-creation
van den Kieboom, T., van Meerkerk, I., & Belabas, W. (2025) · Cities · doi:10.1016/j.cities.2025.106283 · Cited by 1
Ingrams, A. R. (2025) · Information Polity · doi:10.1177/15701255251382078
“As a step in the right direction, scoping reviews are an ideal tool for mapping existing concepts and identifying gaps (Arksey & O’malley, 2005; Rodriguez Müller et al., 2021).”
Love in Formal Education: A Systematic Review of Empirical Studies
Díaz, A., & Falcón, S. (2025) · Review of Educational Research · doi:10.3102/00346543251386453 · Cited by 6
Parycek, P., Sasdelli, D. C., & Edelmann, N. (2026) · Springer eBooks · doi:10.1007/978-3-658-49869-6_24
Conceptualizing an ethics framework for co-creation in the public sector
Edelmann, N., Tambouris, E., Parycek, P., & Voigt, J. (2026) · Journal of Information Communication and Ethics in Society · doi:10.1108/jices-09-2024-0134
Mapping one-stop service in government: Insights from a systematic literature review
Haryanti, J. (2026) · Multidisciplinary Reviews · doi:10.31893/multirev.2026622
“…has been widely used in previous studies with similar objectives to support a transparent process of identification, screening, eligibility assessment, and inclusion of relevant publications (Kostagiolas & Katsani, 2021; Moyson et al., 2018; Rodriguez Müller et al., 2021; Sukmasetya et al., 2018).”
Müller, A. P. R., & Flores, C. A. C. (2026) · Journal of Management & Governance · doi:10.1007/s10997-026-09786-y
Understanding Digital Exclusion Through the Lens of Service Providers
Kim, H., Ferati, M., & Kurti, A. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-31285-3_30 · Cited by 1
Jing, C. (2026) · Australian Journal of Public Administration · doi:10.1111/1467-8500.70065
Schmidt, M., Dahl-Jørgensen, T. C., Farshchian, B. A., & Moalagh, M. (2026) · Lecture notes in computer science · doi:10.1007/978-3-032-36676-4_7
Firdaussy, U. F., Ningsih, S., Rusata, T., & Nisa, K. (2026) · Springer eBooks · doi:10.1007/978-981-95-9989-9_8
Hariani, N. J., & Taufik, R. M. I. (2026) · Springer eBooks · doi:10.1007/978-981-95-9989-9_4
Metadata
- Authors
- Rodriguez Müller, A. P., Casiano Flores, C., Albrecht, V., Steen, T., & Crompvoets, J.
- Affiliations
- Public Governance Institute, KU Leuven, 3000 Leuven, Belgium
- Universität für Weiterbildung Krems (AT)
- KU Leuven (BE)
- Venue
- Administrative Sciences
- Publisher
- MDPI AG
- Published
- 2021-11-10
- Volume
- 11
- Issue
- 4
- Pages
- 130
- ISSN
- 2076-3387 (ISSN-L)
- OpenAlex
- W3211586922
- Cited by
- 65
- References
- 62
- Citations by year
- 2026: 15 · 2025: 16 · 2024: 11 · 2023: 19 · 2022: 4
- FWCI
- 7.27
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Administrative Sciences (publishedVersion, cc-by)
- Lirias (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Econstor (Econstor) (submittedVersion, cc-by)
- Funders
- European Union (962563)
- Topics
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Innovative Approaches in Technology and Social Development
- Social Sciences › Public Administration › Public Policy and Administration Research
- Social Sciences › Political Science and International Relations › E-Government and Public Services
- Keywords
- digital public services, public service innovation, implementation gap, public sector innovation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.