Replication, experiments and knowledge in public management research
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Replication is increasingly recognized as an important part of knowledge production in the social sciences, especially for experimental research. However, despite growing use of experiments, replication is little discussed or practiced in public management. We review the approach to replication taken by research in leading public management journals and note its scarcity. We then use a typology developed by Tsang and Kwan to classify the experimental replications undertaken by the articles in this special issue, which reveals a substantial variety of approach. We conclude by suggesting that replication is undertaken for different purposes and present a protocol about replication for experimental public management research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Yin, R. K. (2009). Case study research: Design and methods (4th Ed.). Thousand Oaks, CA: Sage.
Aberdeen, T. (2013) · The Canadian Journal of Action Research · doi:10.33524/cjar.v14i1.73 · Cited by 3,250
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Defining the 'field at a given time.'
Lewin, K. (1943) · Psychological Review · doi:10.1037/h0062738 · Cited by 1,019 · cited 1×
“Non-replicability may be common and the reasons for this may be complex and directly related to the type of replication attempted (Freese 2007; Lewin 1943; Morrell and Lucas 2012).”
BackgroundRegistered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716 · cited 4×
“Replication is discussed and undertaken, sometimes controversially, in many social science disciplines (Freese 2007; Nosek and Lakens 2014).”
BackgroundInfluentialGrimmelikhuijsen, S. G., & Meijer, A. J. (2014) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mus048 · Cited by 678 · cited 9×
“which Grimmelikhuijsen and Porumbescu (2017) also conducted a conceptual replication to extend knowledge on expectancy disconfirmation theory. Implementing exact replications in public management research is challenging because it can be difficult to obtain funding and access to target populations. Using the same popu…”
BackgroundResultInfluentialTesting the Expectancy Disconfirmation Model of Citizen Satisfaction with Local Government
Van Ryzin, G. G. (2006) · Journal of Public Administration Research and Theory · doi:10.1093/jopart/mui058 · Cited by 301
Bouwman, R., & Grimmelikhuijsen, S. (2016) · International Journal of Public Sector Management · doi:10.1108/ijpsm-07-2015-0129 · Cited by 95 · cited 2×
“…and the number public management studies adopting various types of experimental methods (including field, laboratory and survey types) has grown substantially in recent years (Blom-Hansen and Serritzlew 2015; Bouwman and Grimmelikhuijsen 2016; Margetts 2011; James, Jilke, and Van Ryzin 2017).”
Background
Cited by
Knowledge management, decision-making style and organizational performance
Abubakar, A. M., Elrehail, H., Alatailat, M. A., & Elçi, A. (2019) · Journal of Innovation & Knowledge · doi:10.1016/j.jik.2017.07.003 · Cited by 856
Grimmelikhuijsen, S., John, P., Meijer, A., & Worthy, B. (2019) · Journal of Behavioral Public Administration · doi:10.30636/jbpa.12.34 · Cited by 52
Fang, X., Zhou, H., & Chen, S. (2025) · Public Administration · doi:10.1111/padm.70015 · Cited by 13
Introduction: Experiments in Public Management Research
James, O., Jilke, S., & Van Ryzin, G. G. (2017) · Experiments in Public Management Research · doi:10.1017/9781316676912.002 · Cited by 10
Self-citation
Metadata
- Authors
- Walker, R. M., James, O., & Brewer, G. A.
- Venue
- Public Management Review
- Publisher
- Informa UK Limited
- Published
- 2017-03-02
- Volume
- 19
- Issue
- 9
- Pages
- 1221-1234
- ISSN
- 1461-667X (ISSN-L)
- 1471-9037
- 1471-9045
- OpenAlex
- W2592960191
- Cited by
- 100
- References
- 8
- FWCI
- 24.19
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Replication, experiments and knowledge in public management research. https://app.cochat.ai/papers/10.1080/14719037.2017.1282003
- The paper
- Walker, R. M., James, O., & Brewer, G. A. (2017). Replication, experiments and knowledge in public management research. Public Management Review. https://doi.org/10.1080/14719037.2017.1282003
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.