Evaluating knowledge exchange in interdisciplinary and multi-stakeholder research
The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
Abstract Interdisciplinary and multi-stakeholder research is increasingly being promoted and implemented to enhance understanding of global environment change, identify holistic policy solutions, and assist implementation. These research activities are social processes aiming to enhance the exchange and translation of knowledge. Emphasis on the design and management of knowledge exchange is increasing, but learning about how to do this better is hampered by lack of conceptual development and appropriate methods to evaluate complex and multifaceted knowledge exchange processes. This paper therefore develops principles for the evaluation of knowledge exchange in interdisciplinary, multi-stakeholder environmental change research. The paper is based on an analysis of 135 peer-reviewed evaluations of knowledge exchange from diverse disciplines. The results indicate strong relationships between the field of study (e.g. health care, environmental management), the way knowledge and knowledge exchange were conceptualised and implemented, the approach used for the evaluation, and the outcomes being evaluated. A typology of seven knowledge exchange evaluations is presented to guide discussions about the underlying assumptions of different approaches to knowledge exchange and its evaluation. Five principles for knowledge exchange evaluation are also identified: (i) design for multiple end users; (ii) be explicit about why a particular approach to knowledge exchange is expected to deliver its outcomes; (iii) evaluate diverse outcomes; (iv) use evaluations as part of the process of delivering knowledge exchange; and (v) use mixed methods to evaluate knowledge exchange. We conclude that a catch-all approach to evaluation is neither appropriate nor desirable. Instead, approaches that focus on understanding the underlying processes of knowledge exchange, assess the relative contribution of other factors in shaping outcomes in addition to knowledge exchange, and that involve multiple stakeholders in implementing evaluations, will be the most appropriate for evaluating knowledge exchange in interdisciplinary global environmental change research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Science for the post-normal age
Funtowicz, S. O., & Ravetz, J. R. (1993) · Futures · doi:10.1016/0016-3287(93)90022-l · Cited by 4,255
Stakeholder participation for environmental management: A literature review
Reed, M. S. (2008) · Biological Conservation · doi:10.1016/j.biocon.2008.07.014 · Cited by 4,237
Self-citationSECI, Ba and leadership: A unified model of dynamic knowledge creation
Nonaka, I., Toyama, R., & Konno, N. (2000) · Long Range Planning · doi:10.1016/s0024-6301(99)00115-6 · Cited by 4,135 · cited 2×
“dynamic patterns of collective sense-making that include tacit and experiential knowledge, interpretation of new knowledge and negotiation of its meaning, and collective processing of knowledge influenced by group dynamics (Gabbay et al., 2003; Nonaka et al., 2000).”
BackgroundRe-Thinking Science: Knowledge and the Public in an Age of Uncertainty
Linder, F., Spear, J., Nowotny, H., Scott, P., & Gibbons, M. (2003) · Contemporary Sociology · doi:10.2307/3089636 · Cited by 3,381
Kates, R. W., Clark, W. C., Corell, R., Hall, J. M., Jaeger, C. C., Lowe, I., McCarthy, J. J., Schellnhuber, H. J., Bolin, B., Dickson, N. M., et al. (2001) · Science · doi:10.1126/science.1059386 · Cited by 2,551
Pahl-Wostl, C. (2009) · Global Environmental Change · doi:10.1016/j.gloenvcha.2009.06.001 · Cited by 2,254
Re-thinking science: knowledge and the public in an age of uncertainty
(2001) · Choice Reviews Online · doi:10.5860/choice.39-0899 · Cited by 1,807
Leadership, social capital and incentives promote successful fisheries
Gutiérrez, N. L., Hilborn, R., & Defeo, O. (2011) · Nature · doi:10.1038/nature09689 · Cited by 1,344
Consensus Building and Complex Adaptive Systems: A Framework for Evaluating Collaborative Planning
Innes, J. E., & Booher, D. E. (1999) · Journal of the American Planning Association · doi:10.1080/01944369908976071 · Cited by 1,302
Integrating local and scientific knowledge for environmental management
Raymond, C. M., Fazey, I., Reed, M. S., Stringer, L. C., Robinson, G. M., & Evely, A. C. (2010) · Journal of Environmental Management · doi:10.1016/j.jenvman.2010.03.023 · Cited by 1,116 · cited 6×
“…opportunities for global change research, which encourages co-production and co-management styles of knowledge exchange (Connick and Innes, 2003; Raymond et al., 2010) and brings together multi-stakeholder groups with different values and ontological and epistemological perspectives (Fazey,…”
BackgroundInfluentialSelf-citation
Cited by
Crafting usable knowledge for sustainable development
Clark, W. C., van Kerkhoff, L., Lebel, L., & Gallopin, G. C. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1601266113 · Cited by 582
Cvitanovic, C., Hobday, A. J., van Kerkhoff, L., Wilson, S. K., Dobbs, K., & Marshall, N. A. (2015) · Ocean & Coastal Management · doi:10.1016/j.ocecoaman.2015.05.002 · Cited by 504
Five principles for the practice of knowledge exchange in environmental management
Reed, M. S., Stringer, L. C., Fazey, I., Evely, A. C., & Kruijsen, J. H. J. (2014) · Journal of Environmental Management · doi:10.1016/j.jenvman.2014.07.021 · Cited by 424
Self-citationOteros-Rozas, E., Martín-López, B., Daw, T. M., Bohensky, E. L., Butler, J. R. A., Hill, R., Martin-Ortega, J., Quinlan, A., Ravera, F., Ruiz-Mallén, I., et al. (2015) · Ecology and Society · doi:10.5751/es-07985-200432 · Cited by 412
Djenontin, I. N. S., & Meadow, A. M. (2018) · Environmental Management · doi:10.1007/s00267-018-1028-3 · Cited by 407
Cvitanovic, C., McDonald, J., & Hobday, A. J. (2016) · Journal of Environmental Management · doi:10.1016/j.jenvman.2016.09.038 · Cited by 361
What can climate services learn from theory and practice of co-production?
Vincent, K., Daly, M., Scannell, C., & Leathes, B. (2018) · Climate Services · doi:10.1016/j.cliser.2018.11.001 · Cited by 310
Knowledge co-production: A pathway to effective fisheries management, conservation, and governance
Cooke, S. J., Nguyen, V. M., Chapman, J. M., Reid, A. J., Landsman, S. J., Young, N., Hinch, S. G., Schott, S., Mandrak, N. E., & Semeniuk, C. A. (2021) · Fisheries · doi:10.1002/fsh.10512 · Cited by 182
“Empirical social science research has revealed clearly that co‐production is perhaps the single most effective action that researchers can take to help bridge the knowledge–action divide (Fazey et al. 2014; Cvitanovic et al. 2015, 2016).”
BackgroundBridging knowledge systems to enhance governance of environmental commons: A typology of settings
Rathwell, K. J., Armitage, D., & Berkes, F. (2015) · International Journal of the Commons · doi:10.18352/ijc.584 · Cited by 154
Newig, J., Jahn, S., Lang, D. J., Kahle, J., & Bergmann, M. (2019) · Environmental Science & Policy · doi:10.1016/j.envsci.2019.08.008 · Cited by 125
Stakeholder engagement in the co-production of knowledge for environmental decision-making
Gerlak, A. K., Guido, Z., Owen, G., McGoffin, M. S. R., Louder, E., Davies, J., Smith, K. J., Zimmer, A., Murveit, A. M., Meadow, A., et al. (2023) · World Development · doi:10.1016/j.worlddev.2023.106336 · Cited by 114
Increasing the effectiveness of participatory scenario development through codesign
McBride, M. F., Lambert, K. F., Huff, E. S., Theoharides, K. A., Field, P., & Thompson, J. R. (2017) · Ecology and Society · doi:10.5751/es-09386-220316 · Cited by 88
Metadata
- Authors
- Fazey, I., Bunse, L., Msika, J., Pinke, M., Preedy, K., Evely, A. C., Lambert, E., Hastings, E., Morris, S., & Reed, M. S.
- Venue
- Global Environmental Change
- Publisher
- Elsevier BV
- Published
- 2014-03
- Volume
- 25
- Pages
- 204-220
- ISSN
- 0959-3780 (ISSN-L)
- OpenAlex
- W2010475948
- Cited by
- 333
- References
- 71
- FWCI
- 52.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.