The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Evaluating knowledge exchange in interdisciplinary and multi-stakeholder research
Abstract
Abstract Interdisciplinary and multi-stakeholder research is increasingly being promoted and implemented to enhance understanding of global environment change, identify holistic policy solutions, and assist implementation. These research activities are social processes aiming to enhance the exchange and translation of knowledge. Emphasis on the design and management of knowledge exchange is increasing, but learning about how to do this better is hampered by lack of conceptual development and appropriate methods to evaluate complex and multifaceted knowledge exchange processes. This paper therefore develops principles for the evaluation of knowledge exchange in interdisciplinary, multi-stakeholder environmental change research. The paper is based on an analysis of 135 peer-reviewed evaluations of knowledge exchange from diverse disciplines. The results indicate strong relationships between the field of study (e.g. health care, environmental management), the way knowledge and knowledge exchange were conceptualised and implemented, the approach used for the evaluation, and the outcomes being evaluated. A typology of seven knowledge exchange evaluations is presented to guide discussions about the underlying assumptions of different approaches to knowledge exchange and its evaluation. Five principles for knowledge exchange evaluation are also identified: (i) design for multiple end users; (ii) be explicit about why a particular approach to knowledge exchange is expected to deliver its outcomes; (iii) evaluate diverse outcomes; (iv) use evaluations as part of the process of delivering knowledge exchange; and (v) use mixed methods to evaluate knowledge exchange. We conclude that a catch-all approach to evaluation is neither appropriate nor desirable. Instead, approaches that focus on understanding the underlying processes of knowledge exchange, assess the relative contribution of other factors in shaping outcomes in addition to knowledge exchange, and that involve multiple stakeholders in implementing evaluations, will be the most appropriate for evaluating knowledge exchange in interdisciplinary global environmental change research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Science for the post-normal age
Funtowicz, S. O., & Ravetz, J. R. (1993) · Futures · doi:10.1016/0016-3287(93)90022-l · Cited by 4,255
Stakeholder participation for environmental management: A literature review
Reed, M. S. (2008) · Biological Conservation · doi:10.1016/j.biocon.2008.07.014 · Cited by 4,237
Self-citationSECI, Ba and leadership: A unified model of dynamic knowledge creation
Nonaka, I., Toyama, R., & Konno, N. (2000) · Long Range Planning · doi:10.1016/s0024-6301(99)00115-6 · Cited by 4,135
Re-Thinking Science: Knowledge and the Public in an Age of Uncertainty
Linder, F., Spear, J., Nowotny, H., Scott, P., & Gibbons, M. (2003) · Contemporary Sociology · doi:10.2307/3089636 · Cited by 3,381
Kates, R. W., Clark, W. C., Corell, R., Hall, J. M., Jaeger, C. C., Lowe, I., McCarthy, J. J., Schellnhuber, H. J., Bolin, B., Dickson, N. M., et al. (2001) · Science · doi:10.1126/science.1059386 · Cited by 2,551
Pahl-Wostl, C. (2009) · Global Environmental Change · doi:10.1016/j.gloenvcha.2009.06.001 · Cited by 2,254
Re-thinking science: knowledge and the public in an age of uncertainty
(2001) · Choice Reviews Online · doi:10.5860/choice.39-0899 · Cited by 1,807
Leadership, social capital and incentives promote successful fisheries
Gutiérrez, N. L., Hilborn, R., & Defeo, O. (2011) · Nature · doi:10.1038/nature09689 · Cited by 1,344
Consensus Building and Complex Adaptive Systems: A Framework for Evaluating Collaborative Planning
Innes, J. E., & Booher, D. E. (1999) · Journal of the American Planning Association · doi:10.1080/01944369908976071 · Cited by 1,302
Integrating local and scientific knowledge for environmental management
Raymond, C. M., Fazey, I., Reed, M. S., Stringer, L. C., Robinson, G. M., & Evely, A. C. (2010) · Journal of Environmental Management · doi:10.1016/j.jenvman.2010.03.023 · Cited by 1,116
Self-citationTransdisciplinary global change research: the co-creation of knowledge for sustainability
Mauser, W., Klepper, G., Rice, M., Schmalzbauer, B. S., Hackmann, H., Leemans, R., & Moore, H. (2013) · Current Opinion in Environmental Sustainability · doi:10.1016/j.cosust.2013.07.001 · Cited by 970
Dimensionality and Disciplinary Differences in Personal Epistemology
Hofer, B. K. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1026 · Cited by 926
Stokols, D., Hall, K. L., Taylor, B. K., & Moser, R. P. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.05.002 · Cited by 753
Evaluation Theory, Models, and Applications
Stufflebeam, D. L., & Coryn, C. L. S. (2007) · Cited by 631
Evaluation Theory, Models, and Applications
Wallis, A. B. (2008) · JAMA · doi:10.1001/jama.299.22.2692 · Cited by 590
Plummer, R., & Armitage, D. (2007) · Ecological Economics · doi:10.1016/j.ecolecon.2006.09.025 · Cited by 570
Epistemological Pluralism: Reorganizing Interdisciplinary Research
Miller, T. R., Baird, T. D., Littlefield, C. M., Kofinas, G., Chapin III, F. S., & Redman, C. L. (2008) · Ecology and Society · doi:10.5751/es-02671-130246 · Cited by 533 · cited 3×
“All other fields were included given that global change is inherently interdisciplinary and that cross-fertilization of ideas about knowledge exchange evaluation has so far been limited (Kothari et al., 2011b; Miller et al., 2008).”
BackgroundEmpowerment evaluation: From principles to practice: (628672012-221)
Flaspohler, P., Wandersman, A., & Cherniss, C. (2003) · PsycEXTRA Dataset · doi:10.1037/e628672012-221 · Cited by 490
Knowledge translation is the use of knowledge in health care decision making
Straus, S. E., Tetroe, J. M., & Graham, I. D. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.08.016 · Cited by 383 · cited 1×
“Perhaps not surprisingly then, knowledge exchange is increasingly being recognised as a research field in its own right (Straus et al., 2011).”
BackgroundKnowledge exchange: a review and research agenda for environmental management
FAZEY, I., EVELY, A. C., REED, M. S., STRINGER, L. C., KRUIJSEN, J., WHITE, P. C. L., NEWSHAM, A., JIN, L., CORTAZZI, M., PHILLIPSON, J., et al. (2013) · Environmental Conservation · doi:10.1017/s037689291200029x · Cited by 342
Self-citationEvaluation Roots : Tracing Theorists' Views and Influences
Alkin, M. C. (2004) · Cited by 323
Outcomes of Collaborative Water Policy Making: Applying Complexity Thinking to Evaluation
Connick, S., & Innes, J. E. (2003) · Journal of Environmental Planning and Management · doi:10.1080/0964056032000070987 · Cited by 314
Evans, L., Cherrett, N., & Pemsl, D. (2011) · Journal of Environmental Management · doi:10.1016/j.jenvman.2011.03.010 · Cited by 252
Stakeholder engagement and knowledge exchange in environmental research
Phillipson, J., Lowe, P., Proctor, A., & Ruto, E. (2012) · Journal of Environmental Management · doi:10.1016/j.jenvman.2011.10.005 · Cited by 248
A Systematic Test of an Enterprise Strategy for Community‐Based Biodiversity Conservation
Salafsky, N., Cauley, H., Balachander, G., Cordes, B., Parks, J., Margoluis, C., Bhatt, S., Encarnacion, C., Russell, D., & Margoluis, R. (2001) · Conservation Biology · doi:10.1046/j.1523-1739.2001.00220.x · Cited by 239
Human behavior and sustainability
Fischer, J., Dyball, R., Fazey, I., Gross, C., Dovers, S., Ehrlich, P. R., Brulle, R. J., Christensen, C., & Borden, R. J. (2012) · Frontiers in Ecology and the Environment · doi:10.1890/110079 · Cited by 238
Self-citationMeagher, L., Lyall, C., & Nutley, S. (2008) · Research Evaluation · doi:10.3152/095820208x331720 · Cited by 207
Framework for participative reflection on the accomplishment of transdisciplinary research programs
Roux, D. J., Stirzaker, R. J., Breen, C. M., Lefroy, E. C., & Cresswell, H. P. (2010) · Environmental Science & Policy · doi:10.1016/j.envsci.2010.08.002 · Cited by 197
The ambiguity of participation: a qualified defence of participatory development
Parfitt, T. (2004) · Third World Quarterly · doi:10.1080/0143659042000191429 · Cited by 193
Demystifying knowledge translation: learning from the community
Bowen, S., Martens, P., & The Need to Know Team (2005) · Journal of Health Services Research & Policy · doi:10.1258/135581905774414213 · Cited by 193
Key characteristics of knowledge transfer and exchange in healthcare: integrative literature review
Pentland, D., Forsyth, K., Maciver, D., Walsh, M., Murray, R., Irvine, L. A., & Sikora, S. (2011) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2011.05631.x · Cited by 192
A systems approach to the evaluation of natural resource management initiatives
Bellamy, J. A., Walker, D. H., McDonald, G. T., & Syme, G. J. (2001) · Journal of Environmental Management · doi:10.1006/jema.2001.0493 · Cited by 184
Tracing 'productive interactions' to identify social impacts: an example from the social sciences
Molas-Gallart, J., & Tang, P. (2011) · Research Evaluation · doi:10.3152/095820211x12941371876706 · Cited by 180
Instructional development paradigms
Dills, C. R., & Romiszowski, A. J. (1997) · Medical Entomology and Zoology · Cited by 177
O’Brien, K., Reams, J., Caspari, A., Dugmore, A., Faghihimani, M., Fazey, I., Hackmann, H., Manuel-Navarrete, D., Marks, J., Miller, R., et al. (2013) · Environmental Science & Policy · doi:10.1016/j.envsci.2012.11.011 · Cited by 158
Self-citationAssessing the impact of research on policy: a literature review
Boaz, A., Fitzpatrick, S., & Shaw, B. (2009) · Science and Public Policy · doi:10.3152/030234209x436545 · Cited by 155
Leys, A. J., & Vanclay, J. K. (2010) · Land Use Policy · doi:10.1016/j.landusepol.2010.11.006 · Cited by 146
Kothari, A. R., Hovanec, N., Hastie, R., & Sibbald, S. L. (2011) · BMC Health Services Research · doi:10.1186/1472-6963-11-173 · Cited by 134
Rycroft-Malone, J., Wilkinson, J. E., Burton, C. R., Andrews, G., Ariss, S., Baker, R., Dopson, S., Graham, I., Harvey, G., Martin, G., et al. (2011) · Implementation Science · doi:10.1186/1748-5908-6-74 · Cited by 132
Kuper, M., Dionnet, M., Hammani, A., Bekkar, Y., Garin, P., & Bluemling, B. (2009) · Ecology and Society · doi:10.5751/es-02755-140119 · Cited by 128
Resilience and Higher Order Thinking
Fazey, I. (2010) · Ecology and Society · doi:10.5751/es-03434-150309 · Cited by 127
Self-citationGabbay, J., le May, A., Jefferson, H., Webb, D., Lovelock, R., Powell, J., & Lathlean, J. (2003) · Health An Interdisciplinary Journal for the Social Study of Health Illness and Medicine · doi:10.1177/1363459303007003003 · Cited by 124
Blanton, E., Ombeki, S., Oluoch, G. O., Mwaki, A., Wannemuehler, K., & Quick, R. (2010) · The American Society of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.2010.09-0422 · Cited by 114 · cited 1×
“While there are excellent examples of larger scale and complex evaluations from the healthcare (Blanton et al., 2010; McWilliam et al., 2005; Rycroft-Malone et al., 2011), it has been suggested that the largely positivist, evidence-based approach applied in this field discourages more holistic…”
BackgroundHeylings, P., & Bravo, M. (2006) · Ocean & Coastal Management · doi:10.1016/j.ocecoaman.2006.09.003 · Cited by 111
Indicators at the interface: managing policymaker-researcher collaboration
Kothari, A. R., MacLean, L. M., Edwards, N. C., & Hobbs, A. (2011) · Knowledge Management Research & Practice · doi:10.1057/kmrp.2011.16 · Cited by 109
Reed, M. S., Fazey, I., Stringer, L. C., Raymond, C. M., Akhtar‐Schuster, M., Bégni, G., Bigas, H., Brehm, S., Briggs, J., Bryce, R., et al. (2011) · Land Degradation and Development · doi:10.1002/ldr.1124 · Cited by 95
Self-citationScience and governance in the European Union: a contribution to the debate
Funtowicz, S., Shepherd, I., Wilkinson, D., & Ravetz, J. R. (2000) · Science and Public Policy · doi:10.3152/147154300781781841 · Cited by 88
Adaptive Environmental Management
Allan, C., & Stankey, G. H. (2009) · Springer eBooks · doi:10.1007/978-1-4020-9632-7 · Cited by 83
Sheppard, D. J., Moehrenschlager, A., McPherson, J. M., & Mason, J. J. (2010) · Environmental Conservation · doi:10.1017/s037689291000041x · Cited by 83
Moreno-Sánchez, R. D. P., & Maldonado, J. H. (2010) · Ecological Economics · doi:10.1016/j.ecolecon.2010.07.032 · Cited by 80
Real-world approaches to assessing the impact of environmental research on policy
Bell, S., Shaw, B. G., & Boaz, A. (2011) · Research Evaluation · doi:10.3152/095820211x13118583635792 · Cited by 79
Co‐Management Approach to Marine Conservation in Mohéli, Comoros Islands
Granek, E. F., & BROWN, M. A. (2005) · Conservation Biology · doi:10.1111/j.1523-1739.2005.00301.x · Cited by 74
Muñoz‐Erickson, T. A., Cutts, B. B., Larson, E. K., Darby, K. J., Neff, M. W., Wutich, A., & Bolin, B. (2010) · Ecology and Society · doi:10.5751/es-03390-150322 · Cited by 64
Post-normal science and the art of nature conservation
Francis, R. A., & Goodman, M. K. (2009) · Journal for Nature Conservation · doi:10.1016/j.jnc.2009.04.002 · Cited by 62
Waters, E., Armstrong, R., Swinburn, B. A., Moore, L., Dobbins, M., Anderson, L. M., Petticrew, M. P., Clark, R., Conning, R., Moodie, M., et al. (2011) · BMC Public Health · doi:10.1186/1471-2458-11-34 · Cited by 57
Learning and knowing collectively
Norgaard, R. B. (2004) · Ecological Economics · doi:10.1016/j.ecolecon.2004.03.021 · Cited by 56
A model for collaborative evaluation of university-community partnerships
Bowen, S., & Martens, P. J. (2006) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2005.040881 · Cited by 56
Introducing the Learning Practice – I. The characteristics of Learning Organizations in Primary Care
Rushmer, R. K., Kelly, D. R., Lough, M., et al. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2004.00464.x · Cited by 55
Muñoz‐Erickson, T. A., Aguilar‐González, B., Loeser, M. R., & Sisk, T. D. (2009) · Environmental Management · doi:10.1007/s00267-009-9400-y · Cited by 46
A knowledge‐based development model: the research chair strategy
Cantú-Ortiz, F. J., Bustani, A., Molina, A., & Moreira, H. (2009) · Journal of Knowledge Management · doi:10.1108/13673270910931233 · Cited by 46
Small Scale Fisheries Management: Lessons from Cockle Harvesters in Nicaragua and Tanzania
Crawford, B. R., Herrera, M. D., Hernández, N. D. S., Leclair, C. R., Jiddawi, N. S., Masumbuko, S., & Haws, M. C. (2010) · Coastal Management · doi:10.1080/08920753.2010.483174 · Cited by 44
Knowledge systems, health care teams, and clinical practice: a study of successful change
Olson, C. A., Tooman, T., & Alvarado, C. J. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-009-9214-y · Cited by 43
Gross, D. P., & Lowe, A. (2009) · Disability and Rehabilitation · doi:10.1080/01443610802355965 · Cited by 42 · cited 1×
“Third, actual impacts of changes in practices/policies can be evaluated, such as improvements in business performance or human or ecological health (e.g. Crawford et al., 2010; Gross and Lowe, 2009).”
BackgroundBracken, L. J., & Oughton, E. A. (2012) · Environmental Science & Policy · doi:10.1016/j.envsci.2012.07.010 · Cited by 40
Evaluation of an educational program for the caregivers of persons diagnosed with a malignant glioma
Cashman, R. L., Bernstein, L. J., Bilodeau, D., Bovett, G., Jackson, B., Yousefi, M., Prica, A. A., & Perry, J. (2007) · Canadian Oncology Nursing Journal · doi:10.5737/1181912x171610 · Cited by 30
Linking actions to outcomes in wetland management: An overview of U.S. state wetland management
Peyre, M. K. L., Reams, M. A., & Mendelssohn, I. A. (2001) · Wetlands · doi:10.1672/0277-5212(2001)021[0066:latoiw]2.0.co;2 · Cited by 30
Kirshbaum, M. N. (2008) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2008.00113.x · Cited by 21
New Learning: a different way of approaching conference evaluation
Chapman, D. D., Wiessner, C. A., Storberg‐Walker, J., et al. (2007) · Knowledge Management Research & Practice · doi:10.1057/palgrave.kmrp.8500147 · Cited by 18
Raman, M., Dorasamy, M., Muthaiyah, S., Kaliannan, M., & Muthuveloo, R. (2011) · Systemic Practice and Action Research · doi:10.1007/s11213-011-9193-9 · Cited by 9
Warner, G., Lyons, R., Parker, V. A., & Phillips, S. (2011) · Healthcare policy · doi:10.12927/hcpol.2011.22524 · Cited by 7
McWilliam, C. L., Stewart, M., Brown, J. B., Feightner, J., Rosenberg, M. W., GUTMAN, G. M., Penning, M. J., Stewart, M., Tamblyn, R. M., & Morfitt, G. (2003) · Canadian Journal on Aging / La Revue canadienne du vieillissement · doi:10.1017/s071498080000427x · Cited by 6
Cited by
Crafting usable knowledge for sustainable development
Clark, W. C., van Kerkhoff, L., Lebel, L., & Gallopin, G. C. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1601266113 · Cited by 582
Cvitanovic, C., Hobday, A. J., van Kerkhoff, L., Wilson, S. K., Dobbs, K., & Marshall, N. A. (2015) · Ocean & Coastal Management · doi:10.1016/j.ocecoaman.2015.05.002 · Cited by 504
Five principles for the practice of knowledge exchange in environmental management
Reed, M. S., Stringer, L. C., Fazey, I., Evely, A. C., & Kruijsen, J. H. J. (2014) · Journal of Environmental Management · doi:10.1016/j.jenvman.2014.07.021 · Cited by 424
Self-citationOteros-Rozas, E., Martín-López, B., Daw, T. M., Bohensky, E. L., Butler, J. R. A., Hill, R., Martin-Ortega, J., Quinlan, A., Ravera, F., Ruiz-Mallén, I., et al. (2015) · Ecology and Society · doi:10.5751/es-07985-200432 · Cited by 412
Djenontin, I. N. S., & Meadow, A. M. (2018) · Environmental Management · doi:10.1007/s00267-018-1028-3 · Cited by 407
Metadata
- Authors
- Fazey, I., Bunse, L., Msika, J., Pinke, M., Preedy, K., Evely, A. C., Lambert, E., Hastings, E., Morris, S., & Reed, M. S.
- Venue
- Global Environmental Change
- Publisher
- Elsevier BV
- Published
- 2014-03
- Volume
- 25
- Pages
- 204-220
- ISSN
- 0959-3780 (ISSN-L)
- OpenAlex
- W2010475948
- Cited by
- 333
- References
- 71
- FWCI
- 52.03
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.