The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.
Defining and assessing research quality in a transdisciplinary context
Open accessAbstract
Research increasingly seeks both to generate knowledge and to contribute to real-world solutions, with strong emphasis on context and social engagement. As boundaries between disciplines are crossed, and as research engages more with stakeholders in complex systems, traditional academic definitions and criteria of research quality are no longer sufficient—there is a need for a parallel evolution of principles and criteria to define and evaluate research quality in a transdisciplinary research (TDR) context. We conducted a systematic review to help answer the question: What are appropriate principles and criteria for defining and assessing TDR quality? Articles were selected and reviewed seeking: arguments for or against expanding definitions of research quality, purposes for research quality evaluation, proposed principles of research quality, proposed criteria for research quality assessment, proposed indicators and measures of research quality, and proposed processes for evaluating TDR. We used the information from the review and our own experience in two research organizations that employ TDR approaches to develop a prototype TDR quality assessment framework, organized as an evaluation rubric. We provide an overview of the relevant literature and summarize the main aspects of TDR quality identified there. Four main principles emerge: relevance, including social significance and applicability; credibility, including criteria of integration and reflexivity, added to traditional criteria of scientific rigor; legitimacy, including criteria of inclusion and fair representation of stakeholder interests, and; effectiveness, with criteria that assess actual or potential contributions to problem solving and social change.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The New production of knowledge: the dynamics of science and research in contemporary societies
(1995) · Choice Reviews Online · doi:10.5860/choice.32-4463 · Cited by 7,046
Quality and trustworthiness in qualitative research in counseling psychology.
Morrow, S. L. (2005) · Journal of Counseling Psychology · doi:10.1037/0022-0167.52.2.250 · Cited by 3,199
Transdisciplinary research in sustainability science: Practice, principles, and challenges
Lang, D. J., Wiek, A., Bergmann, M., Stauffacher, M., Martens, P., Moll, P., Swilling, M., & Thomas, C. J. (2012) · Sustainability Science · doi:10.1007/s11625-011-0149-x · Cited by 2,925
Emerging Criteria for Quality in Qualitative and Interpretive Research
Lincoln, Y. S. (1995) · Qualitative Inquiry · doi:10.1177/107780049500100301 · Cited by 1,568
Sustainability science: The emerging research program
Clark, W. C., & Dickson, N. M. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1231333100 · Cited by 1,142
Guidelines for systematic review in Conservation and environmental management
PULLIN, A. S., & STEWART, G. B. (2006) · Conservation Biology · doi:10.1111/j.1523-1739.2006.00485.x · Cited by 1,137
Introduction: `Mode 2' Revisited: The New Production of Knowledge
Nowotny, H., Scott, P., & Gibbons, M. (2003) · Minerva · doi:10.1023/a:1025505528250 · Cited by 871
A review of transdisciplinary research in sustainability science
Brandt, P., Ernst, A., Gralla, F., Luederitz, C., Lang, D. J., Newig, J., Reinert, F., Abson, D. J., & von Wehrden, H. (2013) · Ecological Economics · doi:10.1016/j.ecolecon.2013.04.008 · Cited by 819
Re-thinking new knowledge production: A literature review and a research agenda
Hessels, L. K., & van Lente, H. (2008) · Research Policy · doi:10.1016/j.respol.2008.01.008 · Cited by 779
What is societal impact of research and how can it be assessed? a literature survey
Bornmann, L. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22803 · Cited by 731
Cited by
Principles for knowledge co-production in sustainability research
Norström, A. V., Cvitanovic, C., Löf, M. F., West, S., Wyborn, C., Balvanera, P., Bednarek, A. T., Bennett, E. M., Biggs, R., de Bremond, A., et al. (2020) · Nature Sustainability · doi:10.1038/s41893-019-0448-2 · Cited by 1,620
Metadata
- Authors
- Belcher, B. M., Rasmussen, K. E., Kemshaw, M. R., & Zornes, D. A.
- Venue
- Research Evaluation
- Publisher
- Oxford University Press (OUP)
- Published
- 2015-11-06
- Volume
- 25
- Issue
- 1
- Pages
- 1-17
- ISSN
- 0958-2029 (ISSN-L)
- 1471-5449
- OpenAlex
- W2179962732
- Cited by
- 273
- References
- 38
- FWCI
- 24.44
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Defining and assessing research quality in a transdisciplinary context. https://app.cochat.ai/papers/10.1093/reseval/rvv025
- The paper
- Belcher, B. M., Rasmussen, K. E., Kemshaw, M. R., & Zornes, D. A. (2016). Defining and assessing research quality in a transdisciplinary context. Research Evaluation. https://doi.org/10.1093/reseval/rvv025
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.