What is Essential in Developmental Evaluation? On Integrity, Fidelity, Adultery, Abstinence, Impotence, Long-Term Commitment, Integrity, and Sensitivity in Implementing Evaluation Models
The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
Fidelity concerns the extent to which a specific evaluation sufficiently incorporates the core characteristics of the overall approach to justify labeling that evaluation by its designated name. Fidelity has traditionally meant implementing a model in exactly the same way each time following the prescribed steps and procedures. The essential principles of developmental evaluation (DE), in contrast, provide high-inference sensitizing guidance that must be interpreted and applied contextually. In lieu of operationalizing DE fidelity criteria, I suggest addressing the degree of manifest sensitivity to essential principles. Principles as sensitizing concepts replace operational rules. This means that sensitivity to essential DE principles should be explicitly and contextually manifest in both processes and outcomes, in both design and use of findings. Eight essential principles of DE are identified and explained. Finally, 10 threats to evaluation model fidelity and/or degree of manifest sensitivity are identified with ways to mitigate those threats.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Qualitative research and evaluation methods
Patton, M. Q. (1980) · Cited by 35,733
Self-citationThe SAGE Encyclopedia of Qualitative Research Methods
Given, L. (2008) · doi:10.4135/9781412963909 · Cited by 6,134
What is Wrong with Social Theory?
Blumer, H. (1954) · American Sociological Review · doi:10.2307/2088165 · Cited by 2,535
(1966) · Social Science Education Consortium eBooks · Cited by 2,483
Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use
Patton, M. Q. (2010) · Cited by 1,740
Self-citationIndigenous Research Methodologies
Hanson, C. (2012) · International Journal of Critical Indigenous Studies · doi:10.5204/ijcis.v5i1.97 · Cited by 1,700
Dictionary of qualitative inquiry
(2001) · Choice Reviews Online · doi:10.5860/choice.39-0692 · Cited by 1,322
What Is Wrong with Social Theory?
Blumer, H. (2017) · Sociological Methods · doi:10.4324/9781315129945-8 · Cited by 1,180
Perspectives of Curriculum Evaluation
Walbesser, H. H., Tyler, R. W., Gagné, R. M., Scriven, M., & Gagne, R. M. (1968) · American Educational Research Journal · doi:10.2307/1161709 · Cited by 792
A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009
Coryn, C. L. S., Noakes, L. A., Westine, C. D., & Schröter, D. C. (2011) · American Journal of Evaluation · doi:10.1177/1098214010389321 · Cited by 531
Research works printed but not linked: 10
- Cousins J. B., 2005, Empowerment evaluation principles in practice, 183
- Cousins J. B., 2012, Participatory evaluation up close: An integration of research-based knowledge
- Fetterman D. M., 2005, Empowerment evaluation principles in practice, 1
- FSG. (2014). Next generation evaluation: Embracing complexity, connectivity, and change. Stanford Social Innovation Review. Retrieved from www.ssir.org/nextgenevaluation
- Goldstein R. N., 2015, The New York Review of Books, 48
- Gunderson L. H., 2002, Panarchy: Understanding transformations inhuman and natural system
- Kolata G., 2006, New York Times, 1
- Kolata G., 2006, New York Times, A36
- Rosenshine B., 1971, Research in teacher education, 37
- Williams B., 2007, Systems concepts in evaluation: An expert anthology
Cited by
Van Melle, E., Frank, J. R., Holmboe, E. S., Dagnone, D., Stockley, D., & Sherbino, J. (2019) · Academic Medicine · doi:10.1097/acm.0000000000002743 · Cited by 451
Gates, E. F. (2016) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2016.08.004 · Cited by 106
Patton, M. Q. (2020) · American Journal of Evaluation · doi:10.1177/1098214020933689 · Cited by 90
“I examined fidelity to developmental evaluation (DE) principles that opened with an experienced DE practitioner telling me: “More often than not, I find, people say they are doing Developmental Evaluation, but they are not” (Patton, 2016).”
BackgroundSelf-citationCapturing outcomes of competency-based medical education: The call and the challenge
Melle, E. V., Hall, A. K., Schumacher, D. J., Kinnear, B., Gruppen, L. D., Thoma, B., Caretta‐Weyer, H. A., Cooke, L., Frank, J. R., & Collaborators, O. B. O. T. I. (2021) · Medical Teacher · doi:10.1080/0142159x.2021.1925640 · Cited by 72
“Connect outcomes to fidelity and integrity of implementation Outcomes evaluation is not complete without measurement of the fidelity of implementation (Mowbray et al. 2003; Century et al. 2010; Patton 2016; Rich et al. 2020).”
BackgroundPage, G. G., Wise, R. M., Lindenfeld, L., Moug, P., Hodgson, A. M., Wyborn, C. A., & Fazey, I. (2016) · Current Opinion in Environmental Sustainability · doi:10.1016/j.cosust.2016.09.001 · Cited by 88
Metadata
- Authors
- Patton, M. Q.
- Affiliations
- Utilization-Focused Evaluation, St. Paul, MN, USA
- Corresponding author
- Patton, Michael Quinn
- Venue
- American Journal of Evaluation
- Publisher
- SAGE Publications
- Published
- 2016-03-22
- Volume
- 37
- Issue
- 2
- Pages
- 250-265
- ISSN
- 1098-2140 (ISSN-L)
- 1557-0878
- OpenAlex
- W2308290965
- Cited by
- 75
- References
- 34
- Citations by year
- 2026: 6 · 2025: 7 · 2024: 9 · 2023: 7 · 2022: 1 · 2021: 14 · 2020: 9 · 2019: 12 · 2018: 4 · 2017: 2 · 2016: 4
- FWCI
- 8.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- American Journal of Evaluation (publishedVersion)
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Public Administration › Public Policy and Administration Research
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Keywords
- developmental evaluation, evaluation integrity, evaluation principles
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: What is Essential in Developmental Evaluation? On Integrity, Fidelity, Adultery, Abstinence, Impotence, Long-Term Commitment, Integrity, and Sensitivity in Implementing Evaluation Models. https://app.cochat.ai/papers/10.1177/1098214015626295
- The paper
- Patton, M. Q. (2016). What is Essential in Developmental Evaluation? On Integrity, Fidelity, Adultery, Abstinence, Impotence, Long-Term Commitment, Integrity, and Sensitivity in Implementing Evaluation Models. American Journal of Evaluation. https://doi.org/10.1177/1098214015626295
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.