The DOI matches its Crossref record.
Evaluation Methodology Basics: The Nuts and Bolts of Sound Evaluation
Abstract
What is Evaluation? Basic Definitions A Note About Fitting Evaluation Approach to Purpose The Steps Involved The Ingredients of a Good Evaluation Identifying the Evaluand Additional Readings Exercises Defining the Purpose of the Evaluation Evaluations for Determining Overall Quality or Value Evaluations for Finding Areas for Improvement Questions About vs. Quality/Value Summary and Final Comments Additional Readings Exercises Identifying Evaluative Criteria Why Not Just Use Goals? Identifying Criteria: Basic Concepts and Tools Conducting a Needs Assessment Identifying Other Relevant Criteria Additional Readings Exercises Organizing the Criteria & Identifying Potential Sources of Evidence The Importance of Choosing Multiple Sources of Quality Evidence The Process Evaluation Checkpoint The Outcome Evaluation Checkpoint The Comparative Cost-Effectiveness Checkpoint The Exportability Checkpoint Additional Readings Exercises Dealing With the Causation Issue Certainty about causation Inferring causation: Basic principles Inferring causation: Seven strategies Choosing a blend of methods to address the causation issue Additional Readings Exercises Values in Evaluation The Controversy The Three Types of Subjectivity The Tensions Between Subjectivism and Common Sense Where do the Values in an Evaluation Come From? Additional Readings Exercises Determining Importance Determining Importance: What and Why Determining Importance: Six Strategies Additional Readings Exercises The Merit Determination Step Determining Merit: What and Why Using Rubrics for Determining Absolute Merit Using Rubrics for Determining Relative Merit Making practical use of merit determination rubrics Additional Readings Exercises Synthesis Methodology Synthesis: What and Why The Role of Costs and Comparisons in Synthesis Synthesizing for Grading Synthesizing for Ranking Additional Readings Exercises Putting it All Together The KEC Preliminary Checkpoints The KEC Foundations Checkpoints The KEC Subevaluations Checkpoints The KEC Conclusions Checkpoints Additional Readings Meta-Evaluation The five criteria for evaluating evaluations Key points to remember in meta-evaluation Other options for conducting a meta-evaluation Formative meta-evaluation Should I use meta-evaluation myself? Additional Readings Exercises Answers to Selected Exercises Sample Exam Questions Tips for students answering these exam questions The questions A rubric for grading assignment and exam answers Suggested answers to practice exam questions Glossary References
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Policy Success, Policy Failure and Grey Areas In-Between
McCONNELL, A. (2010) · Journal of Public Policy · doi:10.1017/s0143814x10000152 · Cited by 639
A Systematic Review of Theory-Driven Evaluation Practice From 1990 to 2009
Coryn, C. L. S., Noakes, L. A., Westine, C. D., & Schröter, D. C. (2011) · American Journal of Evaluation · doi:10.1177/1098214010389321 · Cited by 531
TOWARDS A FRAMEWORK FOR ESTABLISHING POLICY SUCCESS
MARSH, D., & McCONNELL, A. (2010) · Public Administration · doi:10.1111/j.1467-9299.2009.01803.x · Cited by 318
What is policy failure? A primer to help navigate the maze
McConnell, A. (2015) · Public Policy and Administration · doi:10.1177/0952076714565416 · Cited by 289
Guideline for good evaluation practice in health informatics (GEP-HI)
Nykänen, P., Brender, J., Talmon, J., de Keizer, N., Rigby, M., Beuscart-Zephir, M.-C., & Ammenwerth, E. (2011) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2011.08.004 · Cited by 105
Metadata
- Authors
- Davidson, E.
- Venue
- Sage eBooks
- Publisher
- SAGE Publications, Inc.
- Published
- 2005
- OpenAlex
- W2153674322
- Cited by
- 363
- References
- 0
- FWCI
- 6.39
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation Methodology Basics: The Nuts and Bolts of Sound Evaluation. https://app.cochat.ai/papers/10.4135/9781452230115
- The paper
- Davidson, E. (2005). Evaluation Methodology Basics: The Nuts and Bolts of Sound Evaluation. Sage eBooks. https://doi.org/10.4135/9781452230115
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.