The DOI matches its Crossref record.
RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints
Abstract
Introduction PART I. OVERVIEW: REALWORLD EVALUATION Chapter 1: RealWorld Evaluation and the Contexts in Which It Is Used Welcome to RealWorld Evaluation The RealWorld Evaluation Context The Four Types of Constraints Addressed by the RealWorld Approach The RealWorld Evaluation Approach to Evaluation Challenges Comparing the RealWorld Evaluation Context and Issues in Developing and Developed Countries Who Uses RealWorld Evaluation, for What Purposes, and When? Summary Further Reading PART II. THE SEVEN STEPS OF THE REALWORLD EVALUATION APPROACH Chapter 2: First clarify the purpose: Scoping the evaluation Stakeholder expectations of impact evaluations Understanding information needs Developing the program theory model Identifying the constraints to be addressed by the RWE and determining the appropriate evaluation design Developing the Terms of Reference for the Evaluation Summary Further reading Chapter 3: Not enough money: Addressing budget constraints Simplifying the evaluation design Clarifying client information needs Using existing data Reducing costs by reducing sample size Reducing costs of data collection and analysis Common threats to validity of budget constraints Summary Further reading Chapter 4: Not enough time: Addressing scheduling and other time constraints Similarities and differences between time and budget constraints Simplifying the evaluation design Clarifying client information needs Using existing documentary data Reducing sample size Rapid data collection methods Reducing time pressures on outside consultants Hiring more resource people Building outcome indicators into project records Data collection and analysis technology Common threats to adequacy and validity relating to time constraints Summary Further reading Chapter 5: Critical information is missing or difficult to collect: Addressing data constraints Data issues facing RealWorld evaluators Reconstructing baseline data Special issues in reconstructing comparison groups Collecting data on sensitive topics or from groups who are difficult to reach Common threats to adequacy and validity relating to data constraints Summary Further reading Chapter 6: Reconciling different priorities and perspectives: Addressing political influences Values, ethics, and politics Political issues at the outset of an evaluation Political issues during the conduct of an evaluation Political issues in evaluation reporting and use RealWorld strategies for addressing political constraints Summary Further reading Chapter 7: Strengthening the evaluation design and the validity of the conclusions Validity in evaluation Factors affecting adequacy and validity Assessing the adequacy of quantitative evaluation designs Strengthening validity in quantitative evaluations Assessing the adequacy of qualitative evaluation designs Strengthening validity in qualitative evaluations Points during the RWE evaluation cycle when corrective measures can be taken Summary Further reading Chapter 8: Making it useful: Helping clients and other stakeholders utilize the evaluation The underutilization of evaluations studies The importance of the RealWorld evaluation scoping phase for utilization Formative evaluation strategies Communicating with clients throughout the evaluation Evaluation capacity building Communicating findings Developing a follow-up action plan Summary Further reading PART III A REVIEW OF EVALUATION METHODS AND APPROACHES AND THEIR APPLICATIONS IN REALWORLD EVALUATION Chapter 9 Applications of program theory in RealWorld evaluation Defining Program Theory Evaluation Applications of Program Theory in evaluation Constructing Program Theory Models Logical framework analysis and results chains Program theory evaluation and causality Summary Further reading Chapter 10: The Most Widely-Used RealWorld Quantitative Evaluation Designs Randomized and quasi-experimental evaluation designs The most widely used quantiative designs Ways to strengthen quantitative RWE designs Seven quasi-experimental designs that cover most RWE scenarios Summary Further reading Chapter 11 Quantitative evaluation methods The quantitative and qualitative traditions in evaluation research Quantitative methodologies Applications of quantitative methodologies in program evaluation Quantitative methods for data collection The management of data collection for quantitative studies Data analysis Summary Further reading Chapter 12 Qualitative evaluation methods Qualitative methodology and tradition Qualitative methodology: An overview Different reasons for using different methodologies Qualitative data collection Qualitative data analysis Summary Further reading Chapter 13 Mixed-method evaluation The mixed method approach Mixed-method strategies Implementing a mixed-method design Summary Further reading Chapter 14 Sampling for RealWorld Evaluation The Importance Of Sampling For RWE Purposive sampling Probability (random) sampling Using power analysis and effect size for estimating the appropriate samp
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Broadening the range of designs and methods for impact evaluations
Stern, E., Stame, N., Mayne, J., Forss, K., Davies, R., & Befani, B. (2012) · doi:10.22163/fteval.2012.100 · Cited by 369
A global count of the extreme poor in 2012: data issues, methodology and initial results
Ferreira, F. H. G., Chen, S., Dabalen, A., Dikhanov, Y., Hamadeh, N., Jolliffe, D., Narayan, A., Prydz, E. B., Revenga, A., Sangraula, P., et al. (2016) · The Journal of Economic Inequality · doi:10.1007/s10888-016-9326-6 · Cited by 338
Outsourcing Social Transformation: Development NGOs as Organizations
Watkins, S. C., Swidler, A., & Hannan, T. (2012) · Annual Review of Sociology · doi:10.1146/annurev-soc-071811-145516 · Cited by 285
A scoping review of the literature on the abolition of user fees in health care services in Africa
Ridde, V., & Morestin, F. (2011) · Health Policy and Planning · doi:10.1093/heapol/czq021 · Cited by 272
Zulman, D. M., Ezeji-Okoye, S. C., Shaw, J. G., Hummel, D. L., Holloway, K. S., Smither, S. F., Breland, J. Y., Chardos, J. F., Kirsh, S., Kahn, J. S., et al. (2014) · Journal of General Internal Medicine · doi:10.1007/s11606-014-3022-7 · Cited by 35
Metadata
- Authors
- Bamberger, M., & Mabry, L.
- Venue
- Sage eBooks
- Publisher
- SAGE Publications, Inc.
- Published
- 2020
- OpenAlex
- W1528691988
- Cited by
- 317
- References
- 0
- FWCI
- 10.34
- Type
- book
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints. https://app.cochat.ai/papers/10.4135/9781071909607
- The paper
- Bamberger, M., & Mabry, L. (2020). RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints. Sage eBooks. https://doi.org/10.4135/9781071909607
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.