The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Measuring Program Outcomes: Using Retrospective Pretest Methodology
Abstract
This study used longitudinal data from 307 mothers with firstborn infants participating in a home-visitation, child-abuse prevention program. A self-report measure of specific constructs the program hoped to affect showed that the retrospective pretest methodology produced a more legitimate assessment of program outcomes than did the traditional pretest-posttest methodology. Results showed that when response shift bias was present, traditional pretest-posttest comparisons resulted in an underestimation of program effects that could easily be avoided by the retrospective pretest methodology. With demands for documenting program outcomes increasing, retrospective pretest designs are shown to be a simple, convenient, and expeditious method for assessing program effects in responsive interventions. The limits of retrospective pretests, and methods for strengthening their use, are discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Evaluation: A Systematic Approach
Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (1979) · Cited by 2,943
Evaluation: A Systematic Approach.
Patton, M. Q., Rossi, P. H., Freeman, H. E., & Wright, S. R. (1981) · Contemporary Sociology · doi:10.2307/2066947 · Cited by 933
Hindsight: Biased judgments of past events after the outcomes are known.
Hawkins, S. A., & Hastie, R. (1990) · Psychological Bulletin · doi:10.1037//0033-2909.107.3.311 · Cited by 855
Response-shift bias: A source of contamination of self-report measures.
Howard, G. S., & Dailey, P. R. (1979) · Journal of Applied Psychology · doi:10.1037/0021-9010.64.2.144 · Cited by 565 · cited 1×
“This change in an individual’s frame of reference because of program participation has been called the response shift bias (Howard & Dailey, 1979).”
Autobiographical Memory and the Validity of Retrospective Reports
(1994) · Springer eBooks · doi:10.1007/978-1-4612-2624-6 · Cited by 490
Howard, G. S., Ralph, K. M., Gulanick, N. A., Maxwell, S. E., Nance, D. W., & Gerber, S. K. (1979) · Applied Psychological Measurement · doi:10.1177/014662167900300101 · Cited by 462
Getting what you want by revising what you had.
Conway, M., & Ross, M. (1984) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.47.4.738 · Cited by 296
Getting what you want by revising what you had.
Conway, M., & Ross, M. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.47.4.738 · Cited by 275
Measuring Program Outcomes: A Practical Approach
Roberts, N. S. (1998) · Journal of Park and Recreation Administration · Cited by 249
Evaluation: A systematic approach, 5th ed.
Rossi, P. H., & Freeman, H. E. (1993) · Cited by 164
Research works printed but not linked: 3
- Brooks, L., 1998, Journal of College Student Development, 34, 383
- Marshak, S. H., 1998, Journal of Extension, 27, 19
- Sprangers, M., 1991, Methodika, 5, 1
Cited by
Measuring bias in self-reported data
Rosenman, R., Tennekoon, V., & Hill, L. G. (2011) · International Journal of Behavioural and Healthcare Research · doi:10.1504/ijbhr.2011.043414 · Cited by 1,050
“…potential for recalibration of self-rating bias as a function of material or skills learned in an intervention has long been a concern to programme evaluators as it may result in underestimates of programme effectiveness (Howard and Dailey, 1979; Norman, 2003; Pratt et al., 2000; Sprangers, 1989).”
BackgroundDuerden, M. D., & Witt, P. A. (2010) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2010.03.007 · Cited by 517
Revisiting the Retrospective Pretest
Hill, L. G., & Betz, D. L. (2005) · American Journal of Evaluation · doi:10.1177/1098214005281356 · Cited by 296
Schulz, C., Möller, M. F., Seidler, D., & Schnell, M. W. (2013) · BMC Medical Education · doi:10.1186/1472-6920-13-1 · Cited by 240
The Development of Conservation Behaviors in Childhood and Youth
Chawla, L., & Derr, V. (2012) · The Oxford Handbook of Environmental and Conservation Psychology · doi:10.1093/oxfordhb/9780199733026.013.0028 · Cited by 231
Metadata
- Authors
- Pratt, C. C., McGuigan, W. M., & Katzev, A. R.
- Affiliations
- Oregon State University (US)
- Pennsylvania State University (US)
- Corresponding author
- Pratt, Clara C.
- ORCID
- McGuigan, William M.
- Venue
- American Journal of Evaluation
- Publisher
- SAGE Publications
- Published
- 2000-09
- Volume
- 21
- Issue
- 3
- Pages
- 341-349
- ISSN
- 1098-2140 (ISSN-L)
- 1557-0878
- OpenAlex
- W2021236920
- Cited by
- 611
- References
- 23
- Citations by year
- 2026: 35 · 2025: 32 · 2024: 34 · 2023: 34 · 2022: 24 · 2021: 41 · 2020: 39 · 2019: 35 · 2018: 29 · 2017: 31 · 2016: 43 · 2015: 29 · 2014: 20 · 2013: 27 · 2012: 24
- FWCI
- 18.67
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- American Journal of Evaluation (publishedVersion)
- Funders
- Oregon State University
- Topics
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- response-shift bias, pre-post test comparison, home visits, child abuse prevention, self-report measures, program evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measuring Program Outcomes: Using Retrospective Pretest Methodology. https://app.cochat.ai/papers/10.1177/109821400002100305
- The paper
- Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000). Measuring Program Outcomes: Using Retrospective Pretest Methodology. American Journal of Evaluation. https://doi.org/10.1177/109821400002100305
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.