The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Revisiting the Retrospective Pretest
Abstract
The purpose of the present study was to examine a common practice in some areas of program evaluation, the retrospective pretest, and to present recommendations regarding its use. The authors review literature to emphasize first, that bias is likely in both prospective and retrospective ratings, and second, that under some circumstances, retrospective pretests may introduce greater bias than traditional pretests. The authors examined data from 100 participants who attended a family program at 15 sites. Results supported the hypothesis that items on which parents were asked to endorse socially desirable parenting behaviors resulted in greater discrepancies between prospective and retrospective ratings. Effect sizes calculated from prospective ratings were comparable with published effect sizes from research trials of the same program. The authors conclude that replacing traditional with retrospective pretests does not eliminate bias. They recommend traditional pretests for examination of program effects and retrospective pretests for examination of subjective experiences of program-related change.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
A Theory of Cognitive Dissonance
Festinger, L. (1957) · doi:10.1515/9781503620766 · Cited by 24,241
A Theory of Cognitive Dissonance
(2017) · Macat Library eBooks · doi:10.4324/9781912282432 · Cited by 18,122
(1963) · Medical Entomology and Zoology · Cited by 15,085
(2002) · Cited by 13,211
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317 · cited 3×
“In an influential publication, Nisbett and Wilson (1977) argued that 502 American Journal of Evaluation / December 2005”
Background(2000) · Cited by 9,198
A new scale of social desirability independent of psychopathology.
Crowne, D. P., & Marlowe, D. (1960) · Journal of Consulting Psychology · doi:10.1037/h0047358 · Cited by 8,686
Heuristics and Biases: The Psychology of Intuitive Judgment
Bottom, W. P., Gilovich, T., Griffin, D., & Kahneman, D. (2004) · The Academy of Management Review · doi:10.2307/20159081 · Cited by 3,536
Integrating response shift into health-related quality of life research: a theoretical model
Sprangers, M. A. G., & Schwartz, C. E. (1999) · Social Science & Medicine · doi:10.1016/s0277-9536(99)00045-3 · Cited by 2,228 · cited 1×
“…so that the present appears to be better is of particular interest to quality-of-life researchers in medical fields (Schwartz & Sprangers, 1999; Sprangers & Schwartz, 1999), who have explored multiple facets of the phenomenon and the function it serves in emotional adjustment to illness.”
Background(2014) · Fundamentals of Psychology · doi:10.4324/9781315736945-36 · Cited by 2,224
Heuristics and Biases: The Psychology of Intuitive Judgment
(2002) · Cambridge University Press eBooks · doi:10.1017/cbo9780511808098 · Cited by 2,192
Relation of implicit theories to the construction of personal histories.
Ross, M. (1989) · Psychological Review · doi:10.1037//0033-295x.96.2.341 · Cited by 1,564
The effect of severity of initiation on liking for a group.
Aronson, E., & Mills, J. (1959) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0047195 · Cited by 1,297 · cited 1×
“Ironically, this tendency, called the effort justification bias (Aronson & Mills, 1959; Beauvois & Joule, 1996), is particularly strong when the experience has been unpleasant.”
BackgroundSocial desirability bias: A neglected aspect of validity testing
King, M. F., & Bruner, G. C. (2000) · Psychology and Marketing · doi:10.1002/(sici)1520-6793(200002)17:2<79::aid-mar2>3.0.co;2-0 · Cited by 1,067
Webster-Stratton, C., Reid, M. J., & Hammond, M. (2004) · Journal of Clinical Child & Adolescent Psychology · doi:10.1207/s15374424jccp3301_11 · Cited by 899
The Role of Constructs in Psychological and Educational Measurement
(2001) · Routledge eBooks · doi:10.4324/9781410607454 · Cited by 871
Schwartz, C. E., & Sprangers, M. A. G. (1999) · Social Science & Medicine · doi:10.1016/s0277-9536(99)00047-7 · Cited by 828
(2002) · Cited by 771
On the "remembrance of things past": A longitudinal evaluation of the retrospective method.
Henry, B., Moffitt, T. E., Caspi, A., Langley, J., & Silva, P. A. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.2.92 · Cited by 642 · cited 1×
“Also, because prospective and retrospective ratings are generally correlated, if the relative ranking of participants’ change scores is of interest, retrospective ratings will serve this purpose (Henry et al., 1994).”
BackgroundMeasuring Program Outcomes: Using Retrospective Pretest Methodology
Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000) · American Journal of Evaluation · doi:10.1177/109821400002100305 · Cited by 611
(2015) · A History of Law and Lawyers in the GATT/WTO · doi:10.30875/eeedee20-en · Cited by 590
Response-shift bias: A source of contamination of self-report measures.
Howard, G. S., & Dailey, P. R. (1979) · Journal of Applied Psychology · doi:10.1037/0021-9010.64.2.144 · Cited by 565 · cited 3×
“The original research by Howard and Dailey (1979) reported use of observational data to assess the relative accuracy of prospective and retrospective pretests.”
BackgroundInfluentialFrom chump to champ: People's appraisals of their earlier and present selves.
Wilson, A. E., & Ross, M. (2001) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.80.4.572 · Cited by 564
Remembering our past : studies in autobiographical memory
Rubin, D. C. (1996) · Cited by 560
Social-desirability bias and the validity of self-reported values
Fisher, R. J., & Katz, J. E. (2000) · Psychology and Marketing · doi:10.1002/(sici)1520-6793(200002)17:2<105::aid-mar3>3.0.co;2-9 · Cited by 544
Cognitive dissonance: Private ratiocination or public spectacle?
Tedeschi, J. T., Schlenker, B. R., & Bonoma, T. V. (1971) · American Psychologist · doi:10.1037/h0032110 · Cited by 430
MacLeod, J., & Nelson, G. (2000) · Child Abuse & Neglect · doi:10.1016/s0145-2134(00)00178-2 · Cited by 394
Response Scales: Effects of Category Range on Reported Behavior and Comparative Judgments
Schwarz, N., Hippler, H.-J., Deutsch, B., & Strack, F. (1985) · Public Opinion Quarterly · doi:10.1086/268936 · Cited by 371
Spoth, R., Redmond, C., & Shin, C. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.66.2.385 · Cited by 310
LAM, T. (2003) · The American Journal of Evaluation · doi:10.1016/s1098-2140(02)00273-4 · Cited by 280
Family-Based Interventions for Substance Use and Misuse Prevention
Kumpfer, K. L., Alvarado, R., & Whiteside, H. O. (2003) · Substance Use & Misuse · doi:10.1081/ja-120024240 · Cited by 250
Schwartz, C. E., & Rapkin, B. D. (2004) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-2-16 · Cited by 246
Hi! How are you? Response shift, implicit theories and differing epistemologies
Norman, G. (2003) · Quality of Life Research · doi:10.1023/a:1023211129926 · Cited by 171
Exploring response shift in longitudinal data
Schwartz, C. E., Sprangers, M. A. G., Carey, A., & Reed, G. W. (2004) · Psychology and Health · doi:10.1080/0887044031000118456 · Cited by 170
Beauvois, J., & Joule, R. (1996) · Cited by 162
Emotional events and emotions in autobiographical memories
Christianson, S., & Safer, M. A. (1996) · Cambridge University Press eBooks · doi:10.1017/cbo9780511527913.009 · Cited by 160
Motivational interpretations of hindsight bias: An individual difference analysis
Campbell, J. D., & Tesser, A. (1983) · Journal of Personality · doi:10.1111/j.1467-6494.1983.tb00868.x · Cited by 155
Brief Psychoeducational Parenting Program: An Evaluation and 1-Year Follow-up
Bradley, S. J., Jadaa, D.-A., BRODY, J., Landy, S., Tallett, S. E., WATSON, W., Shea, B. J., & Stephens, D. (2003) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-200310000-00007 · Cited by 114
Methodological considerations in the evaluation of a teacher-training program.
Bray, J. H., & Howard, G. S. (1980) · Journal of Educational Psychology · doi:10.1037/0022-0663.72.1.62 · Cited by 112
Redmond, C. R., Spoth, R. L., Shin, C., & Lepper, H. S. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.6.975 · Cited by 110
Using a Retrospective Pre-Post Questionnaire to Determine Program Impact
Davis, G. A. (2003) · Journal of Extension · doi:10.66752/1077-5315.5037 · Cited by 107
Invalidity of True Experiments: Self-Report Pretest Biases
Aiken, L. S., & West, S. G. (1990) · Evaluation Review · doi:10.1177/0193841x9001400403 · Cited by 104
The Feasibility of Informed Pretests in Attenuating Response-Shift Bias
Howard, G. S., Dailey, P. R., & Gulanick, N. A. (1979) · Applied Psychological Measurement · doi:10.1177/014662167900300406 · Cited by 99
Evaluating process in child and family interventions: Aggression prevention as an example.
Tolan, P. H., Hanish, L. D., McKay, M. M., & Dickey, M. H. (2002) · Journal of Family Psychology · doi:10.1037//0893-3200.16.2.220 · Cited by 85
Family Investments in Children's Potential : Resources and Parenting Behaviors That Promote Success
Kalil, A., & DeLeire, T. (2004) · Cited by 72
Exploratory Study of a Preventive Intervention with General Population African American Families
Spoth, R. L., Guyll, M., Chao, W., & Molgaard, V. K. (2003) · The Journal of Early Adolescence · doi:10.1177/0272431603258348 · Cited by 57
An Odd Couple with Promise: Researchers and Practitioners in Evaluation Settings*
Myers‐Walls, J. A. (2000) · Family Relations · doi:10.1111/j.1741-3729.2000.00341.x · Cited by 25
Subject bias and the retrospective pretest in retrospect
Sprangers, M. A. G. (1989) · Bulletin of the Psychonomic Society · doi:10.3758/bf03329883 · Cited by 23
Modern Classics in Social Psychology
Devine, P. G., & Brodish, A. B. (2003) · Psychological Inquiry · doi:10.1080/1047840x.2003.9682879 · Cited by 22
Parent- Versus Child-Based Intervention Strategies for Promoting Children's Well-Being
Magnuson, K., & Duncan, G. J. (2004) · Psychology Press eBooks · doi:10.4324/9781410610874-9 · Cited by 19
Cited by
Measuring Change in Quality of Life: Bias in Prospective and Retrospective Evaluation
Blome, C., & Augustin, M. (2015) · Value in Health · doi:10.1016/j.jval.2014.10.007 · Cited by 288
Kezar, A., Gehrke, S., & Elrod, S. (2015) · The Review of Higher Education · doi:10.1353/rhe.2015.0026 · Cited by 111
Nixon, C. L., & Werner, N. E. (2010) · Psychology in the Schools · doi:10.1002/pits.20494 · Cited by 25
A Comparison of Participant and Practitioner Beliefs About Evaluation
Whitehall, A. K., Hill, L. G., & Koehler, C. R. (2012) · American Journal of Evaluation · doi:10.1177/1098214011423803 · Cited by 15
“For example, pretests may provide an opportunity to preview program content and goals, and posttests provide an opportunity to reflect on what has been learned (Hill & Betz, 2005).”
BackgroundSelf-citation
Metadata
- Authors
- Hill, L. G., & Betz, D. L.
- Venue
- American Journal of Evaluation
- Publisher
- SAGE Publications
- Published
- 2005-12
- Volume
- 26
- Issue
- 4
- Pages
- 501-517
- ISSN
- 1098-2140 (ISSN-L)
- 1557-0878
- OpenAlex
- W1975925042
- Cited by
- 296
- References
- 53
- FWCI
- 9.94
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.