The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Addressing Response-shift Bias: Retrospective Pretests in Recreation Research and Evaluation
Abstract
The self-reported pretest/posttest has been commonly used to assess change in recreation research and evaluation efforts. The viability of comparing pre and post measures relies on the assumption that the scale of measurement, or metric, is the same before and after an intervention. With self-report measures, the metric resides within the study participants and, thus, can be directly affected by the intervention. If participants' levels of self-knowledge change as the result of a recreation program, then this metric may also shift, making comparisons between measures from before and after the program problematic. This article aims to both synthesize the theory and literature surrounding this problem and to offer a mixed-methods, data-based example, which illustrates the problem in a recreation context and posits possible reasons for differences in reported precourse attribute levels by reporting time. Results generally supported using a retrospective pretest as a way to address changing metrics with self-report measures. This article further discusses when and how it is appropriate to use retrospective pretests in recreation research and evaluation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Especially when assessing skills prior to educational intervention, learners tend to overestimate their competency because they often cannot yet fully grasp the depth of the field, an effect commonly referred to as response-shift bias [29,30].”
From Evaluating AI Courses: A Valid and Reliable Instrument for Assessing Artificial-Intelligence Learning through Comparative Self-Assessment (2023) · cites this paper as [30]
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2075823 · Cited by 18,773
(1963) · Medical Entomology and Zoology · Cited by 15,085
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,820
How we should measure "change": Or should we?
Cronbach, L. J., & Furby, L. (1970) · Psychological Bulletin · doi:10.1037/h0029382 · Cited by 2,456
Therapeutic Songwriting in Music Therapy
Baker, F. A., Wigram, T., Stott, D., & McFerran, K. S. (2008) · Nordic Journal of Music Therapy · doi:10.1080/08098130809478203 · Cited by 1,140
A growth curve approach to the measurement of change.
Rogosa, D., Brandt, D., & Zimowski, M. F. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.92.3.726 · Cited by 1,084
Measuring Program Outcomes: Using Retrospective Pretest Methodology
Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000) · American Journal of Evaluation · doi:10.1177/109821400002100305 · Cited by 611 · cited 1×
“Pratt et al. (2000) posit that memoir-is a greater problem when the questions are more genet-al in focus.”
BackgroundResponse-shift bias: A source of contamination of self-report measures.
Howard, G. S., & Dailey, P. R. (1979) · Journal of Applied Psychology · doi:10.1037/0021-9010.64.2.144 · Cited by 565 · cited 1×
“…in an effort to please tbe investigator or program (i,e,, acqtiiescence) or to justify-tbe efTort expended in tbe program, a false negative result migbt be presented in tbe bope of gaining access to additional training or treatment (e.g., Howard & Dailey, 1979; Spangers & Hoogsiraten, 1988).”
BackgroundHoward (1980) · doi:10.1177/0193841x8000400105 · Cited by 531
Howard, G. S., Ralph, K., Gulanick, N. A., Maxwell, S. E., Nance, D. W., & Gerber, S. K. (1979) · Applied Psychological Measurement · doi:10.1177/014662167900300101 · Cited by 482
Research works printed but not linked: 3
- Christensen J., 1995, Research about leisure: Past, present, and future (2nd ed.), 231
- Green G., 2000, Journal of Park and Recreation Administration, 18, 76
- Hurtes K. P., 2000, Journal of Park and Recreation Administration, 18, 34
Cited by
Sorted by citations
Duerden, M. D., & Witt, P. A. (2010) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2010.03.007 · Cited by 520
Validation of the interprofessional collaborative competency attainment survey (ICCAS)
Archibald, D., Trumpower, D. L., & Macdonald, C. J. (2014) · Journal of Interprofessional Care · doi:10.3109/13561820.2014.917407 · Cited by 289
Revisiting the utility of retrospective pre-post designs: The need for mixed-method pilot data
Geldhof, G. J., Warner, D. A., Finders, J. K., Thogmartin, A. A., Clark, A., & Longway, K. A. (2018) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2018.05.002 · Cited by 116
Creating Outcomes Through Experiential Education: The Challenge of Confounding Variables
Ewert, A., & Sibthorp, J. (2009) · Journal of Experiential Education · doi:10.1177/105382590803100305 · Cited by 110
Self-citationVitone, T., Stofer, K. A., Steininger, M. S., Hulcr, J., Dunn, R. R., & Lucky, A. (2016) · Journal of Science Communication · doi:10.22323/2.15010203 · Cited by 67
Metadata
- Authors
- Sibthorp, J., Paisley, K., Gookin, J., & Ward, P.
- Affiliations
- University of Utah (US)
- The National Outdoor Leadership School
- Brigham Young University (US)
- Corresponding author
- Sibthorp, Jim
- Venue
- Journal of Leisure Research
- Publisher
- Informa UK Limited
- Published
- 2007-06
- Volume
- 39
- Issue
- 2
- Pages
- 295-315
- ISSN
- 0022-2216 (ISSN-L)
- 2159-6417
- OpenAlex
- W1747140384
- Cited by
- 111
- References
- 41
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 4 · 2023: 10 · 2022: 8 · 2021: 8 · 2020: 4 · 2019: 8 · 2018: 7 · 2017: 8 · 2016: 10 · 2015: 4 · 2014: 7 · 2013: 6 · 2012: 6
- FWCI
- 4.30
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Leisure Research (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Business, Management and Accounting › Tourism, Leisure and Hospitality Management › Recreation, Leisure, Wilderness Management
- Keywords
- response-shift bias, self-report measures, pre-post test comparison, measurement scales
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
