The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Addressing Response-shift Bias: Retrospective Pretests in Recreation Research and Evaluation
Abstract
The self-reported pretest/posttest has been commonly used to assess change in recreation research and evaluation efforts. The viability of comparing pre and post measures relies on the assumption that the scale of measurement, or metric, is the same before and after an intervention. With self-report measures, the metric resides within the study participants and, thus, can be directly affected by the intervention. If participants' levels of self-knowledge change as the result of a recreation program, then this metric may also shift, making comparisons between measures from before and after the program problematic. This article aims to both synthesize the theory and literature surrounding this problem and to offer a mixed-methods, data-based example, which illustrates the problem in a recreation context and posits possible reasons for differences in reported precourse attribute levels by reporting time. Results generally supported using a retrospective pretest as a way to address changing metrics with self-report measures. This article further discusses when and how it is appropriate to use retrospective pretests in recreation research and evaluation.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
When assessing skills prior to educational intervention, learners tend to overestimate their competency because they often cannot yet fully grasp the depth of the field, an effect known as response-shift bias.
“Especially when assessing skills prior to educational intervention, learners tend to overestimate their competency because they often cannot yet fully grasp the depth of the field, an effect commonly referred to as response-shift bias [29,30].”
From Evaluating AI Courses: A Valid and Reliable Instrument for Assessing Artificial-Intelligence Learning through Comparative Self-Assessment (2023) · cites this paper as [30]
Citations
Cites
Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2075823 · Cited by 18,773
(1963) · Medical Entomology and Zoology · Cited by 15,085
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,820
How we should measure "change": Or should we?
Cronbach, L. J., & Furby, L. (1970) · Psychological Bulletin · doi:10.1037/h0029382 · Cited by 2,456
Therapeutic Songwriting in Music Therapy
Baker, F. A., Wigram, T., Stott, D., & McFerran, K. S. (2008) · Nordic Journal of Music Therapy · doi:10.1080/08098130809478203 · Cited by 1,140
A growth curve approach to the measurement of change.
Rogosa, D., Brandt, D., & Zimowski, M. F. (1982) · Psychological Bulletin · doi:10.1037/0033-2909.92.3.726 · Cited by 1,084
Measuring Program Outcomes: Using Retrospective Pretest Methodology
Pratt, C. C., McGuigan, W. M., & Katzev, A. R. (2000) · American Journal of Evaluation · doi:10.1177/109821400002100305 · Cited by 611 · cited 1×
“Pratt et al. (2000) posit that memoir-is a greater problem when the questions are more genet-al in focus.”
BackgroundResponse-shift bias: A source of contamination of self-report measures.
Howard, G. S., & Dailey, P. R. (1979) · Journal of Applied Psychology · doi:10.1037/0021-9010.64.2.144 · Cited by 565 · cited 1×
“…in an effort to please tbe investigator or program (i,e,, acqtiiescence) or to justify-tbe efTort expended in tbe program, a false negative result migbt be presented in tbe bope of gaining access to additional training or treatment (e.g., Howard & Dailey, 1979; Spangers & Hoogsiraten, 1988).”
BackgroundHoward (1980) · doi:10.1177/0193841x8000400105 · Cited by 531
Howard, G. S., Ralph, K., Gulanick, N. A., Maxwell, S. E., Nance, D. W., & Gerber, S. K. (1979) · Applied Psychological Measurement · doi:10.1177/014662167900300101 · Cited by 482
Underreporting by cancer patients: The case of response-shift
Breetvelt, I. S., & van Dam, F. S. A. M. (1991) · Social Science & Medicine · doi:10.1016/0277-9536(91)90156-7 · Cited by 309
Lam, T. C. M., & Bengo, P. (2003) · American Journal of Evaluation · doi:10.1177/109821400302400106 · Cited by 280
INTERNAL INVALIDITY IN STUDIES EMPLOYING SELF‐REPORT INSTRUMENTS: A SUGGESTED REMEDY
Howard, G. S., Schmeck, R. R., & Bray, J. H. (1979) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.1979.tb00094.x · Cited by 151
Caldwell, L. L., Baldwin, C. K., Walls, T. A., & Smith, E. (2004) · Journal of Leisure Research · doi:10.1080/00222216.2004.11950026 · Cited by 137
Cox, S. (1991) · Nursing Standard · doi:10.7748/ns.6.3.52.s63 · Cited by 128
Enhancing a Sense of Independence and Psychological Well-Being Among the Elderly: A Field Experiment
Searle, M. S., Mahon, M. J., Iso‐Ahola, S. E., Adam, H., & van Dyck, J. (1995) · Journal of Leisure Research · doi:10.1080/00222216.1995.11949737 · Cited by 116
Personal recall and the limits of retrospective questions in surveys.
Pearson, R. W., Ross, M. A., & Dawes, R. M. (1992) · Cited by 113
Pretesting effects in retrospective pretest^posttest designs.
Sprangers, M. A. G., & Hoogstraten, J. (1989) · Journal of Applied Psychology · doi:10.1037//0021-9010.74.2.265 · Cited by 107
The Feasibility of Informed Pretests in Attenuating Response-Shift Bias
Howard, G. S., Dailey, P. R., & Gulanick, N. A. (1979) · Applied Psychological Measurement · doi:10.1177/014662167900300406 · Cited by 96
Rohs, F. R. (1999) · Journal of Agricultural Education · doi:10.5032/jae.1999.04028 · Cited by 92
Pretesting effects in retrospective pretest-posttest designs.
Sprangers, M. A. G., & Hoogstraten, J. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.2.265 · Cited by 88
Methods of Analysis with Response-Shift BIAS
Bray, J. H., Maxwell, S. E., & Howard, G. S. (1984) · Educational and Psychological Measurement · doi:10.1177/0013164484444002 · Cited by 79
Influence of Objective Measures on Self-Reports in a Retrospective Pretest-Posttest Design
Hoogstraten, J. (1985) · The Journal of Experimental Education · doi:10.1080/00220973.1985.10806383 · Cited by 66
Townsend, M. A. R., & Wilton, K. M. (2003) · British Journal of Educational Psychology · doi:10.1348/000709903322591190 · Cited by 55
Cantrell, P. (2003) · School Science and Mathematics · doi:10.1111/j.1949-8594.2003.tb18116.x · Cited by 52
Increased Accuracy in Measuring Leadership Impacts
Rohs, F. R., & Langone, C. A. (1997) · Journal of Leadership Studies · doi:10.1177/107179199700400113 · Cited by 48
Using Retrospective Pre-Ratings to Counteract Response-Shift Confounding
Pohl, N. F. (1982) · The Journal of Experimental Education · doi:10.1080/00220973.1982.11011826 · Cited by 47
The Retrospective Pretest and the Role of Pretest Information in Evaluative Studies
Goedhart, H., & Hoogstraten, J. (1992) · Psychological Reports · doi:10.2466/pr0.1992.70.3.699 · Cited by 46
Green, G. T., Kleiber, D. A., & Tarrant, M. A. (2000) · Journal of Park and Recreation Administration · Cited by 36
Lee, T. M. C., Paterson, J. G., & Chan, C. C. H. (1994) · American Journal of Occupational Therapy · doi:10.5014/ajot.48.7.633 · Cited by 29
The Retrospective Pretest: An Alternative Approach in Evaluating Drug Prevention Programs
Rhodes, J. E., & Jason, L. A. (1987) · Journal of Drug Education · doi:10.2190/1lnk-bh22-f201-8je3 · Cited by 26
Benefits-based programming: making an impact on youth.
Hurtes, K. P., Allen, L. R., Stevens, B. W., & Lee, C. (2000) · Journal of Park and Recreation Administration · Cited by 25
On Delay and Reassessment of Retrospective Preratings
Sprangers, M. A. G., & Hoogstraten, J. (1988) · The Journal of Experimental Education · doi:10.1080/00220973.1988.10806480 · Cited by 24
Response-Style Effects, Response-Shift Bias, and a Bogus-Pipeline: A Replication
Sprangers, M. A. G., & Hoogstraten, J. (1988) · Psychological Reports · doi:10.2466/pr0.1988.62.1.11 · Cited by 18
Implications of the response‐shift bias for management
Mann, S. (1997) · Journal of Management Development · doi:10.1108/02621719710174516 · Cited by 14
A method for analyzing retrospective pretest/posttest designs: I. Theory
Koele, P., & Hoogstraten, J. (1988) · Bulletin of the Psychonomic Society · doi:10.3758/bf03334859 · Cited by 14
The response-shift bias in a counsellor education programme
Manthei, R. J. (1997) · British Journal of Guidance and Counselling · doi:10.1080/03069889708253804 · Cited by 11
If Leisure Research is to Matter II
Witt, P. A. (2000) · Journal of Leisure Research · doi:10.1080/00222216.2000.11949912 · Cited by 11
Pre‐then‐post testing: A tool to improve the accuracy of management training program evaluation
Mezoff, B. (1981) · Performance & Instruction · doi:10.1002/pfi.4150200808 · Cited by 10
Leadership Development and Youth Camping: Determining a Relationship.
Toupence, R. H., & Townsend, C. D. (2000) · Cited by 8
Statistical and methodological issues in leisure research.
Christensen, J. L., & Barnett, L. (1988) · Cited by 2
Hopkins, K. D. (1986) · The Journal of Special Education · doi:10.1177/002246698602000105 · Cited by 2
Flagged first, then by citations
Research works printed but not linked: 3
- Christensen J., 1995, Research about leisure: Past, present, and future (2nd ed.), 231
- Green G., 2000, Journal of Park and Recreation Administration, 18, 76
- Hurtes K. P., 2000, Journal of Park and Recreation Administration, 18, 34
Cited by
Sorted by citations
Duerden, M. D., & Witt, P. A. (2010) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2010.03.007 · Cited by 520
Validation of the interprofessional collaborative competency attainment survey (ICCAS)
Archibald, D., Trumpower, D. L., & Macdonald, C. J. (2014) · Journal of Interprofessional Care · doi:10.3109/13561820.2014.917407 · Cited by 289
Revisiting the utility of retrospective pre-post designs: The need for mixed-method pilot data
Geldhof, G. J., Warner, D. A., Finders, J. K., Thogmartin, A. A., Clark, A., & Longway, K. A. (2018) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2018.05.002 · Cited by 116
Creating Outcomes Through Experiential Education: The Challenge of Confounding Variables
Ewert, A., & Sibthorp, J. (2009) · Journal of Experiential Education · doi:10.1177/105382590803100305 · Cited by 110
Self-citationVitone, T., Stofer, K. A., Steininger, M. S., Hulcr, J., Dunn, R. R., & Lucky, A. (2016) · Journal of Science Communication · doi:10.22323/2.15010203 · Cited by 67
Overholt, J. R., & Ewert, A. (2014) · Journal of Experiential Education · doi:10.1177/1053825913513720 · Cited by 60
Gilding the Outcome by Tarnishing the Past
Taylor, P. J., Russ-Eft, D. F., & Taylor, H. (2008) · American Journal of Evaluation · doi:10.1177/1098214008328517 · Cited by 60
Outcomes of Introducing Early Learners to Interprofessional Competencies in a Classroom Setting
Lockeman, K. S., Lanning, S. K., Dow, A. W., Zorek, J. A., DiazGranados, D., Ivey, C. K., & Soper, S. (2017) · Teaching and Learning in Medicine · doi:10.1080/10401334.2017.1296361 · Cited by 55
A New Approach to Testing the Effects of Entrepreneurship Education Among Secondary School Pupils
Lepoutre, J. M. W. N., den Berghe, W. V., Tilleuil, O., & Crijns, H. (2011) · Edward Elgar Publishing eBooks · doi:10.4337/9780857934901.00010 · Cited by 52
Powell, R. B., Stern, M. J., Frensley, B. T., & Moore, D. D. (2019) · Environmental Education Research · doi:10.1080/13504622.2019.1607259 · Cited by 55
Laupichler, M. C., Aster, A., Perschewski, J.-O., & Schleiss, J. (2023) · Education Sciences · doi:10.3390/educsci13100978 · Cited by 48
“Especially when assessing skills prior to educational intervention, learners tend to overestimate their competency because they often cannot yet fully grasp the depth of the field, an effect commonly referred to as response-shift bias [29,30].”
BackgroundHawley, P. H., & Sinatra, G. M. (2018) · Journal of Research in Science Teaching · doi:10.1002/tea.21479 · Cited by 32
The Development of Prosocial Behavior in Adolescents
Furman, N., & Sibthorp, J. (2013) · Journal of Experiential Education · doi:10.1177/1053825913489105 · Cited by 34
Self-citationService-Learning as a Lever to Support STEM Engagement for Underrepresented Youth
Collins, M. A., Totino, J., Hartry, A., Romero, V. F., Pedroso, R., & Nava, R. (2019) · Journal of Experiential Education · doi:10.1177/1053825919887407 · Cited by 27
Casola, W. R., Beall, J. M., Peterson, M. N., Larson, L. R., Jackson, S. B., & Stevenson, K. T. (2022) · Journal for Nature Conservation · doi:10.1016/j.jnc.2022.126176 · Cited by 26
The Impact of Socialization on Youth Program Outcomes: A Social Development Model Perspective
Duerden, M. D., & Witt, P. A. (2010) · Leisure Sciences · doi:10.1080/01490400.2010.488189 · Cited by 26
Self-Assessing the Benefits of Educational Tours
Cohen, E. H. (2014) · Journal of Travel Research · doi:10.1177/0047287514550098 · Cited by 23
Diversity in the Outdoors: National Outdoor Leadership School Students’ Attitudes About Wilderness
Gress, S., & Hall, T. E. (2017) · Journal of Experiential Education · doi:10.1177/1053825916689267 · Cited by 23
Training for Adoption Competency: Building a Community of Adoption-Competent Clinicians
Atkinson, A. J., & Riley, D. B. (2017) · Families in Society The Journal of Contemporary Social Services · doi:10.1606/1044-3894.2017.98.23 · Cited by 23
Carson, S., Rock, J., & Smith, J. S. (2021) · Frontiers in Education · doi:10.3389/feduc.2021.674883 · Cited by 21
Investigating Faculty Learning in the Context of Community-Engaged Scholarship
Jameson, J. K., Clayton, P. H., Jaeger, A. J., & Bringle, R. G. (2012) · University of Michigan Library Repository · Cited by 21
Assessment of caregiver expectations of physician communication in a pediatric setting
Lee, T., Cui, J., Rosario, H., Hilmara, D., Samuelson, K., Lin, E. C., Miller, V. A., & Lin, H. C. (2020) · BMC Health Services Research · doi:10.1186/s12913-020-05262-x · Cited by 20
Buss, R. R., & Avery, A. (2016) · Journal of Research on Leadership Education · doi:10.1177/1942775116674463 · Cited by 20
Coan, L. L., Wijesuriya, U. A., & Seibert, S. A. (2019) · Journal of Dental Education · doi:10.21815/jde.019.071 · Cited by 20
Κουρτεσοπούλου, Ά., & Kriemadis, A. (2020) · Journal of Adventure Education & Outdoor Learning · doi:10.1080/14729679.2020.1784763 · Cited by 19
Auld, G., Baker, S., McGirr, K., Osborn, K. S., & Skaff, P. (2017) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2017.02.006 · Cited by 19
Kerr, W. C., Williams, E., Ye, Y., Subbaraman, M. S., & Greenfield, T. K. (2018) · Alcohol and Alcoholism · doi:10.1093/alcalc/agy004 · Cited by 18
Evaluation of a Brief Online Sexual Health Program for Adolescents: A Randomized Controlled Trial
McCrimmon, J., Widman, L. M., Javidi, H., Brasileiro, J., & Hurst, J. L. (2023) · Health Promotion Practice · doi:10.1177/15248399231162379 · Cited by 17
The impact of parenting education on parent and child behaviors: Moderators by income and ethnicity
Finders, J. K., Díaz, G., Geldhof, G. J., Sektnan, M., & Rennekamp, D. (2016) · Children and Youth Services Review · doi:10.1016/j.childyouth.2016.11.006 · Cited by 17
An Instrument for Examining Elementary Students’ Engineering Interests and Attitudes
Lachapelle, C., & Brennan, R. T. (2018) · International Journal of Education in Mathematics Science and Technology · doi:10.18404/ijemst.428171 · Cited by 16
Garst, B. A., Baughman, S., Franz, N., & Seidel, R. W. (2013) · Journal of Experiential Education · doi:10.1177/1053825913481582 · Cited by 15
Teaching Web 2.0 technologies using Web 2.0 technologies
Rethlefsen, M. L., Piorun, M. E., & Prince, J. D. (2009) · Journal of the Medical Library Association JMLA · doi:10.3163/1536-5050.97.4.008 · Cited by 15
Testing the Retrospective Pretest with High School Youth in Out-of-School Time Programs
Young, J., & Kallemeyn, L. M. (2019) · Journal of Youth Development · doi:10.5195/jyd.2019.635 · Cited by 17
An Evaluation of the Relationship Smarts Plus Program on Adolescents in Georgia
Futris, T. G., Sutton, T. E., & Richardson, E. W. (2013) · Journal of Human Sciences and Extension · doi:10.54718/barj9780 · Cited by 15
Toward a More Just Approach to Poverty Simulations
Browne, L., & Roll, S. J. (2016) · Journal of Experiential Education · doi:10.1177/1053825916643832 · Cited by 17
Behavioral Changes Based on a Course in Agroecology: A Mixed Methods Study
Harms, K., King, J., & Francis, C. A. (2009) · Journal of natural resources and life sciences education · doi:10.4195/jnrlse.2008.0042 · Cited by 15
Measuring Positive Youth Development at Summer Camp: Problem Solving and Camp Connectedness
Sibthorp, J., Browne, L., & Bialeschki, M. D. (2010) · Research in outdoor education · doi:10.1353/roe.2010.0002 · Cited by 15
Self-citationKelly, J. (2019) · Journal of Experiential Education · doi:10.1177/1053825919831724 · Cited by 17
Tona, J., Kruger, J. S., Jacobsen, L. J., Krzyzanowicz, R., Towle-Miller, L. M., Wilding, G. E., & Ohtake, P. J. (2021) · Journal of Interprofessional Care · doi:10.1080/13561820.2020.1806219 · Cited by 14
Testing for Response Shift Bias in Evaluations of School Antibullying Programs
Shaw, T., CROSS, D. S., & Zubrick, S. R. (2015) · Evaluation Review · doi:10.1177/0193841x16629863 · Cited by 14
Communication skills utilized by physicians in the pediatric outpatient setting
Lee, T., Lin, E. C., & Lin, H. C. (2022) · BMC Health Services Research · doi:10.1186/s12913-022-08385-5 · Cited by 13
Drivers of long-term support for marine protected areas in The Bahamas
Casola, W. R., Rehnberg, M., Peterson, M. N., Blake, K., Thorne, T., & Langerhans, R. B. (2021) · Ocean & Coastal Management · doi:10.1016/j.ocecoaman.2021.106000 · Cited by 12
Evaluating Response Shift in Training Evaluation
Piwowar, V., & Thiel, F. (2014) · Evaluation Review · doi:10.1177/0193841x14546932 · Cited by 11
Markoulakis, R., Bowles, K. H., Chan, S., Weingust, S., Dobbin, K., & LEVITT, A. J. (2021) · Community Mental Health Journal · doi:10.1007/s10597-021-00879-6 · Cited by 11
Examining job embeddedness survey items for an adventure education population
Wilson, J. D. (2010) · IUScholarWorks (Indiana University) · Cited by 11
Adolescent Summer Camp Volunteers' Attitudes Toward Peers with Disabilities
Fort, M., Lundberg, N. R., Zabriskie, R. B., Eggett, D. L., Prater, M. A., & Barney, K. W. (2016) · Leisure Sciences · doi:10.1080/01490400.2016.1171740 · Cited by 10
Predictive Validity and Response Shift in the Equanimity Scale-16
Shires, A., Osborne, S., Cayoun, B. A., Williams, E., & Rogers, K. (2023) · Mindfulness · doi:10.1007/s12671-023-02257-7 · Cited by 8
Ewert, A. (2014) · Ecopsychology · doi:10.1089/eco.2013.0035 · Cited by 9
Brown, K. K., Maryman, J., & Collins, T. C. (2017) · Journal of Public Health Management and Practice · doi:10.1097/phh.0000000000000513 · Cited by 9
van der Zee‐Neuen, A., Strobl, V., Dobias, H., Fuchs, J., Untner, J., Foisner, W., Knapp, M., Edtinger, S., Offenbächer, M., Ritter, M., et al. (2022) · BMC Musculoskeletal Disorders · doi:10.1186/s12891-022-05691-1 · Cited by 8
Preparing Preservice Secondary Special Educators
Conderman, G., Johnston-Rodriguez, S., Hartman, P., & Kemp, D. (2013) · Preventing School Failure Alternative Education for Children and Youth · doi:10.1080/1045988x.2012.679326 · Cited by 8
Empirically testing the experience type framework
Duerden, M. D., Hodge, C. J., Melton, K. K., Ward, P., Bagley, M., Anderson, L. C., Meredith, T., Rushton, A., Eggett, D. L., Lacanienta, A., et al. (2023) · Journal of Leisure Research · doi:10.1080/00222216.2023.2244957 · Cited by 8
Self-citationMarchand, G., & Russell, K. C. (2012) · Residential Treatment for Children & Youth · doi:10.1080/0886571x.2013.751809 · Cited by 8
The Expanded Food and Nutrition Education Program’s Impact on Graduates’ Quality of Life
Auld, G., Baker, S., Hernández-Garbanzo, Y., Infante, N., Inglis-Widrick, R., Procter, S. B., & Yerxa, K. (2018) · Journal of Nutrition Education and Behavior · doi:10.1016/j.jneb.2018.07.021 · Cited by 8
van der Zee‐Neuen, A., Fuchs, J., Wildburger, S., Gaisberger, M., Kloppenburg, M., Fioravanti, A., Stamm, T., Offenbächer, M., Radlmueller, R., Foisner, W., et al. (2023) · International Journal of Public Health · doi:10.3389/ijph.2023.1605931 · Cited by 7
Matthew, A., McLeod, D. L., Robinson, J. W., Walker, L. M., Wassersug, R. J., Elliott, S., Guirguis, S., Incze, T., & Trachtenberg, L. (2024) · Sexual Medicine · doi:10.1093/sexmed/qfae033 · Cited by 7
Factors related to youth self-efficacy for injury prevention bicycle skills
Howard, K. A., Griffin, S. F., Rolke, L. J., & Sease, K. K. (2021) · Journal of Safety Research · doi:10.1016/j.jsr.2021.08.009 · Cited by 7
Collins, M. A., Romero, V., Young, A., Dorph, R., Foreman, J., Strang, C., Pande, A., & Laina, V. (2024) · Environmental Education Research · doi:10.1080/13504622.2024.2340502 · Cited by 8
Gagnon, R. J., & Garst, B. A. (2019) · Journal of Outdoor Recreation Education and Leadership · doi:10.18666/jorel-2019-v11-i1-9070 · Cited by 8
Clark, S., Roop, H., Gonzales, K. R., Mohr, C., Dybsetter, A., & Kingery, L. (2023) · Community Science · doi:10.1029/2022csj000020 · Cited by 7
Global Health Competency Skills: A Self-assessment for Medical Students
Polec, L. A. (2012) · uO Research (University of Ottawa) · doi:10.20381/ruor-6008 · Cited by 7
Jackson, J. B. (2017) · Journal of Interprofessional Care · doi:10.1080/13561820.2017.1340878 · Cited by 6
The effect of the integration of design, procurement, and construction relative to health and safety
Deacon, C. (2017) · Nelson Mandela University Research Repository · Cited by 6
Methods and Biases in Measuring Change with Self-Reports
Quinio, A. E., & Lam, T. C. M. (2021) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-64802-604-120251008 · Cited by 5
Pfeiffer, D. L., Pavelko, S. L., Allen-Bronaugh, D., Dudding, C. C., & Timler, G. (2022) · doi:10.30707/tlcsd6.1.1649037808.702214 · Cited by 5
Collins, R., Sibthorp, J., Gookin, J., & Schumann, S. (2012) · Research in outdoor education · doi:10.1353/roe.2012.0004 · Cited by 5
Self-citationGryglewicz, K., Kutash, K., Elzy, M. B., Hangartner, R. R., & Karver, M. S. (2018) · Journal of Family Social Work · doi:10.1080/10522158.2018.1469560 · Cited by 5
Witkin, A. L. (2013) · eScholarship (California Digital Library) · Cited by 5
Impacts of a Poverty Simulation Experience on Student Empathy Levels Toward People Living in Poverty
Schultz, J., Schultz, C. S., Chen, K., Maddox, G., DeBrew, K., & Price, R. A. (2024) · College Teaching · doi:10.1080/87567555.2024.2327080 · Cited by 4
Exploring Course Outcomes Utilizing a New Outward Bound Outcomes Instrument
Bobilya, A. J., & Faircloth, W. B. (2017) · Research in outdoor education · doi:10.1353/roe.2017.0006 · Cited by 4
A comparison of immediate and retrospective affective reports in leisure contexts
Ito, E., Walker, G. J., & Kono, S. (2019) · Journal of Leisure Research · doi:10.1080/00222216.2018.1552486 · Cited by 4
Benefits and Challenges of a Blended Online Youth Development Graduate Degree Program
Garst, B. A., Bowers, E. P., Quinn, W. H., & Weston, K. L. (2021) · American Journal of Distance Education · doi:10.1080/08923647.2020.1829438 · Cited by 5
Examining Attitude Change Following Participation in an International Adaptive Sports Training
Townsend, J., Stone, G. A., Murphy, E., Crowe, B. M., Hawkins, B. L., & Duffy, L. N. (2020) · Therapeutic Recreation Journal · doi:10.18666/trj-2020-v54-i3-10112 · Cited by 4
Study Abroad as a Transformative Experience: Measuring Transformative Learning Phases and Outcomes
Stone, G. A. (2014) · ScholarsArchive (Brigham Young University) · Cited by 4
Leadership Development through Design Based Wilderness Education
Saulnier, C. R., Ahn, B., Bagiati, A., & Brisson, J. G. (2015) · International Journal of Engineering Pedagogy (iJEP) · doi:10.3991/ijep.v5i1.4386 · Cited by 3
Westphale, S., Lock, J. F., Koenig, S., Happel, O., & Paul, M. M. (2026) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-026-03146-z · Cited by 2
Help Me Grow Utah and the impact on family protective factors development
Hill, K. D., & Hill, B. (2018) · Journal of Children s Services · doi:10.1108/jcs-05-2017-0016 · Cited by 3
Fisher, E. A., & Fisher, C. M. (2020) · Music Education Research · doi:10.1080/14613808.2020.1765156 · Cited by 3
Shumway, S. T., Bradshaw, S. D., Zielinski, M., D’Aniello, C., Kimball, T. G., & Soloski, K. L. (2022) · Alcoholism Treatment Quarterly · doi:10.1080/07347324.2021.2019649 · Cited by 3
Richardson, R., Kalvaitis, D., & Delparte, D. M. (2014) · Journal of Outdoor Recreation Education and Leadership · doi:10.7768/1948-5123.1169 · Cited by 3
The Youth Relatedness Scale: Development of a New Evaluation Tool for Youth Programs
D’Eloia, M. H., & Sibthorp, J. (2012) · Journal of Youth Development · doi:10.5195/jyd.2012.142 · Cited by 3
Self-citationHoward, K. A., Griffin, S. F., Rolke, L. J., Venable, J., Stuenkel, M., & Sease, K. K. (2025) · Journal of Transport & Health · doi:10.1016/j.jth.2025.102050 · Cited by 2
Ferrara, E., Scaramuzzino, M., Murmura, G., Balice, G., & Sinjari, B. (2026) · Complementary Therapies in Medicine · doi:10.1016/j.ctim.2026.103354 · Cited by 2
Assessing the Impact of Summer Camp Employment on the Development of Workplace Skills
Botting, R., Ribbe, R., & Robinson, G. (2021) · Journal of Outdoor Recreation Education and Leadership · doi:10.18666/jorel-2021-v13-i1-10620 · Cited by 2
Impacts of a Near-Peer Urban Ecology Research Mentoring Program on Undergraduate Mentors
Aloisio, J. M., Roberts, S., Becker-Klein, R., Dunifon, S. M., Lewis, J. D., Clark, J. A., Munshi‐South, J., & Tingley, K. (2022) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2022.803210 · Cited by 4
Holland, W. H., Powell, R. B., Holland, K. K., Garst, B. A., Baldwin, E. D., & Quigley, C. F. (2023) · Journal of Outdoor and Environmental Education · doi:10.1007/s42322-023-00124-6 · Cited by 2
Hope, J. M. G. (2012) · IRL - University of Missouri, St. Louis (University of Missouri–St. Louis) · Cited by 2
The North Carolina Outward Bound School Course Impression Survey: A Psychometric Investigation
Faircloth, W. B., Bobilya, A. J., & Ewert, A. (2016) · Research in outdoor education · doi:10.1353/roe.2016.0006 · Cited by 2
Jones, T. M., Williford, A., Sole, R. N. D., Hansen, A., Toll, R., Zamzow, M. V., Wentworth, G., & Kebaya, O. E. (2024) · Journal of Community Practice · doi:10.1080/10705422.2024.2428860 · Cited by 2
The Function of Field Study: Comparison of Limited and Full Field Experience Courses
Fine, L., Peterson, T., Duerden, M. D., Nelson, R., & Bennion, J. (2016) · Research in outdoor education · doi:10.1353/roe.2016.0004 · Cited by 1
Vaping Education: A Two-Year Study Examining Health Literacy and Behaviors in a Southeastern State
Duke, A. M., Hinnant, J. B., Norton, J. R., & Gibson‐Young, L. (2025) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph22071086 · Cited by 1
Fan, Y., Hanna, C., Folger, T. D., May, T. A., & Koskey, K. L. K. (2025) · Education Sciences · doi:10.3390/educsci15121709 · Cited by 1
Intellectual functioning and personal recovery in individuals with schizophrenia spectrum disorder
Antens, M. H. H., Kamperman, A. M., van Aken, B. C., Castelein, S., & Mulder, C. L. (2026) · Schizophrenia Research · doi:10.1016/j.schres.2026.04.015 · Cited by 1
Re-examining the Relationship Between Indicators of Program Quality and Learning Leadership at NOLS
Froehly, M., Riley, M., Sibthorp, J., & Rochelle, S. (2023) · Journal of Outdoor Recreation Education and Leadership · doi:10.18666/jorel-2023-11833 · Cited by 1
Self-citationAulisio, M. C., Ballard, J. A., Feld, H., & Ryan, M. A. (2023) · Currents in Pharmacy Teaching and Learning · doi:10.1016/j.cptl.2023.07.012 · Cited by 1
The Effect of Faculty Performance Measurement Systems on Student Retention
Woods, T. (2009) · ScholarWorks (Walden University) · Cited by 1
BUILDING SAFE COMMUNITIES FROM THE START: THE UPSTART PARENT SURVEY
Clark, D., Barker, L., & Benzies, K. (2013) · International Journal of Child Youth and Family Studies · doi:10.18357/ijcyfs41201311849
Accounting for the Response-Shift: Pre-Service Teacher-Efficacy Development in Immersive Learning
Mucherah, W. M., & Thomas, K. J. (2015) · International Journal of Humanities and Social Science Research · doi:10.6000/2371-1655.2015.01.10
Methodological considerations for research on ethnopolitical violence
Little, T. D. (2016) · Development and Psychopathology · doi:10.1017/s0954579416001152
Global Explorers Journaling and Reflection Initiative
Bennion, J., Duerden, M. D., & Whitehouse, A. (2016) · Journal of Youth Development · doi:10.5195/jyd.2016.445
Metadata
- Authors
- Sibthorp, J., Paisley, K., Gookin, J., & Ward, P.
- Affiliations
- University of Utah (US)
- The National Outdoor Leadership School
- Brigham Young University (US)
- Corresponding author
- Sibthorp, Jim
- Venue
- Journal of Leisure Research
- Publisher
- Informa UK Limited
- Published
- 2007-06
- Volume
- 39
- Issue
- 2
- Pages
- 295-315
- ISSN
- 0022-2216 (ISSN-L)
- 2159-6417
- OpenAlex
- W1747140384
- Cited by
- 111
- References
- 41
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 4 · 2023: 10 · 2022: 8 · 2021: 8 · 2020: 4 · 2019: 8 · 2018: 7 · 2017: 8 · 2016: 10 · 2015: 4 · 2014: 7 · 2013: 6 · 2012: 6
- FWCI
- 4.30
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Leisure Research (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Business, Management and Accounting › Tourism, Leisure and Hospitality Management › Recreation, Leisure, Wilderness Management
- Keywords
- response-shift bias, self-report measures, pre-post test comparison, measurement scales
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
