CoChat
Sign Up
Cited by 291Behavioral and Psychological StudiesHealth Policy Implementation ScienceEducational Research and Methods

The DOI matches its Crossref record; 27 of the 29 references it cites were found in a registry or an index.

Moving From the Lab to the Field: The Role of Fidelity and Achieved Relative Intervention Strength

Hulleman, Chris S., Cordray, David S.·2009·Journal of Research on Educational Effectiveness
DOI 10.1080/19345740802539325
Open this paper in CoChat — free account

Abstract

As an example of how the effectiveness of well-designed laboratory interventions is often diffused in the field, we examined the effects of a motivation intervention on students' perceptions and learning. The intervention proved to be more effective in the laboratory (g = 0.45) than the field (g = 0.05) in enhancing subsequent motivation. We explored this reduction in treatment effectiveness through a fidelity analysis that examined the extent to which participants responded to the treatment. We calculated fidelity as three indices of achieved relative treatment strength (Cordray & Pion, 2006 Cordray, D. S. . The cause … or the ‘what’ of what works?. Paper presented at the Institute for Education Sciences 2006 Research Conference. Washington, DC. June, [Google Scholar]), and found that, regardless of how fidelity was calculated, achieved relative strength was about 1 standard deviation less in the classroom than the laboratory. In addition, greater levels of achieved relative strength were associated with greater differences in the motivational outcome—indicating that intervention was more effective for participants who actually received the treatment than those who did not. Multilevel analyses indicated that the drop in classroom treatment fidelity was partially because of teacher, rather than student, factors. Implications for theoretical models of change and research are discussed.

Overview

Integrity signals

Registry

Crossref · 10.1080/19345740802539325

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Research works printed but not linked: 7

  1. Cordray , D. S. . The cause … or the ‘what’ of what works? . Paper presented at the Institute for Education Sciences 2006 Research Conference . Washington, DC. June ,
  2. Cordray , D. S. and Jacobs , N. . Treatment fidelity and core components in school-based ATOD prevention programs . Paper presented at the annual meeting of the Society for Prevention Research . Washington, DC. June ,
  3. Hulleman , C. S. , Godes , O. , Hendricks , B. and Harackiewicz , J. M. 2008 . Enhancing interest in math and psychology with a utility value intervention Unpublished manuscript
  4. Hulleman , C. S. and Harackiewicz , J. M. 2008 . A randomized field trial of expectancy-value motivation in high school science Unpublished manuscript
  5. Hulleman , C. S. , Hendricks , B. and Harackiewicz , J. M. . The role of utility value in promoting interest and achievement . Paper presented at the American Educational Research Association annual meeting . Chicago. April ,
  6. Raudenbush , S. W. , Bryk , A. and Congdon , R. 2007 . HLM for Windows: Version 6.04 , Lincolnwood, IL : Scientific Software International .
  7. 10.1002/pam.10129 · DOI

Cited by

Sorted by citations

See all 291

Related

See all

Metadata

Authors
Hulleman, C. S., & Cordray, D. S.
Affiliations
Vanderbilt University (US)
ORCID
Hulleman, Chris S.
Venue
Journal of Research on Educational Effectiveness
Publisher
Informa UK Limited
Published
2009-01-14
Volume
2
Issue
1
Pages
88-110
ISSN
  • 1934-5739 (ISSN-L)
  • 1934-5747
DOI
10.1080/19345740802539325
OpenAlex
W2088086259
Cited by
291
References
29
Citations by year
2026: 4 · 2025: 10 · 2024: 10 · 2023: 15 · 2022: 17 · 2021: 28 · 2020: 25 · 2019: 22 · 2018: 20 · 2017: 24 · 2016: 24 · 2015: 24 · 2014: 21 · 2013: 17 · 2012: 14
FWCI
17.58
Type
journal article
Language
en
Open access
closed
Locations
Journal of Research on Educational Effectiveness (publishedVersion)
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
  • Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
  • Social Sciences › Education › Educational Research and Methods
Keywords
intervention fidelity, motivational interventions, student motivation, classroom implementation, teacher factors, multilevel analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review