Cited by 291Behavioral and Psychological StudiesHealth Policy Implementation ScienceEducational Research and Methods

The DOI matches its Crossref record; 27 of the 29 references it cites were found in a registry or an index.

Moving From the Lab to the Field: The Role of Fidelity and Achieved Relative Intervention Strength

Hulleman, Chris S., Cordray, David S.·2009·Journal of Research on Educational Effectiveness

DOI 10.1080/19345740802539325

Open this paper in CoChat — free account

Abstract

As an example of how the effectiveness of well-designed laboratory interventions is often diffused in the field, we examined the effects of a motivation intervention on students' perceptions and learning. The intervention proved to be more effective in the laboratory (g = 0.45) than the field (g = 0.05) in enhancing subsequent motivation. We explored this reduction in treatment effectiveness through a fidelity analysis that examined the extent to which participants responded to the treatment. We calculated fidelity as three indices of achieved relative treatment strength (Cordray & Pion, 2006 Cordray, D. S. . The cause … or the ‘what’ of what works?. Paper presented at the Institute for Education Sciences 2006 Research Conference. Washington, DC. June, [Google Scholar]), and found that, regardless of how fidelity was calculated, achieved relative strength was about 1 standard deviation less in the classroom than the laboratory. In addition, greater levels of achieved relative strength were associated with greater differences in the motivational outcome—indicating that intervention was more effective for participants who actually received the treatment than those who did not. Multilevel analyses indicated that the drop in classroom treatment fidelity was partially because of teacher, rather than student, factors. Implications for theoretical models of change and research are discussed.

Integrity signals

Registry

Crossref · 10.1080/19345740802539325

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2075823 · Cited by 18,773
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,820
Untitled work
(2002) · Cited by 13,211
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Expectancies, values and academic behaviors
Eccles, J. S. (1983) · Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) · Cited by 3,901
Untitled work
(2005) · Cited by 3,748
A review of research on fidelity of implementation: implications for drug abuse prevention in school settings
Dusenbury, L. (2003) · Health Education Research · doi:10.1093/her/18.2.237 · Cited by 1,671
PROGRAM INTEGRITY IN PRIMARY AND EARLY SECONDARY PREVENTION: ARE IMPLEMENTATION EFFECTS OUT OF CONTROL?
Dane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · cited 2×
“The notion of intervention fidelity has been captured under a broad array of labels, such as treatment integrity, adherence, compliance, dose, exposure, quality of delivery, and treatment differentiation (for reviews, see Dane & Schneider, 1998 ; Dusenbury, Brannigan, Falco, & Hansen, 2003 ; Mowbray, Holter, Teague, &…”
Background
Defining, Conceptualizing, and Measuring Fidelity of Implementation and Its Relationship to Outcomes in K–12 Curriculum Intervention Research
O’Donnell, C. (2008) · Review of Educational Research · doi:10.3102/0034654307313793 · Cited by 1,037

Show all 29 references

Research works printed but not linked: 7

Cordray , D. S. . The cause … or the ‘what’ of what works? . Paper presented at the Institute for Education Sciences 2006 Research Conference . Washington, DC. June ,
Cordray , D. S. and Jacobs , N. . Treatment fidelity and core components in school-based ATOD prevention programs . Paper presented at the annual meeting of the Society for Prevention Research . Washington, DC. June ,
Hulleman , C. S. , Godes , O. , Hendricks , B. and Harackiewicz , J. M. 2008 . Enhancing interest in math and psychology with a utility value intervention Unpublished manuscript
Hulleman , C. S. and Harackiewicz , J. M. 2008 . A randomized field trial of expectancy-value motivation in high school science Unpublished manuscript
Hulleman , C. S. , Hendricks , B. and Harackiewicz , J. M. . The role of utility value in promoting interest and achievement . Paper presented at the American Educational Research Association annual meeting . Chicago. April ,
Raudenbush , S. W. , Bryk , A. and Congdon , R. 2007 . HLM for Windows: Version 6.04 , Lincolnwood, IL : Scientific Software International .
10.1002/pam.10129 · DOI

Sorted by citations

Items 101–200 of 291

The effects of direct and indirect training in metacognitive learning strategies on near and far transfer in self-regulated learning
Schuster, C., Stebner, F., Geukes, S., Jansen, M., Leutner, D., & Wirth, J. (2022) · Learning and Instruction · doi:10.1016/j.learninstruc.2022.101708 · Cited by 34
Testing the Relation Between Fidelity of Implementation and Student Outcomes in Math
Crawford, L., Carpenter, D. M., Wilson, M. T., Schmeister, M., & McDonald, M. (2012) · Assessment for Effective Intervention · doi:10.1177/1534508411436111 · Cited by 31
Toward a New Approach to the Evaluation of a Digital Curriculum Using Learning Analytics
Rangel, V. S., Bell, E. R., Monroy, C. R., & Whitaker, J. R. (2015) · Journal of Research on Technology in Education · doi:10.1080/15391523.2015.999639 · Cited by 27
Dimensions of Literacy Coaching With Head Start Teachers
Powell, D. R., Steed, E. A., & Diamond, K. E. (2009) · Topics in Early Childhood Special Education · doi:10.1177/0271121409341197 · Cited by 27
Improving Middle School Science Learning Using Diagrammatic Reasoning
Cromley, J. G., Weisberg, S. M., Dai, T., Newcombe, N. S., Schunn, C. D., Massey, C. M., & Merlino, F. J. (2016) · Science Education · doi:10.1002/sce.21241 · Cited by 30
Inside the Black Box: Examining Mediators and Moderators of a Middle School Science Intervention
Desimone, L. M., & Hill, K. L. (2017) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373717697842 · Cited by 26
Using Resource and Cost Considerations to Support Educational Evaluation: Six Domains
Belfield, C., & Bowden, A. B. (2018) · Educational Researcher · doi:10.3102/0013189x18814447 · Cited by 27
Utility value interventions: Why and how instructors should use them in college psychology courses.
Soicher, R. N., & Becker‐Blease, K. A. (2020) · Scholarship of Teaching and Learning in Psychology · doi:10.1037/stl0000240 · Cited by 27
Designing Probability Samples to Study Treatment Effect Heterogeneity
Tipton, E., Yeager, D. S., Iachan, R., & Schneider, B. (2019) · Wiley eBooks · doi:10.1002/9781119083771.ch22 · Cited by 26
Learning More From Educational Intervention Studies: Estimating Complier Average Causal Effects in a Relevance Intervention
Nagengast, B., Brisson, B. M., Hulleman, C. S., Gaspard, H., Häfner, I., & Trautwein, U. (2018) · The Journal of Experimental Education · doi:10.1080/00220973.2017.1289359 · Cited by 24
Self-citation
Long-Term Effects of Social–Emotional Learning on Receipt of Special Education and Grade Retention: Evidence From a Randomized Trial of INSIGHTS
McCormick, M. P., Neuhaus, R., Horn, E. P., O’Connor, E. E., White, H. I., Harding, S., Cappella, E., & McClowry, S. (2019) · AERA Open · doi:10.1177/2332858419867290 · Cited by 32
Fidelity of implementation for an early-literacy intervention: Dimensionality and contribution to children’s intervention outcomes
Guo, Y. J., Dynia, J. M., Logan, J. A. R., Justice, L. M., Breit‐Smith, A., & Kaderavek, J. N. (2016) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2016.06.001 · Cited by 24
What Happens During Language and Literacy Coaching? Coaches’ Reports of Their Interactions With Educators
Schachter, R. E., Weber-Mayrer, M. M., Piasta, S. B., & O'Connell, A. A. (2018) · Early Education and Development · doi:10.1080/10409289.2018.1487222 · Cited by 24
Examining the Impact of Teacher Quality on Fourth-Grade Students' Comprehension and Content-Area Achievement
Hairrell, A., Rupley, W. H., Edmonds, M. S., Larsen, R., Simmons, D. C., Willson, V. L., Byrns, G., & Vaughn, S. R. (2011) · Reading & Writing Quarterly · doi:10.1080/10573569.2011.560486 · Cited by 24
Self-Coding of Fidelity as a Potential Active Ingredient of Consultation to Improve Clinicians’ Fidelity
Caron, E., & Dozier, M. (2021) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-021-01160-4 · Cited by 24
Does the Responsive Classroom Approach Affect the Use of Standards-Based Mathematics Teaching Practices?
Ottmar, E., Rimm‐Kaufman, S. E., Berry, R. Q., & Larsen, R. (2013) · The Elementary School Journal · doi:10.1086/668768 · Cited by 22
Concordance between clinician, supervisor and observer ratings of therapeutic competence in CBT and treatment as usual: does clinician competence or supervisor session observation improve agreement?
Caron, E., Muggeo, M. A., Souer, H. R., Pella, J. E., & Ginsburg, G. S. (2019) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465819000699 · Cited by 22
How can a relevance intervention in math support students' career choices?
Piesch, H., Gaspard, H., Parrisius, C., Wille, E., & Nagengast, B. (2020) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2020.101185 · Cited by 28
Effects of an Intensive Reading Intervention for Ninth-Grade English Learners With Learning Disabilities
Williams, K. J., & Vaughn, S. R. (2019) · Learning Disability Quarterly · doi:10.1177/0731948719851745 · Cited by 21
A model for system‐wide collaboration to support integrated social behavior and literacy evidence‐based practices
Chaparro, E. A., Smolkowski, K., Baker, S. K., Hanson, N., & Ryan-Jackson, K. (2012) · Psychology in the Schools · doi:10.1002/pits.21607 · Cited by 22
Assessing Fidelity of Implementation of an Unprescribed, Diagnostic Mathematics Intervention
Munter, C., Wilhelm, A. G., Cobb, P., & Cordray, D. S. (2014) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2013.809177 · Cited by 21
Self-citation
Cooperative methods and self-regulated strategies development for argumentative writing
Prata, M. J., de Sousa, B. C., Festas, I., & de Oliveira, A. L. (2018) · The Journal of Educational Research · doi:10.1080/00220671.2018.1427037 · Cited by 24
Feasible Implementation Strategies for Improving Vocabulary Knowledge of High-Risk Preschoolers: Results From a Cluster-Randomized Trial
Kelley, E., Barker, R. M., Peters-Sanders, L. A., Madsen, K., Seven, Y., Soto-Boykin, X. T., Olsen, W. L., Hull, K., & Goldstein, H. (2020) · Journal of Speech Language and Hearing Research · doi:10.1044/2020_jslhr-20-00316 · Cited by 21
Using diagrams versus text for spaced restudy: Effects on learning in 10th grade biology classes
Bergey, B. W., Cromley, J. G., Kirchgessner, M. L., & Newcombe, N. S. (2014) · British Journal of Educational Psychology · doi:10.1111/bjep.12062 · Cited by 23
Why Does a Growth Mindset Intervention Impact Achievement Differently across Secondary Schools? Unpacking the Causal Mediation Mechanism from a National Multisite Randomized Experiment
Qin, X., Wormington, S. V., Guzman-Alvarez, A., & Wang, M. (2021) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2021.1894520 · Cited by 27
Elementary school children’s understanding of science: The implementation of an extracurricular science intervention
Schiefer, J., Golle, J., Tibus, M., Trautwein, U., & Oschatz, K. (2017) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2017.09.011 · Cited by 24
An embodied cognition approach to enhancing reading achievement in New York City public schools: Promising evidence
Corcoran, R. P. (2017) · Teaching and Teacher Education · doi:10.1016/j.tate.2017.11.010 · Cited by 25
Treatment Fidelity Procedures for an Aphasia Intervention Within a Randomized Controlled Trial: Design, Feasibility, and Results
Larkin, E., Braun, E. J., Babbitt, E. M., & Cherney, L. R. (2019) · American Journal of Speech-Language Pathology · doi:10.1044/2019_ajslp-cac48-18-0227 · Cited by 22
Efficacy and Insights Gained from a Utility Value Intervention with Inorganic Chemistry Students
Wang, Y., & Lewis, S. E. (2022) · Journal of Chemical Education · doi:10.1021/acs.jchemed.2c00045 · Cited by 19
Testing the effects of a pilot listening comprehension and vocabulary intervention for individuals with autism
Solari, E., Henry, A., McIntyre, N., Grimm, R. P., & Zajic, M. (2020) · Research in Autism · doi:10.1016/j.rasd.2019.101501 · Cited by 17
Unlocking the Potential of the “What Works” Approach to Policymaking and Practice
Granger, R. C., & Maynard, R. A. (2015) · American Journal of Evaluation · doi:10.1177/1098214015594420 · Cited by 19
An Examination of the Benefits, Limitations, and Challenges of Conducting Randomized Experiments With Principals
Camburn, E. M., Goldring, E. B., Sebastian, J. L., May, H., & Huff, J. (2015) · Educational Administration Quarterly · doi:10.1177/0013161x15617808 · Cited by 21
Within-year fidelity growth of SWPBIS during installation and initial implementation.
Schaper, A., McIntosh, K., & Hoselton, R. M. (2015) · School Psychology Quarterly · doi:10.1037/spq0000125 · Cited by 20
Does Fidelity of Implementation Account for Changes in Teacher–Child Interactions in a Randomized Controlled Trial of Banking Time?
LoCasale‐Crouch, J., Williford, A. P., Whittaker, J. V., DeCoster, J., & Álamos, P. (2017) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2017.1329365 · Cited by 19
Intervention Adherence and Self-Efficacy as Predictors of Child Outcomes in School Nurse–Delivered Interventions for Anxiety
Caron, E., Drake, K. L., Stewart, C. E., Muggeo, M. A., & Ginsburg, G. S. (2020) · The Journal of School Nursing · doi:10.1177/1059840520925522 · Cited by 21
Marking the way: School-based interventions that “work”
Murphy, P. K. (2014) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2014.10.003 · Cited by 18
Commentary: new directions in developmentally informed intervention research for vulnerable populations
Yoshikawa, H., Whipps, M. D. M., & Rojas, N. M. (2017) · Child Development · doi:10.1111/cdev.12736 · Cited by 17
The Effectiveness and Precision of Intervention Fidelity Measures in Preschool Intervention Research
Darrow, C. L. (2013) · Early Education and Development · doi:10.1080/10409289.2013.765786 · Cited by 17
Fidelity of implementation in a randomized controlled trial study: The effect of virtual professional development on bilingual teachers
Tang, S., Tong, F., Irby, B. J., Lara‐Alecio, R., & Guerrero, C. L. (2020) · Bilingual Research Journal · doi:10.1080/15235882.2019.1711268 · Cited by 17
Identifying obstacles to transfer of critical thinking skills
van Peppen, L. M., van Gog, T., Verkoeijen, P. P. J. L., & Alexander, P. A. (2021) · Journal of Cognitive Psychology · doi:10.1080/20445911.2021.1990302 · Cited by 24
How Do Intervention Studies Measure the Relation between Implementation Fidelity and Students’ Reading Outcomes?
van Dijk, W., Lane, H. B., & Gage, N. A. (2023) · The Elementary School Journal · doi:10.1086/725672 · Cited by 16
Promoting Acceleration of Comprehension and Content Through Text in High School Social Studies Classes
Wanzek, J., Swanson, E. A., Roberts, G., Vaughn, S. R., & Kent, S. C. (2014) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2014.906011 · Cited by 16
Who sticks to the instructions—and does it matter? Antecedents and effects of students’ responsiveness to a classroom-based motivation intervention
Brisson, B. M., Hulleman, C. S., Häfner, I., Gaspard, H., Flunger, B., Dicke, A., Trautwein, U., & Nagengast, B. (2020) · Zeitschrift für Erziehungswissenschaft · doi:10.1007/s11618-019-00922-z · Cited by 19
Self-citation
Content-rich instruction and cognitive demand in prek: using systematic observations to predict child gains
Maier, M. F., McCormick, M. P., Xia, S., Hsueh, J., Weiland, C., Morales, A., Boni, M., Tonachel, M., Sachs, J., & Snow, C. E. (2022) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2021.12.010 · Cited by 16
Classwide Efficacy of INSIGHTS
Cappella, E., O’Connor, E. E., McCormick, M. P., Turbeville, A. R., Collins, A., & McClowry, S. (2015) · The Elementary School Journal · doi:10.1086/683983 · Cited by 19
Function‐based replacement behavior interventions for students with challenging behavior
McKenna, J. W., Flower, A., Falcomata, T. S., & Adamson, R. (2017) · Behavioral Interventions · doi:10.1002/bin.1484 · Cited by 16
A process for establishing and maintaining inter-rater reliability for two observation instruments as a fidelity of implementation measure: A large-scale randomized controlled trial perspective
Tong, F., Tang, S., Irby, B. J., Lara‐Alecio, R., Guerrero, C. L., & Lopez, T. (2019) · Studies In Educational Evaluation · doi:10.1016/j.stueduc.2019.04.008 · Cited by 18
A Meta-analysis of Multimedia Applications: How Effective Are Interventions with e-Books, Computer-Assisted Instruction and TV/Video on Literacy Learning?
van Daal, V. H. P., Sandvik, J. M., & Adèr, H. J. (2019) · Literacy studies · doi:10.1007/978-3-030-20077-0_14 · Cited by 16
Predicting and Evaluating Treatment Response: Evidence Toward Protracted Response Patterns for Severely Impacted Students With Dyslexia
Middleton, A. E., Farris, E. A., Ring, J. J., & Odegard, T. N. (2021) · Journal of Learning Disabilities · doi:10.1177/00222194211047633 · Cited by 15
Making My Future Work: Evaluation of a New College and Career Readiness Curriculum
Perry, J. C., Wallace, E. W., & McCormick, M. P. (2016) · Youth & Society · doi:10.1177/0044118x16658221 · Cited by 15
Infant mental health home visiting therapists’ fidelity to the Michigan IMH‐HV model in community practice settings
Huth‐Bocks, A. C., Jester, J. M., Stacks, A. M., Muzik, M., & Rosenblum, K. L. (2020) · Infant Mental Health Journal · doi:10.1002/imhj.21839 · Cited by 15
A Pilot Study of the Impact of Double-Dose Robust Vocabulary Instruction on Children's Vocabulary Growth
Language and Reading Research Consortium, Arthur, A. M., & Davis, D. L. (2016) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2015.1126875 · Cited by 14
Towards a framework for spatial reasoning and primary mathematics learning: an analytical synthesis of intervention studies
Woolcott, G., Tran, T. L., Mulligan, J., Davis, B., & Mitchelmore, M. C. (2020) · Mathematics Education Research Journal · doi:10.1007/s13394-020-00318-x · Cited by 14
Integrating Literacy and Science Instruction in Kindergarten: Results From the Efficacy Study of Zoology One
Gray, A. M., Sirinides, P. M., Fink, R. E., & Bowden, A. B. (2021) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2021.1938313 · Cited by 19
Validating a Fidelity Scale to Understand Intervention Effects in Classroom-Based Studies
Buckley, P. R., Moore, B., Boardman, A. G., Arya, D. J., & Maul, A. (2017) · American Educational Research Journal · doi:10.3102/0002831217726522 · Cited by 14
Introduction to the Special Issue on Optimizing the Implementation and Effectiveness of Preventive Interventions Through Motivational Interviewing
Pas, E. T., & Bradshaw, C. P. (2021) · Prevention Science · doi:10.1007/s11121-021-01278-9 · Cited by 14
Implementation Fidelity and the Design of a Fractions Intervention
Crawford, L., Freeman, B., Huscroft-D’Angelo, J. N., Fuentes, S. Q., & Higgins, K. N. (2019) · Learning Disability Quarterly · doi:10.1177/0731948719840774 · Cited by 13
Instructional alignment is associated with PreK persistence: Evidence from the Boston Public Schools
McCormick, M. P., MacDowell, C., Weiland, C., Hsueh, J., Maier, M. F., Pralica, M., Maves, S., Snow, C. E., & Sachs, J. (2023) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2023.11.008 · Cited by 13
Fidelity Moderates the Association Between Negative Condom Attitudes and Outcome Behavior in an Evidence-Based Sexual Risk Reduction Intervention for Female Sex Workers
Pitpitan, E. V., Chavarin, C. V., Semple, S. J., Mendoza, D. V., Magis-Rodríguez, C. L., Staines, H., Aarons, G. A., & Patterson, T. L. (2016) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9861-1 · Cited by 13
Using Complier Average Causal Effect Estimation to Examine Student Outcomes of the PAX Good Behavior Game When Integrated with the PATHS Curriculum
Bradshaw, C. P., Shukla, K. D., Pas, E. T., Berg, J., & Ialongo, N. S. (2020) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-020-01034-1 · Cited by 14
Exploring profiles of coaches' fidelity to Double Check's Motivational Interviewing-embedded coaching: Outcomes associated with fidelity
Pas, E. T., Borden, L. A., Debnam, K. J., Lucia, D. D., & Bradshaw, C. P. (2022) · Journal of School Psychology · doi:10.1016/j.jsp.2022.04.003 · Cited by 16
Using a Meta-analytic Technique to Assess the Relationship between Treatment Intensity and Program Effects in a Cluster-Randomized Trial
Polanin, J. R., & Espelage, D. L. (2014) · Journal of Behavioral Education · doi:10.1007/s10864-014-9205-9 · Cited by 13
The Impact of Paralympic School Day on Student Attitudes Toward Inclusion in Physical Education
McKay, C. (2013) · doi:10.18130/v3qs14 · Cited by 13
Impact of the School Environment on Medical Treatment of Attention Deficit Hyperactivity Disorder: A Population-Wide Register Data Study of School-Wide Positive Behavioral Interventions and Supports
Borgen, N. T., Frønes, I., & Raaum, O. (2021) · Child Development · doi:10.1111/cdev.13574 · Cited by 12
Evaluation of the i3 Scale-up of Reading Recovery
May, H., Gray, A. M., Gillespie, J. N., Sirinides, P. M., Sam, C. H., Goldsworthy, H., Armijo, M., & Tognatta, N. R. (2013) · 2015 Fall Conference: The Golden Age of Evidence-Based Policy · Cited by 12
Novel Methods for Screening: Contributions from Attachment and Biobehavioral Catch-up
Caron, E., Roben, C. K. P., Yarger, H. A., & Dozier, M. (2018) · Prevention Science · doi:10.1007/s11121-018-0894-5 · Cited by 14
Fidelity Assessment Checklist Development for Community Nursing Research in Early Childhood
Anis, L., Benzies, K., Ewashen, C., Hart, M. J., & Letourneau, N. L. (2021) · Frontiers in Public Health · doi:10.3389/fpubh.2021.582950 · Cited by 14
Evaluation of the i3 Scale-up of Reading Recovery | Year Two Report, 2012-13
May, H., Goldsworthy, H., Armijo, M., Gray, A. M., Sirinides, P., & Blalock, T. (2014) · doi:10.12698/cpre.2014.rr79 · Cited by 12
Using Mixed Methods to Explore Variations in Impact Within RCTs: The Case of Project COMPASS
Edmunds, J. A., Gicheva, D., Thrift, B., & Hull, M. C. (2021) · Journal of Mixed Methods Research · doi:10.1177/15586898211033144 · Cited by 11
Is replication possible without fidelity?
Ellefson, M. R., & Oppenheimer, D. M. (2022) · Psychological Methods · doi:10.1037/met0000473 · Cited by 13
Testing the predictive power of an instrument titled “Orientation to School Renewal”
Shen, J., Ma, X., Mansberger, N. B., Gao, X., Palmer, L. B., Burt, W. L., Leneway, R. J., McCrumb, D., Poppink, S., Reeves, P. L., et al. (2020) · School Effectiveness and School Improvement · doi:10.1080/09243453.2020.1749087 · Cited by 12
Issues in Statewide Scale up of a Multi-Tiered System of Support
Choi, J. H., McCart, A. B., Miller, D. D., & Sailor, W. S. (2022) · Journal of School Leadership · doi:10.1177/10526846211067650 · Cited by 10
Improving Community College Students’ Success in Math: Findings From Two Utility-Value Studies
Totonchi, D. A., Francis, M. K., Tibbetts, Y., Huelskoetter, E., Davis, J., Smith, A., Barron, K. E., & Hulleman, C. S. (2023) · The Journal of Experimental Education · doi:10.1080/00220973.2023.2243610 · Cited by 15
Self-citation
A technology-enabled adherence enhancement system for people with bipolar disorder: results from a feasibility and patient acceptance analysis
Sajatovic, M., Davis, M. E., Cassidy, K. A., Nestor, J., Sams, J., & Fuentes‐Casiano, E. (2015) · Patient Preference and Adherence · doi:10.2147/ppa.s81724 · Cited by 10
Caregiver Implementation of a Home-Based Reading Program With Their Children With Disabilities: Patterns of Adherence
Logan, J. A. R., Dynia, J. M., Justice, L. M., & Sawyer, B. E. (2018) · Learning Disability Quarterly · doi:10.1177/0731948718786231 · Cited by 10
Innovation in Education Research: Creation of an Education Research Core
Schwengel, D. A., & Toy, S. (2019) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000003971 · Cited by 10
A Randomized Field Experiment Using Self-Reflection on School Behavior to Help Students in Secondary School Reach Their Performance Potential
Feron, E., & Schils, T. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01356 · Cited by 13
Optimizing Vocabulary Instruction for Preschool Children
Madsen, K., Peters-Sanders, L. A., Kelley, E., Barker, R. M., Seven, Y., Olsen, W. L., Soto-Boykin, X. T., & Goldstein, H. (2022) · Journal of Early Intervention · doi:10.1177/10538151221116596 · Cited by 10
Instruction and cognition
Cromley, J. G., & Byrnes, J. P. (2012) · Wiley Interdisciplinary Reviews Cognitive Science · doi:10.1002/wcs.1192 · Cited by 10
Terracotta: A tool for conducting experimental research on student learning
Motz, B. A., Üner, Ö., Jankowski, H. E., Christie, M. A., Burgas, K., Orobitg, D. D. B., & McDaniel, M. A. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02164-8 · Cited by 12
Meeting the Challenges of Longitudinal Cluster-Based Trials in Schools: Lessons From the Chicago Trial of Positive Action
Lewis, K. M., DuBois, D. L., Ji, P. Y., Day, J. P., Silverthorn, N., Bavarian, N., Vuchinich, S., Acock, A. C., Malloy, M., Schure, M. B., et al. (2016) · Evaluation & the Health Professions · doi:10.1177/0163278716673688 · Cited by 10
The Application of Empirically Supported Practices in Middle School Social Studies Classrooms
Kent, S. C., Wanzek, J., & Martinez, L. R. (2017) · Remedial and Special Education · doi:10.1177/0741932517744662 · Cited by 9
Moving Kindergarten Entry Assessments from Policy to Practice Evidence from North Carolina
Little, M., Cohen‐Vogel, L., Sadler, J., & Merrill, B. (2020) · Early Education and Development · doi:10.1080/10409289.2020.1724600 · Cited by 9
Implementation quality of principles of reciprocal teaching in whole-classroom settings: a two-year study with low-achieving adolescents
Okkinga, M., van Gelderen, A. J. S., van Schooten, E., van Steensel, R., & Sleegers, P. J. C. (2021) · Reading Psychology · doi:10.1080/02702711.2021.1887019 · Cited by 9
Heterogeneity in short-and long-term impacts of school-wide positive behavior support (SWPBS) on academic outcomes, behavioral outcomes, and criminal activity
Borgen, N. T., Raaum, O., Kirkebøen, L. J., Sørlie, M.-A., Ogden, T., & Frønes, I. (2021) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2020.1862375 · Cited by 7
Implementing Adolescent Wellbeing and Health Programs in Schools: Insights from a Mixed Methods and Multiple Informant Study
Dariotis, J. K., Mabisi, K., Jackson‐Gordon, R., Yang, N., Rose, E. J., Mendelson, T., & Fishbein, D. H. (2023) · Prevention Science · doi:10.1007/s11121-022-01481-2 · Cited by 9
The importance of responsive parenting for vulnerable infants
Korom, M., & Dozier, M. (2021) · Advances in child development and behavior · doi:10.1016/bs.acdb.2021.03.001 · Cited by 13
Teacher Utilization of Instructional Consultation Teams
Berger, J., Yiu, H. L., Nelson, D. L., Vaganek, M., Rosenfield, S. A., Gravois, T. A., Gottfredson, G. D., Vu, P. A., Shanahan, K., & Hong, V. (2014) · Journal of Educational and Psychological Consultation · doi:10.1080/10474412.2014.917931 · Cited by 8
Strategies that promote therapist engagement in active and experiential learning: micro-level sequential analysis
Caron, E., Lind, T., & Dozier, M. (2021) · The Clinical Supervisor · doi:10.1080/07325223.2020.1870023 · Cited by 8
Human Systems Engineering and Educational Technology
Roscoe, R. D., Branaghan, R. J., Cooke, N. J., & Craig, S. D. (2017) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-2639-1.ch001 · Cited by 8
A Simulation Study on Latent Transition Analysis for Examining Profiles and Trajectories in Education: Recommendations for Fit StatisticsPreprint
Edelsbrunner, P. A., Flaig, M., & Schneider, M. (2021) · doi:10.31234/osf.io/bqc94 · Cited by 8
Metacomprehension in Multiple Document Reading
Schuster, C., Alef, M., Mierwald, M., Brauch, N., & Stadtler, M. (2023) · Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie · doi:10.1026/0049-8637/a000278 · Cited by 8
Increasing Street-Level Bureaucrats’ Well-Being in Times of Crisis: A Survey Experiment With Two Social Belonging Interventions
de Boer, N., Schott, C., & Loyens, K. M. (2024) · Review of Public Personnel Administration · doi:10.1177/0734371x241227899 · Cited by 7
Employability and motivation: which motivational theories are most appropriate?
Remedios, R., & Sewell, P. (2024) · Higher Education Skills and Work-based Learning · doi:10.1108/heswbl-03-2024-0067 · Cited by 7
Predicting fidelity and treatment outcomes in savoring interventions among mothers of young children
Borelli, J. L., Perzolli, S., Kerr, M., & Smiley, P. A. (2024) · Infant Mental Health Journal · doi:10.1002/imhj.22130 · Cited by 7
Making sense of preschool research: a multi-paper dissertation on the implementation and effectiveness of preschool curriculum interventions
Darrow, C. L. (2010) · Cited by 7
Chapter 8 From Research to Practice in Early Childhood Intervention: A Translational Framework and Approach
Trivette, C. M., & Dunst, C. J. (2013) · Advances in learning and behavioral disabilities · doi:10.1108/s0735-004x(2013)0000026010 · Cited by 7
Efficacy of a Self-Monitoring Tool for Improving the Quality of the Language Environment in the Preschool Classroom
Strasser, K., Mendive, S., Vergara, D., & Darricades, M. (2017) · Early Education and Development · doi:10.1080/10409289.2017.1287992 · Cited by 7
Instructional Support and Academic Skills: Impacts ofINSIGHTSin Classrooms With Shy Children
McCormick, M. P., White, H. I., Horn, P., Lacks, R. S., O’Connor, E., Cappella, E., & McClowry, S. (2018) · Early Education and Development · doi:10.1080/10409289.2018.1435943 · Cited by 9
Reflections versus Extended Quizzes: Which is Better for Student Learning and Self-Regulation?
Clinton‐Lisell, V. (2018) · Journal of the Scholarship of Teaching and Learning · doi:10.14434/josotl.v18i1.22508 · Cited by 7

Authors: Hulleman, C. S., & Cordray, D. S.
Affiliations: Vanderbilt University (US)
ORCID: Hulleman, Chris S.
Venue: Journal of Research on Educational Effectiveness
Publisher: Informa UK Limited
Published: 2009-01-14
Volume: 2
Issue: 1
Pages: 88-110
ISSN: 1934-5739 (ISSN-L)
1934-5747
DOI: 10.1080/19345740802539325
OpenAlex: W2088086259
Cited by: 291
References: 29
Citations by year: 2026: 4 · 2025: 10 · 2024: 10 · 2023: 15 · 2022: 17 · 2021: 28 · 2020: 25 · 2019: 22 · 2018: 20 · 2017: 24 · 2016: 24 · 2015: 24 · 2014: 21 · 2013: 17 · 2012: 14
FWCI: 17.58
Type: journal article
Language: en
Open access: closed
Locations: Journal of Research on Educational Effectiveness (publishedVersion)
Topics: Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Education › Educational Research and Methods
Keywords: intervention fidelity, motivational interventions, student motivation, classroom implementation, teacher factors, multilevel analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Moving From the Lab to the Field: The Role of Fidelity and Achieved Relative Intervention Strength

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks