Cited by 291Behavioral and Psychological StudiesHealth Policy Implementation ScienceEducational Research and Methods

The DOI matches its Crossref record; 27 of the 29 references it cites were found in a registry or an index.

Moving From the Lab to the Field: The Role of Fidelity and Achieved Relative Intervention Strength

Hulleman, Chris S., Cordray, David S.·2009·Journal of Research on Educational Effectiveness

DOI 10.1080/19345740802539325

Open this paper in CoChat — free account

Abstract

As an example of how the effectiveness of well-designed laboratory interventions is often diffused in the field, we examined the effects of a motivation intervention on students' perceptions and learning. The intervention proved to be more effective in the laboratory (g = 0.45) than the field (g = 0.05) in enhancing subsequent motivation. We explored this reduction in treatment effectiveness through a fidelity analysis that examined the extent to which participants responded to the treatment. We calculated fidelity as three indices of achieved relative treatment strength (Cordray & Pion, 2006 Cordray, D. S. . The cause … or the ‘what’ of what works?. Paper presented at the Institute for Education Sciences 2006 Research Conference. Washington, DC. June, [Google Scholar]), and found that, regardless of how fidelity was calculated, achieved relative strength was about 1 standard deviation less in the classroom than the laboratory. In addition, greater levels of achieved relative strength were associated with greater differences in the motivational outcome—indicating that intervention was more effective for participants who actually received the treatment than those who did not. Multilevel analyses indicated that the drop in classroom treatment fidelity was partially because of teacher, rather than student, factors. Implications for theoretical models of change and research are discussed.

Integrity signals

Registry

Crossref · 10.1080/19345740802539325

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Hierarchical Linear Models: Applications and Data Analysis Methods.
Longford, N. T., Bryk, A. S., & Raudenbush, S. W. (1993) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2075823 · Cited by 18,773
Hierarchical Linear Models: Applications and Data Analysis Methods
Davidian, M. (2003) · Journal of the American Statistical Association · doi:10.1198/jasa.2003.s288 · Cited by 13,820
Untitled work
(2002) · Cited by 13,211
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Expectancies, values and academic behaviors
Eccles, J. S. (1983) · Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) · Cited by 3,901
Untitled work
(2005) · Cited by 3,748
A review of research on fidelity of implementation: implications for drug abuse prevention in school settings
Dusenbury, L. (2003) · Health Education Research · doi:10.1093/her/18.2.237 · Cited by 1,671
PROGRAM INTEGRITY IN PRIMARY AND EARLY SECONDARY PREVENTION: ARE IMPLEMENTATION EFFECTS OUT OF CONTROL?
Dane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · cited 2×
“The notion of intervention fidelity has been captured under a broad array of labels, such as treatment integrity, adherence, compliance, dose, exposure, quality of delivery, and treatment differentiation (for reviews, see Dane & Schneider, 1998 ; Dusenbury, Brannigan, Falco, & Hansen, 2003 ; Mowbray, Holter, Teague, &…”
Background
Defining, Conceptualizing, and Measuring Fidelity of Implementation and Its Relationship to Outcomes in K–12 Curriculum Intervention Research
O’Donnell, C. (2008) · Review of Educational Research · doi:10.3102/0034654307313793 · Cited by 1,037

Show all 29 references

Research works printed but not linked: 7

Cordray , D. S. . The cause … or the ‘what’ of what works? . Paper presented at the Institute for Education Sciences 2006 Research Conference . Washington, DC. June ,
Cordray , D. S. and Jacobs , N. . Treatment fidelity and core components in school-based ATOD prevention programs . Paper presented at the annual meeting of the Society for Prevention Research . Washington, DC. June ,
Hulleman , C. S. , Godes , O. , Hendricks , B. and Harackiewicz , J. M. 2008 . Enhancing interest in math and psychology with a utility value intervention Unpublished manuscript
Hulleman , C. S. and Harackiewicz , J. M. 2008 . A randomized field trial of expectancy-value motivation in high school science Unpublished manuscript
Hulleman , C. S. , Hendricks , B. and Harackiewicz , J. M. . The role of utility value in promoting interest and achievement . Paper presented at the American Educational Research Association annual meeting . Chicago. April ,
Raudenbush , S. W. , Bryk , A. and Congdon , R. 2007 . HLM for Windows: Version 6.04 , Lincolnwood, IL : Scientific Software International .
10.1002/pam.10129 · DOI

Sorted by citations

Social-Psychological Interventions in Education: They’re Not Magic
Yeager, D. S., & Walton, G. M. (2011) · Review of Educational Research · doi:10.3102/0034654311405999 · Cited by 1,345
Motivation Interventions in Education: A Meta-Analytic Review
Lazowski, R. A., & Hulleman, C. S. (2016) · Review of Educational Research · doi:10.3102/0034654315617832 · Cited by 607
Self-citation
Why Interventions to Influence Adolescent Behavior Often Fail but Could Succeed
Yeager, D. S., Dahl, R. E., & Dweck, C. S. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617722620 · Cited by 512
Improving Student Outcomes in Higher Education: The Science of Targeted Intervention
Harackiewicz, J. M., & Priniski, S. J. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011725 · Cited by 429
Making connections: Replicating and extending the utility value intervention in the classroom.
Hulleman, C. S., Kosovich, J. J., Barron, K. E., & Daniel, D. B. (2016) · Journal of Educational Psychology · doi:10.1037/edu0000146 · Cited by 396
Self-citation
Fostering adolescents’ value beliefs for mathematics with a relevance intervention in the classroom.
Gaspard, H., Dicke, A., Flunger, B., Brisson, B. M., Häfner, I., Nagengast, B., & Trautwein, U. (2015) · Developmental Psychology · doi:10.1037/dev0000028 · Cited by 401
Mathematics Learned by Young Children in an Intervention Based on Learning Trajectories: A Large-Scale Cluster Randomized Trial
Clements, D. H., Sarama, J. H., Spitler, M. E., Lange, A. A., & Wolfe, C. B. (2011) · Journal for Research in Mathematics Education · doi:10.5951/jresematheduc.42.2.0127 · Cited by 325
Strengthening school readiness for Head Start children: Evaluation of a self-regulation intervention
Schmitt, S. A., McClelland, M. M., Tominey, S. L., & Acock, A. C. (2014) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2014.08.001 · Cited by 333
Implementation Research
Century, J., & Cassata, A. (2016) · Review of Research in Education · doi:10.3102/0091732x16665332 · Cited by 317
How situational is situational interest? Investigating the longitudinal structure of situational interest
Knogler, M., Harackiewicz, J. M., Gegenfurtner, A., & Lewalter, D. (2015) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2015.08.004 · Cited by 219
Efficacy of the Responsive Classroom Approach
Rimm‐Kaufman, S. E., Larsen, R., Baroody, A. E., Curby, T. W., Ko, M., Thomas, J., Merritt, E. G., Abry, T., & DeCoster, J. (2014) · American Educational Research Journal · doi:10.3102/0002831214523821 · Cited by 219
A Procedure for Assessing Intervention Fidelity in Experiments Testing Educational and Behavioral Interventions
Nelson, M. C., Cordray, D. S., Hulleman, C. S., Darrow, C. L., & Sommer, E. C. (2012) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-012-9295-x · Cited by 192
Self-citation
A CONCEPTUAL FRAMEWORK FOR STUDYING THE SOURCES OF VARIATION IN PROGRAM EFFECTS
Weiss, M. J., Bloom, H. S., & Brock, T. (2013) · Journal of Policy Analysis and Management · doi:10.1002/pam.21760 · Cited by 179
Interleaved practice improves mathematics learning.
Rohrer, D., Dedrick, R. F., & Stershic, S. (2015) · Journal of Educational Psychology · doi:10.1037/edu0000001 · Cited by 164
Beyond utility value interventions: The why, when, and how for next steps in expectancy-value intervention research
Rosenzweig, E. Q., Wigfield, A., & Eccles, J. S. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1984242 · Cited by 199
A Systematic Evidence Review of the Check-In/Check-Out Program for Reducing Student Challenging Behaviors
Maggin, D. M., Zurheide, J., Pickett, K. C., & Baillie, S. J. (2015) · Journal of Positive Behavior Interventions · doi:10.1177/1098300715573630 · Cited by 141
Clinical trial of Second Step© middle-school program: Impact on aggression & victimization
Espelage, D. L., Low, S. K., Polanin, J. R., & Brown, E. C. (2015) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2014.11.007 · Cited by 141
Fidelity: An Essential Component of Evidence-Based Practice in Speech-Language Pathology
Kaderavek, J. N., & Justice, L. M. (2010) · American Journal of Speech-Language Pathology · doi:10.1044/1058-0360(2010/09-0097 · Cited by 137
Attachment and Biobehavioral Catch-up: addressing the needs of infants and toddlers exposed to inadequate or problematic caregiving
Dozier, M., & Bernard, K. (2017) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2017.03.003 · Cited by 150
Harnessing Values to Promote Motivation in Education
Harackiewicz, J. M., Tibbetts, Y., Canning, E., & Hyde, J. S. (2014) · Motivational Interventions · doi:10.1108/s0749-742320140000018002 · Cited by 131
Impact of a social-emotional and character development program on school-level indicators of academic achievement, absenteeism, and disciplinary outcomes: a matched-pair, cluster randomized, controlled trial
Snyder, F., Flay, B., Vuchinich, S., Acock, A., Washburn, I., Beets, M., & Li, K.-K. (2009) · Journal of Research on Educational Effectiveness · doi:10.1080/19345740903353436 · Cited by 130
Side Effects of Motivational Interventions? Effects of an Intervention in Math Classrooms on Motivation in Verbal Domains
Gaspard, H., Dicke, A., Flunger, B., Häfner, I., Brisson, B. M., Trautwein, U., & Nagengast, B. (2016) · AERA Open · doi:10.1177/2332858416649168 · Cited by 128
In Vivo Feedback Predicts Parent Behavior Change in the Attachment and Biobehavioral Catch-up Intervention
Caron, E., Bernard, K., & Dozier, M. (2016) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2016.1141359 · Cited by 124
What Really Works in Intervention? Using Fidelity Measures to Support Optimal Outcomes
An, M., Dusing, S. C., Harbourne, R. T., & Sheridan, S. M. (2020) · Physical Therapy · doi:10.1093/ptj/pzaa006 · Cited by 123
Light, lighting and human health
Boyce, P. R. (2021) · Lighting Research & Technology · doi:10.1177/14771535211010267 · Cited by 128
Naturalistic Instructional Approaches in Early Learning
Snyder, P., Rakap, S., Hemmeter, M. L., McLaughlin, T., Sandall, S. R., & McLean, M. (2015) · Journal of Early Intervention · doi:10.1177/1053815115595461 · Cited by 125
Effectiveness of Reading-Strategy Interventions in Whole Classrooms: a Meta-Analysis
Okkinga, M., van Steensel, R., van Gelderen, A. J. S., van Schooten, E., Sleegers, P. J. C., & Arends, L. R. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9445-7 · Cited by 108
Using Indices of Fidelity to Intervention Core Components to Identify Program Active Ingredients
Abry, T., Hulleman, C. S., & Rimm‐Kaufman, S. E. (2014) · American Journal of Evaluation · doi:10.1177/1098214014557009 · Cited by 106
Self-citation
Transfer of metacognitive skills in self-regulated learning: an experimental training study
Schuster, C., Stebner, F., Leutner, D., & Wirth, J. (2020) · Metacognition and Learning · doi:10.1007/s11409-020-09237-5 · Cited by 105
Examining the Association Between Implementation and Outcomes
Pas, E. T., & Bradshaw, C. P. (2012) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-012-9290-2 · Cited by 103
The Impact of Working Alliance, Social Validity, and Teacher Burnout on Implementation Fidelity of the Good Behavior Game
Wehby, J. H., Maggin, D. M., Partin, T. C. M., & Robertson, R. E. (2011) · School Mental Health · doi:10.1007/s12310-011-9067-4 · Cited by 99
Short intervention, sustained effects: Promoting students’ math competence beliefs, effort, and achievement
Brisson, B. M., Dicke, A.-L., Gaspard, H., Häfner, I., Flunger, B., Nagengast, B., & Trautwein, U. (2017) · American Educational Research Journal · doi:10.3102/0002831217716084 · Cited by 98
A randomized controlled trial of interleaved mathematics practice
Rohrer, D., Dedrick, R. F., Hartwig, M. K., & Cheung, C.-N. (2020) · Journal of Educational Psychology · doi:10.1037/edu0000367 · Cited by 90
Faculty Development When Initiating Simulation Programs: Lessons Learned From the National Simulation Study
Jeffries, P. R., Dreifuerst, K. T., Kardong‐Edgren, S., & Hayden, J. K. (2015) · Journal of Nursing Regulation · doi:10.1016/s2155-8256(15)30037-5 · Cited by 91
Predicting teacher participation in a classroom-based, integrated preventive intervention for preschoolers
Baker, C. N., Kupersmidt, J. B., Voegler‐Lee, M. E., Arnold, D. H., & Willoughby, M. T. (2009) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2009.09.005 · Cited by 91
Promoting persistence in the biological and medical sciences: An expectancy-value approach to intervention.
Hecht, C. A., Harackiewicz, J. M., Priniski, S. J., Canning, E. A., Tibbetts, Y., & Hyde, J. S. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000356 · Cited by 90
Toward High-Quality Early Childhood Development Programs and Policies at National Scale: Directions for Research in Global Contexts
Yoshikawa, H., Wuermli, A. J., Raikes, A., Kim, S., & Kabay, S. (2018) · Child Policy Nexus · doi:10.1002/j.2379-3988.2018.tb00091.x · Cited by 99
The influence of fidelity of implementation on teacher–student interaction quality in the context of a randomized controlled trial of the Responsive Classroom approach
Abry, T., Rimm‐Kaufman, S. E., Larsen, R., & Brewer, A. J. (2013) · Journal of School Psychology · doi:10.1016/j.jsp.2013.03.001 · Cited by 102
Professional development in Self-Regulated Strategy Development: Effects on the writing performance of eighth grade Portuguese students
Festas, I., de Oliveira, A. L., Rebelo, J. A., Damião, M. H., Harris, K. R., & Graham, S. (2014) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2014.05.004 · Cited by 83
Beliefs, affordances, and adolescent development: Lessons from a decade of growth mindset interventions
Hecht, C. A., Yeager, D. S., Dweck, C. S., & Murphy, M. C. (2021) · Advances in child development and behavior · doi:10.1016/bs.acdb.2021.04.004 · Cited by 103
An examination of the efficacy of INSIGHTS in enhancing the academic and behavioral development of children in early grades.
O’Connor, E. E., Cappella, E., McCormick, M. P., & McClowry, S. (2014) · Journal of Educational Psychology · doi:10.1037/a0036615 · Cited by 78
Preschool Curricula and Professional Development Features for Getting to High-Quality Implementation at Scale: A Comparative Review Across Five Trials
Weiland, C., McCormick, M. P., Mattera, S. K., Maier, M. F., & Morris, P. (2018) · AERA Open · doi:10.1177/2332858418757735 · Cited by 78
The Positive Action Program: Improving Academics, Behavior, and Character by Teaching Comprehensive Skills for Successful Learning and Living
Flay, B. R., & Allred, C. G. (2010) · Springer eBooks · doi:10.1007/978-90-481-8675-4_28 · Cited by 76
Scaffolding Fidelity and Adaptation in Educational Program Implementation: Experimental Evidence From a Literacy Intervention
Quinn, D. M., & Kim, J. S. (2017) · American Educational Research Journal · doi:10.3102/0002831217717692 · Cited by 74
Attachment and Biobehavioral Catch-Up
Costello, A. H., Roben, C. K. P., & Dozier, M. (2018) · Springer eBooks · doi:10.1007/978-3-030-03110-7_9 · Cited by 70
Improving Middle-School Students’ Knowledge and Comprehension in Social Studies: a Replication
Vaughn, S. R., Roberts, G., Swanson, E. A., Wanzek, J., Fall, A., & Stillman‐Spisak, S. J. (2014) · Educational Psychology Review · doi:10.1007/s10648-014-9274-2 · Cited by 67
The Effectiveness of a Large-Scale Language and Preliteracy Intervention: The SPELL Randomized Controlled Trial in Denmark
Bleses, D., Højen, A., Justice, L. M., Dale, P. S., Dybdal, L., Piasta, S. B., Markussen‐Brown, J., Clausen, M. C., & Haghish, E. F. (2017) · Child Development · doi:10.1111/cdev.12859 · Cited by 68
Examining the Effectiveness of a Multicomponent Reading Comprehension Intervention in Middle Schools: A Focus on Treatment Fidelity
Fogarty, M., Oslund, E. L., Simmons, D. C., Davis, J. L., Simmons, L. E., Anderson, L. L., Clemens, N. H., & Roberts, G. J. (2014) · Educational Psychology Review · doi:10.1007/s10648-014-9270-6 · Cited by 64
The Effects of Group differentiation by students’ learning strategies
Haelermans, C. (2022) · Instructional Science · doi:10.1007/s11251-021-09575-0 · Cited by 113
ManyClasses 1: Assessing the Generalizable Effect of Immediate Feedback Versus Delayed Feedback Across Many College Classes
Fyfe, E. R., de Leeuw, J. R., Carvalho, P. F., Goldstone, R. L., Sherman, J., Admiraal, D., Alford, L. K., Bonner, A., Brassil, C. E., Brooks, C. A., et al. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459211027575 · Cited by 59
Special Educator Burnout and Fidelity in Implementing Behavior Support Plans: A Call to Action
Garwood, J. D. (2022) · Journal of Emotional and Behavioral Disorders · doi:10.1177/10634266221099242 · Cited by 63
Effects of an Automated Vocabulary and Comprehension Intervention
Spencer, E. J., Goldstein, H., Sherman, A., Noe, S., Tabbah, R., Ziolkowski, R. A., & Schneider, N. (2012) · Journal of Early Intervention · doi:10.1177/1053815112471990 · Cited by 72
Improving Learning for All Students Through Equity-Based Inclusive Reform Practices
Choi, J. H., Meisenheimer, J., McCart, A. B., & Sailor, W. S. (2016) · Remedial and Special Education · doi:10.1177/0741932516644054 · Cited by 57
Sustainable bottled water: How nudging and Internet Search affect consumers’ choices
Grebitus, C., Roscoe, R. D., Loo, E. J. V., & Kula, I. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.121930 · Cited by 57
Transfer of metacognitive skills in self-regulated learning: effects on strategy application and content knowledge acquisition
Stebner, F., Schuster, C., Weber, X.-L., Greiff, S., Leutner, D., & Wirth, J. (2022) · Metacognition and Learning · doi:10.1007/s11409-022-09322-x · Cited by 57
Generalizing about Public Health Interventions: A Mixed-Methods Approach to External Validity
Leviton, L. C. (2017) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031816-044509 · Cited by 59
The benefits of combining value for the self and others in utility-value interventions.
Priniski, S. J., Rosenzweig, E. Q., Canning, E. A., Hecht, C. A., Tibbetts, Y., Hyde, J. S., & Harackiewicz, J. M. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000343 · Cited by 56
Embedded Instruction Improves Vocabulary Learning During Automated Storybook Reading Among High-Risk Preschoolers.
Goldstein, H., Kelley, E., Greenwood, C., McCune, L. A., Carta, J., Atwater, J., Guerrero, G., McCarthy, T. M., Schneider, N., & Spencer, T. (2016) · Journal of Speech, Language and Hearing Research · doi:10.1044/2015_jslhr-l-15-0227 · Cited by 44
Middle School Reading Comprehension and Content Learning Intervention for Below-Average Readers
Swanson, E. A., Wanzek, J., Vaughn, S. R., Fall, A., Roberts, G., Hall, C., & Miller, V. L. (2016) · Reading & Writing Quarterly · doi:10.1080/10573569.2015.1072068 · Cited by 53
Collaborative Strategic Reading: Findings From Experienced Implementers
Vaughn, S. R., Roberts, G., Klingner, J. K., Swanson, E. A., Boardman, A., Stillman‐Spisak, S. J., Mohammed, S. S., & Leroux, A. J. (2013) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2012.741661 · Cited by 52
The potential of relevance interventions for scaling up: A cluster-randomized trial testing the effectiveness of a relevance intervention in math classrooms.
Gaspard, H., Parrisius, C., Piesch, H., Kleinhansl, M., Wille, E., Nagengast, B., Trautwein, U., & Hulleman, C. S. (2021) · Journal of Educational Psychology · doi:10.1037/edu0000663 · Cited by 62
Self-citation
Measuring Enactment of Innovations and the Factors that Affect Implementation and Sustainability: Moving Toward Common Language and Shared Conceptual Understanding
Century, J., Cassata, A., Rudnick, M., & Freeman, C. (2012) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-012-9287-x · Cited by 51
The efficacy of Collaborative Strategic Reading in middle school science and social studies classes
Boardman, A. G., Klingner, J. K., Buckley, P. R., Annamma, S. A., & Lasser, C. J. (2015) · Reading and Writing · doi:10.1007/s11145-015-9570-3 · Cited by 69
How Does Fidelity of Implementation Matter? Using Multilevel Models to Detect Relationships Between Participant Outcomes and the Delivery and Receipt of Treatment
Zvoch, K. (2012) · American Journal of Evaluation · doi:10.1177/1098214012452715 · Cited by 48
Getting a good start in school: Effects of INSIGHTS on children with high maintenance temperaments
McCormick, M. P., O’Connor, E. E., Cappella, E., & McClowry, S. (2014) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2014.10.006 · Cited by 49
Assessment in Early Childhood Science Education
Greenfield, D. B. (2015) · Springer eBooks · doi:10.1007/978-94-017-9505-0_16 · Cited by 48
Adapting implementation science for higher education research: the systematic study of implementing evidence-based practices in college classrooms
Soicher, R. N., Becker‐Blease, K. A., & Bostwick, K. C. P. (2020) · Cognitive Research Principles and Implications · doi:10.1186/s41235-020-00255-0 · Cited by 52
Direct and Mediated Effects of a Social-Emotional and Character Development Program on Adolescent Substance Use.
Lewis, K. M., Bavarian, N., Snyder, F. J., Acock, A. C., Day, J., DuBois, D. L., Ji, P. Y., Schure, M. B., Silverthorn, N., Vuchinich, S., et al. (2012) · PubMed · Cited by 46
The effects of repetition on belief in naturalistic settings.
Fazio, L. K., Pillai, R. M., & Patel, D. (2022) · Journal of Experimental Psychology General · doi:10.1037/xge0001211 · Cited by 53
The effectiveness of personalized technology-enhanced learning in higher education: A meta-analysis with association rule mining
Hooshyar, D., Weng, X., Sillat, P. J., Tammets, K., Wang, M., & Hämäläinen, R. (2024) · Computers & Education · doi:10.1016/j.compedu.2024.105169 · Cited by 63
Efficacy of the TELL language and literacy curriculum for preschoolers with developmental speech and/or language impairment
Wilcox, M. J., Gray, S. I., Guimond, A. B., & Lafferty, A. E. (2011) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2010.12.003 · Cited by 46
Behavioral Processes in Long-Lag Intervention Studies
Miller, D. T., Dannals, J. E., & Zlatev, J. J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691616681645 · Cited by 47
Moving an Evidence-Based Parenting Program Into the Community
Roben, C. K. P., Dozier, M., Caron, E., & Bernard, K. (2017) · Child Development · doi:10.1111/cdev.12898 · Cited by 45
Effects of Fidelity-Focused Consultation on Clinicians’ Implementation: An Exploratory Multiple Baseline Design
Caron, E., & Dozier, M. (2019) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-019-00924-3 · Cited by 43
Teachers can do it: Scalable identity-based motivation intervention in the classroom
Horowitz, E., Sorensen, N., Yoder, N. P., & Oyserman, D. (2018) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2018.04.004 · Cited by 43
The Impact of the Measures of Academic Progress (MAP) Program on Student Reading Achievement
Cordray, D. S., Pion, G. M., Brandt, C., & Molefe, A. C. (2013) · Society for Research on Educational Effectiveness · Cited by 43
Self-citation
The Targeted Reading Intervention: Face–to–Face vs. Webcam Literacy Coaching of Classroom Teachers
Vernon‐Feagans, L., Bratsch‐Hines, M., Varghese, C. A., Bean, A., & Hedrick, A. (2015) · Learning Disabilities Research and Practice · doi:10.1111/ldrp.12062 · Cited by 42
CHILD DISRUPTIVE BEHAVIOR AND PARENTING EFFICACY: A COMPARISON OF THE EFFECTS OF TWO MODELS OF INSIGHTS
O'Connor, E., Rodriguez, E. T., Cappella, E., Morris, J., & McClowry, S. (2012) · Journal of Community Psychology · doi:10.1002/jcop.21482 · Cited by 45
Enhancing the Academic Development of Shy Children: A Test of the Efficacy of INSIGHTS
O’Connor, E. E., Cappella, E., McCormick, M. P., & McClowry, S. (2014) · School Psychology Review · doi:10.1080/02796015.2014.12087426 · Cited by 40
Promises and Pitfalls of Adapting Utility Value Interventions for Online Math Courses
Rosenzweig, E. Q., Hulleman, C. S., Barron, K. E., Kosovich, J. J., Priniski, S. J., & Wigfield, A. (2019) · The Journal of Experimental Education · doi:10.1080/00220973.2018.1496059 · Cited by 41
Self-citation
Using the Teaching Pyramid Observation Tool (TPOT) to Support Implementation of Social–Emotional Teaching Practices
Hemmeter, M. L., Snyder, P., & Fox, L. (2017) · School Mental Health · doi:10.1007/s12310-017-9239-y · Cited by 38
Research-Practice
Desimone, L. M., Wolford, T. E., & Hill, K. L. (2016) · AERA Open · doi:10.1177/2332858416679599 · Cited by 42
Reading Recovery: An Evaluation of the Four-Year i3 Scale-Up
May, H., Sirinides, P., Gray, A. M., & Goldsworthy, H. (2016) · doi:10.12698/cpre.2016.readingrecovery · Cited by 38
Impacts of an Early Childhood Mathematics and Science Intervention on Teaching Practices and Child Outcomes
Whittaker, J. V., Kinzie, M. B., Vitiello, V. E., DeCoster, J., Mulcahy, C., & Barton, E. A. (2020) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2019.1710884 · Cited by 36
Putting a speech training program into practice: Its implementation and effects on elementary school children’s public speaking skills and levels of speech anxiety
Herbein, E., Golle, J., Tibus, M., Zettler, I., & Trautwein, U. (2018) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2018.09.003 · Cited by 45
Relationship Between Implementation of Collaborative Strategic Reading and Student Outcomes for Adolescents With Disabilities
Boardman, A. G., Buckley, P. R., Vaughn, S. R., Roberts, G., Scornavacco, K., & Klingner, J. K. (2016) · Journal of Learning Disabilities · doi:10.1177/0022219416640784 · Cited by 35
Interaction of Theory and Practice to Assess External Validity
Leviton, L. C., & Trujillo, M. D. (2017) · Evaluation Review · doi:10.1177/0193841x15625289 · Cited by 35
Long-Term Effects of Social-Emotional Learning on Academic Skills: Evidence from a Randomized Trial of INSIGHTS
McCormick, M. P., Neuhaus, R., O’Connor, E. E., White, H. I., Horn, E. P., Harding, S., Cappella, E., & McClowry, S. (2020) · Journal of Research on Educational Effectiveness · doi:10.1080/19345747.2020.1831117 · Cited by 55
Implementing Team-Based Learning in Middle School Social Studies Classes
Wanzek, J., Kent, S. C., Vaughn, S. R., Swanson, E. A., Roberts, G., & Haynes, M. (2015) · The Journal of Educational Research · doi:10.1080/00220671.2014.893224 · Cited by 41
Examining the Relative Utility of PBIS Implementation Fidelity Scores in Relation to Student Outcomes
Pas, E. T., Johnson, S. R., Debnam, K. J., Hulleman, C. S., & Bradshaw, C. P. (2019) · Remedial and Special Education · doi:10.1177/0741932518805192 · Cited by 34
Self-citation
Program-wide implementation of the Pyramid Model: Supporting fidelity at the program and classroom levels
Hemmeter, M. L., Barton, E. E., Fox, L., Vatland, C. H., Henry, G., Pham, L. D., Horth, K., Taylor, A. L., Binder, D. P., von der Embse, M., et al. (2021) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2021.10.003 · Cited by 33
Promoting content-enriched alignment across the early grades: A study of policies & practices in the Boston Public Schools
McCormick, M. P., Weiland, C., Hsueh, J., Maier, M. F., Hagos, R. M., Snow, C. E., Leacock, N., & Schick, L. (2019) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2019.06.012 · Cited by 32
A Comprehensive Examination of Preschool Teachers’ Implementation Fidelity When Using a Supplemental Language and Literacy Curriculum
Piasta, S. B., Justice, L. M., McGinty, A. S., Mashburn, A. J., & Slocum, L. (2015) · Child & Youth Care Forum · doi:10.1007/s10566-015-9305-2 · Cited by 32
Unpacking intervention effects: Teacher responsiveness as a mediator of perceived intervention quality and change in teaching practice
LoCasale‐Crouch, J., DeCoster, J., Cabell, S. Q., Pianta, R. C., Hamre, B. K., Downer, J. T., Hatfield, B. E., Larsen, R., Burchinal, M., Howes, C. H., et al. (2016) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2015.12.022 · Cited by 35
Measuring the Implementation Fidelity of Student Affairs Programs: A Critical Component of the Outcomes Assessment Cycle
Gerstner, J. J., & Finney, S. J. (2013) · Research & Practice in Assessment · Cited by 31
Process matters: Teachers benefit their classrooms and students when they deliver an identity-based motivation intervention with fidelity
Oyserman, D., O’Donnell, S. C., Sorensen, N., & Wingert, K. M. (2021) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2021.101993 · Cited by 31
Fidelity in After-School Program Intervention Research: A Systematic Review
Maynard, B. R., Peters, K. E., Vaughn, M. G., & Sarteschi, C. M. (2013) · Research on Social Work Practice · doi:10.1177/1049731513491150 · Cited by 30
Using Complier Average Causal Effect Estimation to Determine the Impacts of the Good Behavior Game Preventive Intervention on Teacher Implementers
Berg, J., Bradshaw, C. P., Jo, B., & Ialongo, N. S. (2016) · Administration and Policy in Mental Health and Mental Health Services Research · doi:10.1007/s10488-016-0738-1 · Cited by 30
Can service-learning boost science achievement, civic engagement, and social skills? A randomized controlled trial of Connect Science
Rimm‐Kaufman, S. E., Merritt, E. G., Lapan, C., DeCoster, J., Hunt, A., & Bowers, N. (2021) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2020.101236 · Cited by 37
Description of a Fidelity Implementation System: An Example from a Community-Based Children’s Mental Health Program
Kutash, K., Cross, B. L., Madias, A., Duchnowski, A. J., & Green, A. L. (2012) · Journal of Child and Family Studies · doi:10.1007/s10826-012-9565-5 · Cited by 28

Authors: Hulleman, C. S., & Cordray, D. S.
Affiliations: Vanderbilt University (US)
ORCID: Hulleman, Chris S.
Venue: Journal of Research on Educational Effectiveness
Publisher: Informa UK Limited
Published: 2009-01-14
Volume: 2
Issue: 1
Pages: 88-110
ISSN: 1934-5739 (ISSN-L)
1934-5747
DOI: 10.1080/19345740802539325
OpenAlex: W2088086259
Cited by: 291
References: 29
Citations by year: 2026: 4 · 2025: 10 · 2024: 10 · 2023: 15 · 2022: 17 · 2021: 28 · 2020: 25 · 2019: 22 · 2018: 20 · 2017: 24 · 2016: 24 · 2015: 24 · 2014: 21 · 2013: 17 · 2012: 14
FWCI: 17.58
Type: journal article
Language: en
Open access: closed
Locations: Journal of Research on Educational Effectiveness (publishedVersion)
Topics: Social Sciences › Psychology › Developmental and Educational Psychology › Behavioral and Psychological Studies
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Social Sciences › Education › Educational Research and Methods
Keywords: intervention fidelity, motivational interventions, student motivation, classroom implementation, teacher factors, multilevel analysis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Moving From the Lab to the Field: The Role of Fidelity and Achieved Relative Intervention Strength

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks