The DOI matches its Crossref record; 41 of the 42 references it cites were found in a registry or an index.
Learning More From Educational Intervention Studies: Estimating Complier Average Causal Effects in a Relevance Intervention
Abstract
An emerging literature demonstrates that relevance interventions, which ask students to produce written reflections on how what they are learning relates to their lives, improve student learning outcomes. As part of a randomized evaluation of a relevance intervention (N = 1,978 students from 82 ninth-grade classes), we used Complier Average Causal Effects (CACE) to identify the effect of the intervention on participants who were assigned to the intervention group and were actually compliant with the intervention (i.e., treatment fidelity or compliance). Results revealed larger differences for compliers than noncompliers, although this impact depended on several factors. Implications for the application of CACE models in educational interventions, in general, and relevance interventions, in particular, are discussed.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Finally, we estimated a Complier Average Causal Effect (CACE) to assess the intervention's effect on students who actively participated (Nagengast et al., 2018).”
From Enhancing School Students' Self-Regulated Learning through Generative AI Support: A Randomized Controlled Trial (2026) · cites this paper as Nagengast et al., 2018
Citations
Cites
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Motivational beliefs, values, and goals
Eccles, J. S., & Wigfield, A. (2002) · Annual Review of Psychology · doi:10.1146/annurev.psych.53.100901.135153 · Cited by 7,587
Durlak, J. A., & DuPre, E. P. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9165-0 · Cited by 5,304
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Expectancies, values and academic behaviors
Eccles, J. S. (1983) · Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) · Cited by 3,901
Eccles, J. S., Midgley, C., Wigfield, A., Buchanan, C. M., Reuman, D., Flanagan, C., & Mac Iver, D. (1993) · American Psychologist · doi:10.1037/0003-066x.48.2.90 · Cited by 2,616 · cited 1×
“…compliance (e.g., Trautwein & L€udtke, 2007), on academic engagement (e.g., Fredricks, Blumenfeld, & Paris, 2004), on stage-environment fit theory (Eccles et al., 1993), and on findings on subgroup effects in prior relevance interventions (for a review, see Durik et al., 2015), the authors…”
BackgroundDane, A. V., & Schneider, B. H. (1998) · Clinical Psychology Review · doi:10.1016/s0272-7358(97)00043-3 · Cited by 1,557 · cited 1×
“…fidelity can be further differentiated into subcomponents, such as adherence to the intervention program, quality of delivery by the implementer (e.g., the teacher or scientist), and responsiveness to the treatment by participants (e.g., the students, Dane & Schneider, 1998; O’Donnell, 2008).”
BackgroundSocial-Psychological Interventions in Education: They’re Not Magic
Yeager, D. S., & Walton, G. M. (2011) · Review of Educational Research · doi:10.3102/0034654311405999 · Cited by 1,345 · cited 1×
“As in many social-psychological interventions in education (Yeager & Walton, 2011), relevance interventions are typically based on individually completed writing activities.”
Background
Research works printed but not linked: 7
- Borkenau P., 1991, Diagnostica, 37, 29
- Heller K. A., 2000, Kognitiver Fähigkeitstest für 4. bis 12. Klasse [Cognitive ability test for grades 4 through 12]
- 10.1080/1934574080253925 · doi:10.1080/1934574080253925
- Institute of Education Studies, 2008, What works clearinghouse: Procedures and standards handbook, version 3.0
- 10.1037//1082-989x.7.2.178 · doi:10.1037//1082-989x.7.2.178
- 10.3102/0034654315617832 · DOI · Paper page
- Muthén L. K., 1998, Mplus user's guide, seventh edition
Cited by
Domain-specific self-regulated learning interventions for elementary school students
Lee, M., Lee, S. Y., Kim, J., & Lee, H. J. (2023) · Learning and Instruction · doi:10.1016/j.learninstruc.2023.101810 · Cited by 109
The Relevance of Relevance for Learning and Performance
Alexander, P. A. (2017) · The Journal of Experimental Education · doi:10.1080/00220973.2017.1380592 · Cited by 105
Fütterer, T., Scheiter, K., Cheng, X. C., & Stürmer, K. (2022) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2022.102042 · Cited by 84
Backfisch, I., Sibley, L., Lachner, A., Kirchner, K. T., Hische, C., & Scheiter, K. (2024) · Teaching and Teacher Education · doi:10.1016/j.tate.2024.104532 · Cited by 68
Panayiotou, M., Humphrey, N., & Hennessey, A. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000360 · Cited by 49
Metadata
- Authors
- Nagengast, B., Brisson, B. M., Hulleman, C. S., Gaspard, H., Häfner, I., & Trautwein, U.
- Affiliations
- University of Tübingen (DE)
- University of Virginia (US)
- Corresponding author
- Nagengast, Benjamin
- Venue
- The Journal of Experimental Education
- Publisher
- Informa UK Limited
- Published
- 2017-03-10
- Volume
- 86
- Issue
- 1
- Pages
- 105-123
- ISSN
- 0022-0973 (ISSN-L)
- 1940-0683
- OpenAlex
- W2592932604
- Cited by
- 24
- References
- 42
- Citations by year
- 2026: 3 · 2025: 1 · 2024: 3 · 2023: 4 · 2022: 4 · 2020: 5 · 2019: 2 · 2018: 1 · 2017: 1
- FWCI
- 1.72
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Experimental Education (publishedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Education › School Choice and Performance
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Keywords
- medication adherence, intervention fidelity, student reflection, ninth grade students, learning outcomes, educational intervention effectiveness, randomized evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Learning More From Educational Intervention Studies: Estimating Complier Average Causal Effects in a Relevance Intervention. https://app.cochat.ai/papers/10.1080/00220973.2017.1289359
- The paper
- Nagengast, B., Brisson, B. M., Hulleman, C. S., Gaspard, H., Häfner, I., & Trautwein, U. (2018). Learning More From Educational Intervention Studies: Estimating Complier Average Causal Effects in a Relevance Intervention. The Journal of Experimental Education. https://doi.org/10.1080/00220973.2017.1289359
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.