Assessing the impact of school-based mentoring: Common problems and solutions associated with evaluating nonprescriptive youth development programs
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Like many youth development programs, most youth mentoring programs do not have prescribed practices that target specific outcomes. Because the construct of mentoring represents a broad range of potential activities, researchers face a conundrum when making generalizable causal inferences about the effects of this and similar services. On the one hand, researchers cannot make valid experimental inferences if they do not describe what they manipulate. On the other hand, experiments that include prescribed protocols do not generalize to most mentoring programs. In most cases, researchers conducting school-based mentoring program evaluations err on the side of not sufficiently specifying treatment constructs, which limits the field’s ability to make practically or theoretically useful inferences about this service. We discuss this reality in light of the fundamental logic of the experimental design and suggest several possible solutions to this conundrum. Our goal is to empower researchers to adequately specify treatments while still preserving the treatment construct validity of this and similar interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
How Effective Are Mentoring Programs for Youth? A Systematic Assessment of the Evidence
DuBois, D. L., Portillo, N., Rhodes, J. E., Silverthorn, N., & Valentine, J. C. (2011) · Psychological Science in the Public Interest · doi:10.1177/1529100611414806 · Cited by 889 · cited 2×
“A counterargument, though, is that youth mentoring will continue to yield outcomes of modest magnitude (see, again, DuBois et al., 2011) unless greater attention is given to this beginning step of model specification.”
BackgroundGottfredson, D. C., Cook, T. D., Gardner, F. E. M., Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015) · Prevention Science · doi:10.1007/s11121-015-0555-x · Cited by 627 · cited 2×
“For example, evaluations of the effects of interventions that are being widely implemented in a community but have not previously undergone randomized efficacy trials have great promise for identifying interventions with significant public health impact (Gottfredson et al., 2015, p. 3).”
BackgroundMethodEvidence-based Kernels: Fundamental Units of Behavioral Influence
Embry, D. D., & Biglan, A. (2008) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-008-0036-x · Cited by 396 · cited 1×
“Embry and Biglan (2008), for example, identified 52 elements (called behavioral kernels) associated with a variety of positive behavioral and educational outcomes.”
BackgroundMentoring in schools: an impact study of big brothers’ big sisters’ school-based mentoring
Herrera, C., Grossman, J. B., Kauh, T. J., & McMaken, J. (2011) · Child Development · doi:10.1111/j.1467-8624.2010.01559.x · Cited by 318
DuBois, D., & Karcher, M. (2014) · doi:10.4135/9781412996907 · Cited by 306
Budd, R., & Hughes, I. (2009) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.648 · Cited by 149
The impact of school-based mentoring on youths with different relational profiles
Schwartz, S. E. O., Rhodes, J. E., Chan, C. S., & Herrera, C. (2011) · Developmental Psychology · doi:10.1037/a0021379 · Cited by 114
Bayer, A., Grossman, J. B., & DuBois, D. L. (2015) · Journal of Community Psychology · doi:10.1002/jcop.21693 · Cited by 96
School-Based Mentoring for Adolescents: A Systematic Review and Meta-Analysis
Wood, S., & Mayo-Wilson, E. (2012) · Research on Social Work Practice · doi:10.1177/1049731511430836 · Cited by 83
Youth mentoring with a balanced focus, shared purpose, and collaborative interactions
Karcher, M. J., & Nakkula, M. J. (2010) · New Directions for Youth Development · doi:10.1002/yd.347 · Cited by 78
Research works printed but not linked: 43
- Bernstein L., 2009, Impact evaluation of the U.S. Department of Education’s Student Mentoring Program
- 10.1177/019251396017005004 · DOI · Paper page
- Bruce M., 2014, The mentoring effect: Young people’s perspectives on the outcomes and availability of mentoring. A report for MENTOR: The national mentoring partnership
- 10.1016/S1054-139X(02)00496-2 · DOI · Paper page
- 10.4135/9781412996907.n3 · DOI
- 10.1007/s11020-005-1962-6 · DOI · Paper page
- Cooper F. E., 2005, Mentoring programs funded by the federal government dedicated to disadvantaged youth: Issues and activities
- 10.1002/jcop.20122 · DOI · Paper page
- Fernandes-Alcantara A. L., 2015, Vulnerable youth: Federal mentoring programs and issues
- Fisher S. R. A., 1935, The design of experiments
- 10.1037/0022-0663.100.3.491 · DOI · Paper page
- 10.1016/S0005-7894(86)80091-0 · DOI · Paper page
- Gearing B., 2008, School based mentoring and academic achievement: Connecting students to the instructional program through mentoring relationships
- 10.1016/j.jadohealth.2006.08.004 · DOI
- 10.1007/s10464-011-9435-0 · DOI · Paper page
- Grossman J. B., 1997, Mentoring: A proven delinquency prevention strategy
- Herrera C., 2007, Making a difference in schools: The big brothers big sisters school-based mentoring impact study
- 10.1007/s11121-008-0083-z · DOI · Paper page
- 10.1016/j.addbeh.2016.08.036 · DOI
- 10.1146/annurev-clinpsy-032511-143152PMCJournal · doi:10.1146/annurev-clinpsy-032511-143152pmcjournal
- Lerner J. V., 2013, Comprehensive handbook of psychology: Developmental psychology, 6, 365
- 10.1177/0743554896111007 · DOI · Paper page
- Mboka A. K., 2012, Kriminologija & Socijalna Integracija, 20, 83
- MENTOR, 2015, Elements of effective practice for mentoring
- 10.1002/jcop.20475 · DOI · Paper page
- 10.1080/13611267.2015.1047630 · DOI · Paper page
- 10.1002/jcop.21719 · DOI
- 10.1080/1754730X.2016.1148620 · DOI · Paper page
- 10.1080/1754730X.2013.832009 · DOI
- Morrow K. V., 1995, Building relationships with youth in program settings: A study of big brothers/big sisters
- 10.1016/j.jsat.2016.01.001 · DOI · Paper page
- 10.1007/s11414-012-9295-x · DOI · Paper page
- 10.1002/jcop.10016 · DOI · Paper page
- 10.1007/s10560-012-0260-6 · DOI
- 10.1002/jcop.20487 · DOI · Paper page
- 10.1093/cs/30.3.177 · DOI · Paper page
- 10.1111/j.1467-8721.2008.00585.x · DOI · Paper page
- 10.1080/10888691.2015.1113879 · DOI · Paper page
- 10.1177/0272431696016004001 · DOI · Paper page
- Sechrest L., 1979, Evaluation studies review annual, 4
- 10.1002/pam.10129 · DOI · Paper page
- 10.4135/9781412976664.n5 · DOI
- 10.1002/pam.21760 · DOI · Paper page
Cited by
Lyons, M. D., McQuillin, S. D., & Henderson, L. J. (2019) · American Journal of Community Psychology · doi:10.1002/ajcp.12283 · Cited by 68
McQuillin, S. D., & McDaniel, H. L. (2021) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.14334 · Cited by 16
Self-citationAlwani, N. A., Lyons, M. D., & Edwards, K. D. (2023) · Journal of Community Psychology · doi:10.1002/jcop.22938 · Cited by 4
Self-citationTiraieyari, N., & Krauss, S. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1518053
Metadata
- Authors
- McQuillin, S. D., Lyons, M. D., Clayton, R. J., & Anderson, J. R.
- Venue
- Applied Developmental Science
- Publisher
- Informa UK Limited
- Published
- 2018-05-10
- Volume
- 24
- Issue
- 3
- Pages
- 215-229
- ISSN
- 1088-8691 (ISSN-L)
- 1532-480X
- OpenAlex
- W2800618884
- Cited by
- 27
- References
- 13
- FWCI
- 5.16
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Assessing the impact of school-based mentoring: Common problems and solutions associated with evaluating nonprescriptive youth development programs. https://app.cochat.ai/papers/10.1080/10888691.2018.1454837
- The paper
- McQuillin, S. D., Lyons, M. D., Clayton, R. J., & Anderson, J. R. (2020). Assessing the impact of school-based mentoring: Common problems and solutions associated with evaluating nonprescriptive youth development programs. Applied Developmental Science. https://doi.org/10.1080/10888691.2018.1454837
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.