CoChat

Assessing the impact of school-based mentoring: Common problems and solutions associated with evaluating nonprescriptive youth development programs

McQuillin, Samuel D., Lyons, Michael D., Clayton, Rebecca J., Anderson, Jacqueline R. · 2020 · Applied Developmental Science
Cited by 27

The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.

Abstract

Like many youth development programs, most youth mentoring programs do not have prescribed practices that target specific outcomes. Because the construct of mentoring represents a broad range of potential activities, researchers face a conundrum when making generalizable causal inferences about the effects of this and similar services. On the one hand, researchers cannot make valid experimental inferences if they do not describe what they manipulate. On the other hand, experiments that include prescribed protocols do not generalize to most mentoring programs. In most cases, researchers conducting school-based mentoring program evaluations err on the side of not sufficiently specifying treatment constructs, which limits the field’s ability to make practically or theoretically useful inferences about this service. We discuss this reality in light of the fundamental logic of the experimental design and suggest several possible solutions to this conundrum. Our goal is to empower researchers to adequately specify treatments while still preserving the treatment construct validity of this and similar interventions.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1080/10888691.2018.1454837

Cites

13 of 13 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 13 references

Research works printed but not linked: 43

  1. Bernstein L., 2009, Impact evaluation of the U.S. Department of Education’s Student Mentoring Program
  2. 10.1177/019251396017005004 · DOI · Paper page
  3. Bruce M., 2014, The mentoring effect: Young people’s perspectives on the outcomes and availability of mentoring. A report for MENTOR: The national mentoring partnership
  4. 10.1016/S1054-139X(02)00496-2 · DOI · Paper page
  5. 10.4135/9781412996907.n3 · DOI
  6. 10.1007/s11020-005-1962-6 · DOI · Paper page
  7. Cooper F. E., 2005, Mentoring programs funded by the federal government dedicated to disadvantaged youth: Issues and activities
  8. 10.1002/jcop.20122 · DOI · Paper page
  9. Fernandes-Alcantara A. L., 2015, Vulnerable youth: Federal mentoring programs and issues
  10. Fisher S. R. A., 1935, The design of experiments
  11. 10.1037/0022-0663.100.3.491 · DOI · Paper page
  12. 10.1016/S0005-7894(86)80091-0 · DOI · Paper page
  13. Gearing B., 2008, School based mentoring and academic achievement: Connecting students to the instructional program through mentoring relationships
  14. 10.1016/j.jadohealth.2006.08.004 · DOI
  15. 10.1007/s10464-011-9435-0 · DOI · Paper page
  16. Grossman J. B., 1997, Mentoring: A proven delinquency prevention strategy
  17. Herrera C., 2007, Making a difference in schools: The big brothers big sisters school-based mentoring impact study
  18. 10.1007/s11121-008-0083-z · DOI · Paper page
  19. 10.1016/j.addbeh.2016.08.036 · DOI
  20. 10.1146/annurev-clinpsy-032511-143152PMCJournal · doi:10.1146/annurev-clinpsy-032511-143152pmcjournal
  21. Lerner J. V., 2013, Comprehensive handbook of psychology: Developmental psychology, 6, 365
  22. 10.1177/0743554896111007 · DOI · Paper page
  23. Mboka A. K., 2012, Kriminologija & Socijalna Integracija, 20, 83
  24. MENTOR, 2015, Elements of effective practice for mentoring
  25. 10.1002/jcop.20475 · DOI · Paper page
  26. 10.1080/13611267.2015.1047630 · DOI · Paper page
  27. 10.1002/jcop.21719 · DOI
  28. 10.1080/1754730X.2016.1148620 · DOI · Paper page
  29. 10.1080/1754730X.2013.832009 · DOI
  30. Morrow K. V., 1995, Building relationships with youth in program settings: A study of big brothers/big sisters
  31. 10.1016/j.jsat.2016.01.001 · DOI · Paper page
  32. 10.1007/s11414-012-9295-x · DOI · Paper page
  33. 10.1002/jcop.10016 · DOI · Paper page
  34. 10.1007/s10560-012-0260-6 · DOI
  35. 10.1002/jcop.20487 · DOI · Paper page
  36. 10.1093/cs/30.3.177 · DOI · Paper page
  37. 10.1111/j.1467-8721.2008.00585.x · DOI · Paper page
  38. 10.1080/10888691.2015.1113879 · DOI · Paper page
  39. 10.1177/0272431696016004001 · DOI · Paper page
  40. Sechrest L., 1979, Evaluation studies review annual, 4
  41. 10.1002/pam.10129 · DOI · Paper page
  42. 10.4135/9781412976664.n5 · DOI
  43. 10.1002/pam.21760 · DOI · Paper page

Cited by

See all 27

Metadata

Authors
McQuillin, S. D., Lyons, M. D., Clayton, R. J., & Anderson, J. R.
Venue
Applied Developmental Science
Published
2018-05-10
Volume
24
Issue
3
Pages
215-229
ISSN
  • 1088-8691 (ISSN-L)
  • 1532-480X
OpenAlex
W2800618884
Cited by
27
References
13
FWCI
5.16
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Assessing the impact of school-based mentoring: Common problems and solutions associated with evaluating nonprescriptive youth development programs. https://app.cochat.ai/papers/10.1080/10888691.2018.1454837
The paper
McQuillin, S. D., Lyons, M. D., Clayton, R. J., & Anderson, J. R. (2020). Assessing the impact of school-based mentoring: Common problems and solutions associated with evaluating nonprescriptive youth development programs. Applied Developmental Science. https://doi.org/10.1080/10888691.2018.1454837

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.