The DOI matches its Crossref record.
The Causal Analysis of Cognitive Outcomes in the Coleman, Hoffer and Kilgore Report
Abstract
In their report to the National Center for Education Statistics, James Coleman, Thomas Hoffer and Sally Kilgore (henceforth referred to as CHK) (1981) address three questions with respect to cognitive outcomes (= test scores) in the American high school system (= 3 sectors: public, Catholic and other-private): (1) Do mnean test scores differ across the three sectors? (2) Do the sectors actually produce the differences in outcome? (3) How do the sectors produce those differences-that is, by what policies do they accomplish their effects? CHK provide these answers: (1) Yes: Mean test scores are higher in the private sectors than in the public sector. (2) Yes: Test scores are higher in the private sector even after controlling for differences in student characteristics. Furthermore, the private sectors produce larger gains in test scores during the last two years of high schoolthan does the public sector. Furthermore, the Catholic come closer to the common schoorl ideal, by educating students of varying background more nearly alike than do the other-private and public schools. (3) The private produce their higher test scores by placing higher academic demands and imposing stricter discipline on their students than do the public schools. Our task is to assess the validity of these answers-that is, to evaluate the evidence and reasoning that generated them. We have been handicapped by the style of the Report, a document of 233 pages + appendices. Elaborate calculations from various regression equations are given, but the equations themselves are rarely presented. Sample sizes are seldom in-, dicated. The definitions of variables are often cryptic. In such circumstances one might want to rely on the objectivity and scientific judgment of the authors as a substitute for the documentation one expects to find in a scientific report. But there is so much advocacy in the CHK Report that this option was unavailable to us. We have, however, been assisted by access to some of the authors' computer output provided to us on request and by access to unpublished studies by others who have been reanalyzing the original data set. Finally, we have tapped CHK's article, Cognitive outcomes in public and private schools (Coleman et al., 1982), and Coleman's own restatement, Private schools, public and the public interest (Coleman, 1981). Our summary assessments are that the methods and interpretations used by CHK fall below the minimum standards for socialscientific research, and that the CHK answers to the questions posed above are not warranted by their evidence.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Selection on observed and unobserved variables: Assessing the effectiveness of Catholic schools
Altonji, J. G., Elder, T. E., & Taber, C. R. (2005) · Journal of Political Economy · doi:10.1086/426036 · Cited by 3,706
(1986) · Journal of Economic Literature · Cited by 2,705
Card, D., & Krueger, A. (1990) · National Bureau of Economic Research · doi:10.3386/w3358 · Cited by 1,236
A Hierarchical Model for Studying School Effects
Raudenbush, S., & Bryk, A. S. (1986) · Sociology of Education · doi:10.2307/2112482 · Cited by 818
Finishing High School and Starting College: Do Catholic Schools Make a Difference?
Evans, W. N., & Schwab, R. M. (1995) · The Quarterly Journal of Economics · doi:10.2307/2946645 · Cited by 682
A Multilevel Model of the Social Distribution of High School Achievement
Lee, V. E., & Bryk, A. S. (1989) · Sociology of Education · doi:10.2307/2112866 · Cited by 654
Rouse, C. E. (1998) · The Quarterly Journal of Economics · doi:10.1162/003355398555685 · Cited by 570
The Stratification of High School Learning Opportunities
Gamoran, A. (1987) · Sociology of Education · doi:10.2307/2112271 · Cited by 526
Politics, Markets, and the Organization of Schools
Chubb, J. E., & Moe, T. M. (1988) · American Political Science Review · doi:10.2307/1961750 · Cited by 389
Multilevel Models: Methods and Substance
DiPrete, T. A., & Forristal, J. D. (1994) · Annual Review of Sociology · doi:10.1146/annurev.so.20.080194.001555 · Cited by 370
The Effects of Stratification in Secondary Schools: Synthesis of Survey and Ethnographic Research
Gamoran, A., & Berends, M. (1987) · Review of Educational Research · doi:10.2307/1170430 · Cited by 354
The Variable Effects of High School Tracking
Gamoran, A. (1992) · American Sociological Review · doi:10.2307/2096125 · Cited by 335
Effects of single-sex secondary schools on student achievement and attitudes.
Lee, V. E., & Bryk, A. S. (1986) · Journal of Educational Psychology · doi:10.1037//0022-0663.78.5.381 · Cited by 331
Rosenbaum, P. R. (1984) · Journal of the American Statistical Association · doi:10.1080/01621459.1984.10477060 · Cited by 279
Counterfactuals, Causal Effect Heterogeneity, and the Catholic School Effect on Learning
Morgan, S. L. (2001) · Sociology of Education · doi:10.2307/2673139 · Cited by 269
Barnard, J., Frangakis, C. E., Hill, J. L., & Rubin, D. B. (2003) · Journal of the American Statistical Association · doi:10.1198/016214503000071 · Cited by 268
Achievement Growth in Public and Catholic Schools
Hoffer, T., Greeley, A. M., & Coleman, J. S. (1985) · Sociology of Education · doi:10.2307/2112249 · Cited by 262
Curriculum Tracking as Mediating the Social Distribution of High School Achievement
Lee, V. E., & Bryk, A. S. (1988) · Sociology of Education · doi:10.2307/2112266 · Cited by 258
An Evaluation of Instrumental Variable Strategies for Estimating the Effects of Catholic Schools
Altonji, J., Elder, T., & Taber, C. (2002) · National Bureau of Economic Research · doi:10.3386/w9358 · Cited by 256
Metadata
- Authors
- Goldberger, A. S., & Cain, G. G.
- Venue
- Sociology of Education
- Publisher
- JSTOR
- Published
- 1982-04
- Volume
- 55
- Issue
- 2/3
- Pages
- 103
- ISSN
- 0038-0407 (ISSN-L)
- OpenAlex
- W2027199850
- Cited by
- 177
- References
- 0
- FWCI
- 67.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.