Cited by 482Educational Assessment and ImprovementTeacher Education and AssessmentsSchool Choice and Performance

The Myth of the Texas Miracle in Education

Open access
Haney, Walt·2000·Education Policy Analysis Archives

Abstract

I summarize the recent history of education reform and statewide testing in Texas, which led to introduction of the Texas Assessment of Academic Skills (TAAS) in 1990-91. A variety of evidence in the late 1990s led a number of observers to conclude that the state of Texas had made near miraculous progress in reducing dropouts and increasing achievement. The passing scores on TAAS tests were arbitrary and discriminatory. Analyses comparing TAAS reading, writing and math scores with one another and with relevant high school grades raise doubts about the reliability and validity of TAAS scores. I discuss problems of missing students and other mirages in Texas enrollment statistics that profoundly affect both reported dropout statistics and test scores. Only 50% of minority students in Texas have been progressing from grade 9 to high school graduation since the initiation of the TAAS testing program. Since about 1982, the rates at which Black and Hispanic students are required to repeat grade 9 have climbed steadily, such that by the late 1990s, nearly 30% of Black and Hispanic students were "failing" grade 9. Cumulative rates of grade retention in Texas are almost twice as high for Black and Hispanic students as for White students. Some portion of the gains in grade 10 TAAS pass rates are illusory. The numbers of students taking the grade 10 tests who were classified as "in special education" and hence not counted in schools' accountability ratings nearly doubled between 1994 and 1998. A substantial portion of the apparent increases in TAAS pass rates in the 1990s are due to such exclusions. In the opinion of educators in Texas, schools are devoting a huge amount of time and energy preparing students specifically for TAAS, and emphasis on TAAS is hurting more than helping teaching and learning in Texas schools, particularly with at-risk students, and TAAS contributes to retention in grade and dropping out. Five different sources of evidence about rates of high school completion in Texas are compared and contrasted. The review of GED statistics indicated that there was a sharp upturn in numbers of young people taking the GED tests in Texas in the mid-1990s to avoid TAAS. A convergence of evidence indicates that during the 1990s, slightly less than 70% of students in Texas actually graduated from high school. Between 1994 and 1997, TAAS results showed a 20% increase in the percentage of students passing all three exit level TAAS tests (reading, writing and math), but TASP (a college readiness test) results showed a sharp decrease (from 65.2% to 43.3%) in the percentage of students passing all three parts (reading, math, and writing). As measured by performance on the SAT, the academic learning of secondary school students in Texas has not improved since the early 1990s, compared with SAT takers nationally. SAT-Math scores have deteriorated relative to students nationally. The gains on NAEP for Texas fail to confirm the dramatic gains apparent on TAAS. The gains on TAAS and the unbelievable decreases in dropouts during the 1990s are more illusory than real. The Texas "miracle" is more hat than cattle.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.14507/epaa.v8n41.2000

Cites

2 of 2 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In the United States, the implementation of standards and standardized testing in states such as Texas and New York has resulted in more students leaving school, students living in poverty and students of color being forced out of school, and increasing disparity between the wealthier and poorer districts.

    “In the United States, the implementation of standards and standardized testing in states such as Texas and New York has resulted in more students leaving school, students living in poverty and students of color being forced out of school, and increasing disparity between the wealthier and poorer districts (Haney, 2000;Orfield et al, 2004;Winter, 2004).”

    From Neo-Liberalism, Markets and Accountability: Transforming Education and Undermining Democracy in the United States and England (2005) · cites this paper as Haney, 2000

    The section “Emphasis on TAAS contributes to retention in grade and dropping out of school” says Texas testing contributed to students leaving school, and “Emphasis on TAAS is particularly harmful to at-risk students” describes concerns about lower-income students. The paper also reports disproportionately poor progression for Black and Hispanic students in “Hazards of High Stakes Testing.” These passages do not establish the claim about New York or increasing disparities between wealthier and poorer districts; the evidence on lower-income students also does not specifically show that they were forced out of school. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 41

  1. Arrow, K. J. (1950). A difficulty in the concept of social welfare. Journal of political economy. 58, 328-346. http://epaa.asu.edu/epaa/v8n41/refs.htm (4 of 11)7/30/2004 4:39:11 AM EPAA Vol. 8 No. 41 Haney: The Myth of the Texas Miracle in Education--Notes and References
  2. Barasch, S. et al. (1990). ARCO GED High School Equivalency Examination. NY: Prentice Hall.
  3. Becker, B. J. (1990). Coaching for the Scholastic Aptitude Test: Further synthesis and appraisal. Review of Educational Research, 60(3), 373-417.
  4. Berk, R. (1986). A consumer's guide to setting performance standards on criterion-referenced tests. Review of Educational Research, 56(1), 137-172.
  5. Cameron, S. V. and Heckman, J.J. (1993), "The Nonequivalence of High School Equivalents," Journal of Labor Economics, 11(1) Part 1, 1-47.
  6. Cannell, J. J. (1988). Nationally normed elementary achievement testing in America's public schools: How all 50 states are above the national average. Educational Measurement: Issues and Practice, 7 (2), 5-9.
  7. Catterall, J. S. (1989). Standards and school dropouts: A national study of tests required for graduation. American Journal of Education, 98(1), 1-34.
  8. Dyer, H. S. (1973). Does Coaching Help? College Board Review, 19, 331-335.
  9. Fienberg, S. (1989). The evolving role of statistical assessments as evidence in courts. (Report of the Panel on Statistical Assessments as Evidence in Courts of the National Research Council.) NY: Springer-Verlag.
  10. Scottsdale, AZ: Gorsuch Scarisbrick. GED Testing Service. (1989-1998). Statistical Reports, 1989, 1990, 1991, 1992, 1994, 1996, 1997, 1998.
  11. Gilmore, M. E. (1927). Coaching for intelligence tests. Journal of Educational and Psychological Measurement, 19, 319-330.
  12. Glass, G. V. (1978). Standards and criteria. Journal of Educational Measurement, 15, 237-261.
  13. Glass, G.V, McGaw, B. and Smith, M.L. (1981) Meta-analysis in Social Research. Beverly Hills, CA: SAGE Publications.
  14. Gordon, S. P. and Reese, M. High stakes testing: Worth the price? Journal of School Leadership. Volume 7 ( July 1997) 345-368.
  15. Haladyna, T. M., Nolen, S. B., & Haas, N. S. (1991). Raising standardized test scores and the origins of test score pollution. Educational Researcher, 20(5), 2-7.
  16. Haney, W. (1993). Testing and minorities. In Weis, L. & Fine, M. (Eds). Beyond silence: Class, race and gender in United States schools. Albany, NY: State University of New York Press, pp. 45-73.
  17. Chestnut Hill, MA: Boston College Center for the Study of Testing Evaluation and Educational Policy. (Portions of this report have been published in volume 2, number 2 issue of The Scholar: St. Mary's Law Review on Minority Issues).
  18. Haney, W. (1999). Supplementary report on Texas Assessment of Academic Skills Exit Test (TAAS- X). Chestnut Hill, MA: Boston College Center for the Study of Testing Evaluation and Educational Policy. (Portions of this report have been published in volume 2, number 2 issue of The Scholar: St. Mary's Law Review on Minority Issues).
  19. Hauser, R. M. (1997). Indicators of High School Completion and Dropout. Pp. 152-84 in R. M. Hauser, B. V. Brown, and W. Prosser (Eds.) Indicators of Children's Well-Being. New York: Russell Sage Foundation.
  20. Heubert, J. & Hauser, R. (Eds.) (1999). High Stakes: Testing for Tracking, Promotion, and Graduation. A Report of the National Research Council, Washington, D.C.: National Academy Press.
  21. Hoel, P. (1971). Introduction to mathematical statistics . NY: Wiley, 1971.
  22. Jaynes, G., D. and Williams, R.n. W. (Eds.) (1989). A common destiny: Blacks and American society. National Academy Press.
  23. Jerald, C. (2000). The state of the states. Education Week (January 13, 2000) pp. 62-163.
  24. Wigdor, A. K. & Garner, W. R. Ability testing: Uses consequences and controversies. Part II. Washington, D.C. National Academy Press. Pp. 335-388.
  25. Linn, R. L., Graue, M. E., and Sanders, N. M. (1990). Comparing state and district test results to national norms: The validity of claims that "everyone is above average". Educational Measurement: Issues and Practice, 9(3), 5-14.
  26. Linton, T.H. and Debiec, M. (1992). The secondary level TAAS test: An analysis of the 70% mastery level. Paper presented to the Texas Testing Conference, Austin, Texas, March 2-4, 1992.
  27. Murdock, S., Hoque, M. N., Michael, M., White, S., & Pecotte, B.. (1997). The Texas challenge: Population change and the future of Texas. College Station, TX: Texas A&M University Press.
  28. Murnane, R. J., J. B. Willett, and J. H. Tyler. (2000) Who Benefits from Obtaining a GED?: Evidence from High School and Beyond? Review of Economics and Statistics, 82:1, 23-37
  29. National Education Goals Panel, (November 5, 1998). North Carolina and Texas Recognized as Models for Boosting Student Achievement (press release). Washington, D.C.: National Education Goals Panel. Office of Civil Rights (1999). The use of tests when making high-stakes decisions for students: A resource guide for educators and policy-makers. (Draft) Washington, D.C.: U.S. Department of Education. Office of Technology Assessment. (1987). State Educational Testing Practices. (Background Paper, December 1987).
  30. Palmaffy, T. (1998). The Gold Star State: How Texas jumped to the head of the class in elementary school achievement. Policy Review (March-April, 1998). No. 88. (http://www.policyreview.com// mar98/goldstar.html)
  31. Schumpeter, J. A. (1954). History of economic analysis. NY: Oxford University press.
  32. Shepard, L. A. (1990). Inflated test score gains: Is the problem old norms or teaching to the test? Educational Measurement: Issues and Practice, 9(3), 15-22.
  33. Shepard, L.A. & Smith, M.L. (1989) Flunking Grades: Research and Policies on Retention. London: The Falmer Press.
  34. Balfanz, R. & Letgers, N. (2001). How many central city high schools have a sever dropout problem, where are they located and who attends them? Paper presented at the Dropout Research: Accurate Counts and Positive Interventions Conference Sponsored by Achieve and the Harvard Civil Rights Project, January 13, 2001, Cambridge MA.
  35. Callahan, Raymond, E. Education and the cult of efficiency from 1910 to 1930. Chicago: University of Chicago Press, 1962.
  36. Cameron, S. V. and Heckman, J. J. (1993), "The Nonequivalence of High School Equivalents," Journal of Labor Economics, 11(1) Part 1, 1-47.
  37. Cannell, J. J. (1988). Nationally normed elementary achievement testing in America's public schools: How all 50 states are above the national average. Educational Measurement: Issues and Practice, 7(2), 5-9.
  38. Holland, P. & Rubin, D. (Eds.). (1982). Test equating. New York: Academic Press.
  39. Murnane, R. J., Willett, J. B. , and Tyler, J. H.. (2000). Who benefits from obtaining a GED?: Evidence from High School and Beyond? Review of Economics and Statistics, 82:1, 23-37.
  40. Thorndike, E. L. (1907). The elimination of pupils from school. Education Bulletin, No. 4. Series No. 379. Wash., D.C: U.S. Government Printing Office.
  41. Tyack, D. B. (1974). The one best system. Cambridge, MA: Harvard University Press.

Cited by

Authors
Haney, W.
Affiliations
Boston College (US)
Corresponding author
Haney, Walt
Venue
Education Policy Analysis Archives
Published
2000-08-19
Volume
8
Pages
41
ISSN
1068-2341 (ISSN-L)
OpenAlex
W2022310841
Cited by
482
References
2
Citations by year
2026: 1 · 2025: 4 · 2024: 2 · 2023: 1 · 2022: 3 · 2021: 1 · 2020: 9 · 2019: 9 · 2018: 8 · 2017: 14 · 2016: 19 · 2015: 7 · 2014: 17 · 2013: 22 · 2012: 21
FWCI
106.07
Type
journal article
Language
en
Open access
Licence
cc-by-sa
Locations
  • Education Policy Analysis Archives (publishedVersion, cc-by-sa)
  • Digital Commons - University of South Florida (University of South Florida) (submittedVersion, cc-by-nc-nd)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
Boston College
Topics
  • Social Sciences › Decision Sciences › Information Systems and Management › Educational Assessment and Improvement
  • Social Sciences › Education › Teacher Education and Assessments
  • Social Sciences › Education › School Choice and Performance
Keywords
Texas Assessment of Academic Skills, standardized testing, educational reform, high school dropout, school retention, test score validity, racial inequality in education, GED, school accountability, at-risk students, Texas education policy, graduation rates, student enrollment statistics, Black and Hispanic students, California, New York, New Jersey

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review