High-Stakes Testing and Curricular Control: A Qualitative Metasynthesis
The DOI matches its Crossref record; 91 of the 99 references it cites were found in a registry or an index.
Abstract
Using the method of qualitative metasynthesis, this study analyzes 49 qualitative studies to interrogate how high-stakes testing affects curriculum, defined here as embodying content, knowledge form, and pedagogy. The findings from this study complicate the understanding of the relationship between high-stakes testing and classroom practice by identifying contradictory trends. The primary effect of high-stakes testing is that curricular content is narrowed to tested subjects, subject area knowledge is fragmented into test-related pieces, and teachers increase the use of teacher-centered pedagogies. However, this study also finds that, in a significant minority of cases, certain types of high-stakes tests have led to curricular content expansion, the integration of knowledge, and more student-centered, cooperative pedagogies. Thus the findings of the study suggest that the nature of high-stakes-test-induced curricular control is highly dependent on the structures of the tests themselves.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Socioeconomic Status and Academic Achievement: A Meta-Analytic Review of Research
Sirin, S. R. (2005) · Review of Educational Research · doi:10.3102/00346543075003417 · Cited by 4,687 · cited 1×
“As such, I am interested in the relationship between high-stakes testing and inequalities associated with race and socioeconomic status (see, e.g., Hunter & Bartee, 2003; Kim & Sunderman, 2005; Sirin, 2005).”
Background(1999) · Practitioner Research in Counselling · doi:10.4135/9781849209588.n8 · Cited by 3,958
Realist review - a new method of systematic review designed for complex policy interventions
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005) · Journal of Health Services Research & Policy · doi:10.1258/1355819054308530 · Cited by 3,190 · cited 2×
“Second, reliability in template analysis is also improved when researchers are explicitly reflexive about both the process of their research and their positioning in relation to their study (King, 1998, 2006; Pawson et al., 2005).”
MethodNoblit, G., & Hare, R. (1988) · doi:10.4135/9781412985000 · Cited by 2,723
Meta-Ethnography: Synthesizing Qualitative Studies
Noblit, G. W., & Hare, R. D. (1988) · Medical Entomology and Zoology · Cited by 2,191
The Educational Imagination: On the Design and Evaluation of School Programs
Eisner, E. W. (1994) · Medical Entomology and Zoology · Cited by 1,877
Journal of Curriculum and Supervision
(2010) · Encyclopedia of Curriculum Studies · doi:10.4135/9781412958806.n274 · Cited by 1,852
Apple, M. W. (2012) · Routledge eBooks · doi:10.4324/9780203143124 · Cited by 1,494
Reclaiming reality: a critical introduction to contemporary philosophy
(1990) · Choice Reviews Online · doi:10.5860/choice.27-3818 · Cited by 1,253
(1998) · Choice Reviews Online · doi:10.5860/choice.35-5304 · Cited by 1,250
Crabtree, B. F., Miller, W. L., & Swenson, M. M. (1995) · Nursing Research · doi:10.1097/00006199-199507000-00011 · Cited by 956
Collateral damage: how high-stakes testing corrupts America's schools
(2008) · Choice Reviews Online · doi:10.5860/choice.46-1032 · Cited by 845
Qualitative methods and analysis in organizational research : a practical guide
Gillian Symon, B., & Cassell, C. M. (1998) · SAGE Publications Ltd eBooks · Cited by 815
Below the Bubble: “Educational Triage” and the Texas Accountability System
Booher-Jennings, J. (2005) · American Educational Research Journal · doi:10.3102/00028312042002231 · Cited by 762 · cited 3×
“However, after I undertook the template analysis, for instance, in addition to finding the theme ofnarrowing/contraction ~I DUCTIONAL RESEARGHER Table 2 Qualitative Metasynthesis Code Template Curriculum Code Content SAC-Subject matter content alignment, contraction SAE-Subject matter content alignment, expansion Know…”
InfluentialQualitative Metasynthesis: Reflections on Methodological Orientation and Ideological Agenda
Thorne, S., Jensen, L., Kearney, M. H., Noblit, G., & Sandelowski, M. (2004) · Qualitative Health Research · doi:10.1177/1049732304269888 · Cited by 749 · cited 2×
“Qualitative metasynthesis is part of a tradition ofmetaresearch that involves synthesizing the results of qualitative studies to gain a better understanding of the general nature ofa given phenomenon (DeWitt-Brinks & Rhodes, 1992; Thorne et al., 2004).”
BackgroundContradictions of School Reform: Educational Costs of Standardized Testing
McNeil, L. (2001) · NASSP Bulletin · doi:10.1177/0192636501085621011 · Cited by 731
High Stakes Education: Inequality, Globalization, and Urban School Reform
Lipman, P. (2003) · Cited by 535
Lipman, P. (2004) · Routledge eBooks · doi:10.4324/9780203465509 · Cited by 516
Using Codes and Code Manuals: A Template Organizing Style of Interpretation
Crabtree, B. F., & Miller, W. L. (1999) · Cited by 514
Put to the Test: The Effects of External Testing on Teachers
Smith, M. L. (1991) · Educational Researcher · doi:10.2307/1176396 · Cited by 509
High-stakes testing, uncertainty, and student learning
Amrein‐Beardsley, A., & Berliner, D. C. (2002) · Digital Commons - University of South Florida (University of South Florida) · Cited by 500
Tayler, J. L. (1925) · The Sociological Review · doi:10.1111/j.1467-954x.1925.tb02869.x · Cited by 492
Contradictions of School Reform: Educational Costs of Standardized Testing
Hall, T. (2001) · NASSP Bulletin · doi:10.1177/019263650108562111 · Cited by 378
The testing trap: how state writing assessments control learning
(2002) · Choice Reviews Online · doi:10.5860/choice.40-2300 · Cited by 376
Raising Standards or Raising Barriers?: Inequality and High Stakes Testing in Public Education
Orfield, G., & Kornhaber, M. L. (2001) · Medical Entomology and Zoology · Cited by 360
Philosophy of Social Science. The Philosophical Foundations of Social Thought
Moñivas, J. R., Benton, T., & Craib, I. (2005) · Reis · doi:10.2307/40184720 · Cited by 356
Reconsidering the Impact of High-stakes Testing
Braun, H. (2004) · Education Policy Analysis Archives · doi:10.14507/epaa.v12n1.2004 · Cited by 333
The unintended consequences of high-stakes testing
(2004) · Choice Reviews Online · doi:10.5860/choice.41-6045 · Cited by 291
The Influence of Testing on the Curriculum
Madaus, G. F., & Keillor, G. (1988) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146818808900505 · Cited by 279
High-Stakes Testing & Student Learning
Amrein, A. L., & Berliner, D. C. (2002) · Education Policy Analysis Archives · doi:10.14507/epaa.v10n18.2002 · Cited by 263
Performance-Based Assessment and Instructional Change: The Effects of Testing in Maine and Maryland
Firestone, W. A., Mayrowetz, D., & Fairman, J. C. (1998) · Educational Evaluation and Policy Analysis · doi:10.2307/1164376 · Cited by 260
The Harmful Impact of the TAAS System of Testing in Texas: Beneath the Accountability Rhetoric.
McNeil, L. M., & Valenzuela, A. (2000) · Cited by 253
Handbook of research on curriculum: a project of the American Educational Research Association
(1992) · Choice Reviews Online · doi:10.5860/choice.29-5811 · Cited by 240
No child left behind?: the politics and practice of school accountability
(2004) · Choice Reviews Online · doi:10.5860/choice.41-6672 · Cited by 240
Leaving children behind: how "Texas-style" accountability fails Latino youth
(2006) · Choice Reviews Online · doi:10.5860/choice.43-6026 · Cited by 229
Kim, J. S., & Sunderman, G. L. (2005) · Educational Researcher · doi:10.3102/0013189x034008003 · Cited by 229
Revisiting pedagogical content knowledge: the pedagogy of content/the content of pedagogy
Segall, A. (2004) · Teaching and Teacher Education · doi:10.1016/j.tate.2004.04.006 · Cited by 224
History lessons: teaching, learning, and testing in U.S. high school classrooms
(2004) · Choice Reviews Online · doi:10.5860/choice.41-2941 · Cited by 192
State-Mandated Testing and Teachers' Beliefs and Practice
Cimbricz, S. K. (2002) · Education Policy Analysis Archives · doi:10.14507/epaa.v10n2.2002 · Cited by 191
Educational Policy and Practice From the Perspective of Institutional Theory: Crafting a Wider Lens
Burch, P. (2007) · Educational Researcher · doi:10.3102/0013189x07299792 · Cited by 179
(2003) · Routledge eBooks · doi:10.4324/9780203465639 · Cited by 175
The Pedagogic Nature of Subject Matter Knowledge
McEwan, H., & Bull, B. (1991) · American Educational Research Journal · doi:10.2307/1162943 · Cited by 165
Agee, J. (2004) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1111/j.1467-9620.2004.00357.x · Cited by 151
How Teachers’ Professional Identities Position High-Stakes Test Preparation in Their Classrooms
Rex, L. A., & Nelson, M. C. (2004) · Teachers College Record The Voice of Scholarship in Education · doi:10.1111/j.1467-9620.2004.00380.x · Cited by 148
Lipman, P. (2002) · American Educational Research Journal · doi:10.3102/00028312039002379 · Cited by 145
Acquiescence, Accommodation, and Resistance in Learning to Teach within a Prescribed Curriculum
Smagorinsky, P., Lakly, A., & Johnson, T. S. (2002) · English Education · doi:10.58680/ee20021609 · Cited by 140
Reinterpretations Across Studies: An Approach to Meta-Analysis
McCormick, J., Rodney, P., & Varcoe, C. (2003) · Qualitative Health Research · doi:10.1177/1049732303253480 · Cited by 127
An Analysis of Some Unintended and Negative Consequences of High-Stakes Testing
Amrein‐Beardsley, A., & Berliner, D. C. (2002) · CU Scholar (University of Colorado Boulder) · Cited by 119
Measuring history : cases of state-level testing across the United States
Grant, S. G. (2006) · Cited by 112
Segall, A. (2003) · Theory & Research in Social Education · doi:10.1080/00933104.2003.10473227 · Cited by 97
Differentiation and High-Stakes Testing: An Oxymoron?
Brimijoin, K. (2005) · Theory Into Practice · doi:10.1207/s15430421tip4403_10 · Cited by 94
The New Accountability, Student Failure, and Teachers' Work in Urban High Schools
Anagnostopoulos, D. (2003) · Educational Policy · doi:10.1177/0895904803017003001 · Cited by 94
The learning environment and the curriculum
Harden, R. M. (2001) · Medical Teacher · doi:10.1080/01421590120063321 · Cited by 94
State Mandated Testing and Educational Reform: Context and Consequences
Airasian, P. W. (1987) · American Journal of Education · doi:10.1086/444312 · Cited by 92
The Freedom to Teach: Contrasting History Teaching in Elective and State–Tested Courses
Gerwin, D., & Visone, F. (2006) · Theory & Research in Social Education · doi:10.1080/00933104.2006.10473307 · Cited by 82
The Impact of Mandated Standardized Testing on Minority Students
Lomax, R. G., West, M. M., Harmon, M., et al. (1995) · The Journal of Negro Education · doi:10.2307/2967240 · Cited by 80
Valenzuela, A. (2000) · Hispanic Journal of Behavioral Sciences · doi:10.1177/0739986300224009 · Cited by 79
The New Accountability: High Schools and High-Stakes Testing
Riffert, F. (2018) · Journal of Educational Thought / Revue de la Pensée Educative · doi:10.55016/ojs/jet.v39i3.52608 · Cited by 75
Displaced Teacher and State Priorities in a High-Stakes Accountability Context
Watanabe, M. (2007) · Educational Policy · doi:10.1177/0895904805284114 · Cited by 74
Limiting the Unintended Consequences of High-Stakes Testing.
Yeh, S. S. (2005) · Education Policy Analysis Archives · doi:10.14507/epaa.v13n43.2005 · Cited by 72
Expectant fathers: Influence of perinatal education on stress, coping, and spousal relations
Diemer, G. A. (1997) · Research in Nursing & Health · doi:10.1002/(sici)1098-240x(199708)20:4<281::aid-nur2>3.0.co;2-c · Cited by 67
Curriculum theory: Meaning, development, and use
Beauchamp, G. A. (1982) · Theory Into Practice · doi:10.1080/00405848209542976 · Cited by 67
Leaving Children Behind: How "Texas-Style" Accountability Fails Latino Youth
Maxcy, B. D. (2006) · Educational Administration Quarterly · doi:10.1177/0013161x05279449 · Cited by 64
Hunter, R. C., & Bartee, R. D. (2003) · Education and Urban Society · doi:10.1177/0013124502239389 · Cited by 63
The relationship of high school graduation exams to graduation rates and SAT scores.
Marchant, G. J., & Paulson, S. E. (2005) · Education Policy Analysis Archives · doi:10.14507/epaa.v13n6.2005 · Cited by 58
The Impact of the MCAS: Teachers Talk about High-Stakes Testing
Luna, C., & Turner, C. L. (2001) · The English Journal · doi:10.2307/821659 · Cited by 57
Grant, S. G., Gradwell, J. M., Lauricella, A. M., Derme-Insinna, A., Pullano, L., & Tzetzo, K. (2002) · Theory & Research in Social Education · doi:10.1080/00933104.2002.10473208 · Cited by 57
Politics, Control, and the Future of School Accountability.
Moe, T. M. (2002) · Cited by 53
Testing and Student Engagement with Literature in Urban Classrooms: A Multi-layered Perspective
Anagnostopoulos, D. (2003) · Research in the Teaching of English · doi:10.58680/rte20031794 · Cited by 45
The Classroom Impact of High-Stress Testing
Perreault, G. (2000) · Cited by 39
Teaching the Culture of High Stakes Testing: Listening to New Teachers
Costigan, A. T. (2002) · Action in Teacher Education · doi:10.1080/01626620.2002.10463085 · Cited by 34
Valenzuela, A., Prieto, L., & Hamilton, M. P. (2007) · Anthropology & Education Quarterly · doi:10.1525/aeq.2007.38.1.1 · Cited by 33
The Influence of State-Mandated Testing on Teachers of Literature
Zancanella, D. (1992) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737014003283 · Cited by 33
Experiences with Student-Centered Teaching and Learning in High-Stakes Assessment Environments
Passman, R. (2001) · Cited by 31
Problems of Definition in Curriculum.
Kliebard, H. M. (1989) · Journal of curriculum and supervision · Cited by 30
"Doesn't It Feel Morbid Here?" High-Stakes Testing and the Widening of the Equity Gap.
Groves, P. (2002) · Educational foundations · Cited by 26
Williamson, P. S., Bondy, E., Langley, L. K., et al. (2005) · Childhood Education · doi:10.1080/00094056.2005.10522271 · Cited by 19
Blurring the Lines between Content and Pedagogy.
Segall, A. (2004) · Social Education · Cited by 18
Wright, W. E., & Choi, D. H. (2005) · Cited by 17
An Integrated Curriculum Using State Standards in a High-Stakes Testing Environment
Vogler, K. E. (2003) · Middle School Journal · doi:10.1080/00940771.2003.11495383 · Cited by 16
Loss of the Creature: The Obscuring of Inclusivity in Classroom Discourse
Rex, L. A. (2003) · Communication Education · doi:10.1080/03634520302464 · Cited by 16
Listening Instruction: A Qualitative Meta-Analysis of Twenty-Four Selected Studies.
DeWitt-Brinks, D., & Rhodes, S. C. (1992) · Cited by 15
Teaching in a High-Stakes Testing Setting: What Becomes of Teacher Knowledge?
Salinas, C. (2006) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-540-020251010 · Cited by 15
Teachers' Assessment Practices in a High-Stakes Testing Environment.
Bol, L. (2004) · Teacher education & practice · Cited by 14
Interrupting Globalization as an Educational Practice
Au, W. W., & Apple, M. W. (2004) · Educational Policy · doi:10.1177/0895904804269095 · Cited by 13
Self-citationPrincipled Teaching To(wards) the Test? Persuasive Writing in Two Classrooms.
Wollman‐Bonilla, J. E. (2004) · Language Arts · Cited by 12
van Hover, S. D. (2006) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-540-020251011 · Cited by 11
Narratives from the Classroom: An Introduction to Teaching
Miller, P. C. (2005) · Sage eBooks · doi:10.4135/9781452229829 · Cited by 10
Teaching True and To the Test in Writing
Wolf, S. A., & Wolf, K. (2002) · Language Arts · doi:10.58680/la2002232 · Cited by 9
Smith, A. M. (2003) · Cited by 8
Power, Identity, and the Third Rail
Au, W. W. (2005) · Sage eBooks · doi:10.4135/9781452229829.n5 · Cited by 6
Self-citationWollman‐Bonilla, J. E. (2004) · Language Arts · doi:10.58680/la20042933 · Cited by 4
Teaching in Spite Of, Rather than Because Of, the Test
Gradwell, J. M. (2006) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-540-020251009 · Cited by 3
van Hover, S. D., & Heinecke, W. F. (2005) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-682-720251007 · Cited by 3
Using Primary Documents with Fourth-Grade Students
Bolgatz, J. (2006) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-540-020251008 · Cited by 1
The State of State-Level History Tests
Grant, S. G., & Horn, C. L. (2006) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-540-020251003 · Cited by 1
“I’m Not Saying These are Going to be Easy”
Barton, K. C. (2005) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-682-720251003
How She Stopped Worrying and Learned to Love the Test … Sort of
Libresco, A. S. (2005) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-60752-682-720251004
Research works printed but not linked: 12
- AuWAgainst economic determinism: Revisiting the roots of neo-Marxism in critical educational theoryJournal for Critical Education Policy Studies2006November42Retrieved December 12, 2006, from http://www.jceps.com/?pageID=article&articleID=66
- AuWSocial studies, social justice: W(h)ither the social studies in high-stakes testing?Teacher Education Quarterlyin press
- BentonTCraibIPhilosophy of social science: The philosophical foundations of social thought2001New YorkPalgrave
- BhaskarRReclaiming reality: A critical introduction to contemporary philosophy19892New YorkVerso
- *BolLTeachers’ assessment practices in a high-stakes testing environmentTeacher Education and Practice2004172162181
- *HillocksGJrThe testing trap: How state writing assessments control learning2002New YorkTeachers College Press
- *McNeilLMContradictions of school reform: Educational costs of standardized testing2000New YorkRoutledge
- OrfieldGWaldJTesting, testing: The high-stakes testing mania hurts poor and minority students the mostNation2000270223840
- *PerreaultGThe classroom impact of high-stress testingEducation20001204705710
- SchneiderALIngramHPolicy design for democracy1997LawrenceUniversity of Kansas
- SegallABlurring the lines between content and pedagogySocial Education2004a687479482
- *WolfSAWolfKPTeaching true and to the test in writingLanguage Arts2002793240
Cited by
Gender similarities characterize math performance
Hyde, J. S., Lindberg, S. M., Linn, M. C., Ellis, A. B., & Williams, C. C. (2008) · Science · doi:10.1126/science.1160364 · Cited by 1,054
New trends in gender and mathematics performance: A meta-analysis.
Lindberg, S. M., Hyde, J. S., Petersen, J. L., & Linn, M. C. (2010) · Psychological Bulletin · doi:10.1037/a0021276 · Cited by 920
Accelerating Progress in Obesity Prevention: Solving the Weight of the Nation
Glickman, D., Parker, L., Sim, L. J., Cook, H. D. V., & Miller, E. A. (2012) · Cited by 707
Science education in Europe: Critical reflections : a report to the Nuffield Foundation
Osborne, J. F., & Dillon, J. S. (2008) · Cited by 602
Parameters of Content Analysis
Çalık, M., & Sözbilir, M. (2014) · Education and Science · doi:10.15390/eb.2014.3412 · Cited by 582
Metadata
- Authors
- Au, W.
- Affiliations
- California State University, Fullerton (US)
- Corresponding author
- Au, Wayne
- ORCID
- Au, Wayne
- Venue
- Educational Researcher
- Published
- 2007-06
- Volume
- 36
- Issue
- 5
- Pages
- 258-267
- ISSN
- 0013-189X (ISSN-L)
- 1935-102X
- OpenAlex
- W2143658024
- Cited by
- 1,250
- References
- 91
- Citations by year
- 2026: 66 · 2025: 61 · 2024: 47 · 2023: 56 · 2022: 76 · 2021: 73 · 2020: 75 · 2019: 84 · 2018: 83 · 2017: 96 · 2016: 104 · 2015: 86 · 2014: 71 · 2013: 70 · 2012: 68
- FWCI
- 121.43
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Educational Researcher (publishedVersion)
- Topics
- Social Sciences › Education › Educational Assessment and Pedagogy
- Social Sciences › Sociology and Political Science › Educational Theory and Curriculum Studies
- Social Sciences › Education › Educational Assessment and Improvement
- Keywords
- high-stakes testing, curriculum narrowing, curriculum expansion, teacher-centered instruction, student-centered learning, cooperative learning, test content, test design, teaching practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.