Predictive Validity of the Algebra Concept Inventory (ACI): The Importance of Algebraic Conceptual Understanding to College Math and STEM Outcomes
Open accessThe DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.
Abstract
The Algebra Concept Inventory (ACI) is the first large-scale instrument validated to measure the foundational algebraic conceptual understanding of college students. This study uses ACI scores to conduct the first quantitative analysis on the relationship between algebraic conceptual understanding and college outcomes, thus exploring the predictive validity of the ACI. Specifically, we investigate whether ACI scores predict: (1) math course grades; (2) subsequent completion of math courses required for STEM (science, technology, engineering, and mathematics) majors; (3) completion of STEM versus non-STEM degrees; and (4) the extent that differences in these outcomes by race/ethnicity or gender are explained by ACI scores. Results indicate that ACI scores significantly predict math course outcomes and STEM versus non-STEM degree completion, as well as significant proportions of differences in these outcomes by race/ethnicity and gender. This illustrates the importance of providing every student instruction that supports development of the kinds of foundational algebraic conceptual understanding measured by the ACI.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Bayesian model selection in social research
Raftery, A. E. (1995) · Sociological Methodology · doi:10.2307/271063 · Cited by 6,823
Hainmueller, J. (2012) · Political Analysis · doi:10.1093/pan/mpr025 · Cited by 6,026
mirt: A Multidimensional Item Response Theory Package for the R Environment
Chalmers, R. P. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i06 · Cited by 2,643
Wai, J., Lubinski, D., & Benbow, C. P. (2009) · Journal of Educational Psychology · doi:10.1037/a0016127 · Cited by 1,846
The Effects of Classroom Mathematics Teaching on Students’ Learning
Hiebert, J., & Grouws, D. A. (2007) · Emerald Group Publishing Limited eBooks · doi:10.1108/978-1-28141-200-320251013 · Cited by 1,336
Wang, X. (2013) · American Educational Research Journal · doi:10.3102/0002831213488622 · Cited by 896
Referral, enrollment, and completion in developmental education sequences in community colleges
Bailey, T., Jeong, D. W., & Cho, S.-W. (2010) · Economics of Education Review · doi:10.1016/j.econedurev.2009.09.002 · Cited by 845
Regression Models with Ordinal Variables
Winship, C., & Mare, R. D. (1984) · American Sociological Review · doi:10.2307/2095465 · Cited by 796
Miller, R. B., Greene, B. A., Montalvo, G. P., Ravindran, B., & Nichols, J. D. (1996) · Contemporary Educational Psychology · doi:10.1006/ceps.1996.0028 · Cited by 606
VanderWeele, T. J., & Robinson, W. R. (2014) · Epidemiology · doi:10.1097/ede.0000000000000105 · Cited by 567
Research works printed but not linked: 27
- Alkhasawneh R. Hargraves R. H. (2014). Developing a hybrid model to predict student first year retention in STEM disciplines using machine learning techniques. LITEE 15(3) 35–42. https://doi.org/10.25772/6XXJ-7Q43 · DOI
- Anderson E. Kim D. (2006). Increasing the success of minority students in science and technology (No. 310736). American Council on Education. http://hdl.handle.net/10919/86900
- Buckles E. L. Haydel N. W. Thompson-Sanchez J. Page Y. W. (2019). Implementing a corequisite algebra gateway course. Association of American Colleges and Universities Peer Review 21(1–2) 42–46. https://www.aacu.org/peerreview/2019/winter-spring/Buckles
- Charleston L. J. Adserias R. P. Lang N. Jackson J. F. (2014). Intersectionality and STEM: The role of race and gender in the academic pursuits of African American women in STEM. Journal of Progressive Policy & Practice 2(3) 273–293. https://www.researchgate.net/publication/280157009_Intersectionality_and_STEM_The_Role_of_Race_and_Gender_in_the_Academic_Pursuits_of_African_American_Women_in_STEM
- Coltharp J. (2020). Instruction type student major and success in developmental mathematics. Journal of Developmental Education 44(10) 713–728. https://files.eric.ed.gov/fulltext/EJ1320656.pdf
- Hammerman N., Goldberg R. (2003). Strategies for developmental mathematics at the college level. Mathematics and Computer Education, 37(1), 79–95.
- Juraev D. A. Bozorov M. N. (2024). The role of algebra and its application in modern sciences. IJFANS 3(1) 59–67. https://www.researchgate.net/publication/378260241_The_role_of_algebra_and_its_application_in_modern_sciences
- Kalamkarian H. S. Raufman J. Edgecombe N. (2015). Early implementation in Virginia and North Carolina (Statewide Developmental Education Reform p. 30). The Community College Research Center Teachers College Columbia University. https://doi.org/10.7916/5xc6-gt93 · DOI
- Long J. S. (1997). Regression models for categorical and limited dependent variables. Sage Publications. https://uk.sagepub.com/en-gb/eur/regression-models-for-categorical-and-limited-dependent-variables/book6071
- Lubienski S. T., Ganley C. M. (2017). Research on gender and mathematics. In Cai J. (Ed.), First compendium for research in mathematics education (pp. 649–666). National Council of Teachers of Mathematics.
- Maltese A. (2008). Persistence in STEM: An investigation of the relationship between high school experiences in science and mathematics and college degree completion in STEM fields [PhD thesis University of Virginia]. https://www.researchgate.net/profile/Adam-Maltese/publication/234510692_Persistence_in_STEM_An_investigation_of_the_relationship_between_high_school_experiences_in_science_and_mathematics_and_college_degree_completion_in_STEM_fields/links/55255d880cf25d66dc9426e6/Persistence-in-STEM-An-investigation-of-the-relationship-between-high-school-experiences-in-science-and-mathematics-and-college-degree-completion-in-STEM-fields.pdf
- Minaya V. (2021). Can dual enrollment algebra reduce racial/ethnic gaps in early STEM outcomes? Evidence from Florida. Community College Research Center Teachers College Columbia University. https://doi.org/10.7916/d8-gven-xq29 · doi:10.7916/d8-gven-xq29
- Reardon K. Bromley K. W. Unruh D. (2021). The promise of universal design in postsecondary education: A literature review. Journal of Postsecondary Education and Disability 34(3) 209–221. https://eric.ed.gov/?id=EJ1325431
- Sahin A. Morgan J. Capraro M. M. Capr R. M. (2012). The effects of high school course taking and sat scores on college major selection. Sakarya University Journal of Education 2(3) 96–109. https://www.researchgate.net/publication/255682577_The_Effects_of_High_School_Course_Taking_and_SAT_Scores_on_College_Major_Selection
- Snyder J. L. Cudney E. A. (2017). A review of retention models for STEM majors and their alignment to community colleges. Journal of STEM Education: Innovations and Research 18(3) 58–57. https://www.jstem.org/jstem/index.php/JSTEM/article/view/2194
- Stewart S. Reeder S. Raymond K. Troup J. (2018). Could algebra be the root of problems in calculus courses? In Weinberg C. Rasmussen J. Rabin J. Wawro M. Brown S. (Eds.) Proceedings of the 21st annual conference on research in undergraduate mathematics education (pp. 1023–1030) San Diego CA. http://sigmaa.maa.org/rume/crume2018/Abstracts_Files/Submissions/178_Could_Algebra_be_the_Root_of_Problems_in_Calculus_Courses.pdf
- Wladis C. Bjorkman K. Duranczyk I. Selbach-Allen M. Schaub B. Tintera G. (2023). What is college-level mathematics? A proposed framework for generating developmental progressions in mathematics up to and through college. In Cook S. Katz B. Moore-Russo D. (Eds.) Proceedings of the 25th Annual Conference on Research in Undergraduate Mathematics Education (pp. 833–841). RUME. http://sigmaa.maa.org/rume/Site/Proceedings.html
- Wladis C. Murray E. Aly G. D. (2025a). Undergraduate student conceptions of mathematical syntax meanings. In Cook S. Katz B. P. Melhuish K. (Eds.) Proceedings of the 27th Annual Conference on Research in Undergraduate Mathematics Education (pp. 363–370). The Special Interest Group of the Mathematical Association of America (SIGMAA) for Research in Undergraduate Mathematics Education (RUME). https://par.nsf.gov/servlets/purl/10627391
- Wladis C. Murray E. Aly G. D. (2025b February). Predictive validity of the algebra concept inventory [Conference session]. Proceedings of the 14th Congress of the European Society for Research in Mathematics Education (CERME14) European Society for Research in Mathematics Education (ERME); Bozen-Bolzano Italy. https://www.cerme14.it/proceedings/
- Wladis C. Murray E. Hachey A. C. Myszkowski N. Aly G. D. Sencindiver B. Offehnholley K. Samuels J. (2025c). Algebra conceptual understanding and predicting STEM degree completion. In Cook S. Katz B. P. Melhuish K. (Eds.) Proceedings of the 27th Annual Conference on Research in Undergraduate Mathematics Education (pp. 328–337) The Special Interest Group of the Mathematical Association of America (SIGMAA) for Research in Undergraduate Mathematics Education (RUME); Alexandria VA. https://par.nsf.gov/servlets/purl/10627391
- Wladis C. Offenholley K. Licwinko S. Dawes D. Lee J. (2018). Development of the elementary algebra concept inventory for the college context. In Weinberg C. Rasmussen J. Rabin J. Wawro M. Brown S. (Eds.) Proceedings of the 21st Annual Conference on Research in Undergraduate Mathematics Education (pp. 605–617) The Special Interest Group of the Mathematical Association of America (SIGMAA) for Research in Undergraduate Mathematics Education (RUME); San Diego CA. http://sigmaa.maa.org/rume/crume2018/Abstracts_Files/Submissions/75_Development_of_the_Elementary_Algebra_Concept_Inventory_for_the_College_Context.pdf
- Wladis C. Offenholley K. Sencindiver B. Hachey A. Myszkowski N. Samuels J. Mirin A. Murray E. Aly G. (manuscript under review). The Algebra Concept Inventory (ACI): Development and Validation of the ACI as a Measure of the Fundamental Algebraic Conceptual Understanding of College Students [Manuscript under review].
- Wladis C. Offenholley K. Sencindiver B. Myszkowski N. Aly G. D. (2024b). Creation and validation of the Algebra Concept Inventory in the tertiary context. In Evans T. Marmur O. Hunter J. Leach G. Jhagroo J. (Eds.) Proceedings of the 47th Conference of the International Group for the Psychology of Mathematics Education (Vol. 1 p. 299) The International Group for the Psychology of Mathematics Education (IGPME); University Park PA. https://par.nsf.gov/servlets/purl/10558103
- Wladis C. Sencindiver B. Offenholley K. (2023). How do college students conceptualize algebraic properties? Proceedings of the Thirteenth Congress of the European Society for Research in Mathematics Education (CERME 13) 676–683 The Special Interest Group of the Mathematical Association of America (SIGMAA) for Research in Undergraduate Mathematics Education (RUME); Omaha NE. https://hal.science/hal-04418311/document
- Wladis C. Sencindiver B. Offenholley K. Jaffe E. Taton J. (2022). Modeling student definitions of equivalence: Operational vs. structural views and extracted vs. stipulated definitions. In Karunakaran S. S. Higgins A. (Eds.) Proceedings for the 24th Annual Conference on Research in Undergraduate Mathematics Education (pp. 708–715) The Special Interest Group of the Mathematical Association of America (SIGMAA) for Research in Undergraduate Mathematics Education (RUME); Boston MA. https://par.nsf.gov/biblio/10378561
- Wladis C. Hachey A. C. Conway K. M. (2024). It’s about time Part II: Does time poverty contribute to inequitable college outcomes by gender and race/ethnicity. AERA Open 10(1) 1–20. https://doi.org/10.1177/23328584241237971 · DOI
- Wooldridge J. M. (2002). Econometric analysis of cross-section and panel data (1st ed.). The MIT Press. https://ipcid.org/evaluation/apoio/Wooldridge%20-%20Cross-section%20and%20Panel%20Data.pdf
Cited by
Aregahegn, A., Ayele, M. A., & Abate, A. (2026) · Discover Education · doi:10.1007/s44217-026-01793-3
“Such procedural flexibility improves the ability to use algebraic concepts in diverse contexts and to solve a wider range of algebraic problems [8].”
Metadata
- Authors
- Wladis, C., Sencindiver, B., Hachey, A. C., Myszkowski, N., Offenholley, K., Samuels, J., & Aly, G.
- Affiliations
- The Graduate Center, CUNY (US)
- Mathematics Department, University of Texas at San Antonio
- The University of Texas at El Paso (US)
- Pace University (US)
- Borough of Manhattan Community College (US)
- Corresponding author
- Wladis, Claire
- Venue
- AERA Open
- Publisher
- SAGE Publications
- Published
- 2026-01
- Volume
- 12
- ISSN
- 2332-8584 (ISSN-L)
- OpenAlex
- W7149310870
- Cited by
- 1
- References
- 84
- Citations by year
- 2026: 1
- FWCI
- 4.25
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by-nc
- creativecommons.org/licenses/by-nc/4.0/ (vor)
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- AERA Open (publishedVersion, cc-by-nc)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (1760491, 2300725)
- Topics
- Social Sciences › Education › Mathematics Education and Programs
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Social Sciences › Education › Mathematics Education and Teaching Techniques
- Keywords
- predictive validity, STEM degree completion, racial and ethnic differences, gender differences, university students, mathematics assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Predictive Validity of the Algebra Concept Inventory (ACI): The Importance of Algebraic Conceptual Understanding to College Math and STEM Outcomes. https://app.cochat.ai/papers/10.1177/23328584261419497
- The paper
- Wladis, C., Sencindiver, B., Hachey, A. C., Myszkowski, N., Offenholley, K., Samuels, J., & Aly, G. (2026). Predictive Validity of the Algebra Concept Inventory (ACI): The Importance of Algebraic Conceptual Understanding to College Math and STEM Outcomes. AERA Open. https://doi.org/10.1177/23328584261419497
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.