CoChat

Predictive Validity of the Algebra Concept Inventory (ACI): The Importance of Algebraic Conceptual Understanding to College Math and STEM Outcomes

Open access

The DOI matches its Crossref record; 85 of the 85 references it cites were found in a registry or an index.

Abstract

The Algebra Concept Inventory (ACI) is the first large-scale instrument validated to measure the foundational algebraic conceptual understanding of college students. This study uses ACI scores to conduct the first quantitative analysis on the relationship between algebraic conceptual understanding and college outcomes, thus exploring the predictive validity of the ACI. Specifically, we investigate whether ACI scores predict: (1) math course grades; (2) subsequent completion of math courses required for STEM (science, technology, engineering, and mathematics) majors; (3) completion of STEM versus non-STEM degrees; and (4) the extent that differences in these outcomes by race/ethnicity or gender are explained by ACI scores. Results indicate that ACI scores significantly predict math course outcomes and STEM versus non-STEM degree completion, as well as significant proportions of differences in these outcomes by race/ethnicity and gender. This illustrates the importance of providing every student instruction that supports development of the kinds of foundational algebraic conceptual understanding measured by the ACI.

Overview

Integrity signals

Registry

Crossref · 10.1177/23328584261419497

Cites

85 of 85 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Show all 85 references

Research works printed but not linked: 27

  1. Alkhasawneh R. Hargraves R. H. (2014). Developing a hybrid model to predict student first year retention in STEM disciplines using machine learning techniques. LITEE 15(3) 35–42. https://doi.org/10.25772/6XXJ-7Q43 · DOI
  2. Anderson E. Kim D. (2006). Increasing the success of minority students in science and technology (No. 310736). American Council on Education. http://hdl.handle.net/10919/86900
  3. Buckles E. L. Haydel N. W. Thompson-Sanchez J. Page Y. W. (2019). Implementing a corequisite algebra gateway course. Association of American Colleges and Universities Peer Review 21(1–2) 42–46. https://www.aacu.org/peerreview/2019/winter-spring/Buckles
  4. Charleston L. J. Adserias R. P. Lang N. Jackson J. F. (2014). Intersectionality and STEM: The role of race and gender in the academic pursuits of African American women in STEM. Journal of Progressive Policy & Practice 2(3) 273–293. https://www.researchgate.net/publication/280157009_Intersectionality_and_STEM_The_Role_of_Race_and_Gender_in_the_Academic_Pursuits_of_African_American_Women_in_STEM
  5. Coltharp J. (2020). Instruction type student major and success in developmental mathematics. Journal of Developmental Education 44(10) 713–728. https://files.eric.ed.gov/fulltext/EJ1320656.pdf
  6. Hammerman N., Goldberg R. (2003). Strategies for developmental mathematics at the college level. Mathematics and Computer Education, 37(1), 79–95.
  7. Juraev D. A. Bozorov M. N. (2024). The role of algebra and its application in modern sciences. IJFANS 3(1) 59–67. https://www.researchgate.net/publication/378260241_The_role_of_algebra_and_its_application_in_modern_sciences
  8. Kalamkarian H. S. Raufman J. Edgecombe N. (2015). Early implementation in Virginia and North Carolina (Statewide Developmental Education Reform p. 30). The Community College Research Center Teachers College Columbia University. https://doi.org/10.7916/5xc6-gt93 · DOI
  9. Long J. S. (1997). Regression models for categorical and limited dependent variables. Sage Publications. https://uk.sagepub.com/en-gb/eur/regression-models-for-categorical-and-limited-dependent-variables/book6071
  10. Lubienski S. T., Ganley C. M. (2017). Research on gender and mathematics. In Cai J. (Ed.), First compendium for research in mathematics education (pp. 649–666). National Council of Teachers of Mathematics.
  11. Maltese A. (2008). Persistence in STEM: An investigation of the relationship between high school experiences in science and mathematics and college degree completion in STEM fields [PhD thesis University of Virginia]. https://www.researchgate.net/profile/Adam-Maltese/publication/234510692_Persistence_in_STEM_An_investigation_of_the_relationship_between_high_school_experiences_in_science_and_mathematics_and_college_degree_completion_in_STEM_fields/links/55255d880cf25d66dc9426e6/Persistence-in-STEM-An-investigation-of-the-relationship-between-high-school-experiences-in-science-and-mathematics-and-college-degree-completion-in-STEM-fields.pdf
  12. Minaya V. (2021). Can dual enrollment algebra reduce racial/ethnic gaps in early STEM outcomes? Evidence from Florida. Community College Research Center Teachers College Columbia University. https://doi.org/10.7916/d8-gven-xq29 · doi:10.7916/d8-gven-xq29
  13. Reardon K. Bromley K. W. Unruh D. (2021). The promise of universal design in postsecondary education: A literature review. Journal of Postsecondary Education and Disability 34(3) 209–221. https://eric.ed.gov/?id=EJ1325431
  14. Sahin A. Morgan J. Capraro M. M. Capr R. M. (2012). The effects of high school course taking and sat scores on college major selection. Sakarya University Journal of Education 2(3) 96–109. https://www.researchgate.net/publication/255682577_The_Effects_of_High_School_Course_Taking_and_SAT_Scores_on_College_Major_Selection
  15. Snyder J. L. Cudney E. A. (2017). A review of retention models for STEM majors and their alignment to community colleges. Journal of STEM Education: Innovations and Research 18(3) 58–57. https://www.jstem.org/jstem/index.php/JSTEM/article/view/2194
  16. Stewart S. Reeder S. Raymond K. Troup J. (2018). Could algebra be the root of problems in calculus courses? In Weinberg C. Rasmussen J. Rabin J. Wawro M. Brown S. (Eds.) Proceedings of the 21st annual conference on research in undergraduate mathematics education (pp. 1023–1030) San Diego CA. http://sigmaa.maa.org/rume/crume2018/Abstracts_Files/Submissions/178_Could_Algebra_be_the_Root_of_Problems_in_Calculus_Courses.pdf
  17. Wladis C. Bjorkman K. Duranczyk I. Selbach-Allen M. Schaub B. Tintera G. (2023). What is college-level mathematics? A proposed framework for generating developmental progressions in mathematics up to and through college. In Cook S. Katz B. Moore-Russo D. (Eds.) Proceedings of the 25th Annual Conference on Research in Undergraduate Mathematics Education (pp. 833–841). RUME. http://sigmaa.maa.org/rume/Site/Proceedings.html
  18. Wladis C. Murray E. Aly G. D. (2025a). Undergraduate student conceptions of mathematical syntax meanings. In Cook S. Katz B. P. Melhuish K. (Eds.) Proceedings of the 27th Annual Conference on Research in Undergraduate Mathematics Education (pp. 363–370). The Special Interest Group of the Mathematical Association of America (SIGMAA) for Research in Undergraduate Mathematics Education (RUME). https://par.nsf.gov/servlets/purl/10627391
  19. Wladis C. Murray E. Aly G. D. (2025b February). Predictive validity of the algebra concept inventory [Conference session]. Proceedings of the 14th Congress of the European Society for Research in Mathematics Education (CERME14) European Society for Research in Mathematics Education (ERME); Bozen-Bolzano Italy. https://www.cerme14.it/proceedings/
  20. Wladis C. Murray E. Hachey A. C. Myszkowski N. Aly G. D. Sencindiver B. Offehnholley K. Samuels J. (2025c). Algebra conceptual understanding and predicting STEM degree completion. In Cook S. Katz B. P. Melhuish K. (Eds.) Proceedings of the 27th Annual Conference on Research in Undergraduate Mathematics Education (pp. 328–337) The Special Interest Group of the Mathematical Association of America (SIGMAA) for Research in Undergraduate Mathematics Education (RUME); Alexandria VA. https://par.nsf.gov/servlets/purl/10627391
  21. Wladis C. Offenholley K. Licwinko S. Dawes D. Lee J. (2018). Development of the elementary algebra concept inventory for the college context. In Weinberg C. Rasmussen J. Rabin J. Wawro M. Brown S. (Eds.) Proceedings of the 21st Annual Conference on Research in Undergraduate Mathematics Education (pp. 605–617) The Special Interest Group of the Mathematical Association of America (SIGMAA) for Research in Undergraduate Mathematics Education (RUME); San Diego CA. http://sigmaa.maa.org/rume/crume2018/Abstracts_Files/Submissions/75_Development_of_the_Elementary_Algebra_Concept_Inventory_for_the_College_Context.pdf
  22. Wladis C. Offenholley K. Sencindiver B. Hachey A. Myszkowski N. Samuels J. Mirin A. Murray E. Aly G. (manuscript under review). The Algebra Concept Inventory (ACI): Development and Validation of the ACI as a Measure of the Fundamental Algebraic Conceptual Understanding of College Students [Manuscript under review].
  23. Wladis C. Offenholley K. Sencindiver B. Myszkowski N. Aly G. D. (2024b). Creation and validation of the Algebra Concept Inventory in the tertiary context. In Evans T. Marmur O. Hunter J. Leach G. Jhagroo J. (Eds.) Proceedings of the 47th Conference of the International Group for the Psychology of Mathematics Education (Vol. 1 p. 299) The International Group for the Psychology of Mathematics Education (IGPME); University Park PA. https://par.nsf.gov/servlets/purl/10558103
  24. Wladis C. Sencindiver B. Offenholley K. (2023). How do college students conceptualize algebraic properties? Proceedings of the Thirteenth Congress of the European Society for Research in Mathematics Education (CERME 13) 676–683 The Special Interest Group of the Mathematical Association of America (SIGMAA) for Research in Undergraduate Mathematics Education (RUME); Omaha NE. https://hal.science/hal-04418311/document
  25. Wladis C. Sencindiver B. Offenholley K. Jaffe E. Taton J. (2022). Modeling student definitions of equivalence: Operational vs. structural views and extracted vs. stipulated definitions. In Karunakaran S. S. Higgins A. (Eds.) Proceedings for the 24th Annual Conference on Research in Undergraduate Mathematics Education (pp. 708–715) The Special Interest Group of the Mathematical Association of America (SIGMAA) for Research in Undergraduate Mathematics Education (RUME); Boston MA. https://par.nsf.gov/biblio/10378561
  26. Wladis C. Hachey A. C. Conway K. M. (2024). It’s about time Part II: Does time poverty contribute to inequitable college outcomes by gender and race/ethnicity. AERA Open 10(1) 1–20. https://doi.org/10.1177/23328584241237971 · DOI
  27. Wooldridge J. M. (2002). Econometric analysis of cross-section and panel data (1st ed.). The MIT Press. https://ipcid.org/evaluation/apoio/Wooldridge%20-%20Cross-section%20and%20Panel%20Data.pdf

Cited by

See all 1

Metadata

Authors
Wladis, C., Sencindiver, B., Hachey, A. C., Myszkowski, N., Offenholley, K., Samuels, J., & Aly, G.
Affiliations
  • The Graduate Center, CUNY (US)
  • Mathematics Department, University of Texas at San Antonio
  • The University of Texas at El Paso (US)
  • Pace University (US)
  • Borough of Manhattan Community College (US)
Corresponding author
Wladis, Claire
Venue
AERA Open
Published
2026-01
Volume
12
ISSN
2332-8584 (ISSN-L)
OpenAlex
W7149310870
Cited by
1
References
84
Citations by year
2026: 1
FWCI
4.25
Type
journal article
Language
en
Open access
Licence
Locations
  • AERA Open (publishedVersion, cc-by-nc)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
National Science Foundation (1760491, 2300725)
Topics
  • Social Sciences › Education › Mathematics Education and Programs
  • Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
  • Social Sciences › Education › Mathematics Education and Teaching Techniques
Keywords
predictive validity, STEM degree completion, racial and ethnic differences, gender differences, university students, mathematics assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Predictive Validity of the Algebra Concept Inventory (ACI): The Importance of Algebraic Conceptual Understanding to College Math and STEM Outcomes. https://app.cochat.ai/papers/10.1177/23328584261419497
The paper
Wladis, C., Sencindiver, B., Hachey, A. C., Myszkowski, N., Offenholley, K., Samuels, J., & Aly, G. (2026). Predictive Validity of the Algebra Concept Inventory (ACI): The Importance of Algebraic Conceptual Understanding to College Math and STEM Outcomes. AERA Open. https://doi.org/10.1177/23328584261419497

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.