Building a Conceptual Framework for Data Literacy
The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
Background The increasing focus on education as an evidence-based practice requires that educators can effectively use data to inform their practice. At the level of classroom instructional decision making, the nature of the specific knowledge and skills teachers need to use data effectively is complex and not well characterized. Being able to characterize this requisite knowledge and skills supports definition and measurement of data literacy. Evolving from empirical analyses, an emergent conceptual framework of knowledge and skills is proposed for the construct, data literacy for teaching. The framework is based on a domain analysis, which is the first step of an evidence-centered design process for data literacy. The framework is contextualized in existing research, with an objective of having it ground future work in the development of instruments to measure data literacy. Purpose This article reports on work to develop a conceptual framework to undergird research, development, and capacity building around data literacy for teaching. The emergent nature of the framework is intended to inform the discussions around data literacy so that continued refinement of operational definitions of the construct will emerge. Without such operational definitions, measurement of progress toward teacher data literacy is not possible. Research Design The conceptual framework is based on a sequence of qualitative studies that sought to determine the nature of knowledge and skills that are required for teachers to be considered data literate. A first study examined the ways that the knowledge and skills around the use of data were characterized in practical guides, books, and manuals on data use, formative assessment, and related topics. These characteristics were integrated with definitions of data literacy elicited from experts. A second study examined the licensure and certification documents required by states for teacher candidates for their treatment of data- and assessment-related knowledge and skills. The synthesis of these studies and their components have yielded an evolving conceptual framework for a new construct: data literacy for teachers. Conclusions The conceptual framework described in this article reflects an evolving effort to understand what it means for teachers to be data literate—that is, what knowledge and skills are required for teachers to use data effectively and responsibly set within an iterative inquiry cycle. The work posits that the construct comprises three interacting domains (data use for teaching, content knowledge, and pedagogical content knowledge), six components of the inquiry cycle (identify problems, frame questions, use data, transform data into information, transform information into a decision, and evaluate outcomes), and, finally, 59 elements of knowledge and skills embedded within those components. However, the complex construct requires additional discussion from policy, research, and practitioners to refine and reorganize it and to expand it beyond a cognitive focus on knowledge and skills to include beliefs/values, identity, and epistemic elements. Next steps will include structuring an ongoing discussion about the nature of the framework and expansion beyond domain analysis through the evidence-centered design process to the development of a suite of instruments to measure the construct.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Self-efficacy: the exercise of control
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1826 · Cited by 24,281
Those Who Understand: Knowledge Growth in Teaching
SHULMAN, L. S. (1986) · Educational Researcher · doi:10.3102/0013189x015002004 · Cited by 18,546 · cited 1×
“This content knowledge is integrated with an understanding of how that particular content knowledge can be translated through curricular materials and instructional strategies into experiences that facilitate student learn-ing—what Shulman (1986) called pedagogical content knowledge.”
BackgroundContent Knowledge for Teaching: What Makes It Special?
Loewenberg Ball, D., Thames, M. H., & Phelps, G. (2008) · Journal of Teacher Education · doi:10.1177/0022487108324554 · Cited by 5,388
Effects of Teachers’ Mathematical Knowledge for Teaching on Student Achievement
Hill, H. C., Rowan, B., & Ball, D. L. (2005) · American Educational Research Journal · doi:10.3102/00028312042002371 · Cited by 2,812
Russell, W. F. (1930) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146813003100748 · Cited by 1,972
Standards for educational and psychological testing: (500832009-001)
(1985) · PsycEXTRA Dataset · doi:10.1037/e500832009-001 · Cited by 1,480
The interplay of evidence and consequences in the validation of performance assessments
Messick, S. (1994) · Educational Researcher · doi:10.3102/0013189x023002013 · Cited by 1,315
Review of Educational Measurement.
Langmuir, C. R. (1952) · Journal of Educational Psychology · doi:10.1037/h0051392 · Cited by 903
Developing measures of teachers’ mathematics knowledge for teaching
Hill, H. C., Schilling, S. G., & Ball, D. L. (2004) · The Elementary School Journal · doi:10.1086/428763 · Cited by 902 · cited 3×
“…of interrater reliability and internal consistency, as well as initial criterion validity evidence in the relationship between teachers’ scores on the TASK instrument and the Mathematical Knowledge for Teaching instrument (MKT) (hill, Schilling, & Ball, 2004; Schilling, Blunk, & hill, 2007).”
BackgroundFocus Article: On the Structure of Educational Assessments
Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0101_02 · Cited by 802
Research works printed but not linked: 12
- Aguerrebere J. (2009). Panel discussion at Teachers' Use of Data to Impact Teaching and Learning conference, Alliance for Excellent Education, Washington, DC.
- American Educational Research Association. (2000). The standards for educational and psychological testing. Washington, DC: Author.
- CCSSO Task Force on Teacher Preparation and Entry Into the Profession. (2012). Our responsibility, our promise: Transforming teacher preparation and entry into the profession. Washington, DC: Council of Chief State School Officers.
- Cibulka J. (2013, August). Leveraging the InTASC standards and progressions. Presentation made during the webinar, Next Generation Standards & Accreditation Policies for Teacher Prep. Washington, DC: Alliance for Excellent Education.
- Confrey J. Maloney A. P. Nguyen K. H. Mojica G. & Myers M. (2009). Equipartitioning/ splitting as a foundation of rational number reasoning using learning trajectories. Presentation at the conference of the International Group for the Psychology of Mathematics Education Thessaloniki Greece.
- Council for the Accreditation of Educator Preparation. (2013, August). CAEP accreditation standards. Washington, DC: Author.
- Data Quality Campaign. (2014, February). Teacher data literacy: It's about time. Washington, DC: Author.
- Hall G. E., George A. A., & Rutherford W. L. (1979). Measuring stages of concerns about the innovation: A manual for use of the SoC Questionnaire. University of Texas, Austin.
- Mandinach E. B., & Gummer E. S. (2013). Defining data literacy: A report on a convening of experts. Journal of Educational Research and Policy Studies, 13(2), 6–28.
- Messick S. J. (1989). Validity. In Linn R. L. (Ed.), Educational measurement(3rd ed., pp. 13–103). New York, NY: American Council on Education and Macmillan.
- Mislevy R. J., Behrens J. T., Bennett R. E., Demark S. F., Frezzo D. C., Levy R., … Winters F. I. (2010). On the roles of external knowledge representations in assessment design. Journal of Technology, Learning, and Assessment, 8(2). Retrieved from http://ejournals.bc.edu/ojs/index.php/jtla
- U.S. Department of Education, Office of Planning, Evaluation and Policy Development. (2010). Teachers' ability to use data to inform instruction. Washington, DC: Author.
Cited by
Leading teachers' perspective on teacher-AI collaboration in education
Kim, J. (2024) · Education and Information Technologies · doi:10.1007/s10639-023-12109-5 · Cited by 376
“…data, teachers’ data literacy, the ability to transform data into actionable instructional knowledge and practices by collecting, processing, analyzing, interpreting, and managing various types of data incurred from their instruction to help determine instructional steps (Gummer & Mandinach, 2015).”
Mandinach, E. B., & Gummer, E. S. (2016) · Teaching and Teacher Education · doi:10.1016/j.tate.2016.07.011 · Cited by 363
“It has included the theoretical work to develop a conceptual framework for the construct, DLFT (Gummer & Mandinach, 2015).”
BackgroundMethodInfluentialSelf-citationDatnow, A., & Hubbard, L. (2016) · Journal of Educational Change · doi:10.1007/s10833-015-9264-2 · Cited by 287
“The knowledge and skills that teachers require in order to use data effectively are broad and embedded in the craft of teaching itself (Gummer and Mandinach 2015).”
BackgroundInfluentialCarmi, E., Yates, S. J., Lockley, E., & Pawluczuk, A. (2020) · Internet Policy Review · doi:10.14763/2020.2.1481 · Cited by 222
“More recently, as algorithmic decision-making processes have become widespread, data literacy has joined this conversation (Gilster, 1997; Eshet, 2004; Bawden, 2008; Gummer and Mandinach, 2015).”
BackgroundTeachers’ Sensemaking of Data and Implications for Equity
Bertrand, M., & Marsh, J. A. (2015) · American Educational Research Journal · doi:10.3102/0002831215599251 · Cited by 209
“Data use is influenced by teachers’ knowledge of how to interpret and respond to data (Gummer & Mandinach, 2015; Marsh, 2012).”
Background
Metadata
- Authors
- Gummer, E. S., & Mandinach, E. B.
- Affiliations
- U.S. National Science Foundation (US)
- Venue
- Teachers College Record: The Voice of Scholarship in Education
- Publisher
- SAGE Publications
- Published
- 2015-04
- Volume
- 117
- Issue
- 4
- Pages
- 1-22
- ISSN
- 0040-0475 (ISSN-L)
- 0161-4681
- 1467-9620
- OpenAlex
- W333991843
- Cited by
- 263
- References
- 31
- Citations by year
- 2026: 30 · 2025: 22 · 2024: 41 · 2023: 43 · 2022: 17 · 2021: 22 · 2020: 28 · 2019: 25 · 2018: 5 · 2017: 12 · 2016: 10 · 2015: 7
- FWCI
- 22.27
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Teachers College Record The Voice of Scholarship in Education (publishedVersion)
- Topics
- Social Sciences › Education › Educational Assessment and Improvement
- Social Sciences › Education › Teacher Education and Assessments
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Keywords
- data literacy, conceptual framework, teacher data use, formative assessment, pedagogical content knowledge, content knowledge, instructional decision-making, evidence-centered design, domain analysis, inquiry cycle, teacher beliefs and values, teacher professional development, teacher capacity building
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Building a Conceptual Framework for Data Literacy. https://app.cochat.ai/papers/10.1177/016146811511700401
- The paper
- Gummer, E. S., & Mandinach, E. B. (2015). Building a Conceptual Framework for Data Literacy. Teachers College Record: The Voice of Scholarship in Education. https://doi.org/10.1177/016146811511700401
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.