Using information and communication technology (ICT)-based data systems to support teacher data-driven decision-making: Insights from the literature (2013–2023)
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index; 12 of the 130 sources its claims cite were checked for support.
Abstract
The use of information and communication technology-based data systems to support teachers in data-driven decision-making (DDDM) remains limited. Despite the growing number of data systems available, their uptake remains limited, and there is a limited understanding of what data system characteristics increase and factors that influence teacher adoption and use. To address this gap, we reviewed the literature using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Synthesis of the 17 articles from three databases revealed six data systems commonly used in schools. Also, there are eight key data system characteristics that teachers find helpful. We have found several factors that influence teacher adoption of data systems related to data features, leadership, individual disposition, and the socio-cultural context. The findings of our review have critical implications for designing and using technology-based data systems for supporting teacher data-driven decision-making.
Overview
CoChat Summary
TL;DR
This PRISMA-based review synthesized 17 articles on ICT-based data systems for teacher data-driven decision-making (DDDM) published between 2013 and 2023. It identifies six commonly used school data systems, eight helpful system characteristics, and a set of enabling and hindering factors shaping teacher adoption and use.
Key findings
- The review synthesized 17 articles from three databases and found six commonly used school data systems: student information systems, assessment systems, data warehousing systems, learning management systems, human resource management systems, decision support systems, and classroom-based management systems.
- It identifies eight key data system characteristics teachers find helpful: integration, standard reporting and labelling, timeliness of data collection and feedback, log maintenance and utilisation, query tools and visualisation, quality content and display, online capability and remote access, and qualitative data capture.
- The review reports nine enabling factors for adoption: availability of support and professional development, leadership influence, time and workload to engage in data, usefulness of the data system, data triangulation, knowledge and awareness, efficient data access, teacher involvement, and a culture of data use within the school.
- It also reports nine barriers: inaccessibility and unavailability, low data literacy, perceived reliability and validity concerns, lack of time and preparation, negative leadership, inappropriate data system design, sustainability issues, and lack of user buy-in; the text says these barriers “need to be carefully addressed” when implementing systems in schools.
Methods
- The study is a literature review/scoping review conducted using PRISMA guidelines and thematic synthesis.
- Searches were run in ProQuest, Scopus, Web of Science, and ScienceDirect for 2013–2023, limited to English scholarly journal articles and conference proceedings; the initial search yielded 879 records, with 17 studies included after screening.
- The authors coded the final papers using NVivo and Zotero, then developed descriptive and analytical themes guided by the research questions.
Limitations
- The paper states it did not cover critical aspects of teacher DDDM such as the types and quality of data most useful, the competing uses of data for accountability/administration/pedagogy/behaviour, and teachers’ capacity for using technology-based data systems.
- The authors say the review was limited to four databases and English-language scholarly journal articles and conference proceedings, so relevant literature may have been missed.
- The text also makes evident that some full-text articles were inaccessible and excluded (2 articles), which could have affected the synthesis.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
11 Valid · 12 Not valid · 99 Not checked · 66 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Another significant hindering factor revealed in this study is the perceived reliability and validity of data (Tyler, 2013).”
§ Using information and communication technology (ICT)-based data systems to support teacher data-driven decision-making: Insights from the literature (2013-2023) > 3.2.12 Perceived reliability and validity of data
What the sources say
- Partly supportedcites Tyler, 2013 sourceExperimental — accuracy not yet measured
The Prior Research section says teachers’ belief that test data contain valid information, and their perception of its validity, affect data use. But it summarizes earlier research rather than reporting a barrier revealed by Tyler’s own study, and it does not identify perceived reliability as a separate factor. The Introduction describes Tyler’s study as examining whether and how long teachers access the data, not their perceptions of it; page numbers were not provided in our copy. (LLM, conf=0.86)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Time allocated for teachers to review and discuss data in small groups and adopt procedures for discussing data is essential for data use (Tyler, 2013).”
§ Using information and communication technology (ICT)-based data systems to support teacher data-driven decision-making: Insights from the literature (2013-2023) > 3.2.3 Time and workload to engage in data
What the sources say
- Partly supportedcites Tyler, 2013 sourceExperimental — accuracy not yet measured
The Summary and Conclusions section says time needs to be allocated for teachers to access and analyze student data regularly; Prior Research also identifies allotted time as a factor that promotes data use. Neither passage specifies reviewing and discussing data in small groups or adopting procedures for those discussions. Page numbers are not available in our copy. (LLM, conf=0.87)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“If teachers' attitude towards data is negative, they will be less inclined to use data to inform practice (Tyler, 2013;van der Kleij & Eggen, 2013).”
§ Using information and communication technology (ICT)-based data systems to support teacher data-driven decision-making: Insights from the literature (2013-2023) > 3.2.17 Lack of user buy-in
What the sources say
- Partly supportedcites Tyler, 2013 sourceExperimental — accuracy not yet measured
In Prior Research (page unavailable), Tyler reports that teachers’ belief in the validity of test data affects data use, and describes teachers who were unconvinced that a data-analysis system was useful. This supports a link between particular negative perceptions and data use, but not the broader, categorical claim that any negative attitude toward data means teachers will be less inclined to use it to inform practice. (LLM, conf=0.82)
- Not checked — no full text of the sourcecites van der Kleij & Eggen, 2013 source
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“In addition, the availability of training for teachers increases their skills and confidence in using data systems to extract useful insights to inform learning and teaching activities (Tyler, 2013;van der Kleij & Eggen, 2013).”
§ Using information and communication technology (ICT)-based data systems to support teacher data-driven decision-making: Insights from the literature (2013-2023) > 4 Discussion
What the sources say
- Partly supportedcites Tyler, 2013 sourceExperimental — accuracy not yet measured
The Summary and Conclusions (page unavailable) says teachers need training and support to use data effectively and translate analysis into instructional practice. But it does not establish that training increases teachers’ skills or confidence. In Results and Discussion, additional training may have increased printing of data, but did not increase interactive use of the Dashboard. (LLM, conf=0.85)
- Not checked — no full text of the sourcecites van der Kleij & Eggen, 2013 source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“The ability of a process or system to continue functioning effectively over a long period of time enables long-term school improvement (Schildkamp et al., 2016).”
§ Using information and communication technology (ICT)-based data systems to support teacher data-driven decision-making: Insights from the literature (2013-2023) > 3.2.16 Sustainability
What the sources say
- Partly supportedcites Schildkamp et al., 2016 sourceExperimental — accuracy not yet measured
The Implications for practice section says sustainability matters because a sustained focus on data use is crucial for long-term school improvement. It does not establish the broader claim that any process or system that continues functioning effectively enables long-term improvement; it also says the long-term effects of data teams need further study. No page number is available in our copy. (LLM, conf=0.82)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
101 more claims · 1 with their cited sources checked
Create a free account to see all 188 claims and to verify the 39 references still open.
- Probably not a substantial claim. 58
- Borderline: one of the tests for a substantial claim is unclear. 1
- It may state two separate claims as one. 41
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
Methods for the thematic synthesis of qualitative research in systematic reviews
Thomas, J., & Harden, A. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-45 · Cited by 9,312 · cited 1×
“Three stages of thematic synthesis in systematic reviews highlighted by Thomas and Harden (2008) were used.”
Reprint—Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & and the PRISMA Group (2009) · Physical Therapy · doi:10.1093/ptj/89.9.873 · Cited by 2,486
Contemporary Issues in Technology and Teacher Education
(2025) · Contemporary issues in technology and teacher education · doi:10.70725/833004pqfpbd · Cited by 2,368
The acceptance and use of a virtual learning environment in China
van Raaij, E. M., & Schepers, J. J. L. (2008) · Computers & Education · doi:10.1016/j.compedu.2006.09.001 · Cited by 940 · cited 2×
“The individual dispositions cited by van Raaij and Schepers (2008) are expounded into teachers’ knowledge and awareness of data systems and teacher involvement.”
Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.038 · Cited by 449 · cited 1×
“Examples of popular LMS include Moodle, WebCT, Blackboard, and Sakai (Tempelaar et al., 2015).”
Mandinach, E. B., & Gummer, E. S. (2016) · Teaching and Teacher Education · doi:10.1016/j.tate.2016.07.011 · Cited by 363 · cited 1×
“Teacher data-driven decision-making (DDDM) to inform pedagogical practice and improve student outcomes is gaining significant prominence in many educational systems worldwide (Mandinach & Gummer, 2016; Mandinach & Schil-dkamp, 2021a, b).”
Datnow, A., & Hubbard, L. (2016) · Journal of Educational Change · doi:10.1007/s10833-015-9264-2 · Cited by 287 · cited 1×
“Research shows that workload influence how teachers perceive, utilise, and interpret data (Datnow & Hubbard, 2016).”
Wayman, J. C. (2005) · Journal of Education for Students Placed at Risk (JESPAR) · doi:10.1207/s15327671espr1003_5 · Cited by 249 · cited 1×
“…(e.g. demographics, test scores, enrolment information, attendance, and other student data) and related organisational data (e.g. staff data, organisational reports, school calendar, schedule data, and other school data) to inform various decisions institutions (Rankin, 2016, 2014; Wayman, 2005).”
Marsh, J. A., & Farrell, C. C. (2015) · Educational Management Administration & Leadership · doi:10.1177/1741143214537229 · Cited by 233
Cited by
Moradi, H. (2025) · Humanities and Social Sciences Communications · doi:10.1057/s41599-025-04524-5 · Cited by 45
“…between perceived ICT support and ease of use (r = 0.587) exceeds that of similar relationships reported in several Western studies (e.g., Alonzo et al. 2024; Tondeur et al. 2017), suggesting that institutional support may be particularly crucial for Chinese teachers ’ con fi dence in…”
InfluentialTorres-Santos, M. C., & Castulo, N. J. (2025) · Education 3-13 · doi:10.1080/03004279.2025.2468398 · Cited by 5
Sam, R., Voeun, N., Vando, P., Vet, K., No, S., Hour, R., Em, S., Sou, S., Phuong, S., & Da, V. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-3291-8.ch007 · Cited by 2
Alt, D., & Oved, O. (2026) · Teaching and Teacher Education · doi:10.1016/j.tate.2026.105483 · Cited by 1
Metadata
- Authors
- Alonzo, D., Quimno, V., Townend, G., & Oo, C. Z.
- Affiliations
- UNSW Sydney (AU)
- Corresponding author
- Alonzo, Dennis
- Venue
- Educational Assessment, Evaluation and Accountability
- Published
- 2024-10-05
- Volume
- 36
- Issue
- 4
- Pages
- 433-451
- ISSN
- 1874-8597 (ISSN-L)
- 1874-8600
- OpenAlex
- W4403117743
- Cited by
- 16
- References
- 47
- Citations by year
- 2026: 10 · 2025: 5 · 2024: 1
- FWCI
- 5.99
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- Educational Assessment Evaluation and Accountability (publishedVersion, cc-by)
- Funders
- University of New South Wales
- Topics
- Social Sciences › Education › Educational Assessment and Improvement
- Physical Sciences › Computer Science › Information Systems › Educational Management and Quality
- Physical Sciences › Computer Science › Computer Science Applications › Online Learning and Analytics
- Keywords
- educational information systems, information and communication technologies, technology adoption, school leadership, teacher dispositions, sociocultural context, educational technology design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Using information and communication technology (ICT)-based data systems to support teacher data-driven decision-making: Insights from the literature (2013–2023). https://app.cochat.ai/papers/10.1007/s11092-024-09443-8
- The paper
- Alonzo, D., Quimno, V., Townend, G., & Oo, C. Z. (2024). Using information and communication technology (ICT)-based data systems to support teacher data-driven decision-making: Insights from the literature (2013–2023). Educational Assessment, Evaluation and Accountability. https://doi.org/10.1007/s11092-024-09443-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
