Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index; 4 of the 66 sources its claims cite were checked for support.

A Feasibility and Implementation Integrity Study of the Community Builder (CoBi): An AI-based Collaboration Support System in K-12 Classrooms

Open access
Breideband, Thomas, Bush, Jeffrey B., Reitman, Jason G., Rose, Sierra, Weatherley, John, Penuel, William R., D’Mello, Sidney K. · 2025 · International Journal of Artificial Intelligence in Education

Abstract

Recently, RSTs have been developed to provide feedback to students on their collaboration skills. We present the feasibility and implementation integrity study of Community Builder (CoBi), an AI-based collaboration support system in K-12 classrooms. CoBi provides automated feedback to students and teachers during collaborative problem solving.

Overview

CoChat Summary

TL;DR

CoBi is a classroom-wide, speech-based AI system that detects "uplifting" small-group discourse and displays non-evaluative, privacy-preserving visualizations at the class level to support K-12 students' collaboration skills. Across an interview study and two classroom pilots (61 consented students total), students and teachers broadly valued the concept and CoBi was technically feasible, but high-integrity use required substantial teacher professional learning.

Key findings

  • Study 1 (3 teachers, 12 students): broad buy-in for the idea; 83.3% of students preferred the qualitative tree over the quantitative radar; 75% of students were comfortable with teachers/researchers seeing their data, but some raised privacy concerns (one said CoBi must not be a "snitch"); all teachers worried real-time displays could disrupt teaching.
  • Study 2 (CoBi v1, 3 classrooms, 24 consented students): technically feasible — interfaces loaded, visualizations updated every 10 s, and reached end states after ~15 min; establishing and enacting phases succeeded, but the revisiting phase was cut short by time constraints, and the time slider in both teacher and student views caused confusion about whether visualizations were group- or class-level.
  • Study 3 (CoBi v2, 3 classrooms, 37 consented students, 20 days of instruction, ~200 min of video): teachers showed diverse adaptations and high-integrity engagements; some used noticings to prompt meta-analytical debate about classification accuracy, while two teachers steered discussions toward AI literacy and some used visualizations for participation assessment rather than reflection.
  • Model performance (Appendix): three fine-tuned RoBERTa classifiers achieved AUROCs of 0.84, 0.77, and 0.82 on human transcripts (0.71, 0.67, 0.71 on Whisper transcripts) for three of the four CA categories; "being equitable" occurred below 1% in training data and was not modeled.

Methods

  • Design-based research with three studies conducted in 2023/2024: Study 1 interview study (thematic analysis of teacher transcripts and student notes); Study 2 technical feasibility/initial implementation with CoBi v1 (field notes, classroom video, analysis of student-inputted CAs); Study 3 implementation integrity with CoBi v2 (grounded theory on field notes for 20 days and ~200 min of teacher focal video).
  • Participants: Study 1 — 3 middle school STEM/science teachers and 12 seventh graders from two schools; Study 2 — 1 lead teacher (plus a co-teacher for a summer camp) across 3 classrooms, 24 fully consented students; Study 3 — 3 teachers and 37 fully consented students across 3 classrooms (97 including non-consenting), same Western US district.
  • CoBi pipeline: omnidirectional tabletop microphones stream 10-s audio chunks to cloud servers, Whisper ASR transcribes, RoBERTa-based discourse classifiers detect CA enactments, and results are aggregated to classroom-level tree, radar, sentence cloud, and rule-based noticings visualizations.

Limitations

  • Stated: the study was not designed to test efficacy (future randomized control trials planned); CoBi is unimodal (verbal only, no nonverbal cues such as gaze); testing occurred in a limited number of schools and models were trained on data from one curriculum unit; only three of four CAs are modeled, and the fourth (equitable contribution) is being addressed via work on communicative influence.
  • Evident from the text: consented samples were small (24 and 37 students) and drawn from a single district with limited demographic diversity (district-wide: 20% Hispanic or Latino, 73% White, 1% Black, 3% Asian, 3% Two or more races); Study 1 student interviews were very short (2–5 min), unrecorded, and captured only as notes; Study 3 collected only teacher focal video, not student video.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1007/s40593-025-00509-2

Cites

93 of 93 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

4 Valid · 5 Not valid · 31 Not checked · 129 Own results and interpretations

69 more claims

Create a free account to see all 169 claims and to verify the 4 references still open.

See all claims — free account
  • Probably not a substantial claim. 63
  • It may state two separate claims as one. 53
  • The quote only partly states this claim. 2

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 85 references

Research works printed but not linked: 12

  1. Adamson, 2014, “Intensification of Group Knowledge Exchange with Academically Productive Talk Agents.”, Proceedings of the 10th International Conference on Computer Supported Collaborative Learning., 10
  2. Biddy, 2021, A Professional Development Model to Integrate Computational Thinking Into, Contemporary Issues in Technology and Teacher Education, 21, 53
  3. Bush, 2024, Curriculum routines to support collaborative AI partner deployment in classrooms, The workshop on child-centered AI design (CCAI) at CHI 2024.
  4. Cooperrider, 1987, A Contemporary Commentary on Appreciative Inquiry in Organizational Life, Adv Appreciative Inq, 1, 129
  5. Dede, 2010, “Comparing Frameworks for 21st Century Skills.”, 21st century skills: Rethinking how students learn.
  6. Hyesun, 2023, “Trust in AI and Its Role in the Acceptance of AI Technologies.”, International Journal of Human–Computer Interaction, 39, 1727, 10.1080/10447318.2022.2050543 · DOI · Paper page
  7. 2017, “PISA 2015 Collaborative Problem Solving Framework.”, PISA 2015 Assessment and Analytical Framework: Science, Reading, Mathematic, Financial Literacy and Collaborative Problem Solving, 131
  8. Radford, Alec, Jong Wook Kim, Tao Xu, Greg Brockman, Christine Mcleavey, and Ilya Sutskever. 2023. “Robust Speech Recognition via Large-Scale Weak Supervision.” Pp. 28492–518 in Proceedings of the 40th International Conference on Machine Learning. vol. 202, Proceedings of Machine Learning Research, edited by A. Krause, E. Brunskill, K. Cho, B. Engelhardt, S. Sabato, and J. Scarlett. PMLR.
  9. Resnick, 2010, “How (Well Structured) Talk Builds the Mind.”, Innovations in Educational Psychology: Perspectives on Learning, Teaching and Human Development, 163
  10. Richardson, Daniel C., and Rick Dale. 2006. “UC Merced Proceedings of the Annual Meeting of the Cognitive Science Society Title Grounding Dialogue: Eye Movements Reveal the Coordination of Attention During Conversation and the Effects of Common Ground Grounding Dialogue: Eye Movements Reveal the Coordination of Attention During Conversation and the Effects of Common Ground.” (28):28.
  11. Southwell, 2022, Challenges and feasibility of automatic speech recognition for modeling student collaborative discourse in classrooms, Proceedings of the 15th international conference on educational data mining (EDM 2022).
  12. Tegos, 2017, “Conversational Agents Improve Peer Learning through Building on Prior Knowledge.”, Journal of Educational Technology & Society, 20, 99

Cited by

See all 5

Metadata

Authors
Breideband, T., Bush, J. B., Reitman, J. G., Rose, S., Weatherley, J., Penuel, W. R., & D’Mello, S. K.
Affiliations
University of Colorado Boulder (US)
Corresponding author
Breideband, Thomas
Venue
International Journal of Artificial Intelligence in Education
Publisher
Elsevier BV
Published
2025-12
Volume
35
Issue
6
Pages
3579-3613
ISSN
1560-4292 (ISSN-L)
OpenAlex
W4416141883
Cited by
5
References
85
Citations by year
2026: 4 · 2025: 1
FWCI
2.02
Type
journal article
Language
en
Open access
Licence
Locations
International Journal of Artificial Intelligence in Education (publishedVersion, cc-by)
Funders
National Science Foundation (2019805)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
  • Social Sciences › Education › Artificial Intelligence in Education
  • Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
Keywords
classroom collaboration, speech recognition, junior high school students, teacher learning, implementation fidelity, K-12 education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A Feasibility and Implementation Integrity Study of the Community Builder (CoBi): An AI-based Collaboration Support System in K-12 Classrooms. https://app.cochat.ai/papers/10.1007/s40593-025-00509-2
The paper
Breideband, T., Bush, J. B., Reitman, J. G., Rose, S., Weatherley, J., Penuel, W. R., & D’Mello, S. K. (2025). A Feasibility and Implementation Integrity Study of the Community Builder (CoBi): An AI-based Collaboration Support System in K-12 Classrooms. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-025-00509-2

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.