Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index; 14 of the 39 sources its claims cite were checked for support.

Integrating AI-generated content tools in higher education: a comparative analysis of interdisciplinary learning outcomes

Open access
Yan, Zhang, Qianjun, Tang · 2025 · Scientific Reports

Abstract

This study examines the integration of artificial intelligence-generated content (AIGC) tools across disciplines in higher education settings. Using a mixed-methods approach, we analyzed implementation patterns and learning outcomes across humanities, STEM, and social sciences programs at multiple institutions. Findings revealed a 37% increase in interdisciplinary project outcomes (measured by collaborative problem-solving scores, cross-domain knowledge integration ratings, and peer evaluation metrics) when AIGC tools were strategically implemented, with significant variations in effectiveness based on implementation approach. While these technologies demonstrated substantial value in breaking down disciplinary silos and accommodating diverse learning preferences, challenges emerged regarding algorithmic bias, digital equity, and maintenance of discipline-specific skills. This research contributes to educational theory by proposing a revised framework for AI-human collaboration in knowledge production. We conclude with policy recommendations for governance frameworks that balance innovation with academic integrity, emphasizing faculty co-design approaches and the establishment of cross-disciplinary communities of practice.

Overview

CoChat Summary

TL;DR

This mixed-methods study examines AIGC tool integration across higher education disciplines and reports improved interdisciplinary learning outcomes when tools are strategically implemented. It also identifies challenges involving algorithmic bias, digital equity, critical thinking, and discipline-specific skill maintenance.

Key findings

  • The abstract and conclusion report a 37% increase in interdisciplinary project outcomes with strategic AIGC implementation. Table 7 shows improvements over traditional teaching: interdisciplinary communication +23.6%, creativity +17.4%, knowledge acquisition +17.2%, skill development +16.0%, attitude formation +14.5%, and critical thinking +7.5%; ANOVA differences were significant at p < 0.01, with effect sizes of d = 1.12 for interdisciplinary communication, d = 0.89 for creativity, d = 0.85 for knowledge acquisition, and d = 0.42 for critical thinking.
  • Discipline adoption varied: STEM fields had the highest Technology Acceptance Index (mean TAI = 7.8) while humanities and fine arts were more moderate (mean TAI = 5.2). Table 6 reports STEM at 87% weekly use and 63% curriculum integration, humanities/social sciences at 62% and 58%, business/economics at 79% and 52%, arts/design at 56% and 34%, and medical/health sciences at 41% and 37%.
  • Integration challenges included 47% of educators reporting difficulties incorporating AIGC tools into existing learning management systems, and humanities departments experiencing 2.3 times more ethical dilemmas than STEM disciplines. Successful models included a 27% increase in conceptual understanding in STEM laboratory augmentation and a 31% average improvement in decision-making competencies in business simulation enhancement.
  • Institutions adhering to four or more universal implementation principles reported 68% higher faculty satisfaction and 54% improved student learning outcomes compared with those implementing fewer principles.

Methods

  • Mixed-methods design: quantitative pre-post experimental design with validated instruments measuring learning outcomes (n = 1099), 32-item Likert technology acceptance surveys, and LMS learning analytics; qualitative semi-structured interviews (n = 42), focus groups (n = 8), and classroom observations (86 sessions).
  • Sampling covered 15 higher education institutions across four geographical regions using multi-stage stratified random sampling, with 95% confidence level, ±3.5% margin of error, and 20% non-response adjustment. Table 4 reports 252 faculty and 1099 students across STEM, humanities, social sciences, and health sciences.
  • Analysis included descriptive statistics, t-tests, ANOVA, structural equation modeling, hierarchical linear modeling, ANCOVA, cluster analysis, and discriminant analysis; qualitative data were coded in NVivo 14.0 using open, axial, and selective coding, with inter-rater reliability via Cohen’s Kappa.

Limitations

  • Stated in the paper: the study focused on short-term learning outcomes and rapidly evolving AIGC technologies; the sample from specific disciplines may not fully represent higher education diversity; benefits were not distributed equally across student populations; outcomes depended heavily on prompting sophistication; and critical evaluation skills require careful instructional design.
  • Evident from the text: participant and institutional counts are inconsistent across sections—methods report n = 1099 and 15 institutions, data collection reports 428 participants across eight universities, and results report a survey of n = 487 across 26 institutions—which complicates interpretation of the sample and findings.
  • Evident from the text: several equations are presented without defined symbols or numeric values, limiting reproducibility of the quantitative models.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/s41598-025-10941-y

Cites

30 of 30 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig. 1 Cross-disciplinary AIGC integration heatmap.
Fig. 1 Cross-disciplinary AIGC integration heatmap.CC BY · PubMed Central
Fig. 2 Learning outcomes improvement heatmap by discipline.
Fig. 2 Learning outcomes improvement heatmap by discipline.CC BY · PubMed Central

Verification

Claims the paper makes

3 Valid · 14 Not valid · 26 Not checked · 51 Own results and interpretations

53 more claims · 4 with their cited sources checked

Create a free account to see all 94 claims and every source verdict.

See all claims — free account
  • Probably not a substantial claim. 12
  • It may state two separate claims as one. 27

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

2 of 2

Citations

Cites

Show all 23 references

Research works printed but not linked: 16

  1. Johnson, M. K., Smith, A. L. & Davis, R. P. Educational technology acceptance in higher education: A framework for AI integration. J. Educational Technol. Res. 28 (3), 145–162 (2023).
  2. Chen, X., Wang, H. & Liu, Z. AI-generated content tools in Language education: effectiveness and student perceptions. Comput. Educ. 201, 104–118 (2023).
  3. Martinez, L. A., Rodriguez, C. & Thompson, S. Diffusion models in educational image generation: applications and ethical considerations. Educational Technol. Soc. 26 (2), 89–103 (2023).
  4. Liu, S., Anderson, P. & Wilson, D. Epistemological traditions and AI adoption in academic disciplines. High. Educ. Res. Dev. 42 (4), 234–251 (2023).
  5. Thompson, R. & Williams, M. Cross-disciplinary educational technology taxonomy: A framework for comparative analysis. Educational Res. Rev. 38, 100–115 (2023).
  6. Crompton, H. & Burke, D. The use of technology in learning and teaching: A systematic review of the extant literature. Educational Res. Rev. 40, 100–118 (2023).
  7. Jalil, S., Myers, T. & Atkinson, I. ChatGPT and the future of digital literacy in higher education: A systematic review. Comput. Hum. Behav. 148, 107–121 (2023).
  8. Urban, M., Degeling, M. & Koban, L. Artificial intelligence in higher education: A critical examination of benefits and challenges. Eur. J. Educ. 59 (2), 234–251 (2024).
  9. Nugroho, R. A., Basuki, Y. & Surjono, H. D. The impact of AI writing assistants on academic writing in higher education: A systematic review. Education Tech. Research Dev. 72 (1), 145–167 (2024).
  10. Zhou, M. & Kim, S. Facilitating complex knowledge comprehension through AI-assisted learning environments. Comput. Educ. 210, 104–119 (2024).
  11. Sun, Y., Wang, H. & Chen, L. AI-enhanced learning outcomes in interdisciplinary education: A meta-analysis. Educational Res. Rev. 42, 100–116 (2024).
  12. Roehler, L., Fear, K. & Herrmann, B. Connecting response to literature with the academic disciplines through character analysis: some research implications. Res. Teach. Engl. 32 (2), 201–228 (1998).
  13. Warren, A. Biodiversity and sustainable development: Decision-making processes. Environ. Manage. 37 (3), 341–353 (2006).
  14. Escalante, J., Martin, K. & Brown, P. Limitations of AI in educational contexts: A critical analysis. Education Tech. Research Dev. 71 (3), 456–474 (2023).
  15. Niloy, M. R., Ahmed, S. & Rahman, T. Potential drawbacks of AI integration in learning environments. Comput. Hum. Behav. 142, 107–118 (2023).
  16. Yang, L., Zhang, W. & Kim, J. Critical evaluation of AI tools in higher education: benefits and risks. High. Educ. 89 (2), 234–251 (2025).

Cited by

See all 21

Metadata

Authors
Yan, Z., & Qianjun, T.
Venue
Scientific Reports
Published
2025-07-16
Volume
15
Issue
1
Pages
25802-25802
ISSN
2045-2322 (ISSN-L)
OpenAlex
W4412478578
Cited by
21
References
23
Citations by year
2026: 15 · 2025: 6
FWCI
21.67
Type
journal article
Language
en
Open access
Licence
Locations
  • Scientific Reports (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
American Indian Graduate Center
Topics
  • Social Sciences › Education › Artificial Intelligence in Education
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Social Sciences › Education › Educational Technology in Learning
Keywords
AI-generated content, interdisciplinary learning, learning outcomes, collaborative problem solving, algorithmic bias, digital equity, human-AI collaboration, academic integrity, AI governance, communities of practice, disciplinary silos

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Integrating AI-generated content tools in higher education: a comparative analysis of interdisciplinary learning outcomes. https://app.cochat.ai/papers/10.1038/s41598-025-10941-y
The paper
Yan, Z., & Qianjun, T. (2025). Integrating AI-generated content tools in higher education: a comparative analysis of interdisciplinary learning outcomes. Scientific Reports. https://doi.org/10.1038/s41598-025-10941-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.