Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 188

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

AI Chatbots in Chinese higher education: adoption, perception, and influence among graduate students—an integrated analysis utilizing UTAUT and ECM models

Open access
Tian, Weiqi, Ge, Jingshen, Zhao, Yu, Zheng, Xu · 2024 · Frontiers in Psychology

Abstract

This study is centered on investigating the acceptance and utilization of AI Chatbot technology among graduate students in China and its implications for higher education. Employing a fusion of the UTAUT (Unified Theory of Acceptance and Use of Technology) model and the ECM (Expectation-Confirmation Model), the research seeks to pinpoint the pivotal factors influencing students’ attitudes, satisfaction, and behavioral intentions regarding AI Chatbots. The study constructs a model comprising seven substantial predictors aimed at precisely foreseeing users’ intentions and behavior with AI Chatbots. Collected from 373 students enrolled in various universities across China, the self-reported data is subject to analysis using the partial-least squares method of structural equation modeling to confirm the model’s reliability and validity. The findings validate seven out of the eleven proposed hypotheses, underscoring the influential role of ECM constructs, particularly “Confirmation” and “Satisfaction,” outweighing the impact of UTAUT constructs on users’ behavior. Specifically, users’ perceived confirmation significantly influences their satisfaction and subsequent intention to continue using AI Chatbots. Additionally, “Personal innovativeness” emerges as a critical determinant shaping users’ behavioral intention. This research emphasizes the need for further exploration of AI tool adoption in educational settings and encourages continued investigation of their potential in teaching and learning environments.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fpsyg.2024.1268549

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 27 references

Research works printed but not linked: 63

  1. Achiam, 2023, GPT-4 Technical Report
  2. Ain, 2016, The influence of learning value on learning management system use, Inf. Dev., 32, 1306, 10.1177/0266666915597546 · DOI · Paper page
  3. Alotumi, 2022, Factors influencing graduate students’ behavioral intention to use Google classroom: case study-mixed methods research, Educ. Inf. Technol., 27, 10035, 10.1007/s10639-022-11051-2 · DOI
  4. Al-Saedi, 2020, Developing a general extended UTAUT model for M-payment adoption, Technol. Soc., 62, 101293, 10.1016/j.techsoc.2020.101293 · DOI · Paper page
  5. Bagozzi, 1988, On the evaluation of structural equation models, J. Acad. Mark. Sci., 16, 74, 10.1007/BF02723327 · DOI · Paper page
  6. Bao, 2017, Factors influencing the intention to use mobile learning among open education learners, J. Dist. Educ., 3, 102, 10.15881/j.cnki.cn33-1304/g4.2017.03.012 · doi:10.15881/j.cnki.cn33-1304/g4.2017.03.012
  7. Brislin, 1986, The wording and translation of research instruments, 37
  8. Chin, 1998, The partial least squares approach for structural equation modeling, Adv. Hosp. Leis., 8, 295
  9. Cidral, 2018, E-learning success determinants: Brazilian empirical study, Comput. Educ., 122, 273, 10.1016/j.compedu.2017.12.001 · DOI · Paper page
  10. Dajani, 2019, Behavioral intention of animation usage among university students, Heliyon, 5, e02536, 10.1016/j.heliyon.2019.e02536 · DOI
  11. Donaldson, 2010, Student acceptance of mobile learning
  12. El-Masri, 2017, Factors affecting the adoption of e-learning systems in Qatar and USA: extending the unified theory of acceptance and use of technology 2 (UTAUT2), Educ. Technol. Res. Dev., 65, 743, 10.1007/s11423-016-9508-8 · DOI · Paper page
  13. Gan, 2015, Continuance intention of academic blogs: the effects of interactivity, immersion, and satisfaction, Inf. Sci., 3, 70, 10.13833/j.cnki.is.2015.03.014 · doi:10.13833/j.cnki.is.2015.03.014
  14. Haenlein, 2004, A beginner’s guide to partial least squares analysis, Underst. Stat., 3, 283, 10.1207/s15328031us0304_4 · DOI · Paper page
  15. Hamoudi, 2023, Artificial intelligence in medicine and medical education, Adv. Biomed. Health Sci., 2, 1, 10.4103/abhs.abhs_69_22 · DOI
  16. Henseler, 2012, Goodness-of-fit indices for partial least squares path modeling, Comput. Stat., 28, 565, 10.1007/s00180-012-0317-1 · DOI · Paper page
  17. Holden, 2009, The technology acceptance model: its past and its future in health care, J. Biomed. Inform., 43, 159, 10.1016/j.jbi.2009.07.002 · DOI · Paper page
  18. Horodyski, 2023, Recruiter's perception of artificial intelligence (AI)-based tools in recruitment, Comput. Hum. Behav. Rep., 10, 100298, 10.1016/j.chbr.2023.100298 · DOI
  19. Hou, 2023, ChatGPT legal challenges and institutional responses in academic use, J. Northeast Norm. Univ. (Philos. Soc. Sci. Edition), 324, 29, 10.16164/j.cnki.22-1062/c.2023.04.004 · doi:10.16164/j.cnki.22-1062/c.2023.04.004
  20. Hu, 2020, Exploring factors affecting academics’ adoption of emerging mobile technologies-an extended UTAUT perspective, Educ. Inf. Technol., 25, 4615, 10.1007/s10639-020-10171-x · DOI · Paper page
  21. Kock, 2018, Minimum sample size estimation in PLS-SEM: An application in tourism and hospitality research, Applying partial least squares in tourism and hospitality research, 1
  22. Kumar, 2019, Google classroom for mobile learning in higher education: modelling the initial perceptions of students, Educ. Inf. Technol., 24, 1793, 10.1007/s10639-018-09858-z · DOI · Paper page
  23. Lee, 2010, Explaining and predicting users’ continuance intention toward e-learning: An extension of the expectation-confirmation model, Comput. Educ., 54, 506, 10.1016/j.compedu.2009.09.002 · DOI · Paper page
  24. Lee, 2023, Understanding continuance intention of artificial intelligence (AI)-enabled mobile banking applications: an extension of AI characteristics to an expectation confirmation model, Humanit. Soc. Sci. Commun., 10, 1, 10.1057/s41599-023-01845-1 · DOI
  25. Li, 2019, Examining EFL learners’ individual antecedents on the adoption of automated writing evaluation in China, Comput. Assist. Lang. Learn., 32, 784, 10.1080/09588221.2018.1540433 · DOI
  26. Li, 2016, Research on the continuance intention and mechanism of social reading app usage among college students, J. Chin. Libr. Inf. Sci., 1, 52, 10.13530/j.cnki.jlis.160005 · doi:10.13530/j.cnki.jlis.160005
  27. Lori, 2015, Usability, expectation, confirmation, and continuance intentions to use electronic textbooks, Behav. Inform. Technol., 34, 992, 10.1080/0144929X.2015.1039061 · DOI
  28. Lu, 2019, Developing customer product loyalty through mobile advertising: affective and cognitive perspectives, Int. J. Inf. Manag., 47, 101, 10.1016/j.ijinfomgt.2018.12.020 · DOI
  29. MacNeil, 2022, Generating diverse code explanations using the GPT-3 large language model, 37
  30. Mageira, 2022, Educational AI chatbots for content and language integrated learning, Appl. Sci., 12, 3239, 10.3390/app12073239 · DOI · Paper page
  31. Moore, 2022, Assessing the quality of student-generated short answer questions using GPT-3[C], 243
  32. Neeraj, 2022, Tourists’ post-adoption continuance intentions of chatbots: integrating task–technology fit model and expectation–confirmation theory, Foresight, 25, 209, 10.1108/FS-10-2021-0207 · DOI
  33. Pal, 2020, The future of smartwatches: assessing the end-users’ continuous usage using an extended expectation-confirmation model, Univ. Access Inf. Soc., 19, 261, 10.1007/s10209-018-0639 · doi:10.1007/s10209-018-0639
  34. Qiang, 2023, Adoption of new technologies under the myth of the electronic revolution and identity identification: a user study of ChatGPT based on grounded theory, News Univ., 4, 59, 10.20050/j.cnki.xwdx.2023.04.008 · doi:10.20050/j.cnki.xwdx.2023.04.008
  35. Raza, 2022, E-learning in higher education during COVID-19: evidence from black-board learning system, J. Appl. Res. High. Educ., 14, 1603, 10.1108/JARHE-02-2021-0054 · DOI
  36. Samsudeen, 2019, University students’ intention to use e-learning systems, Interact. Technol. Smart Educ., 16, 219, 10.1108/ITSE-11-2018-0092 · DOI
  37. Shawar, 2017, Integrating CALL systems with chatbots as conversational partners, Comput. Sist., 21, 615, 10.13053/cys-21-4-2868 · DOI
  38. Sitar-Taut, 2021, Mobile learning acceptance and use in higher education during social distancing circumstances: an expansion and customization of UTAUT2, Online Inf. Rev., 45, 1000, 10.1108/OIR-01-2021-0017 · DOI
  39. Stone, 1976, Cross-validatory choice and assessment of statistical predictions (with discussion), J. R. Stat. Soc., Ser. B Methodol., 38, 102, 10.1111/j.2517-6161.1976.tb01573.x · DOI · Paper page
  40. Šumak, 2010, Investigation of E-learning system acceptance using UTAUT, Int. J. Eng. Educ., 26, 1327
  41. Su, 2023, Collaborating with ChatGPT in argumentative writing classrooms, Assess. Writ., 57, 100752, 10.1016/j.asw.2023.100752 · DOI · Paper page
  42. Tam, 2020, Exploring the influential factors of continuance intention to use mobile apps: extending the expectation confirmation model, Inf. Syst. Front., 22, 1, 10.1007/s10796-018-9864-5 · DOI · Paper page
  43. Tan, 2023, Legal risks and governance pathways of ChatGPT, J. Hunan Univ. Sci. Technol. (Soc. Sci. Edition), 26, 117
  44. Twum, 2022, Using the UTAUT, personal innovativeness and perceived financial cost to examine student’s intention to use E-learning, J. Sci. Technol. Policy Manag., 13, 713, 10.1108/JSTPM-12-2020-0168 · DOI
  45. Venkatesh, 2003, User acceptance of information technology: toward a unified view, MIS Q., 27, 425, 10.2307/30036540 · DOI · Paper page
  46. Wan, 2016, Research on factors influencing the adoption and use of information technology by primary and secondary school teachers in ethnic regions based on the UTAUT model, Mod. Distance Educ., 2, 70, 10.13927/j.cnki.yuan.2016.0021 · doi:10.13927/j.cnki.yuan.2016.0021
  47. Wang, 2016, Analysis of factors influencing MOOC learning behavior based on the UTAUT model, Res. Digit. Educ., 6, 43, 10.13811/j.cnki.eer.2016.06.006 · doi:10.13811/j.cnki.eer.2016.06.006
  48. Wang, 2023, Exploring the potential impact of artificial intelligence (AI) on international students in higher education: generative AI, Chatbots, analytics, and international student success, Appl. Sci., 13, 6716, 10.3390/app13116716 · doi:10.3390/app13116716
  49. Wang, 2009, Investigating the determinants and age and gender differences in the acceptance of mobile learning, Br. J. Educ. Technol., 40, 92, 10.1111/j.1467-8535.2007.00809.x · DOI · Paper page
  50. Wang, 2020, Factors influencing relevance judgment in video retrieval: an empirical study based on PLS-path analysis, J. Inf. Sci., 39, 926, 10.3772/j.issn.1000-0135.2020.09.005 · doi:10.3772/j.issn.1000-0135.2020.09.005
  51. Wu, 2022, Exploring factors of the willingness to accept AI-assisted learning environments: an empirical investigation based on the UTAUT model and perceived risk theory, Front. Psychol., 13, 870777, 10.3389/fpsyg.2022.870777 · DOI · Paper page
  52. Xu, 2020, AI customer service: task complexity, problem-solving ability, and usage intention, Australas. Mark. J., 28, 189, 10.1016/j.ausmj.2020.03.005 · DOI · Paper page
  53. Yang, 2016, Factors influencing the sustained usage behavior of MOOC users, Open. Educ. Res., 1, 100
  54. Yang, 2015, An empirical study on continued usage behavior of digital educational resources: based on an extended ECM-ISC model, Chinese Electrified Educ., 11, 54, 10.3969/j.issn.1006-9860.2015.11.008 · doi:10.3969/j.issn.1006-9860.2015.11.008
  55. Zeebaree, 2022, Sustainable adoption of E-government from the UTAUT perspective, Sustain. For., 14, 5370, 10.3390/su14095370 · DOI
  56. Zhai, 2022, Research on factors influencing user intention to use ChatGPT, Inf. Theory Pract., 2, 28, 10.13833/j.issn.1007-7634.2022.02.004 · doi:10.13833/j.issn.1007-7634.2022.02.004
  57. Zhang, 2023, Algorithmic "comfort zone" and its breakthrough: a discussion on the algorithmic content of ChatGPT, Party Government Stud., 3, 22, 10.13903/j.cnki.cn51-1575/d.20230220.001 · doi:10.13903/j.cnki.cn51-1575/d.20230220.001
  58. Zhang, 2023, Research on factors influencing user intention to use ChatGPT, Inf. Theory Pract., 4, 15, 10.16353/j.cnki.1000-7490.2023.04.003 · doi:10.16353/j.cnki.1000-7490.2023.04.003
  59. Zhang, 2016, Research on factors influencing the use of online learning spaces by primary and secondary school teachers: a survey based on the UTAUT model, Chinese Digit. Educ., 3, 99, 10.3969/j.issn.1006-9860.2016.03.017 · doi:10.3969/j.issn.1006-9860.2016.03.017
  60. Zhang, 2017, Research on continued usage behavior of crowdsourcing community users: based on ECM-ISC and commitment-trust theory, Inf. Resourc. Manag., 2, 54, 10.3969/j.issn.1002-0314.2017.02.008 · doi:10.3969/j.issn.1002-0314.2017.02.008
  61. Zhu, 2017, Research on the effects of interactivity and immersion in online learning spaces on students' continuance intention, Chinese Digit. Educ., 2, 89, 10.3969/j.issn.1006-9860.2017.02.014 · doi:10.3969/j.issn.1006-9860.2017.02.014
  62. Zhu, 2023, How to harness the potential of ChatGPT in education?[J], Knowl. Manag. E-Learn., 15, 133, 10.34105/j.kmel.2023.15.008 · DOI
  63. Zhu, 2023, Operating modes, key technologies, and future prospects of ChatGPT, J. Xinjiang Norm. Univ. (Philos. Soc. Sci. Edition), 4, 113, 10.14100/j.cnki.65-1039/g4.20230217.001 · doi:10.14100/j.cnki.65-1039/g4.20230217.001

Cited by

See all 188

Metadata

Authors
Tian, W., Ge, J., Zhao, Y., & Zheng, X.
Venue
Frontiers in Psychology
Published
2024-02-07
Volume
15
Pages
1268549-1268549
ISSN
1664-1078 (ISSN-L)
OpenAlex
W4391609188
Cited by
188
References
27
FWCI
71.69
Type
journal article
Language
en
Open access
gold

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: AI Chatbots in Chinese higher education: adoption, perception, and influence among graduate students—an integrated analysis utilizing UTAUT and ECM models. https://app.cochat.ai/papers/10.3389/fpsyg.2024.1268549
The paper
Tian, W., Ge, J., Zhao, Y., & Zheng, X. (2024). AI Chatbots in Chinese higher education: adoption, perception, and influence among graduate students—an integrated analysis utilizing UTAUT and ECM models. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2024.1268549

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.