Construction and Exploration of an Intelligent Evaluation System for Educational APP through Artificial Intelligence Technology
Open accessAbstract
To improve the evaluation accuracy of educational applications (APPs), the evaluation methods of educational APPs under artificial intelligence (AI) technology are explored. First, based on the principles of establishing evaluation indexes, the evaluation indexes for educational APPs are established. Second, an index evaluation system for educational APPs is constructed, and weights are assigned to the established evaluation indexes of educational APPs with the aid of analytic hierarchy process (AHP). Finally, the availability and effectiveness of the established evaluation system are investigated through empirical analysis. The results show: Five first-level indexes and 20 second-level indexes have been established through the existing index establishment principles, and a framework for intelligent evaluation of educational APPs has been successfully constructed; AHP is utilized to calculate the weight of each index; among the first-level indexes, the weight ratios of the educational and scientific indexes of the educational APPs are larger, whose proportion exceeds 60%; among the second-level indexes, the educational objective, educational principle, and knowledge systematization account for the highest proportion; therefore, the intelligent evaluation system of education APPs is obtained; finally, the empirical analysis has revealed that the score given by the intelligent evaluation system and the actual score of users have a high consistency, which proves that the proposed intelligent evaluation system is feasible and effective. The proposed intelligent evaluation system can be used as the basis for the design of educational APPs to improve the values of educational APPs.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
ChatGPT and Midjourney can improve the performance of school offices by completing routine and laboring tasks.
“They can improve the performance of school offices by completing routines and laboring tasks (Khan & Alotaibi, 2020;Li, 2021;Tang & Hai, 2021).”
From The impact of Generative AI (GenAI) on practices, policies and research direction in education: a case of ChatGPT and Midjourney (2024) · cites this paper as Tang & Hai, 2021
The Conclusion (page not available) suggests that more intelligent methods could reduce manual work in evaluating educational apps. It does not discuss ChatGPT, Midjourney, routine school-office tasks, or improved school-office performance. (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Brain intelligence: go beyond artificial intelligence
Lu, H., Li, Y., Chen, M., Kim, H., & Serikawa, S. (2018) · Mobile Networks and Applications · doi:10.1007/s11036-017-0932-8 · Cited by 1,153 · see citing works
Designing and creating an educational app rubric for preschool teachers
Papadakis, S., Kalogiannakis, M., & Zaranis, N. (2017) · Education and Information Technologies · doi:10.1007/s10639-017-9579-0 · Cited by 154 · see citing works
Cui, C., Wang, B., Zhao, Y., Wang, Q., & Sun, Z. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.10.324 · Cited by 71 · see citing works
Papadakis, S., Kalogiannakis, M., Orfanakis, V., & Zaranis, N. (2017) · International Journal of Web-Based Learning and Teaching Technologies · doi:10.4018/ijwltt.2017100106 · Cited by 69 · see citing works
Developing an App Evaluation Rubric for Practitioners in Special Education
Weng, P.-L. (2015) · Journal of Special Education Technology · doi:10.1177/016264341503000104 · Cited by 49 · see citing works
Shaw, C. M., & Tan, S. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.01.015 · Cited by 47 · see citing works
Integration of Fuzzy Analytic Hierarchy Process into multi-objective Computer Aided Molecular Design
Ooi, J., Promentilla, M. A. B., Tan, R. R., Ng, D. K. S., & Chemmangattuvalappil, N. G. (2017) · Computers & Chemical Engineering · doi:10.1016/j.compchemeng.2017.11.015 · Cited by 47 · see citing works
A Detailed Rubric for Assessing the Quality of Teacher Resource Apps
Cherner, T. S., Lee, C.-Y., Fegely, A. G., & Santaniello, L. A. (2016) · Journal of Information Technology Education Innovations in Practice · doi:10.28945/3527 · Cited by 34 · see citing works
An analytic hierarchy process for school quality and inspection
Qubaisi, A. A., Badri, M. A., Mohaidat, J. M., Aldhaheri, H., Yang, G., Rashedi, A. A., & Greer, K. (2016) · International Journal of Educational Management · doi:10.1108/ijem-09-2014-0123 · Cited by 34 · see citing works
An intelligent tutoring system for teaching the grammar of the Arabic language
Mahmoud, M. H., & El-Hamayed, S. H. A. (2016) · Journal of Electrical Systems and Information Technology · doi:10.1016/j.jesit.2016.04.001 · Cited by 31 · see citing works
Zhang, D., Shen, J., Liu, P., Zhang, Q., & Sun, F. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17062063 · Cited by 21 · see citing works
Siew, L. W., Singh, R., & Hoe, L. W. (2017) · Advanced Science Letters · doi:10.1166/asl.2017.9878 · Cited by 17 · see citing works
Yusoff, A. M., Salam, S., Mohamad, S. N. M., & Daud, R. (2017) · Advanced Science Letters · doi:10.1166/asl.2017.9956 · Cited by 8 · see citing works
A Participatory Design Approach for a Mobile App-Based Personal Response System
Song, D., & Oh, E. Y. (2016) · Journal of Educational Technology Systems · doi:10.1177/0047239515618465 · Cited by 6 · see citing works
Orthogonal design for scale invariant feature transform optimization
Ding, X., Luo, Y., Yi, Y., Jie, B., Wang, T., & Bian, W. (2016) · Journal of Electronic Imaging · doi:10.1117/1.jei.25.5.053030 · Cited by 5 · see citing works
Assessment of A Mobile Educational Coaching App
Shahidi, N., Tossan, V., & Cacho-Elizondo, S. (2017) · International Journal of Technology and Human Interaction · doi:10.4018/ijthi.2018010102 · Cited by 3 · see citing works
Using a web analysis tool to evaluate an educational app usage
de Oliveira, M. L., & Galembeck, E. (2015) · International Journal of Mobile Learning and Organisation · doi:10.1504/ijmlo.2015.070705 · Cited by 1 · see citing works
Flagged first, then by citations
1 of the 18 references couldn’t be matched to a known paper.
Research works printed but not linked: 3
- Tishman, S. Clapp, E. P. (2017). Building students' sense. Educational Leadership Journal of the Department of Supervision & Curriculum Development N.e.a, 75(2): 58-62.
- Xinkai, D. Yuan, T. (2015). The definition of strong province in ip and the principles and methods of construction of evaluation index. Science & Technology Progress and Policy, 398(4): 765-770.
- Chen, S. (2016). Construction of evaluation index system of innovation and entrepreneurship in local colleges and universities. journal of biological chemistry, 275(27): 20748-53.
Cited by
Sorted by citations
Chiu, T. K. F., Xia, Q., Zhou, X., Chai, C. S., & Cheng, M. (2023) · Computers and Education: Artificial Intelligence · doi:10.1016/j.caeai.2022.100118 · Cited by 1,181 · see citing works
Chiu, T. K. F. (2024) · Interactive Learning Environments · doi:10.1080/10494820.2023.2253861 · Cited by 852 · see citing works
“They can improve the performance of school o ffi ces by completing routines and laboring tasks (Khan & Alotaibi, 2020; Li, 2021; Tang & Hai, 2021).”
Gabsi, A. E. H. (2024) · Annals of Operations Research · doi:10.1007/s10479-024-06012-6 · Cited by 92 · see citing works
Framework of Artificial Intelligence Learning Platform for Education
Thongprasit, J., & Wannapiroon, P. (2022) · International Education Studies · doi:10.5539/ies.v15n1p76 · Cited by 38 · see citing works
Tian, X., & Cui, S. (2022) · Security and Communication Networks · doi:10.1155/2022/7483566 · Cited by 5 · see citing works
RetractedJuandi, T., Kaniawati, I., Samsudin, A., & Riza, L. S. (2023) · Momentum Physics Education Journal · doi:10.21067/mpej.v7i2.8252 · Cited by 5 · see citing works
Tu, Y. (2022) · Journal of Control Science and Engineering · doi:10.1155/2022/8512433 · Cited by 3 · see citing works
RetractedWang, Y. (2023) · Applied Mathematics and Nonlinear Sciences · doi:10.2478/amns.2023.2.01354 · Cited by 2 · see citing works
Design and Application of a Moral Education Evaluation System Based on Big Data
Guan, W. (2023) · International Conference on Applied Intelligence and Sustainable Computing (ICAISC) · doi:10.1109/icaisc58445.2023.10200506 · Cited by 1 · see citing works
Optimization of Information Retrieval Systems for Learning Contexts
Kameni, J. S. H., Batchakui, B., & Nkambou, R. (2024) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00415-z · Cited by 3 · see citing works
Salas-Rueda, R.-A., Ramírez-Ortega, J., Martínez-Ramírez, S.-M., Alvarado-Zamorano, C., Martínez, R. C., Cervantes, A. L. E., Madrigal, A. M. G., & González-Chávez, M.-F. (2021) · Dilemas contemporáneos Educación Política y Valores · doi:10.46377/dilemas.v9i1.2869 · Cited by 1 · see citing works
Wang, Z. (2023) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v18i22.44849 · Cited by 1 · see citing works
Juandi, T., Kaniawati, I., Samsudin, A., & Riza, L. S. (2024) · Journal for the Education of Gifted Young Scientists · doi:10.17478/jegys.1502503 · Cited by 1 · see citing works
Yin, Q., & Dong, Y. (2022) · Wireless Communications and Mobile Computing · doi:10.1155/2022/1852502 · Cited by 1 · see citing works
RetractedDu, L. (2023) · Learning and analytics in intelligent systems · doi:10.1007/978-3-031-38074-7_5
Zhao, Y.-J., Zhao, H.-Q., & Yang, X.-X. (2024) · Applied Mathematics and Nonlinear Sciences · doi:10.2478/amns-2024-1217
Chen, J. (2023) · International Conference on Information Technology: IoT and Smart City (ICIT) · doi:10.1109/itiotsc60379.2023.00051
Jia, P. (2025) · Applied Mathematics and Nonlinear Sciences · doi:10.2478/amns-2025-0686
Lu, D.-H., & Ge, Y.-P. (2026) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-025-10627-x
Evaluation method of college students’ education based on artificial neural network
Sheng, Q. (2026) · Discover Artificial Intelligence · doi:10.1007/s44163-026-01622-4
- Authors
- Tang, J., & Hai, L.
- Affiliations
- Hunan Mechanical And Electrical Polytechnic (CN)
- ORCID
- Tang, Juan
- Venue
- International Journal of Emerging Technologies in Learning (iJET)
- Published
- 2021-03-16
- Volume
- 16
- Issue
- 05
- Pages
- 17
- ISSN
- 1863-0383 (ISSN-L)
- OpenAlex
- W3139405371
- Cited by
- 20
- References
- 18
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 4 · 2023: 7 · 2022: 5 · 2021: 1
- FWCI
- 1.50
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- International Journal of Emerging Technologies in Learning (iJET) (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Educational Technology and Pedagogy
- Physical Sciences › Environmental Science › Ecological Modeling › Evaluation Methods in Various Fields
- Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
- Keywords
- educational apps, intelligent evaluation system, evaluation index system, analytic hierarchy process, index weighting, educational app design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
