AI-Assisted Teaching and Learning: A Real Application Of Course Design, Assessment and Evaluation in Higher Education

Probably not a substantial claim: may not pass S3 (load-bearing).

The Decompose-Ask-Response (DAR) framework addresses Bartolomé et al.'s concerns over the lack of pedagogical grounding in educational technology.

“Using the Decompose-Ask-Response (DAR) framework, our research addresses Bartolomé et al. 's concerns over the lack of pedagogical grounding in educational technology [2].”

• cites [2] [2] A. Bartolomé, L. Castañeda, and J. Adell, 'Personalisation in educational technology: The absence of underlying pedagogies,' International journal of educational technology in higher education, vol. 15, pp. 1-17, 2018. - sourceSupported

Classified as probably not a substantial claim.

Our findings stress the gap between AI design and educational demands.

“Our findings further stress the gap between AI design and educational demands, reinforcing Zawacki-Richter et al.'s call for closer collaboration between educators and AI developers to build inclusive, effective systems. [6]”

• cites [6] [6] O. Zawacki-Richter, V. I. Marín, M. Bond, and F. Gouverneur, 'Systematic review of research on artificial intelligence applications in higher education-where are the educators?,' International Journal of Educational Technology in Higher Education, vol. 16, no. 1, pp. 1-27, 2019. - sourcePartly supported

  The review’s concluding discussion identifies a lack of educational perspectives in AI research and calls for more work by educators and learning designers to integrate AI into teaching. It also urges attention to what makes pedagogical sense. These points support the concern about a gap, but our copy does not explicitly call for collaboration between educators and AI developers to build inclusive, effective systems. (LLM, conf=0.82)

  Experimental — accuracy not yet measured

May combine two claims.

AI-assisted instruction significantly enhances student performance, particularly for students with weaker foundational knowledge.

“Our findings reveal that AI-assisted instruction significantly enhances student performance, particularly for those with weaker foundational knowledge.”

• Also stated in: § 4.1 Impact of AI-Assisted Teaching on Performance Across Competency Levels · p. 3 · plain

  “In summary, AI-assisted students outperform their peers across all categories, with the greatest improvement observed among lower-performing students.”

• Also stated in: § 5 Discussions · p. 6 · boosted

  “Our study shows that AI-assisted teaching significantly improves student performance, especially for those with weaker foundations, aligning with Kamalov et al [4] on AI's potential for personalized and collaborative learning.”

May combine two claims.

AI is notably effective in aiding conceptual understanding but shows limited impact on operational tasks.

“Moreover, we find that AI is notably effective in aiding conceptual understanding but shows limited impact on operational tasks.”

• Also stated in: § 4.2 Impact of Task Completion on Overall Performance with AI Assistance · p. 4 · plain

  “In summary, Experiment Two reveals that AI-assisted learning greatly improves conceptual understanding and higher-level tasks, though its effect on operational tasks remains limited, calling for more refined experimental designs.”

• Also stated in: § 6.1 Findings · p. 6 · plain

  “While AI excels in conceptual understanding, its effect on operational tasks is limited.”

• AssumptionRests on an assumption: Control group students likely had stronger foundations for operational tasks.

May combine two claims.

The treatment group achieved average scores of 72.5, 77.6, 86.4, and 91.5 across the four prior-performance categories (Fail, Pass, Good, Excellent), surpassing both their own prerequisite performance and the control group's scores.

“The treatment group achieved average scores of 72.5, 77.6, 86.4, and 91.5 across the four categories, surpassing both their own prerequisite performance and the control group's scores.”

May combine two claims.

The control group's scores declined, with the Pass category dropping to 61.6 and the Good category falling to 68.3, below its original range.

“In contrast, the control group's scores declined, with the Pass category dropping to 61.6 and the Good category falling to 68.3, below its original range.”

May combine two claims.

Among the 147 students in the treatment group, all completed the first conceptual task (Y1), and 91.84% completed both initial conceptual tasks, with only 8.16% failing the second task.

“Among the 147 students in the treatment group, all completed the first conceptual task (Y1), and 91.84% completed both initial conceptual tasks, with only 8.16% failing the second task.”

May combine two claims.

Of the 135 treatment group students who completed the first two tasks, 78 (57.8%) fully completed the third task (Y3), compared to 27 of 43 students (62.8%) in the control group.

“Of the 135 treatment group students who completed the first two tasks, 78 (57.8%) fully completed the third task (Y3), compared to 27 of 43 students (62.8%) in the control group, indicating no clear AI advantage for operational tasks since control group students likely had stronger foundations.”

May combine two claims.

OLS regression shows that average question length (X1), repetition of semantically similar words (X3), and referencing AI's keywords (X5) significantly affect test scores.

“Table 4 shows that variables such as average question length (X1), repetition of semantically similar words (X3), and referencing AI's keywords (X5) significantly affect test scores.”

May combine two claims.

In the control group, only 65.38% completed Y1 and just 41.35% completed both initial tasks.

“In contrast, Table 3 shows that in the control group, only 65.38% completed Y1 and just 41.35% completed both initial tasks.”

May combine two claims.

Longer, well-structured questions (X1) lead to better answers and higher scores.

“Longer, well-structured questions (X1) lead to better answers and higher scores, while high repetition rates (X3) correlate negatively, indicating comprehension struggles.”

May combine two claims.

Emotional expressions like 'don't understand' (X4) strongly predict lack of understanding among male students but are less meaningful for female students.

“Emotional expressions like 'don't understand' (X4) show gender differences: they strongly predict lack of understanding among male students but are less meaningful for female students, where they may reflect emotion rather than comprehension.”

May combine two claims.

Frequent keyword referencing (X5) signals effective dialogue and deeper understanding, improving performance.

“Frequent keyword referencing (X5) signals effective dialogue and deeper understanding, improving performance.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

The sample size and demographic composition may limit generalizability.

“The sample size and demographic composition may also limit generalizability, and the absence of long-term follow-up restricts understanding of AI's sustained impact.”