Generative AI-Enhanced Oral Exams in Economics Education

Probably not a substantial claim: may not pass S3 (load-bearing).

AI-generated content challenges traditional definitions of authorship and originality.

“As Cotton, Cotton, & Shipway (2024) note, AI-generated content challenges traditional definitions of authorship and originality, a concern echoed by Perkins (2023).”

• cites Cotton, Cotton, & Shipway (2024) sourceNot checked — no full text of the source
• cites Perkins (2023) sourceSupported

Classified as probably not a substantial claim. May combine two claims.

Dependence on GenAI undermines critical thinking and reduces opportunities for deep learning.

“Bhullar, Joshi, & Chugh (2024) warn that such dependence undermines critical thinking and reduces opportunities for deep learning.”

• cites Bhullar, Joshi, & Chugh (2024) sourcePartly supported

  Section 3.3.2 says ChatGPT could reduce students’ motivation to explore topics and draw conclusions independently. Section 3.4 warns of possible learning impediments and stresses the importance of critical thinking. These passages support a concern about learning, but they do not establish that dependence undermines critical thinking or specifically reduces opportunities for deep learning. (LLM, conf=0.82)

  Experimental — accuracy not yet measured

May combine two claims.

When students talk through their answers with a peer, they think more carefully about their reasoning, making assessment more collaborative and learning oriented.

“Prior research on peer instruction shows that when students can talk through their answers with a peer, they think more carefully about their reasoning, and this makes the assessment more collaborative and learning oriented (Tullis and Goldstone, 2020).”

• cites Tullis and Goldstone, 2020 sourceSupported

May combine two claims.

Students who rely on tools like ChatGPT for support may experience reduced social interaction, lower wellbeing, and a weaker sense of belonging.

“Crawford et al. (2024) found that students who rely on tools like ChatGPT for support may experience reduced social interaction, lower wellbeing, and a weaker sense of belonging.”

• cites Crawford et al. (2024) sourceSupported

Probably not a substantial claim: may not pass S3 (load-bearing).

AI-generated responses to in-class prompts could sometimes contain errors.

“One common challenge is that AI-generated responses to in-class prompts could sometimes contain errors.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Working in pairs encouraged collaboration and reduced the temptation to let GenAI do all the work.

“Working in pairs encouraged collaboration and reduced the temptation to let GenAI do all the work.”

May combine two claims.

Most pairs in the GenAI-enhanced oral exams were self-selected, while only a few were assigned by the instructor.

“Most pairs were self-selected, while only a few were assigned by the instructor.”

May combine two claims.

Survey responses and instructor observations showed that students felt more motivated and preferred the GenAI-enhanced oral exam over traditional tests.

“Survey responses and instructor observations showed that students felt more motivated and preferred this new approach over traditional tests.”

May combine two claims.

Students appreciated the conversational tone and opportunity to think aloud in the GenAI-enhanced oral exams.

“They appreciated the conversational tone and opportunity to think aloud.”

May combine two claims.

Instructor informal check-ins helped keep students on task, and the group format added an extra layer of accountability.

“These informal check-ins helped keep students on task, and the group format itself added an extra layer of accountability.”

May combine two claims.

In the first round of one-on-one Zoom oral exams without GenAI, the format was time-consuming and difficult to scale.

“The format was timeconsuming and difficult to scale.”

• Also stated in: § Initial Exam Structure · plain

  “Even with a manageable class size of 40 students, it was challenging to reach everyone, let alone imagine doing so in larger classes.”

Probably not a substantial claim: may not pass S3 (load-bearing).

Many students offered more thoughtful responses because they were bouncing ideas off a peer in real time.

“In fact, many students offered more thoughtful responses simply because they were bouncing ideas off a peer in real time.”

Probably not a substantial claim: may not pass S3 (load-bearing).

We did not encounter language-related issues in our implementation of GenAI-enhanced oral exams.

“While we did not encounter language-related issues in our implementation, we acknowledge that oral exams may pose additional challenges for non-native speakers.”

May combine two claims.

Students in the GenAI-enhanced oral exams experienced a more engaging and interactive format, with questions tailored to their understanding and real-time feedback that encouraged deeper thinking.

“In this study, students experienced a more engaging and interactive format, with questions tailored to their understanding and real-time feedback that encouraged deeper thinking.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

Informal observations suggested that self-selected partners tended to collaborate more smoothly due to prior rapport, whereas instructor-assigned pairs sometimes required additional guidance to work effectively together.

“Informal observations suggested that self-selected partners tended to collaborate more smoothly due to prior rapport, whereas instructor-assigned pairs sometimes required additional guidance to work effectively together.”

May combine two claims.

The GenAI-enhanced oral exam format helped students feel more at ease, boosted their confidence, and led to thoughtful conversations.

“This format helped students feel more at ease, boosted their confidence, and led to some genuinely thoughtful conversations.”

Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

In one case, a student was granted extended time and allowed to complete the exam individually outside of class.

“In one case, the student was granted extended time and allowed to complete the exam individually outside of class.”

May combine two claims.

In informal course evaluations, students described the GenAI-enhanced oral exam format as more engaging and less stressful than traditional exams.

“In informal course evaluations for the principles of macroeconomics course, students described the format as more engaging and less stressful than traditional exams.”

May combine two claims.

In the first round of oral exams, not all students were able to finish within the scheduled class time, requiring extra sessions outside of class.

“Not all students were able to finish the exam within the scheduled class time, which meant extra sessions had to be arranged outside of class.”

May combine two claims.

GenAI tools are becoming easier to use and can produce accurate and detailed human-like responses to academic assignments.

“According to Lo (2023), these GenAI tools are becoming easier to use and can produce accurate and detailed human-like responses to academic assignments”

• cites Lo (2023)Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

The GenAI-enhanced oral exam approach offers a practical model for faculty interested in integrating GenAI tools like ChatGPT into oral assessments.

“This approach offers a practical model for faculty interested in integrating GenAI tools like ChatGPT into oral assessments.”

May combine two claims.

Remote settings weaken student-instructor connections and make academic dishonesty easier for students to rationalize.

“Studies by Swartz and Cole (2013) and Agha, Zhu, & Chikwa (2022) show that remote settings weaken student-instructor connections and make academic dishonesty easier for students to rationalize.”

• cites Swartz and Cole (2013)Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

• cites Agha, Zhu, & Chikwa (2022) sourceNot checked — no full text of the source

May combine two claims.

By guiding students through personalized, interactive questions, the GenAI-enhanced oral exam approach makes assessments more engaging while helping protect academic integrity.

“By guiding students through personalized, interactive questions, this approach makes assessments more engaging while helping protect academic integrity.”

• AssumptionRests on an assumption: Oral exams are a powerful way to truly understand what students know, more so than traditional written tests.

Probably not a substantial claim: may not pass S3 (load-bearing).

Many college students enjoy using GenAI as part of their academic experience.

“A recent survey confirms that many college students enjoy using GenAI as part of their academic experience (Mowreader, 2025).”

• cites Mowreader, 2025Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

May combine two claims.

No personally identifiable information was included in GenAI transcripts or prompts, and pseudonyms were used to ensure confidentiality.

“No personally identifiable information was included in GenAI transcripts or prompts, and we used pseudonyms to ensure confidentiality.”

May combine two claims.

GenAI-enhanced exams can support deeper learning and uphold academic integrity, particularly in hybrid and online courses.

“By fostering more interactive, personalized, and ethical evaluations, GenAI-enhanced exams can support deeper learning and uphold academic integrity, particularly in hybrid and online courses.”

• AssumptionRests on an assumption: Oral exams are a powerful way to truly understand what students know, more so than traditional written tests.

The quote only partly states this claim.

The GenAI-enhanced oral exam approach may not work well for all learners, especially those with delayed processing disorders.

“Despite these benefits, this approach may not work well for all learners, especially those with diverse needs.”

Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

When used thoughtfully, GenAI can strengthen the learning experience, help students think more deeply, stay more engaged, and feel more connected to the material without taking the place of meaningful instructor involvement.

“When used thoughtfully, GenAI can strengthen the learning experience, help students think more deeply, stay more engaged, and feel more connected to the material without taking the place of meaningful instructor involvement.”

Classified as probably not a substantial claim. May combine two claims.

The GenAI-enhanced oral exam approach provides a scalable alternative that still draws on the instructor's expertise and judgment.

“While the approach is not without challenges, it provides a scalable alternative that still draws on the instructor's expertise and judgment.”

Classified as probably not a substantial claim.

For students with delayed processing disorders, the fast-paced, conversational format can create added pressure, making it difficult to organize thoughts or respond confidently without additional time or accommodations.

“For students with delayed processing disorders, this fast-paced, conversational format can create added pressure, making it difficult for them to organize their thoughts or respond confidently without additional time or other accommodations.”

May combine two claims.

In a hybrid or online environment, the GenAI-enhanced oral exam approach creates a more connected and authentic learning experience while maintaining academic rigor and reducing the temptation to rely on shortcuts.

“In a hybrid or online environment, where it can be easy to disengage or feel isolated, this approach creates a more connected and authentic learning experience, while maintaining academic rigor and reducing the temptation to rely on shortcuts.”

• AssumptionRests on an assumption: Oral exams are a powerful way to truly understand what students know, more so than traditional written tests.

Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

The GenAI-enhanced oral exam approach is flexible, and the template can be adapted for other disciplines and course formats.

“The approach is flexible, and the template can be adapted for other disciplines and course formats.”

May combine two claims.

The GenAI prompt simulated a structured oral exam that elicited detailed responses and reinforced comprehension, critical thinking, and application of key macroeconomic concepts.

“The use of this prompt simulated a structured oral exam that elicited detailed responses, and reinforced comprehension, critical thinking, and application of key macroeconomic concepts.”

May combine two claims.

Utilizing breakout rooms for student pairs to complete the oral exams fostered collaboration and peer-to-peer dialogue, supporting students' sense of connection within an online environment.

“Utilizing breakout rooms for student pairs to complete the oral exams, fostered collaboration and peer-to-peer dialogue.This atmosphere supported students' sense of connection within an online environment.”

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

Oral exams may pose additional challenges for non-native speakers.

“While we did not encounter language-related issues in our implementation, we acknowledge that oral exams may pose additional challenges for non-native speakers.”

May combine two claims.

Traditional proctored exams can help maintain oversight and uphold academic integrity but are often costly and logistically demanding.

“While traditional proctored exams, in-person or remote, can help maintain oversight and uphold academic integrity, they are often costly and logistically demanding (Dadashzadeh, 2021).”

• cites Dadashzadeh, 2021Not matched

  Couldn’t be matched to a paper in Crossref, so it can’t be checked.

Probably not a substantial claim: may not pass S3 (load-bearing).

The GenAI-enhanced oral exam was implemented by one author across multiple sections of a hybrid-format principles of macroeconomics course.

“The GenAI-enhanced oral exam was implemented by one author across multiple sections of a hybrid-format principles of macroeconomics course.”

May combine two claims.

The GenAI-enhanced oral exam approach promoted engagement and minimized opportunities for academic dishonesty, making it a practical alternative.

“The approach promoted engagement and minimized opportunities for academic dishonesty, making it a practical alternative.”

• AssumptionRests on an assumption: Cheating on exams is a growing concern in higher education, especially with the rise of Generative AI.

Probably not a substantial claim: may not pass S3 (load-bearing).

A pilot of a related GenAI tutor-style prompt in an asynchronous Health Economics course demonstrated the potential to extend GenAI-assisted assessment into flexible learning environments.

“While this setting did not include the same oral exam format, it demonstrated the potential to extend GenAI-assisted assessment into flexible learning environments.”

May combine two claims.

All students used the free version of ChatGPT, and no subscription-based features were required.

“To ensure equitable participation, all students used the free version of ChatGPT.”

• Also stated in: § 3. AI-enhanced Oral Exams -Design and Implementation · plain

  “No subscription-based features were required, permitting every student to participate regardless of financial limitations.”

May combine two claims.

By automating parts of the assessment process, GenAI-enhanced oral exams help streamline assessment for instructors, allowing them to focus more on in-class activities and personalized support.

“By automating parts of the assessment process, GenAI-enhanced oral exams help streamline assessment for instructors, allowing them to focus more on in-class activities and personalized support.”

May combine two claims.

Incorporating real-time elements into assessments can safeguard against unauthorized GenAI use and ensure a more accurate reflection of each student's understanding.

“Incorporating real-time elements into assessments in the form of oral responses or monitored discussions can safeguard against unauthorized GenAI use and ensure a more accurate reflection of each student's understanding (Cotton, Cotton, & Shipway 2024).”

• cites Cotton, Cotton, & Shipway 2024 sourceNot checked — no full text of the source

Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

Designing GenAI prompts requires time, as does reviewing students' GenAI interactions to ensure the quality of student responses and alignment with course learning outcomes.

“Designing GenAI prompts requires time, as does reviewing students GenAI interactions to ensure the quality of student responses and alignment with course learning outcomes.”