Cited by 275Artificial Intelligence in EducationAcademic integrity and plagiarismStudent Assessment and Feedback

Educator and Student Perspectives on the Impact of Generative AI on Assessments in Higher Education

Open access
Smolansky, Adele, Cram, Andrew, Raduescu, Corina, Zeivots, Sandris, Huber, Elaine, Kizilcec, Rene F.·2023·Proceedings of the Tenth ACM Conference on Learning @ Scale

Abstract

The sudden popularity and availability of generative AI tools, such as ChatGPT that can write compelling essays on any topic, code in various programming languages, and ace standardized tests across domains, raises questions about the sustainability of traditional assessment practices. To seize this opportunity for innovation in assessment practice, we conducted a survey to understand both the educators' and students' perspectives on the issue. We measure and compare attitudes of both stakeholders across various assessment scenarios, building on an established framework for examining the quality of online assessments along six dimensions. Responses from 389 students and 36 educators across two universities indicate moderate usage of generative AI, consensus for which types of assessments are most impacted, and concerns about academic integrity. Educators prefer adapted assessments that assume AI will be used and encourage critical thinking, but students' reaction is mixed, in part due to concerns about a loss of creativity. The findings show the importance of engaging educators and students in assessment reform efforts to focus on the process of learning over its outputs, higher-order thinking, and authentic applications.

Integrity signals

Registry

Crossref · 10.1145/3573051.3596191

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 8 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    Educators have a strong preference for the adapted prompt.

    “It shows that educators have a strong preference for the adapted prompt while students are less convinced by the adaptation, especially for the essay prompt.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In today's context, generative AI tools such as ChatGPT are widely available and students have equal access to the tool.
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • Findingown data

    The assignment types rated to be least impacted by generative AI are presentations and discussions that are either pre-recorded or live.

    “The assignment types rated to be least impacted are presentations and discussions that are either pre-recorded or live.”
    Quote in the paperNot a substantial claim
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • Findingreasoning

    A similar pattern of drop and restoration was observed for students' ratings of the assessment's authenticity.

    “A similar pattern was observed for students' ratings of the assessment's authenticity.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In today's context, generative AI tools such as ChatGPT are widely available and students have equal access to the tool.
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • Findingown data

    About one in four students used ChatGPT weekly or daily for coursework (29% Australia; 24% US).

    “However, only one in four students used it weekly or daily for coursework (29% Australia; 24% US) and for fun (25% Australia; 14% US).”
    Quote in the paperNot a substantial claim
  • Findingown data

    Students are less convinced by the adaptation, especially for the essay prompt.

    “It shows that educators have a strong preference for the adapted prompt while students are less convinced by the adaptation, especially for the essay prompt.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In today's context, generative AI tools such as ChatGPT are widely available and students have equal access to the tool.
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • May combine two claims. 11
  • Classified as probably not a substantial claim. 12
  • The quote only partly states this claim. 3
  • May combine two claims.

    Findingown data

    The sample consists of 389 students and 36 educators from two selective institutions of higher education, one in Australia (338 students; 26 educators) and one in the United States (51 students; 10 educators).

    “The sample we have collected thus far consists of 389 students and 36 educators from two selective institutions of higher education, one in Australia (338 students; 26 educators) and one in the United States (51 students; 10 educators).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    Almost every student and all educators in the sample have heard of ChatGPT.

    “We find that almost every student and all educators in our sample have heard of ChatGPT.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Besides ChatGPT, students and educators use tools like Anthropic, Bard, BingChat, ClaudeAI, DALL-E, Midjourney, and Stable Diffusion.

    “Besides ChatGPT, students and educators use tools like Anthropic, Bard, BingChat, ClaudeAI, DALL-E, Midjourney, and Stable Diffusion.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    An important exception to the agreement is that students are more hesitant to endorse the adapted prompt than educators, for reasons including a perceived loss in creativity.

    “An important exception is that students are more hesitant to endorse the adapted prompt than educators for reasons including a perceived loss in creativity.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: In today's context, generative AI tools such as ChatGPT are widely available and students have equal access to the tool.
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims. The quote only partly states this claim.

    Findingown data

    For the coding assessment, students noted that they are already using various tools, such as Google or GitHub to search for similar codes, which is also widely accepted in the workplace.

    “For the coding assessment, students noted that they are already using various tools:”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In today's context, generative AI tools such as ChatGPT are widely available and students have equal access to the tool.
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Students had forward-looking ethical concerns, including that students should be allowed to use generative AI tools to boost productivity as long as they can be accepted in their future workplace.

    “Students also had forward-looking ethical concerns:”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In today's context, generative AI tools such as ChatGPT are widely available and students have equal access to the tool.
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • Probably not a substantial claim: may not pass S3 (load-bearing). The quote only partly states this claim.

    Findingown data

    Some students felt the adapted coding assessment replaces the teacher with ChatGPT, removing space for quality feedback.

    “Students also raised concerns about the adapted coding assessment:”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In today's context, generative AI tools such as ChatGPT are widely available and students have equal access to the tool.
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    Some students preferred to learn how to write code than learn to analyse in the adapted coding assessment.

    “Students also raised concerns about the adapted coding assessment:”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In today's context, generative AI tools such as ChatGPT are widely available and students have equal access to the tool.
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • May combine two claims.

    Findingown data

    There was consensus among students and educators that essays (including reports, literature reviews, case studies, research papers), computer code (including pseudo-code, mathematical proofs), short-answer and multiple-choice questions are very or at least moderately impacted by generative AI.

    “that essays (incl.reports, literature review, case studies, research papers), computer code (incl.pseudo-code, mathematical proofs), short-answer and multiple-choice questions are very or at least moderately impacted.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • May combine two claims. The quote only partly states this claim.

    Findingown data

    Students indicated that ChatGPT is useful to get them started as a prompt or inspiration but they would not use it directly as a source.

    “Yet students also indicated that ChatGPT is useful to get them started”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: In today's context, generative AI tools such as ChatGPT are widely available and students have equal access to the tool.
    • Rests on an assumption: Pooling responses across the two institutions is valid for observing major trends.
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    The study design yields a clear within-participant comparison of how the adaptation affects participants' judgement of assessment quality.

    “This yields a clear within-participant comparison of how the adaptation affects their judgement of assessment quality.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    Researchers have identified several challenges educators face in designing and implementing new online assessments, including additional teacher time and effort, logistics and timing, technology access, consistency, functionality, alignment with student preferences, preparing students for new formats, and institutional policies.

    “Researchers have identified several challenges educators face in designing and implementing new online assessments [4].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [4]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Premisecitation

    Unless educators and academic institutions adapt to generative AI, it can undermine academic integrity in online assessment and the purpose of higher education, and ultimately reduce the value of a university degree.

    “Unless educators and academic institutions adapt to this new reality, generative AI can undermine academic integrity in online assessment and the purpose of higher education to educate students, and ultimately reduce the value of a university degree [1].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [1]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Online assessment presents practical challenges for student authentication and academic integrity: identity verification is especially difficult in online essays, and remote invigilation is challenging for online examinations.

    “Online assessment presents practical challenges for student authentication and academic integrity: identity verification is especially difficult in online essays, and remote invigilation is challenging for online examinations [2,4].”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [2]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [4]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The framework for quality online assessment includes six design criteria and four contextual factors.

    “Building on an extensive literature review, they identified six design criteria and four contextual factors at play (Figure 1).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [5]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    The survey format and questions were almost identical for educators and students to enable comparison of their perspectives.

    “The survey format and questions were almost identical for educators and students since our goal is to compare their perspectives.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Generative AI tools can write human-like text in a conversational style, and ChatGPT has been applied in language translation, chat bots, writing articles, stories, computer code, and other types of writing.

    “Generative AI tools can write human-like text in a conversational style, and ChatGPT has been applied in language translation, chat bots for conversations with humans, writing articles, stories, computer code, and other types of writing [1].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [1]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Study design and conductcitation

    The survey instrument was developed to evaluate the impact across various dimensions of online assessments and to evaluate similarities and differences between student and educator perspectives.

    “The survey instrument we developed allows us to evaluate the impact across various dimensions of online assessments [5] and evaluate similarities and differences between the student and educator perspectives.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [5]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

18 of 18
  • The authors state this as an assumption.

    The framework for online assessment quality is likely to generalize across countries.

    “We believe that the framework is likely to generalize across countries and we are interested in examining if it can accurately reflect students' perspectives on assessment as well.”
  • The authors state this as an assumption.

    In today's context, generative AI tools such as ChatGPT are widely available and students have equal access to the tool.

    “Now consider the same assessment prompt again but in today's context when generative AI tools, such as ChatGPT, are widely available (i.e., students have equal access to the tool).”
  • The paper relies on this without support.

    ChatGPT can write compelling essays on any topic, code in various programming languages, and ace standardized tests across domains.

    “The sudden popularity and availability of generative AI tools, such as ChatGPT that can write compelling essays on any topic, code in various programming languages, and ace standardized tests across domains, raises questions about the sustainability of traditional assessment practices.”
  • The paper relies on this without support.

    Pooling responses across the two institutions is valid for observing major trends.

    “To analyze the data we have collected so far, we compute percentages and means of participants' ratings to observe major trends pooling across the two institutions.”
  • The paper relies on this without support.

    Students can potentially use generative AI tools like ChatGPT to cheat on online assessments by submitting essays that are not their own work.

    “Students can potentially use generative AI tools like ChatGPT to cheat on online assessments by submitting essays that are not their own work.”
5 of 5

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • In a May 2023 survey of 3,017 high school and college students, nearly one-third admitted to using ChatGPT to complete their homework.

    “In a survey by Intelligent.comconducted in May 2023 among 3,017 high school and college students, it was found that nearly one-third of the students admitted to using ChatGPT to complete their homework [6].”

    From Survey on Plagiarism Detection in Large Language Models: The Impact of ChatGPT and Gemini on Academic Integrity (2024) · cites this paper as [6]

    The Methods section reports a survey of 389 students and 36 educators at two higher-education institutions, not 3,017 high school and college students. Preliminary Findings report weekly or daily ChatGPT use for coursework (29% in Australia; 24% in the US), not that nearly one-third admitted using it to complete homework. Our copy does not mention an Intelligent.com survey. (LLM, conf=0.88)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured
  • GenAI may erode students' critical thinking and reflection if used uncritically, leading to 'metacognitive laziness'.

    “On the other, it may erode students' critical thinking and reflection if used uncritically, leading to what scholars have termed 'metacognitive laziness' (Fan et al., 2025;Smolansky et al., 2023).”

    From Enhancing service-learning through Generative AI: a mixed-methods study on educational Game design in a finance course (2025) · cites this paper as Smolansky et al., 2023

    The Preliminary Findings report students’ concerns about lost creativity and opportunities to learn in AI-adapted assessments, while the Discussion calls for assessments that center higher-order thinking. These passages support a general concern about learning, but do not say that uncritical GenAI use erodes critical thinking or reflection, or describe ‘metacognitive laziness.’ No page numbers are available in our copy. (LLM, conf=0.77)

    Experimental — accuracy not yet measured
  • Our understanding of the sociotechnical implications of GenAI on an increasingly diverse student population is still in its infancy.

    “While much of the discourse around students' use of GenAI tools has tended to focus on academic integrity concerns, our understanding of the sociotechnical implications on an increasingly diverse student population is still in its infancy [33, 41, 101, 116].”

    From "I'd Never Actually Realized How Big An Impact It Had Until Now": Perspectives of University Students with Disabilities on Generative Artificial Intelligence (2025) · cites this paper as [101]

    The Discussion (section 5; page unavailable) describes the study as ongoing, plans to examine differences across student backgrounds, and calls for attention to the interplay of technology, cognition, social interaction, and values. This supports the idea that understanding is still developing, but the paper does not establish that the student population is increasingly diverse or assess sociotechnical implications across that population broadly. (LLM, conf=0.82)

    Experimental — accuracy not yet measured
  • Educators favor adapted assessments integrating GenAI to maintain academic integrity and encourage critical thinking.

    “While educators favor adapted assessments integrating GenAI to maintain academic integrity and encourage critical thinking, students express mixed reactions, particularly concerning the loss of creativity [40].”
  • Students express mixed reactions, particularly concerning the loss of creativity.

    “While educators favor adapted assessments integrating GenAI to maintain academic integrity and encourage critical thinking, students express mixed reactions, particularly concerning the loss of creativity [40].”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Impact ratings are attributed to the wrong figure

    Minor

    The text cites Figure 1 for Australian educators' and students' impact ratings, but the paper identifies Figure 2 as showing those ratings. Figure 1 is the assessment framework.

1 of 1

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Smolansky, A., Cram, A., Raduescu, C., Zeivots, S., Huber, E., & Kizilcec, R. F.
Affiliations
  • Cornell University (US)
  • The University of Sydney (AU)
  • Cornell University, Ithaca, NY, USA
Venue
Proceedings of the Tenth ACM Conference on Learning @ Scale
Publisher
ACM
Published
2023-07-20
Pages
378-382
OpenAlex
W4384662087
Cited by
275
References
6
Citations by year
2026: 76 · 2025: 116 · 2024: 79 · 2023: 4
FWCI
63.59
Type
conference paper
Language
en
Open access
Locations
ACM Conference on Learning @ Scale (L@S) (publishedVersion)
Funders
USyd-Cornell Partnership Collaboration Awards (PCA) (1178246719)
Topics
  • Physical Sciences › Computer Science › Information Systems › Artificial Intelligence in Education
  • Social Sciences › Safety Research › Academic integrity and plagiarism
  • Social Sciences › Education › Student Assessment and Feedback
Keywords
generative AI, ChatGPT, higher education assessment, academic integrity, student perceptions, educator perspectives, assessment reform, critical thinking, creativity, higher-order thinking skills, artificial intelligence in education

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-23.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-23.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review