Marking ‘on the fly’ in interactive oral assessments in Business
Open accessAbstract
Interactive orals (IOs) are described as a pedagogically rigorous and authentic form of assessment. However, there is little research to-date on the assessor experience of facilitating a conversation and marking ‘on the fly’, nor the student experience of thinking ‘on the spot’. This paper investigates assessor and student experiences of IOs in the context of a large Australian business school where IOs were implemented in five courses from several sub-disciplines. Participant interviews confirmed what is already known about IOs and their place as an assured assessment of learning in the Artificial Intelligence (AI) age. This study contributes to new knowledge on the assessor experience and suggests that academics will need a distinct skillset to ensure reliable and valid ‘conversational’ assessments.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Sotiriadou, P., Logan, D., Daly, A., & Guest, R. (2020) · Studies in Higher Education · doi:10.1080/03075079.2019.1582015 · Cited by 265 · see citing works
Flagged first, then by citations
- Authors
- Norman, A., Wilson, S., Casey, A., & Nash, J.
- Affiliations
- The University of Sydney (AU)
- Venue
- ASCILITE Publications
- Publisher
- Open Access Publishing Association
- Published
- 2024-11-23
- Pages
- 584-589
- ISSN
- 2653-665X (ISSN-L)
- OpenAlex
- W4404202792
- Cited by
- 0
- References
- 1
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- ASCILITE Publications (publishedVersion, cc-by)
- Funders
- University of Sydney
- Division of Emerging Frontiers
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Management and Marketing Education
- Social Sciences › Education › Evaluation of Teaching Practices
- Keywords
- student experience, business education, assessment validity and reliability, academic skills, AI-assisted assessment, authentic assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
