Replacing Traditional Written Laboratory Reports with Interactive Oral Assessments: Enhancing Laboratory Skill Assessment in Undergraduate Genetics Education
Open accessAbstract
Traditional written laboratory assessments often fail to accurately measure individual laboratory competencies, prompting the introduction of short interactive oral assessments (mini-IOA) in a second-year Genetics course at the [University]. This comparative longitudinal mixed-methods study (2009–2023) evaluated the replacement of written laboratory reports with mini-IOA, comparing student performance, perceptions, and equity outcomes before ( n = 218) and after ( n = 504) implementation. Data analysis revealed significantly enhanced academic performance following mini-IOA introduction, with laboratory scores improving from 67.8% to 76.2% ( p < 0.0001) and theoretical assessment performance increasing from 55.4% to 60.5% ( p < 0.01). Student satisfaction significantly improved across multiple measires, with the majority of students expressing strong preference for mini-IOA over traditional written reports despite initial anxiety that decreased over time. The interactive format provided immediate feedback opportunity, fostering deeper understanding of theoretical and practical course content. Statistical analysis demonstrated that mini-IOA were equitable across different student cohorts, with no significant performance differences based on gender, international status, degree program or age. Implementation analysis revealed practical advantages including enhanced academic integrity, immediate marking efficiency, and authentic assessment of individual understanding. This study provides evidence that mini-IOA represent an effective, equitable alternative to written laboratory assessment, with findings consistent with substantial benefits for both students and educators in contemporary science education.
AI snapshot
Written from the paper’s full text.
TL;DR
This longitudinal mixed-methods study evaluated replacing traditional written laboratory reports with short interactive oral assessments (mini-IOA) in a second-year undergraduate Genetics course. It reports improved laboratory and theoretical marks, higher student satisfaction, reduced anxiety over repeated exposure, and no significant performance differences across gender, international status, degree program, or age.
Key findings
- Laboratory marks increased from 67.8% pre-IOA to 76.2% post-IOA (p < 0.0001), and theoretical assessment marks increased from 55.4% to 60.5% (p = 0.0097; abstract reports p < 0.01).
- Student satisfaction significantly improved on three myCourseExperience questions; in 2023 surveys, most students agreed or strongly agreed that mini-IOA were effective, provided helpful feedback, had real-world relevance, and aided understanding and engagement, with effectiveness agreement increasing from Survey 1 to Survey 2 and anxiety significantly decreasing after repeated mini-IOA.
- Mini-IOA were equitable: no significant differences in mean scores by gender, international versus domestic enrolment, degree program, or age group.
- Implementation advantages included immediate marking efficiency and academic integrity; traditional reports for 100 students might require 20–30 h of marking, while mini-IOA need 3–4 h of direct assessment, and classes of 20–25 students with 3–4 teaching staff complete assessments in 45–60 min.
Methods
- Comparative longitudinal mixed-methods study in a second-year Genetics course from 2009–2023: pre-IOA cohorts 2009–2013 (n = 218) and post-IOA cohorts 2015–2023 (n = 504), with 2014 excluded as a transition year; total 722 students.
- The intervention replaced formal written laboratory reports with six summative mini-IOAs of approximately five minutes each in an eight-week laboratory component; session marks combined pre-laboratory quiz (25%), experimental results (37.5%), and mini-IOA (37.5%), scored with a standardised rubric across four criteria (0–5 each).
- Data included enrolment demographics, assessment grades, myCourseExperience surveys (2009–2023, average response rate 33.4%), and optional 2023 pre/post surveys (n = 59, 90% response) with Likert items and open responses; analysis used GraphPad Prism, Mann-Whitney/Kruskal-Wallis/t-tests with p < 0.05, and inductive thematic analysis.
Limitations
- The paper states that myCourseExperience response rate was 33.4% and subject to response bias; the study was conducted at a single institution and discipline; the before-and-after design lacked a contemporaneous control group and cannot account for all confounders; long-term retention and subsequent-course performance were not examined.
- The paper also notes temporal confounds across 14 years, including modest post-IOA increases in mean GPA and age that reflect a university-wide trend but cannot be entirely discounted; different questions were used for individual students to preserve integrity, limiting strict question-by-question comparability; and formal inter-rater reliability coefficients were not calculated across the full dataset.
- The paper states that the quasi-experimental design means observed associations cannot be interpreted as strictly causal.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
8 of 38 cited sources checked · 6 supported · 0 flagged · accuracy not yet measured
- Premisecitation
Written report-based assessments are ubiquitous in undergraduate science laboratories due to their convenience, ease of implementation and being resource-friendly.
“Written report-based assessments are ubiquitous in undergraduate science laboratories due to their convenience, ease of implementation and being resource-friendly (Adams, 2009).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Adams, 2009 source
In “The importance of social interaction during laboratory classes” (page not given), Adams describes an alternative assessment that would eliminate the need for tedious write-ups after every class, indicating that written reports are used in laboratory assessment. The passage does not establish that they are ubiquitous across undergraduate science laboratories or that their use is due to convenience, ease of implementation, or resource efficiency. (LLM, conf=0.78)
Experimental — accuracy not yet measured
- Premisecitation
Report writing can devolve into a perfunctory type exercise of completing predetermined sections, rather than fostering argumentative skills or critical thinking.
“Consequently, report writing can devolve into a perfunctory type exercise of completing predetermined sections, rather than fostering argumentative skills or critical thinking (Gouvea et al., 2022).”
Quote in the paperSubstantial claim1 of 1 sources checked- cites Gouvea et al., 2022 source
- Premisecitation
Oral assessments provide authentic evaluation opportunities that align closely with professional workplace requirements.
“Furthermore, oral assessments provide authentic evaluation opportunities that align closely with professional workplace requirements (Iannone et al., 2020;Sotiriadou et al., 2020;Turjamaa et al., 2018)”
Quote in the paperSubstantial claim2 of 3 sources checked - Findingown data
Immediate feedback and opportunity to discuss problems in-person was described as enabling students to grasp concepts more thoroughly compared to passive learning methods such as reading or watching content recordings.
“The immediate feedback and opportunity to discuss problems in-person was described as enabling students to grasp concepts more thoroughly compared to passive learning methods such as reading or watching content recordings”
Quote in the paperSubstantial claim
- Findingown data
myCourseExperience scores significantly improved across questions related to course satisfaction, the utility of assessment items, and the quality of feedback.
“The significant improvements in myCourseExperience scores across questions related to course satisfaction, the utility of assessment items, and the quality of feedback suggest that students perceive the mini-IOA as beneficial to their learning experience.”
Quote in the paperSubstantial claim - Findingown data
A systematic comparison of mini-IOA and traditional written laboratory reports across key performance factors reveals direct advantages and challenges for each approach.
“A systematic comparison of mini-IOA and traditional written laboratory reports across key performance factors reveals direct advantages and challenges for each approach (Table 2).”
Quote in the paperSubstantial claim - Findingreasoning
IOA were repeatedly highlighted as a strong tool for reinforcing understanding.
“IOA were repeatedly highlighted as a strong tool for reinforcing understanding.”
Quote in the paperSubstantial claim - Findingown data
Anxiety and nervousness constituted a prominent theme across responses; students recurrently described feeling anxious or nervous during the assessment.
“Anxiety and nervousness constituted a prominent theme across responses.Students recurrently described feeling anxious or nervous during the assessment”
Quote in the paperNot a substantial claim - Findingown data
The implementation of mini-IOA demonstrated equitable assessment outcomes across all demographic groups examined.
“The implementation of mini-IOA demonstrated equitable assessment outcomes across all demographic groups examined.”
Quote in the paperSubstantial claim - Findingown data
There was a significant increase in total laboratory mark after the introduction of the IOA (p < 0.0001).
“laboratory scores improving from 67.8% to 76.2% (p < 0.0001)”
- Also stated in: § Student Performance and Learning Outcomes · plain
“There was a significant increase in total laboratory mark after the introduction of the IOA (p < 0.0001, Fig. 3a).”
- Also stated in: § Student Performance and Learning Outcomes · plain
“The mean score for the laboratory component of the course increased from 67.8% before the mini-IOA to 76.2% after the assessment was introduced.”
Quote in the paperSubstantial claim - Also stated in: § Student Performance and Learning Outcomes · plain
- Findingown data
Most students agreed or strongly agreed at both time points that the mini-IOA aided their understanding of the course.
“and aided their understanding and engagement with the course (Fig. 5d and e).”
Quote in the paperSubstantial claim - Findingown data
There were no significant differences in performance between international and domestic students.
“While there might be concerns that oral assessments could disadvantage non-native English speakers or students from cultural backgrounds where direct verbal interaction with authority figures is less common, our data shows no significant differences in performance between international and domestic students.”
Quote in the paperSubstantial claim - Findingown data
Students reported anxiety with the assessment at both timepoints.
“Students did report anxiety with the assessment at both timepoints”
Quote in the paperNot a substantial claim - Findingown data
Most students agreed or strongly agreed at both time points that they received helpful feedback.
“that they received helpful feedback (Fig. 5b)”
Quote in the paperSubstantial claim - Findingreasoning
Students reported that the immediate feedback from mini-IOA was beneficial in enhancing and reinforcing their understanding of course material.
“Students reported that the immediate feedback from mini-IOA was beneficial in enhancing and reinforcing their understanding of course material.”
Quote in the paperSubstantial claim - Findingown data
Initially, students expressed moderate agreement regarding the effectiveness and relevance of mini-IOA.
“Initially, students expressed moderate agreement regarding the effectiveness and relevance of mini-IOA.”
Quote in the paperNot a substantial claim - Findingown data
There was a significant decrease in anxiety after the students had completed an IOA for each laboratory class with several iterations of the assessment.
“however there was a significant decrease in anxiety after the students had completed an IOA for each laboratory class with several iterations of the assessment (Fig. 5f).”
Quote in the paperNot a substantial claim - Findingown data
There was a significant increase in the number of students that agreed or strongly agreed that the mini-IOAs were an effective way to assess laboratory activities from the first to second survey point.
“Furthermore, there was a significant increase in the number of students that agreed or strongly agreed that the mini-IOAs were an effective way to assess laboratory activities from the first to second survey point (Fig. 5a).”
Quote in the paperSubstantial claim - Findingown data
Most students agreed or strongly agreed at both time points that the mini-IOA were effective.
“Most students agreed or strongly agreed at both time points that the mini-IOA were effective (Fig. 5a)”
Quote in the paperSubstantial claim - Findingown data
By the end of the course, there was a significant increase in the number of students who agreed or strongly agreed that mini-IOA were effective and relevant.
“By the end of the course, there was a significant increase in the number of students who agreed or strongly agreed with these sentiments.”
Quote in the paperSubstantial claim - Findingown data
The perceived subjectivity in marking is not supported by statistical analysis of variation in assessor provided marks.
“The perceived subjectivity in marking is not supported by statistical analysis of variation in assessor provided marks.”
Quote in the paperNot a substantial claim - Findingown data
Most students agreed or strongly agreed at both time points that the mini-IOA aided their engagement with the course.
“and aided their understanding and engagement with the course (Fig. 5d and e).”
Quote in the paperSubstantial claim - Findingown data
Most students agreed or strongly agreed at both time points that the mini-IOA had real world relevance.
“that the min-IOA had real world relevance (Fig. 5c)”
Quote in the paperNot a substantial claim - Findingown data
Since the introduction of the IOA, a significant increase in marks in the assessment of theoretical content has been observed (p = 0.0097).
“theoretical assessment performance increasing from 55.4% to 60.5% (p < 0.01)”
- Also stated in: § Student Performance and Learning Outcomes · hedged
“Since the introduction of the IOA, a significant increase in marks in the assessment of theoretical content has been observed which suggests the students are more engaged with the theoretical as well as the laboratory course content (p = 0.0097, Fig. 3b).”
- Also stated in: § Student Performance and Learning Outcomes · plain
“student performance in other aspects of the course also significantly improved since the introduction of laboratory mini-IOA (mean 55.4% pre-IOA to 60.5% post-IOA).”
Quote in the paperSubstantial claim - Also stated in: § Student Performance and Learning Outcomes · hedged
- Findingown data
Significant increases in myCourseExperience scores were observed for each of the three questions after the introduction of the mini-IOA.
“Significant increases in myCour-seExperience scores are observed for each of the three questions after the introduction of the mini-IOA (Fig. 4).”
Quote in the paperNot a substantial claim - Findingreasoning
There was a significant decrease in student anxiety across repeated mini-IOA iterations.
“The significant decrease in student anxiety across repeated mini-IOA iterations is consistent with this: as the assessment format becomes familiar and students internalise the dialogic expecta-tions, the task shifts progressively from the ZPD toward independent competence, reducing the affective load of the interaction.”
Quote in the paperNot a substantial claim - Findingnone given
Enhanced student engagement was associated with improved academic performance in both laboratory and theoretical content of the course.
“Enhanced student engagement was associated with improved academic performance in both laboratory and theoretical content of the course.”
Quote in the paperNot a substantial claim - Premisecitation
Oral assessment format encourages more thorough preparation and engagement with course content.
“with studies showing the format encourages more thorough preparation and engagement with course content (Turjamaa et al., 2018).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Turjamaa et al., 2018 source
- Premisecitation
Students often perform better in oral assessments compared to written examinations.
“Research indicates that students often perform better in oral assessments compared to written examinations (Burke-Smalley, 2014;Dicks et al., 2012;Huxham et al., 2012)”
Quote in the paperSubstantial claim0 of 3 sources checked - Premisecitation
Overreliance on written report-based assessment in bioscience education presents several challenges.
“However, the overreliance on this type of assessment in bioscience education presents several challenges (Drumm et al., 2024).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Drumm et al., 2024 source
- Premisecitation
Design of mini-IOA was informed by social constructivist learning theory, where learning occurs through guided dialogue within the zone of proximal development.
“The design of mini-IOA was informed by social constructivist learning theory, where learning occurs through guided dialogue within the zone of proximal development (ZPD)_ (Vygotsky, 1978).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Vygotsky, 1978
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Premisecitation
Traditional written laboratory assessments often fail to accurately measure individual laboratory competencies.
“Traditional written laboratory assessments often fail to accurately measure individual laboratory competencies, prompting the introduction of short interactive oral assessments (mini-IOA) in a second-year Genetics course at the [University].”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Drumm et al., 2024 source
- Interpretationreasoning
The informal, supportive nature of mini-IOA may help mitigate potential cultural and linguistic barriers.
“This finding is particularly noteworthy as it suggests that the informal, supportive nature of mini-IOA may help mitigate potential cultural and linguistic barriers.”
Quote in the paperSubstantial claim - Premisecitation
Traditional written laboratory reports can be tedious and time-consuming for a relatively low mark percentage.
“Traditional written laboratory reports can be tedious and timeconsuming for a relatively low mark percentage (Drumm et al., 2024;Hunt et al., 2012).”
Quote in the paperSubstantial claim0 of 2 sources checked - Interpretationreasoning
The immediate feedback and opportunity to discuss problems in-person helped students to grasp concepts more effectively than passive learning methods such as reading, watching recordings or attending lectures.
“The immediate feedback and opportunity to discuss problems inperson helped students to grasp concepts more effectively than passive learning methods such as reading, watching recordings or attending lectures.”
Quote in the paperSubstantial claim - Study design and conductreasoning
Consistent use of a standardised rubric, combined with pre-course assessor training, a peer mentorship system for novice assessors, and the within-year moderation process, served as the primary mechanisms for maintaining assessment reliability.
“The consistent use of a standardised rubric, combined with pre-course assessor training, a peer mentorship system for novice assessors, and the within-year moderation process, served as the primary mechanisms for maintaining assessment reliability.”
Quote in the paperSubstantial claim - Interpretationreasoning
The pattern of assessor scaffolding within the mini-IOA, where follow-up questions guide students toward deeper analysis, reflects dialogic interaction through which social constructivism proposes understanding is co-constructed.
“The pattern of assessor scaffolding within the mini-IOA, where follow-up questions guide students toward deeper analysis rather than simply confirming or correcting, reflects the kind of dialogic interaction through which social constructivism proposes that understanding is co-constructed.”
Quote in the paperNot a substantial claim - Premisecitation
Formative assessment principles informed the immediate feedback component, where assessment serves both summative and learning purposes.
“Additionally, formative assessment principles informed the immediate feedback component, where assessment serves both summative and learning purposes (Black & Wiliam, 1998).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Black & Wiliam, 1998 source
- Interpretationreasoning
The improved engagement associated with the mini-IOA may have contributed to the observed improvements in student performance in other aspects of the course.
“Therefore, the improved engagement associated with the mini-IOA may have con- tributed to the observed improvements in student performance in other aspects of the course.”
Quote in the paperNot a substantial claim - Interpretationown data
The increase in theoretical assessment marks suggests students are more engaged with the theoretical as well as the laboratory course content.
“Since the introduction of the IOA, a significant increase in marks in the assessment of theoretical content has been observed which suggests the students are more engaged with the theoretical as well as the laboratory course content (p = 0.0097, Fig. 3b).”
Quote in the paperSubstantial claim - Interpretationown data
Repeated exposure to mini-IOA may enhance students' appreciation of this assessment method.
“This indicates that repeated exposure to mini-IOA may enhance students' appreciation of this assessment method.”
Quote in the paperNot a substantial claim - Study design and conductnone given
The inclusion of a clear rubric and extensive training of assessors reduces the risk of subjectivity in student marks.
“The inclusion of a clear rubric for this assessment and extensive training of assessors reduces the risk of subjectivity in student marks.”
Quote in the paperSubstantial claim - Study design and conductreasoning
The consistency of findings across 15 years of data collection, multiple student cohorts, and diverse assessment measures strengthens the validity of these conclusions.
“The consistency of findings across 15 years of data collection, multiple student cohorts, and diverse assessment measures strengthens the validity of these conclusions.”
Quote in the paperSubstantial claim - Interpretationown data
Students perceive the mini-IOA as beneficial to their learning experience.
“The significant improvements in myCourseExperience scores across questions related to course satisfaction, the utility of assessment items, and the quality of feedback suggest that students perceive the mini-IOA as beneficial to their learning experience.”
Quote in the paperSubstantial claim - Interpretationown data
This longitudinal study provides robust evidence across multiple dimensions of assessment efficacy, from academic performance to equity and practical implementation considerations.
“This longitudinal study provides robust evidence across multiple dimensions of assessment efficacy, from academic performance to equity and practical implementation considerations.”
Quote in the paperSubstantial claim - Interpretationreasoning
Mini-IOA can scale effectively with appropriate planning and resource allocation.
“These strategies demonstrate that mini-IOA can scale effectively with appropriate planning and resource allocation.”
Quote in the paperSubstantial claim - Interpretationreasoning
The decrease in anxiety is consistent with social constructivism: as the format becomes familiar, the task shifts from the ZPD toward independent competence, reducing affective load.
“The significant decrease in student anxiety across repeated mini-IOA iterations is consistent with this: as the assessment format becomes familiar and students internalise the dialogic expecta-tions, the task shifts progressively from the ZPD toward independent competence, reducing the affective load of the interaction.”
Quote in the paperNot a substantial claim - Study design and conductown data
The 33.4% response rate restricts the generalisability of the findings.
“The response rate for the course evaluation was 33.4%, which, while typical for such surveys, restricts the generalisability of the findings.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The dialogic structure of the mini-IOA creates the condition of immediate feedback, distinguishing it from the delayed, decontextualised feedback typical of written laboratory reports.
“The dialogic structure of the mini-IOA creates precisely this condition, distinguishing it from the delayed, decontextualised feedback typical of written laboratory reports.”
Quote in the paperSubstantial claim - Premisecitation
This ensures that there is enough evidence to determine the quality of student performance.
“This ensures that there is enough evidence to determine the quality of student performance (Tan et al., 2022).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Tan et al., 2022 source
- Interpretationown data
Mini-IOA can be successfully implemented without disadvantaging any particular student population.
“This finding indicates that mini-IOA can be successfully implemented without disadvantaging any particular student population.”
Quote in the paperSubstantial claim - Study design and conductnone given
While there is some overlap between the laboratory and theoretical content, most of the marks from these two assessments are not directly related to the laboratory content.
“While there is some overlap between the laboratory and theoretical content, most of the marks from these two assessments are not directly related to the laboratory content.”
Quote in the paperNot a substantial claim - Study design and conductreasoning
The before-and-after comparison design cannot account for all potential confounding variables that may have influenced student performance beyond the assessment method change.
“Additionally, the before-and-after comparison design, while robust for demonstrating change over time, cannot account for all potential confounding variables that may have influenced student performance beyond the assessment method change.”
Quote in the paperNot a substantial claim - Study design and conductreasoning
The lack of a contemporaneous control group receiving traditional written assessments limits the strength of causal inferences.
“The lack of a contemporaneous control group receiving traditional written assessments limits the strength of causal inferences.”
Quote in the paperSubstantial claim - Interpretationown data
The improved student engagement observed with mini-IOA suggests that this assessment method effectively evaluates traditional scientific discourse in an environment of digital learning.
“The improved student engagement we observed with mini-IOA suggests that this assessment method effectively evaluates traditional scientific discourse in an environment of digital learning.”
Quote in the paperSubstantial claim - Study design and conductreasoning
Temporal confounds represent a limitation; the dataset spans 14 years during which broader changes in student demographics, institutional practices, and educational culture may have occurred independently of the assessment change.
“Temporal confounds represent a further limitation.The dataset spans 14 years (2009)(2010)(2011)(2012)(2013)(2014)(2015)(2016)(2017)(2018)(2019)(2020)(2021)(2022)(2023), during which broader changes in student demographics, institutional practices, and educational culture may have occurred independently of the assessment change.”
Quote in the paperNot a substantial claim - Study design and conductown data
The response rate for myCourseExperience surveys (33.4%) may limit the generalisability of student perception data.
“The response rate for myCourseExperience surveys (33.4%) may limit the generalisability of student perception data, and course evaluations are subject to response bias.”
Quote in the paperNot a substantial claim
- Classified as probably not a substantial claim. 52
- May combine two claims. 52
- The quote only partly states this claim. 4
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationImproved student engagement is consistent with other applications of IOA in the literature.
“This improved student engagement is consistent with other applications of IOA in the literature (Davey et al., 2025;Ward et al., 2023).”
Quote in the paperNot a substantial claim1 of 2 sources checked- cites Davey et al., 2025 source
- cites Ward et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationFor other students, anxiety can have serious consequences on assessment outcomes due to worry, procrastination and an inability to concentrate.
“For other students, anxiety can have serious consequences on assessment outcomes due to worry, procrastination and an inability to concentrate (Jerrim, 2023).”
Quote in the paperNot a substantial claim1 of 1 sources checked- cites Jerrim, 2023 source
The available passages from the Results and Conclusions contain only section headings, not findings. Searches for procrastination and for anxiety-related effects on examination performance returned no substantive passage addressing the claimed consequences or mechanisms, so our copy cannot verify the sentence. (LLM, conf=0.72)
Experimental — accuracy not yet measured
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenMany students spend time revising the material after completing their laboratory work, resulting in a bottleneck of students ready for the assessment towards the end of the laboratory session.
“However, many students will spend time revising the material after completing their laboratory work, resulting in a bottleneck of students ready for the assessment towards the end of the laboratory session.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingreasoningA larger workload for completion of the experimental phase directly affects the wait time to see an assessor.
“However, it is evident when there is a larger workload for completion of the experimental phase, this directly affects the wait time to see an assessor.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThematic analysis of student responses identified seven major themes.
“A detailed thematic analysis of the student responses identified seven major themes.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataWaiting time was a recurrent concern in student responses; waiting in line for their turn was frustrating and time-consuming, affecting their overall experience negatively.
“Waiting time was a recurrent concern in student responses.Waiting in line for their turn was frustrating and time-consuming, affecting their overall experience negatively”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingreasoningAs students complete more laboratory sessions and mini-IOA, there is a small shift in wait time as students become comfortable with the assessment type and spend less time revising material.
“As the students complete more laboratory sessions and mini-IOA there is a small shift in the wait time as students become comfortable with the assessment type and spend less time revising material.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataRespondents compared IOA favourably to other assessment methods, such as written reports or exams, finding them more efficient, interactive, and effective.
“Respondents compared IOA favourably to other assessment methods, such as written reports or exams.They found IOA to be a more efficient, interactive, and effective way of testing knowledge and understanding”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingreasoningWaiting times for the mini-IOA are sometimes an issue, depending on the length of the laboratory session and the number of staff available to assess students.
“Waiting times for the mini-IOA are sometimes an issue, depending on the length of the laboratory session and the number of staff available to assess students.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe response rate for the course evaluation was 33.4%.
“The response rate for the course evaluation was 33.4%, which, while typical for such surveys, restricts the generalisability of the findings.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenStudents reported struggling with anxiety, waiting times, and perceived subjectivity in marking.
“Students did report struggling with anxiety, waiting times, and perceived subjectivity in marking.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataConcerns about subjectivity and variation in marking were raised; inconsistency between different assessors' questions and marking criteria led to a perception of unfairness and inconsistency in assessments.
“Concerns about subjectivity and variation in marking were raised.The inconsistency between different assessors' questions and marking criteria led to a perception of unfairness and inconsistency in assessments”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataStudents highlighted the casual nature of the assessment and felt that this encouraged engagement with the course content.
“Particularly, students highlighted the casual nature of the assessment and felt that this encouraged engagement with the course content.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMini-IOA excel in time efficiency, immediate feedback delivery, and academic integrity maintenance, while traditional written reports offer advantages in scalability and develop different communication skills.
“Mini-IOA excel in areas of time efficiency, immediate feedback delivery, and academic integrity maintenance, while traditional written reports offer advantages in scalability and develop different communication skills.”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningMini-IOA are much more efficient to mark, significantly reducing marking time.
“From an assessor point of view, the mini-IOA are much more efficient to mark as well.With the use of a robust rubric, students can be marked immediately after completion of the mini-IOA, significantly reducing marking time.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOpen-ended survey responses revealed that students appreciated the informality of the assessment, the interactive feedback, and learning opportunities.
“The open-ended survey responses revealed a nuanced view of IOA, with students appreciating the informality of the assessment, the interactive feedback, and learning opportunities.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataStudents recurrently described the mini-IOA as beneficial in enhancing their understanding of the course material, appreciating the opportunity to clarify concepts, receive rephrased questions for better comprehension, and discuss specific aspects of the content.
“Students recurrently described the assessment as beneficial in enhancing their understanding of the course material, appreciating the opportunity to clarify concepts, receive rephrased questions for better comprehension, and discuss specific aspects of the content”
Quote in the paperSubstantial claimMay combine two claims.
FindingreasoningMini-IOA provide superior capability for individualized assessment through real-time verification of student understanding and the ability to adapt questioning based on student responses.
“Notably, mini-IOA provide superior capability for individualized assessment through real-time verification of student understanding and the ability to adapt questioning based on student responses.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingreasoningAssessors raised concerns regarding academic integrity, as the waiting period provided students with an opportunity to discuss the questions with those who had already completed the IOA.
“Assessors raised concerns regarding academic integrity, as the waiting period provided students with an opportunity to discuss the questions with those who had already completed the IOA.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataStudents appreciated the efficiency of the mini-IOA and preferred the assessment type to a written report.
“Students also appreciated the efficiency of the mini-IOA and preferred the assessment type to a written report.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMini-IOA scores were equitable regardless of gender, international status, program, or age.
“The equitable nature of mini-IOA scores, regardless of gender, international status, program, or age, suggests that the assessment method was fair and inclusive.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Findingown dataThe interactive format was seen as a quick and efficient way to demonstrate and consolidate understanding, often preferred over written reports.
“This interactive format was seen as a quick and efficient way to demonstrate and consolidate understanding, often preferred over written reports.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataEngagement and enjoyment emerged as a distinct theme; the interactive and casual nature of the assessments was described as making learning more enjoyable and encouraging active participation with the course content.
“Engagement and enjoyment emerged as a distinct theme in student reponses.The interactive and casual nature of the assessments was described as making learning more enjoyable and encouraging active participation with the course content”
Quote in the paperNot a substantial claimMay combine two claims.
Findingnone givenAnxiety associated with the mini-IOA was a persistent concern, but decreased over time with increased familiarity.
“Anxiety associated with the mini-IOA was a persistent concern, albeit one that decreased over time with increased familiarity.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAnalysis of mini-IOA performance revealed no significant differences in mean scores based on gender, international versus domestic enrolment status, degree program, or age group.
“Analysis of mini-IOA performance revealed no significant differences in mean scores based on gender, international versus domestic enrolment status, degree program, or age group (Fig. 6).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataResource analysis reveals that mini-IOA require immediate staff time but eliminate extensive marking time, representing a net efficiency gain.
“Importantly, resource analysis reveals that while mini-IOA require immediate staff time, they eliminate extensive marking time.Traditional reports for 100 students might require 20-30 h of marking, while mini-IOA need 3-4 h of direct assessment with immediate scoring, representing a net efficiency gain.”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataMean student laboratory marks were significantly higher post-IOA than pre-IOA.
“Mean student marks in the laboratory component before the introduction of mini-IOA (Pre-IOA, 2009-2013) and after their introduction (Post-IOA 2015-2023).”
Quote in the paperSubstantial claimMay combine two claims. The quote only partly states this claim.
Findingown dataMean Likert-style survey responses for effectiveness, helpful feedback, real-world relevance, understanding, and engagement increased significantly from before to after mini-IOA.
“Mean Likert-style survey responses before the first mini-IOA (Survey 1) and after the final mini-IOA (Survey 2).”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataThe post-IOA cohorts showed modest increases in mean GPA and mean student age relative to pre-IOA cohorts.
“As noted in Table 1, the post-IOA cohorts showed modest increases in mean GPA and mean student age relative to pre-IOA cohorts.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMean mini-IOA marks showed no statistically significant differences by gender, international vs. domestic enrolment, degree program, or student age.
“Mean mini-IOA marks were calculated based on A: gender, B: international vs. domestic enrolments, C: degree program (IBBL -Bachelor of Laboratory Medicine, IBMS -Bachelor of Biomedical Sciences, IBPA -Bachelor of Pharmaceutical Sciences), and D: student age.Mann-Whitney (a, b) or Kruskal-Wallis (c, d) test.No statistically significant differences observed”
Quote in the paperSubstantial claimThe quote only partly states this claim.
Findingown dataMean student theoretical marks were significantly higher post-IOA than pre-IOA.
“Mean student marks in theoretical assignments (problem-based written assignment and comprehensive examination) before the introduction of mini-IOA (Pre-IOA) and after their introduction (Post-IOA).”
Quote in the paperSubstantial claimMay combine two claims.
Findingnone givenThe interactive nature and immediate feedback of mini-IOA was highly valued by students, increased satisfaction and resulted in a more dynamic and effective learning environment.
“The interactive nature and immediate feedback of this assessment type was highly valued by students, increased satisfaction and resulted in a more dynamic and effective learning environment.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationOral assessments offer advantages in higher education, particularly ability to assess deep understanding and critical thinking while developing workplace-relevant communication skills.
“Oral assessments offer several significant advantages in higher education, particularly in their ability to assess students' deep understanding and critical thinking capabilities while simultaneously developing workplace-relevant communication skills that employers value (Brink & Costigan, 2015;Thomas et al., 2014).”
Quote in the paperSubstantial claim0 of 2 sources checkedMay combine two claims.
PremisecitationBoth written reports and worksheets fail to improve student oral communication skills and can be challenging due to diverse objectives.
“Both fail to improve student oral communication skills and can be challenging due to the diverse objectives (Moni et al., 2007).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Moni et al., 2007 source
May combine two claims.
PremisecitationRequirement for verbal explanations draws from cognitive elaboration theory, as articulating knowledge enhances learning and retention.
“The requirement for verbal explanations draws from cognitive elaboration theory, as articulating knowledge enhances learning and retention (Reigeluth et al., 1980).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Reigeluth et al., 1980 source
May combine two claims.
PremisecitationInteractive nature of oral assessments allows examiners to probe students' understanding more deeply and distinguish between superficial and deep knowledge.
“The interactive nature of oral assessments allows examiners to probe students' understanding more deeply and distinguish between superficial and deep knowledge (Pearce & Lee, 2009)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Pearce & Lee, 2009 source
May combine two claims.
PremisecitationStudents struggle to contextualize experimental data within broader scientific frameworks, which sometimes leads students to resort to plagiarism to complete their reports.
“A frequently cited difficulty is students' struggle to contextualize experimental data within broader scientific frameworks, which sometimes leads students to resort to plagiarism to complete their reports (Bertram Gallant et al., 2019;McGlade et al., 2012).”
Quote in the paperSubstantial claim0 of 2 sources checkedMay combine two claims.
PremisecitationIOA are considered an authentic assessment type that prepare students for their professional career and promote academic integrity by combatting plagiarism and inappropriate use of generative AI.
“IOA are considered an authentic assessment type that prepare students for their professional career and promote academic integrity by combatting plagiarism and the inappropriate use of generative artificial intelligence (Ward et al., 2023).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Ward et al., 2023
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
InterpretationreasoningMini-IOA offer distinct advantages in efficiency, feedback quality, and authentic assessment of individual understanding, particularly relevant in contemporary educational contexts where academic integrity is increasingly challenged by technological developments.
“This comparison reveals that while both assessment methods have merit, mini-IOA offer distinct advantages in terms of efficiency, feedback quality, and authentic assessment of individual understanding, particularly relevant in contemporary educational contexts where academic integrity is increasingly challenged by technological developments.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
Study design and conductnone givenThroughout the investigation period, the core instructional personnel and laboratory protocols remained consistent.
“Throughout the investigation period, the core instructional personnel and laboratory protocols remained consistent.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Study design and conductnone givenThe laboratory component of the course was unaffected by the COVID pandemic in 2020 and 2021; all classes remained face-to-face with no change in timetable.
“The laboratory component of the course was unaffected by the COVID pandemic in 2020 and 2021, all classes remained face-to-face with no change in timetable.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductreasoningDespite the disruptions associated with the SARS-CoV-2 pandemic, in-person instruction was preserved, thus the implementation of the mini-IOA constituted the sole substantive modification to laboratory assessment methods during this timeframe.
“Despite the disruptions associated with the SARS-CoV-2 pandemic, in-person instruction was preserved, thus the implementation of the mini-IOA constituted the sole substantive modification to laboratory assessment methods during this timeframe.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationHigher levels of student engagement enhance both the learning experience and students' academic achievement.
“This is consistent with reports in the literature that higher levels of student engagement enhance both the learning experience and students' academic achievement (Gerber et al., 2013;Lei et al., 2018).”
Quote in the paperSubstantial claim0 of 2 sources checkedProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe conversational nature of mini-IOA may help international students develop confidence in scientific discourse in English.
“Furthermore, the conversational nature of mini-IOA may help international students develop confidence in scientific discourse in English, a valuable skill for their future careers in the global scientific community.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe immediate feedback and opportunity for clarification during the assessment allows students to seek clarification when needed, potentially benefiting those who might struggle with written English or cultural interpretations of assessment requirements.
“The immediate feedback and opportunity for clarification during the assessment allows students to seek clarification when needed, potentially benefiting those who might struggle with written English or cultural interpretations of assessment requirements.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationFor some students, assessment anxiety is associated with increased levels of motivation, focus, and effort.
“For some students, assessment anxiety is associated with increased levels of motivation, focus, and effort (Kader, 2016).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Kader, 2016 source
May combine two claims.
PremisecitationIOAs offer the opportunity to assess students' learning and clarify their ability to achieve learning outcomes in an equitable manner.
“This observation aligns with recent work demonstrating that IOAs offer the opportunity to assess students' learning and clarify their ability to achieve learning outcomes in an equitable manner (Krautloher, 2024).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Krautloher, 2024 source
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenThe immediate feedback benefit would be particularly valuable for developing foundational scientific thinking skills and building confidence in scientific discourse from an early age.
“The immediate feedback benefit would be particularly valuable for developing foundational scientific thinking skills and building confidence in scientific discourse from an early age.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe feasibility of mini-IOA with larger student numbers can be addressed through several strategies.
“The feasibility of mini-IOA with larger student numbers can be addressed through several strategies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenThe casual, unstructured nature of IOA manages anxious students to perform in this assessment format.
“Furthermore, the casual, unstructured nature of IOA further manages anxious students to perform in this assessment format.”
Quote in the paperNot a substantial claim- Rests on an assumption: Anxiety can be a factor in any assessment type and may not necessarily be associated with a poor outcome.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
InterpretationreasoningThe interactive oral assessment approach could be adapted for younger students with appropriate scaffolding and age-appropriate questioning techniques.
“The interactive oral assessment approach could be adapted for younger students with appropriate scaffolding and ageappropriate questioning techniques.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe 2023 surveys achieved a 90% response rate (n = 59).
“These surveys were presented to students in paper format during the laboratory session and a 90% response rate (n = 59) was achieved.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
Study design and conductreasoningDue to the variation in questions and unstructured follow-up questions, students are required to demonstrate their individual understanding during the IOA.
“Due to the variation in questions and unstructured follow-up questions, students are required to demonstrate their individual understanding during the IOA.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationHattie and Timperley's (2007) model of effective feedback identifies feedback that addresses the gap between current and desired understanding, delivered at the moment of performance, as most likely to support learning.
“This immediacy aligns with Hattie and Timperley's (2007) model of effective feedback, which identifies feedback that addresses the gap between current and desired understanding, delivered at the moment of performance, as most likely to support learning.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hattie and Timperley's (2007) source
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningResponse bias could skew the results and overrepresent the experiences of certain groups of students.
“This could skew the results and overrepresent the experiences of certain groups of students.”
Quote in the paperNot a substantial claim- Rests on an assumption: Course evaluations are often subject to response bias, where students with strong opinions are more likely to participate.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe findings from this study have significant implications for science education beyond the specific context of undergraduate genetics laboratories.
“The findings from this study have significant implications for science education beyond the specific context of undergraduate genetics laboratories.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe mini-IOA framework is readily transferable to other laboratory-based disciplines including chemistry, physics, and biology, where similar challenges exist with traditional written report assessment.
“The mini-IOA framework is readily transferable to other laboratory-based disciplines including chemistry, physics, and biology, where similar challenges exist with traditional written report assessment.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataThe student cohorts were similar regarding gender and number of overseas international students.
“The student cohorts were similar regarding gender and number of overseas international students.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationThe requirement to verbally articulate experimental outcomes and connect them to underlying theory during the mini-IOA represents a qualitatively different cognitive demand than written report completion, and elaborative processing of this kind is theorised to strengthen encoding and promote integration of new information with existing knowledge structures.
“From a cognitive elaboration perspective, the requirement to verbally articulate experimental outcomes and connect them to underlying theory during the mini-IOA represents a qualitatively different cognitive demand than written report completion, and elaborative processing of this kind is theorised to strengthen encoding and promote integration of new information with existing knowledge structures”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Reigeluth et al., 1980 source
May combine two claims.
Interpretationown dataThe mini-IOA assessment method was fair and inclusive.
“The equitable nature of mini-IOA scores, regardless of gender, international status, program, or age, suggests that the assessment method was fair and inclusive.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductreasoningBy design, students are asked different questions to ensure academic integrity, and this may be the source of some perceived subjectivity.
“By design, students are asked different questions to ensure academic integrity, and this may be the source of some of this perceived subjectivity.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningSeveral factors inherent in the mini-IOA format are consistent with the observed performance improvements, though the quasi-experimental design means these associations cannot be interpreted as strictly causal.
“Several factors inherent in the mini-IOA format are consistent with the observed performance improvements, though the quasi-experimental design means these associations cannot be interpreted as strictly causal.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Interpretationnone givenThe opportunity for discussion is beneficial to the assessors as well, engaging with students and supporting students during the mini-IOA without providing the answers.
“This opportunity for discussion is beneficial to the assessors as well, engaging with students and supporting students during the mini-IOA without providing the 'answers.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningThe mini-IOA format creates conditions for elaborative rehearsal in a way that written report completion may not.
“The mini-IOA format, by requiring students to articulate links between practical results and theoretical content in real time, creates conditions for elaborative rehearsal in a way that written report completion may not.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningIf elaborative processing is strengthened by requiring students to explain and justify experimental outcomes verbally, then improved performance on theoretical assessments would be an expected downstream consequence.
“If elaborative processing, understood as the active construction of connections between new information and existing knowledge, is strengthened by requiring students to explain and justify experimental outcomes verbally, then improved performance on theoretical assessments would be an expected downstream consequence.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationSocial constructivism predicts that guided dialogue, particularly within the zone of proximal development, should scaffold students toward understanding they could not readily achieve independently.
“Social constructivism predicts that guided dialogue, particularly within the zone of proximal development, should scaffold students toward understanding they could not readily achieve independently (Vygotsky, 1978).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Vygotsky, 1978
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
May combine two claims.
PremisecitationImmediate feedback and scaffolding provided by assessors during mini-IOA enables students to bridge gaps in their understanding in real-time, supporting deeper learning.
“The immediate feedback and scaffolding provided by assessors during mini-IOA enables students to bridge gaps in their understanding in real-time, supporting deeper learning consistent with Hattie and Timperley's model of effective feedback (Hattie & Timperley, 2007).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Hattie & Timperley, 2007 source
May combine two claims.
Interpretationown dataThis data supports the efficacy of mini-IOA as students are performing at a higher standard and achieving the expectations of the laboratory component of the course.
“This data supports the efficacy of this assessment type as students are performing at a higher standard and achieving the expectations of the laboratory component of the course.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
InterpretationreasoningFor larger cohorts (>100 students), multiple trained assessors working simultaneously can maintain quality while reducing waiting times.
“For larger cohorts (> 100 students).Multiple trained assessors working simultaneously can maintain quality while reducing waiting times.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductown dataThe mean GPA and mean age of students increased after the inclusion of the mini-IOA.
“The mean GPA and mean age of students increased as well; however, this is a trend within [University] as a whole and is not specific to this course.”
Quote in the paperNot a substantial claim- Rests on an assumption: The increase in mean GPA and age of students is a trend within the University as a whole and is not specific to this course.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThe average student response rate for myCourseExperience was 33.4% during 2009-2023.
“Response rate varied from year to year, but average student response rate was 33.4% during this period.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataThe implementation of mini-IOA into the laboratory assessment for the Genetics course represents a significant pedagogical shift that has yielded measurable improvements in student learning outcomes, engagement, and satisfaction.
“The implementation of mini-IOA into the laboratory assessment for the Genetics course at [University] represents a significant pedagogical shift that has yielded measurable improvements in student learning outcomes, engagement, and satisfaction.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataThere were differences in the program of study, with higher percentages of Bachelor of Biomedical Sciences and Bachelor of Pharmaceutical Science students enrolled after the inclusion of the mini-IOA.
“There were differences in the program of study, with higher percentages of Bachelor of Biomedical Sciences and Bachelor of Pharmaceutical Science students enrolled after the inclusion of the mini-IOA.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
Interpretationnone givenThe principles underlying mini-IOA success-immediate feedback, authentic assessment, and active student engagement-are applicable across educational levels and disciplines.
“The principles underlying mini-IOA success-immediate feedback, authentic assessment, and active student engagement-are applicable across educational levels and disciplines.”
Quote in the paperNot a substantial claimThe quote only partly states this claim.
Interpretationown dataThe increases in mean GPA and mean student age cannot be entirely discounted as contributors to the observed performance improvements.
“While this reflects a university-wide trend rather than a course-specific effect, it cannot be entirely discounted as a contributor to the observed performance improvements.”
Quote in the paperNot a substantial claim- Rests on an assumption: The increases in mean GPA and mean student age reflect a university-wide trend rather than a course-specific effect.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe significant improvements in both laboratory and theoretical performance suggest the potential for long-term benefits of mini-IOA beyond immediate course outcomes.
“The significant improvements in both laboratory and theoretical performance suggest the potential for long-term benefits of mini-IOA beyond immediate course outcomes.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenWithin-year inter-assessor consistency was monitored through comparison of assessor means and moderation applied where warranted, but formal inter-rater reliability coefficients were not calculated across the full dataset.
“Finally, although within-year inter-assessor consistency was monitored through comparison of assessor means and moderation applied where warranted, formal inter-rater reliability coefficients were not calculated across the full dataset.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductnone givenThe study did not examine long-term retention of learning or track students' performance in subsequent courses.
“The study did not examine long-term retention of learning or track students' performance in subsequent courses, which would provide additional evidence of the assessment method's effectiveness.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
InterpretationreasoningEngineering practical assessments could also adopt similar methodologies for evaluating hands-on technical competencies.
“Engineering practical assessments could also adopt similar methodologies for evaluating hands-on technical competencies.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S4 (based).
InterpretationreasoningThe implementation of mini-IOA is particularly relevant in the current digital learning environment, where educators face unprecedented challenges in maintaining academic integrity.
“The implementation of mini-IOA is particularly relevant in the current digital learning environment, where educators face unprecedented challenges in maintaining academic integrity.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based).
InterpretationreasoningMini-IOA address the academic integrity concern by requiring students to demonstrate their understanding through real-time verbal interactions, making it virtually impossible to rely on AI-generated responses.
“Mini-IOA address this concern by requiring students to demonstrate their understanding through real-time verbal interactions, making it virtually impossible to rely on AI-generated responses.”
Quote in the paperNot a substantial claim- Rests on an assumption: Traditional written laboratory reports have become increasingly problematic with the advent of generative artificial intelligence tools, which can produce sophisticated scientific writing that may be difficult to distinguish from student-generated work.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationActive engagement in learning processes leads to better knowledge retention and application.
“This aligns with research showing that active engagement in learning processes leads to better knowledge retention and application (Lei et al., 2018).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Lei et al., 2018 source
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenThe study was conducted within a single institution and discipline, which may limit transferability to other contexts.
“The study was conducted within a single institution and discipline, which may limit transferability to other contexts.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).
InterpretationreasoningClinical assessment in health sciences could particularly benefit from this approach, as it mirrors the oral case presentation skills required in professional practice.
“Clinical assessment in health sciences could particularly benefit from this approach, as it mirrors the oral case presentation skills required in professional practice.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningAssessment is standardised at the level of competency domains via the rubric rather than at the level of individual questions, which limits strict question-by-question comparability across students.
“While assessment is standardised at the level of competency domains via the rubric rather than at the level of individual questions, this necessarily limits strict question-by-question comparability across students and represents an inherent trade-off in this assessment format.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing). May combine two claims.
InterpretationreasoningThe development of verbal scientific communication skills and the ability to articulate complex genetic concepts could provide enduring benefits for students' academic and professional development.
“While this study focused on performance within a single course, the development of verbal scientific communication skills and the ability to articulate complex genetic concepts could provide enduring benefits for students' academic and professional development.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenBy design, individual students receive different questions during their mini-IOA to preserve academic integrity.
“By design, individual students receive different questions during their mini-IOA to preserve academic integrity.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
InterpretationreasoningThe immediate, interactive nature of mini-IOA provides experience with face-to-face professional scientific dialogue while maintaining academic integrity.
“The immediate, interactive nature of mini-IOA provides this crucial experience while maintaining academic integrity in an era where information is readily available but understanding must be demonstrated through authentic interaction.”
Quote in the paperSubstantial claim- Rests on an assumption: The ability to verbally communicate complex scientific concepts remains an essential skill that cannot be automated or digitized.
- Rests on an assumption: Today's students, while highly adept at digital communication, often need more practice with face-to-face professional scientific dialogue.
Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
Interpretationnone givenRegular exposure to professional scientific dialogue through mini-IOA may better prepare students for future research environments where clear communication of methodologies and results is essential.
“Furthermore, regular exposure to professional scientific dialogue through mini-IOA may better prepare students for future research environments where clear communication of methodologies and results is essential.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningThe results of this study highlight significant benefits of incorporating mini-IOA into the laboratory curriculum, particularly in enhancing student engagement, satisfaction and academic performance.
“The results of this study highlight the significant benefits of incorporating mini-IOA into the laboratory curriculum, particularly in terms of enhancing student engagement, satisfaction and academic performance.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing).
InterpretationreasoningThe enhanced student engagement observed with mini-IOA may foster deeper learning approaches that students carry forward into subsequent courses.
“The enhanced student engagement observed with mini-IOA may foster deeper learning approaches that students carry forward into subsequent courses, particularly in how they prepare for, and engage with, laboratory work.”
Quote in the paperNot a substantial claim
The paper relies on this without support.
Written worksheets contain fixed questions susceptible to interpretation by students and do not reflect real-world practice.
“To reduce student cognitive load and academic marking workload a common alternative assessment format includes written worksheets; however, they contain fixed questions susceptible to interpretation by students and do not reflect real-world practice.”
The paper relies on this without support.
The increase in mean GPA and age of students is a trend within the University as a whole and is not specific to this course.
“The mean GPA and mean age of students increased as well; however, this is a trend within [University] as a whole and is not specific to this course.”
The paper relies on this without support.
Course evaluations are often subject to response bias, where students with strong opinions are more likely to participate.
“Additionally, course evaluations are often subject to response bias, where students with strong opinions-either positive or negative-are more likely to participate.”
The paper relies on this without support.
Anxiety can be a factor in any assessment type and may not necessarily be associated with a poor outcome.
“However, anxiety can be a factor in any assessment type and may not necessarily be associated with a poor outcome.”
The paper relies on this without support.
Traditional written laboratory reports have become increasingly problematic with the advent of generative artificial intelligence tools, which can produce sophisticated scientific writing that may be difficult to distinguish from student-generated work.
“Traditional written laboratory reports have become increasingly problematic with the advent of generative artificial intelligence tools, which can produce sophisticated scientific writing that may be difficult to distinguish from student-generated work.”
The paper relies on this without support.
The ability to verbally communicate complex scientific concepts remains an essential skill that cannot be automated or digitized.
“Furthermore, while digital literacy is crucial in modern science education, the ability to verbally communicate complex scientific concepts remains an essential skill that cannot be automated or digitized.”
The paper relies on this without support.
Today's students, while highly adept at digital communication, often need more practice with face-to-face professional scientific dialogue.
“This is particularly noteworthy as today's students, while highly adept at digital communication, often need more practice with face-to-face professional scientific dialogue.”
The paper relies on this without support.
The increases in mean GPA and mean student age reflect a university-wide trend rather than a course-specific effect.
“While this reflects a university-wide trend rather than a course-specific effect, it cannot be entirely discounted as a contributor to the observed performance improvements.”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Formative session is described as earning a mark
MinorThe paper says laboratory session 1 earns a formative assessment mark, but explicitly defines formative assessments as having no assigned marks.
“Laboratory session 1 achieves a formative assessment mark.”
“For the purposes of this report, formative assessment refers to assessments that are not assigned marks, while summative assessment involves assessments where marks are awarded regardless of weighting.”
Claim of no statistical support for assessor variation conflicts with reported significant variation
MinorThe paper says statistical analysis did not support perceived variation in marking, yet reports finding statistically significant inter-assessor variation in some years. Moderation may have addressed that variation, but it does not negate the reported finding.
“The perceived subjectivity in marking is not supported by statistical analysis of variation in assessor provided marks.”
“In years where statistically significant inter-assessor variation was identified, student marks were reviewed and moderated accordingly and discussions with assessors were undertaken to improve reliability.”
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414 · see citing works
Hattie, J., & Timperley, H. (2007) · Review of Educational Research · doi:10.3102/003465430298487 · Cited by 12,905 · see citing works
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · see citing works
Analyzing and Interpreting Data From Likert-Type Scales
Sullivan, G. M., & Artino, A. R. (2013) · Journal of Graduate Medical Education · doi:10.4300/jgme-5-4-18 · Cited by 3,044 · see citing works
Relationships between student engagement and academic achievement: A meta-analysis
Lei, H., Cui, Y., & Zhou, W. (2018) · Social Behavior and Personality: an international journal · doi:10.2224/sbp.7054 · Cited by 987 · see citing works
Sotiriadou, P., Logan, D., Daly, A., & Guest, R. (2020) · Studies in Higher Education · doi:10.1080/03075079.2019.1582015 · Cited by 265 · see citing works
Abrahams, I. (2008) · International Journal of Science Education · doi:10.1080/09500690802342836 · Cited by 192 · see citing works
Oral versus written assessments: a test of student performance and attitudes
Huxham, M., Campbell, F., & Westwood, J. (2012) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2010.515012 · Cited by 187 · see citing works
Reeves, S. M., & Crippen, K. J. (2020) · Journal of Science Education and Technology · doi:10.1007/s10956-020-09866-0 · Cited by 171 · see citing works
A rubric to characterize inquiry in the undergraduate chemistry laboratory
Fay, M. E., Grove, N. P., Towns, M. H., et al. (2007) · Chemistry Education Research and Practice · doi:10.1039/b6rp90031c · Cited by 149 · see citing works
The elaboration theory of instruction: A model for sequencing and synthesizing instruction
Reigeluth, C., Merrill, M. D., Wilson, B., & Spiller, R. (1980) · Instructional Science · doi:10.1007/bf00177327 · Cited by 124 · see citing works
Brink, K. E., & Costigan, R. D. (2015) · Academy of Management Learning & Education · doi:10.5465/amle.2013.0044 · Cited by 110 · see citing works
Inquiry-Based Writing in the Laboratory Course
Moskovitz, C. A., & Kellogg, D. (2011) · Science · doi:10.1126/science.1200353 · Cited by 92 · see citing works
Smith, M. K., & Knight, J. (2012) · Genetics · doi:10.1534/genetics.111.137810 · Cited by 91 · see citing works
Current Trends in Laboratory Class Teaching in University Bioscience Programmes
Adams, D. J. (2009) · Bioscience Education · doi:10.3108/beej.13.3 · Cited by 79 · see citing works
Viva Voce (Oral Examination) as an Assessment Method: Insights From Marketing Students
Pearce, G., & Lee, G. (2009) · Journal of Marketing Education · doi:10.1177/0273475309334050 · Cited by 60 · see citing works
Test anxiety: Is it associated with performance in high-stakes examinations?
Jerrim, J. (2023) · Oxford Review of Education · doi:10.1080/03054985.2022.2079616 · Cited by 60 · see citing works
Iannone, P., Czichowsky, C., & Ruf, J. (2020) · Educational Studies in Mathematics · doi:10.1007/s10649-020-09937-4 · Cited by 42 · see citing works
Undergraduate Oral Examinations in a University Organic Chemistry Curriculum
Dicks, A. P., Lautens, M., Koroluk, K. J., & Skonieczny, S. (2012) · Journal of Chemical Education · doi:10.1021/ed200782c · Cited by 34 · see citing works
Brame, C. J., Pruitt, W. M., & Robinson, L. C. (2008) · CBE—Life Sciences Education · doi:10.1187/cbe.08-07-0036 · Cited by 34 · see citing works
Kader, A. A. (2016) · International Review of Economics Education · doi:10.1016/j.iree.2016.07.002 · Cited by 30 · see citing works
Using Oral Exams to Assess Communication Skills in Business Courses
Burke-Smalley, L. A. (2014) · Business and Professional Communication Quarterly · doi:10.1177/2329490614537873 · Cited by 29 · see citing works
Assessing practical laboratory skills in undergraduate molecular biology courses
Hunt, L., Koenders, A., & Gynnild, V. (2012) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2011.576313 · Cited by 29 · see citing works
Developing interactive oral assessments to foster graduate attributes in higher education
Tan, C. P., Howes, D., Tan, R. K. W., & Dancza, K. M. (2022) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2021.2020722 · Cited by 29 · see citing works
Motivating and Shaping Scientific Argumentation in Lab Reports
Gouvea, J., Appleby, L., Fu, L., & Wagh, A. (2022) · CBE—Life Sciences Education · doi:10.1187/cbe.21-11-0316 · Cited by 27 · see citing works
Investigating the moderating effect of student engagement on academic performance
Gerber, C., Mans-Kemp, N., & Schlechter, A. (2013) · Acta Academica: Critical views on society, culture and politics · doi:10.38140/aa.v45i4.1425 · Cited by 26
Kang, D., Goico, S., Ghanbari, S., Bennallack, K., Pontes, T., O’Brien, D., & Hargis, J. (2019) · International Journal for the Scholarship of Teaching and Learning · doi:10.20429/ijsotl.2019.130210 · Cited by 25 · see citing works
Ward, M., O’Riordan, F., Logan-Fleming, D., Cooke, D., Concannon-Gibney, T., Efthymiou, M., & Watkins, N. (2024) · Innovations in Education and Teaching International · doi:10.1080/14703297.2023.2251967 · Cited by 25 · see citing works
Assessing core manipulative skills in a large, first-year laboratory
Moni, R. W., Hryciw, D. H., Poronnik, P., Lluka, L. J., & Moni, K. B. (2007) · Advances in Physiology Education · doi:10.1152/advan.00020.2007 · Cited by 21 · see citing works
Plagiarism or not? investigation of Turnitin®‐detected similarity hits in biology laboratory reports
Bertram Gallant, T., Picciotto, M., Bozinovic, G., & Tour, E. (2019) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21236 · Cited by 21 · see citing works
An alternative approach to student assessment for engineering–laboratory learning
Lal, S., Lucey, A. D., Lindsay, E. D., Sarukkalige, R., Mocerino, M., Treagust, D. F., & Zadnik, M. G. (2017) · Australasian journal of engineering education · doi:10.1080/22054952.2018.1435202 · Cited by 20 · see citing works
Peteroy-Kelly, M. A., Marcello, M. R., Crispo, E., Buraei, Z., Strahs, D., Isaacson, M. K., Jaworski, L., Lopatto, D. E., & Zuzga, D. S. (2017) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v18i1.1226 · Cited by 20 · see citing works
The Student View of 1st year Laboratory Work in the Biosciences — Score Gamma?
Collis, M., Gibson, A., Hughes, I. E., Sayers, G., & Todd, M. H. (2008) · Bioscience Education · doi:10.3108/beej.11.2 · Cited by 19 · see citing works
Jiang, S., Huang, X., Sung, S., & Xie, C. (2022) · Research in Science Education · doi:10.1007/s11165-022-10061-x · Cited by 18 · see citing works
Handwritten undergraduate case reports
McGlade, K., Cargo, C., Fogarty, D., Boohan, M., & McMullin, M. (2012) · The Clinical Teacher · doi:10.1111/j.1743-498x.2011.00494.x · Cited by 11 · see citing works
Academic integrity and oral examination: an Arabian Gulf perspective
Thomas, J., Raynor, M., & McKinnon, M. (2014) · Innovations in Education and Teaching International · doi:10.1080/14703297.2013.796724 · Cited by 10 · see citing works
Davey, S. K., Birbeck, D., Nallaya, S., Sallows, G., & Della Vedova, C. B. (2025) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2025.2502577 · Cited by 9 · see citing works
Self-citationCostabile, M., & Turkanovic, J. (2022) · Journal of Biological Education · doi:10.1080/00219266.2022.2026804 · Cited by 9 · see citing works
Drumm, B. T., Bree, R., Griffin, C. S., & O’Leary, N. (2024) · Advances in Physiology Education · doi:10.1152/advan.00257.2023 · Cited by 8 · see citing works
Dialogic oral exam in nursing education: A qualitative study of nursing students' perceptions
Turjamaa, R., Hynynen, M.-A., Mikkonen, I., & Ylinen, E.-R. (2018) · Nurse Education in Practice · doi:10.1016/j.nepr.2017.11.008 · Cited by 6 · see citing works
Improving assessment equity using Interactive Oral Assessments
Krautloher, A. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/4hg1me11 · Cited by 6 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Vygotsky, L. S. (1978). Mind in Society: The Development of Higher Psychological Processes. Harvard University Press.
- Authors
- Della Vedova, C. B., Birbeck, D., & Davey, S. K.
- Affiliations
- Adelaide University (AU)
- Venue
- Research in Science Education
- Published
- 2026-09-28
- ISSN
- 0157-244X (ISSN-L)
- 1573-1898
- OpenAlex
- W7214594727
- Cited by
- 0
- References
- 39
- FWCI
- 0.00
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Research in Science Education (publishedVersion, cc-by)
- Topics
- Social Sciences › Education › Student Assessment and Feedback
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Education › Innovative Teaching Methods
- Keywords
- genetics education, assessment equity, student perceptions, academic performance, student anxiety, academic integrity, authentic assessment, science education assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-29.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-29.
Cited sources are checked by gpt-6-sol.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review