Two-Stage Collaborative Exams have Little Impact on Subsequent Exam Performance in Undergraduate Mathematics
Open accessAbstract
In this paper, I investigate whether two-stage exams aid learning in undergraduate mathematics, as measured by students’ performance on subsequent exams. In a two-stage exam, students complete the exam individually then form into groups to solve it again, with grades based on a combination of the two stages. Previous research in other disciplines has found mixed results about their effect on subsequent performance, and little is known about their use in undergraduate mathematics. Here, I report on three studies which investigate the use of two-stage exams in different undergraduate mathematics contexts. The first two studies replicate observational methods from previous research, and find indications of a positive impact from group collaboration. The third study is experimental and finds that, in a delayed post-test, there is no difference in performance between students who answered related questions in a two-stage exam format and a control group which had no collaborative second stage. The findings suggest that two-stage exams may have little impact on longer-term learning of mathematics, but instructors may still wish to use them to emphasise a collaborative classroom pedagogy.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
With less time available for the individual stage, instructors face constraints not only in the number and complexity of questions they can pose but also in the breadth of topics covered.
“With less time available for the individual stage, instructors face constraints not only in the number and complexity of questions they can pose but also in the breadth of topics covered (Kinnear, 2021;Rieger & Heiner, 2014;Rieger & Rieger, 2020).”
From Active learning through flexible collaborative exams: Improving assessments across disciplines (2026) · cites this paper as Kinnear, 2021
The Method section describes a 25-minute individual stage with six questions, and Student Views reports that almost all free-text comments mentioned insufficient time to complete it. The General Discussion also notes reliance on a small number of questions. These passages support a time and question-count constraint, but they do not say that reduced individual-stage time limited instructors’ choice of question complexity or breadth of topics. (LLM, conf=0.78)
Experimental — accuracy not yet measuredThe benefits of two-stage exams can vary; not all studies have demonstrated significant long-term retention, and the effects may diminish over time.
“However, these benefits can vary, as not all studies have demonstrated significant long-term retention, and the effects may diminish over time (Cao & Porter, 2017;Kinnear, 2021;Leight et al., 2012).”
From Active learning through flexible collaborative exams: Improving assessments across disciplines (2026) · cites this paper as Kinnear, 2021
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The power of testing memory: Basic research and implications for educational practice
Roediger, H. L., & Karpicke, J. D. (2006) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2006.00012.x · Cited by 2,037 · see citing works
Bayesian Versus Orthodox Statistics: Which Side Are You On?
Dienes, Z. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691611406920 · Cited by 938 · see citing works
Analyzing ordinal data with metric models: What could possibly go wrong?
Liddell, T. M., & Kruschke, J. K. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2018.08.009 · Cited by 773 · see citing works
Rejecting or Accepting Parameter Values in Bayesian Estimation
Kruschke, J. K. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918771304 · Cited by 734 · cited 18× · see citing works
“Every parameter in the model has an exact credible interval” (Liddell and Kruschke 2018, p339); this enables us to look at the strength of evidence for differences between different groups of students, without needing to worry about corrections for multiple comparisons.”
BackgroundInfluential
Flagged first, then by citations
Research works printed but not linked: 30
- Alcock, L., Gilmore, C., Inglis, M. (2013). Experimental methods in mathematics education research. Research in Mathematics Education, 15(2), 97-99.
- Biggs, J., & Tang, C. (2011). Teaching for quality learning at university: what the student does. McGraw- Hill/Society for Research into Higher Education/Open University Press.
- Bjork, E.L., & Bjork, R.A. (2014). Making things hard on yourself, but in a good way: Creating desirable difficulties to enhance learning. In Gernsbacher, M.A., & Pomerantz, J. (Eds.) Psychology and the real world. 2nd edn. (pp. 59-68). New York. Chap.
- Brame, C.J., & Biel, R. (2015). Test-enhanced learning: the potential for testing to promote greater learning in undergraduate science courses. CBE Life Sciences Education, 14(2), 14:es4.
- Cao, Y., & Porter, L. (2017a). Evaluating student learning from collaborative group tests in introductory computing. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education -SIGCSE '17 (pp. 99-104). New York: ACM Press.
- Cao, Y., & Porter, L. (2017b). Impact of performance level and group composition on student learning dur- ing collaborative exams. In Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education -ITiCSE '17 (pp. 152-157). New York: ACM Press.
- Cortright, R.N., et al. (2003). Student retention of course content is improved by collaborative-group testing. AJP: Advances in Physiology Education, 27(3), 102-108.
- Earl, L.M. (2004). Assessment as learning : using classroom assessment to maximize student learning, (p. 132). Thousand Oaks: Corwin Press.
- Freeman, S. et al. (2014). Active learning increases student performance in science, engineering, and math- ematics. Proceedings of the National Academy of Sciences of the United States of America, 111(23), 8410-5.
- Garaschuk, K.M., & Cytrynbaum, E.N. (2019). Feasibility and effectiveness of group exams in mathemat- ics courses. PRIMUS, 29(10), 1061-1079.
- Gilley, B.H., & Clarkston, B. (2014). Collaborative testing: Evidence of learning in a controlled in-class study of undergraduate students. Journal of college science teaching, 43(3), 83-91.
- Giuliodori, M.J., Lujan, H.L., DiCarlo, S.E. (2008). Collaborative group testing benefits high-and low- performing students. AJP: Advances in Physiology Education, 32(4), 274-278.
- Iannone, P., & Simpson, A. (2015). Students' preferences in undergraduate mathematics assessment. Studies in Higher Education, 40(6), 1046-1067.
- Iannone, P., & Simpson, A. (2012). A survey of current assessment practices. In Iannone, P., & Simpson, A. (Eds.) Mapping university mathematics assessment practices, Chap. 1 (pp. 3-15).
- Ives, J. (2014). Measuring the learning from Two-Stage collaborative group exams. In Physics education research conference 2014. PER Conference. Minneapolis, MN (pp. 123-126).
- Jang, H. et al. (2017). Collaborative exams: Cheating? Or learning? American Journal Of Physics, 85(3), 223-227.
- Jones, I. et al. (2019). Measuring conceptual understanding in randomised controlled trials: Can compar- ative judgement help? British Educational Research Journal, 45(3), 662-680.
- Kapitanoff, S.H. (2009). Collaborative testing. Active Learning in Higher Education, 10(1), 56-70.
- Leight, H. et al. (2012). Collaborative testing improves performance but not content retention in a large- enrollment introductory biology class. Cell Biology Education, 11(4), 392-401.
- Mazur, E. (1997). Peer instruction: A user's manual, (p. 253). Upper Saddle River: Prentice Hall.
- Rieger, G.W., & Heiner, C.E. (2014). Examinations that support collaborative learning: The students' perspective. Journal of College Science Teaching, 43(4), 41-47.
- Rittle-Johnson, B., Schneider, M., Star, J.R. (2015). Not a one-way street: Bidirectional relations between procedural and conceptual knowledge of mathematics. Educational Psychology Review, 27(4), 587-597.
- Sadler, D. (1989). Royce formative assessment and the design of instructional systems. Instructional Science Instructional Science, 18(2), 119-144.
- Sangwin, C.J., & Jones, I. (2017). Asymmetry in student achievement on multiple-choice and constructed- response items in reversible mathematics processes. Educational Studies in Mathematics, 94(2), 205- 222.
- Smith, G. et al. (1996). Constructing mathematical examinations to assess a range of knowledge and skills. International Journal of Mathematical Education in Science and Technology, 27(1), 65-77.
- Torrance, H. (2007). Assessment as learning? How the use of explicit learning objectives, assessment crite- ria and feedback in post-secondary education and training can come to dominate learning. Assessment in Education: Principles, Policy & Practice, 14(3), 281-294.
- Wieman, C., & Gilbert, S. (2014). The teaching practices inventory: a new tool for characterizing college and university teaching in mathematics and science. CBE Life Sciences Education, 13(3), 552-69.
- Wiliam, D., & Black, P. (1996). Meanings and Consequences: a basis for distinguishing formative and summative functions of assessment?. British Educational Research Journal, 22(5), 537-548.
- Wooldridge, C.L. et al. (2014). The testing effect with authentic educational materials: a cautionary note. Journal of Applied Research in Memory and Cognition, 3, 214-221.
- Zipp, J.F. (2007). Learning by exams: The impact of two-stage cooperative tests. Teaching Sociology, 35(1), 62-76.
Cited by
Sorted by citations
Active learning through flexible collaborative exams: Improving assessments across disciplines
Callaghan, K., Kestin, G., Klales, A., McCarty, L., & Deslauriers, L. (2026) · Active Learning in Higher Education · doi:10.1177/14697874251344293 · Cited by 2 · see citing works
“However, these benefits can vary, as not all studies have demonstrated significant long-term retention, and the effects may diminish over time (Cao & Porter, 2017; Kinnear, 2021; Leight et al., 2012).”
- Authors
- Kinnear, G.
- Affiliations
- University of Edinburgh (GB)
- Corresponding author
- Kinnear, George
- ORCID
- Kinnear, George
- Venue
- International Journal of Research in Undergraduate Mathematics Education
- Published
- 2020-09-17
- Volume
- 7
- Issue
- 1
- Pages
- 33-60
- ISSN
- 2198-9745 (ISSN-L)
- 2198-9753
- OpenAlex
- W3087245920
- Cited by
- 16
- References
- 4
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 1 · 2023: 4 · 2022: 2 · 2021: 2
- FWCI
- 3.02
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- International Journal of Research in Undergraduate Mathematics Education (publishedVersion, cc-by)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Innovative Teaching and Learning Methods
- Physical Sciences › Mathematics › Modeling and Simulation › Mathematics Education and Programs
- Social Sciences › Education › Student Assessment and Feedback
- Keywords
- cooperative learning, group work, undergraduate mathematics, exam performance, long-term learning, mathematics assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review