Assessment of Learning Gains Associated with Independent Exam Analysis in Introductory Biology
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
This study evaluates the impact of an independent postmidterm question analysis exercise on the ability of students to answer subsequent exam questions on the same topics. It was conducted in three sections (∼400 students/section) of introductory biology. Graded midterms were returned electronically, and each student was assigned a subset of questions answered incorrectly by more than 40% of the class to analyze as homework. The majority of questions were at Bloom's application/analysis level; this exercise therefore emphasized learning at these higher levels of cognition. Students in each section answered final exam questions matched by topic to all homework questions, providing a within-class control group for each question. The percentage of students who correctly answered the matched final exam question was significantly higher (p < 0.05) in the Topic Analysis versus Control Analysis group for seven of 19 questions. We identified two factors that influenced activity effectiveness: 1) similarity in topic emphasis of the midterm–final exam question pair and 2) quality of the completed analysis homework. Our data suggest that this easy-to-implement exercise will be useful in large-enrollment classes to help students develop self-regulated learning skills. Additional strategies to help introductory students gain a broader understanding of topic areas are discussed.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessment and Classroom Learning
Black, P., & Wiliam, D. (1998) · Assessment in Education: Principles, Policy & Practice · doi:10.1080/0969595980050102 · Cited by 8,152 · cited 3×
“…aligns the faculty desire for students to increase their mastery of the course material at the application and analysis level with the students’ desire to increase their grades, and is ecologically valid, as the activity/assessment is embedded in the normal curriculum (Black and Wiliam, 1998).”
BackgroundKirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 7,776 · cited 1×
“Teaching novice learners to recognize underlying concepts for problem solving requires careful guidance of the learners (Novick, 1988; Kirschner et al., 2006).”
BackgroundFormative assessment and the design of instructional systems
Sadler, D. R. (1989) · Instructional Science · doi:10.1007/bf00117714 · Cited by 4,285 · cited 1×
“Current theory and research indicates that this development is facilitated by formative assessment opportunities that allow students to evaluate their progress while learning (Sadler, 1989; Black and Wiliam, 1998; Wood, 2009).”
BackgroundSchema induction and analogical transfer
Gick, M. L., & Holyoak, K. J. (1983) · Cognitive Psychology · doi:10.1016/0010-0285(83)90002-6 · Cited by 3,010 · cited 1×
“Sorting problems into categories and making analogical comparisons are approaches that have also been used to help students recognize underlying concepts (Chi et al., 1981; Gick and Holyoak, 1983; Quilici and Mayer, 2002).”
MethodWhen and where do we apply what we learn?: A taxonomy for far transfer
Barnett, S. M., & Ceci, S. J. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.4.612 · Cited by 2,076 · cited 2×
“Because our introductory biology students are novice learners, they are likely to be relying more heavily on surface features, which makes it difficult for them to transfer information learned in one context to another application (Barnett and Ceci, 2002; Wagner, 2006).”
BackgroundThe Critical Importance of Retrieval for Learning
Karpicke, J. D., & Roediger, H. L. (2008) · Science · doi:10.1126/science.1152408 · Cited by 1,791 · cited 1×
“The act of retrieving an answer from memory, as occurs when students are tested on the same or even similar material multiple times, can increase learning independently of other interventions (Karpicke and Roediger, 2008; Karpicke and Blunt, 2011).”
BackgroundClickers in the large classroom: Current research and best-practice tips
Caldwell, J. E. (2007) · CBE—Life Sciences Education · doi:10.1187/cbe.06-12-0205 · Cited by 1,291 · cited 3×
““ASCB R©” and “The American Society for Cell Biology R©” are registered trademarks of The American Society for Cell Biology. a goal, we adopted a number of formative strategies others have used effectively in large entry-level courses (Allen and Tanner, 2005; Knight and Wood, 2005; Caldwell, 2007).”
MethodRetrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping
Karpicke, J. D., & Blunt, J. R. (2011) · Science · doi:10.1126/science.1199327 · Cited by 1,019
Biology in Bloom: Implementing Bloom's Taxonomy to Enhance Student Learning in Biology
Crowe, A., Dirks, C., & Wenderoth, M. P. (2008) · CBE—Life Sciences Education · doi:10.1187/cbe.08-05-0024 · Cited by 629 · cited 3×
“Most of these questions were ranked as application- or analysislevel questions on Bloom’s rating scale (Bloom et al., 1956; Crowe et al., 2008), and the exercise therefore emphasized learning in the context of these higher levels of cognition.”
BackgroundMethodPrescribed Active Learning Increases Performance in Introductory Biology
Freeman, S., O'Connor, E., Parks, J. W., Cunningham, M., Hurley, D., Haak, D., Dirks, C., & Wenderoth, M. P. (2007) · CBE—Life Sciences Education · doi:10.1187/cbe.06-09-0194 · Cited by 455
Learning our L.I.M.I.T.S.: less is more in teaching science
Hoskins, S. G., & Stevens, L. M. (2009) · Advances in Physiology Education · doi:10.1152/advan.90184.2008 · Cited by 43 · cited 2×
“…expanding database of knowledge in the biological sciences, introductory-level courses in universities are now placing less emphasis on knowledge acquisition and more on developing students who are independent, analytical thinkers (Boud, 2000; Kitchen et al., 2003; Hoskins and Stevens, 2009).”
Background
Cited by
Evaluation module based on Bayesian networks to intelligent tutoring systems
Ramírez-Noriega, A., Juárez-Ramírez, R., & Martínez-Ramírez, Y. (2017) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2016.05.007 · Cited by 61
Mynlieff, M., Manogaran, A. L., St. Maurice, M., & Eddinger, T. J. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.13-05-0097 · Cited by 60
“William et al. (2011) recently reported positive results from their evaluation of exam analysis in their large-enrollment introductory biology class by asking students to write an analysis on a few questions incorrectly answered by the class.”
BackgroundKnight, J. K., Weaver, D. C., Peffer, M. E., & Hazlett, Z. S. (2022) · CBE—Life Sciences Education · doi:10.1187/cbe.21-12-0341 · Cited by 18
“Some of these practices include post-exam analysis exercises (Williams et al., 2011; Mynlieff et al., 2014; Stanton et al., 2015), cues to check their answers in multiple circumstances (on practice problems, homework, and exams; McDonnell and Mullally, 2016), and using enhanced answer keys and reflections (Sabel et al.”
MethodAndaya, G., Hrabak, V. D., Reyes, S. T., Diaz, R. E., & McDonald, K. K. (2017) · Journal of College Science Teaching · doi:10.2505/4/jcst17_046_04_84 · Cited by 16
Angell, D. K., Lane-Getaz, S., Okonek, T., & Smith, S. (2024) · CBE—Life Sciences Education · doi:10.1187/cbe.22-10-0212 · Cited by 8
“Performance was also improved in biology classes using such post exam assignments (Mynlieff et al. , 2014; Williams et al. , 2011).”
Metadata
- Authors
- Williams, A. E., Aguilar-Roca, N. M., Tsai, M., Wong, M., Beaupré, M. M., & O’Dowd, D. K.
- Venue
- CBE—Life Sciences Education
- Published
- 2011-12
- Volume
- 10
- Issue
- 4
- Pages
- 346-356
- ISSN
- 1931-7913 (ISSN-L)
- OpenAlex
- W2159370903
- Cited by
- 25
- References
- 11
- FWCI
- 7.62
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.