Understanding Randomness and its Impact on Student Learning: Lessons Learned from Building the Biology Concept Inventory (BCI)
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
While researching student assumptions for the development of the Biology Concept Inventory (BCI; http://bioliteracy.net ), we found that a wide class of student difficulties in molecular and evolutionary biology appears to be based on deep-seated, and often unaddressed, misconceptions about random processes. Data were based on more than 500 open-ended (primarily) college student responses, submitted online and analyzed through our Ed's Tools system, together with 28 thematic and think-aloud interviews with students, and the responses of students in introductory and advanced courses to questions on the BCI. Students believe that random processes are inefficient, whereas biological systems are very efficient. They are therefore quick to propose their own rational explanations for various processes, from diffusion to evolution. These rational explanations almost always make recourse to a driver, e.g., natural selection in evolution or concentration gradients in molecular biology, with the process taking place only when the driver is present, and ceasing when the driver is absent. For example, most students believe that diffusion only takes place when there is a concentration gradient, and that the mutational processes that change organisms occur only in response to natural selection pressures. An understanding that random processes take place all the time and can give rise to complex and often counterintuitive behaviors is almost totally absent. Even students who have had advanced or college physics, and can discuss diffusion correctly in that context, cannot make the transfer to biological processes, and passing through multiple conventional biology courses appears to have little effect on their underlying beliefs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hake, R. R. (1998) · American Journal of Physics · doi:10.1119/1.18809 · Cited by 6,072 · cited 1×
“Which best describes how you would manage to “find” an ATP synthase so that you could become an ATP molecule?) We see little improvement in recognition of the correct response, even after two or three “conventional,” in Hake’s terminology (1998), i.”
BackgroundArrow, K. J. (1973) · Journal of Public Economics · doi:10.1016/0047-2727(73)90013-3 · Cited by 5,121
Content Analysis for the Social Sciences and Humanities.
Parker, E. B., & Holsti, O. R. (1970) · American Sociological Review · doi:10.2307/2093233 · Cited by 4,564
Hestenes, D., Wells, M., & Swackhamer, G. (1992) · The Physics Teacher · doi:10.1119/1.2343497 · Cited by 3,235 · cited 1×
“The FCI (Hestenes et al., 1992; Hestenes and Halloun, 1995), the most widely used instrument, was designed to measure students’ conceptual understanding of Newton’s laws of motion (a staple of most first-semester physics courses) and, as a result, has also been the most influential.”
MethodAn overview of content analysis
Stemler, S. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/z6fm-2e34 · Cited by 2,813
The origins of genome complexity
Lynch, M., & Conery, J. S. (2003) · Science · doi:10.1126/science.1089370 · Cited by 1,698 · cited 1×
“(see Lynch and Conery, 2003; Lynch, 2006; Yi, 2006; Brockhurst, 2007; Lynch, 2007).”
The frailty of adaptive hypotheses for the origins of organismal complexity
Lynch, M. (2007) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0702207104 · Cited by 817 · cited 2×
“Genetic drift is a completely random process, whose importance appears to be poorly understood, even among working scientists (see Lynch, 2007 ).”
BackgroundThornton, R. K., & Sokoloff, D. R. (1998) · American Journal of Physics · doi:10.1119/1.18863 · Cited by 799 · cited 1×
“More recently, the FCI has been joined by the Force and Motion Concept Evaluation (FMCE; Thornton and Sokoloff, 1998 ), which covers similar ideas, and the Brief Electricity and Magnetism Assessment (BEMA; Ding et al., 2006), which deals with concepts common to many second-semester physics courses.”
MethodDevelopment and evaluation of the conceptual inventory of natural selection
Anderson, D. L., Fisher, K. M., & Norman, G. J. (2002) · Journal of Research in Science Teaching · doi:10.1002/tea.10053 · Cited by 572 · cited 1×
“Some instruments have been described; there exist instruments focused on diffusion and osmosis (Odom and Barrow, 1995), natural selection ( Anderson et al., 2002 ), and there are ongoing efforts to build concept inventories covering other areas.”
BackgroundA Test of Leadership: charting the future of U.S. Higher education
Department of Education, S. O. E. C. O. T. F. O. H. E. (2006) · Deep Blue (University of Michigan) · Cited by 425
Evaluating an electricity and magnetism assessment tool: Brief electricity and magnetism assessment
Ding, L., Chabay, R., Sherwood, B., & Beichner, R. (2006) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.2.010105 · Cited by 413
The Origins of Eukaryotic Gene Structure
Lynch, M. (2006) · Molecular Biology and Evolution · doi:10.1093/molbev/msj050 · Cited by 395 · cited 1×
“(see Lynch and Conery, 2003; Lynch, 2006; Yi, 2006; Brockhurst, 2007; Lynch, 2007).”
Interpreting the force concept inventory: A response to March 1995 critique by Huffman and Heller
Hestenes, D., & Halloun, I. (1995) · The Physics Teacher · doi:10.1119/1.2344278 · Cited by 360
Morpheus Unbound: Reimagining the Morphogen Gradient
Lander, A. D. (2007) · Cell · doi:10.1016/j.cell.2007.01.004 · Cited by 331 · cited 1×
“In his review of morphogen gradients, Lander (2007)”
BackgroundFooled by Randomness: The Hidden Role of Chance in Life and in the Markets
Taleb, N. N. (2001) · Medical Entomology and Zoology · Cited by 282
Odom, A. L., & Barrow, L. H. (1995) · Journal of Research in Science Teaching · doi:10.1002/tea.3660320106 · Cited by 265 · cited 2×
“Some instruments have been described; there exist instruments focused on diffusion and osmosis (Odom and Barrow, 1995), natural selection (Anderson et al.”
BackgroundRecognizing Student Misconceptions through Ed's Tools and the Biology Concept Inventory
Klymkowsky, M. W., & Garvin-Doxas, K. (2007) · PLoS Biology · doi:10.1371/journal.pbio.0060003 · Cited by 109 · cited 1×
“These student responses are typically 100 to 200 words long and are captured and analyzed using our Ed’s Tools Web software system (Klymkowsky and Garvin-Doxas, 2008; Garvin-Doxas et al., 2007b).”
MethodSelf-citationSecondary & College Biology Students' Misconceptions about Diffusion & Osmosis
Odom, A. L. (1995) · The American Biology Teacher · doi:10.2307/4450030 · Cited by 105 · cited 1×
“The presence of such problems has been discussed previously by Odom and colleagues (Odom, 1995; Odom and Barrow, 1995).”
BackgroundBioliteracy and Teaching Efficacy: What Biologists Can Learn from Physicists
Klymkowsky, M. W., Garvin-Doxas, K., & Zeilik, M. (2003) · Cell Biology Education · doi:10.1187/cbe.03-03-0014 · Cited by 99 · cited 1×
“In the biological sciences there has been an increased awareness of the need for similar assessments as a means to drive improved teaching and enhanced students’ understanding of key ideas (Klymkowsky et al., 2003; GarvinDoxas et al., 2007a).”
BackgroundSelf-citationHow Effective Are Simulated Molecular-level Experiments for Teaching Diffusion and Osmosis?
Meir, E., Perry, J., Stal, D., Maruca, S. L., & Klopfer, E. D. (2005) · Cell Biology Education · doi:10.1187/cbe.04-09-0049 · Cited by 90 · cited 1×
“Although these results are preliminary and need to be supported by further study in terms of their reproducibility and generality across various curricula, they do suggest that conceptual improvements in this area are possible through directed activities— similar conclusions have been reported by Meir et al. (2005) .”
ResultGarvin-Doxas, K., Klymkowsky, M. W., & Elrod, S. L. (2007) · CBE—Life Sciences Education · doi:10.1187/cbe.07-05-0031 · Cited by 87
Self-citationPopulation Bottlenecks Promote Cooperation in Bacterial Biofilms
Brockhurst, M. A. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000634 · Cited by 48
Non‐adaptive evolution of genome complexity
Yi, S. V. (2006) · BioEssays · doi:10.1002/bies.20478 · Cited by 34 · cited 1×
“(see Lynch and Conery, 2003; Lynch, 2006; Yi, 2006; Brockhurst, 2007; Lynch, 2007).”
Fooled by Randomness: The Hidden Role of Chance in Life and in the Markets
Sriram, S. (2014) · SDMIMD Journal of Management · doi:10.18311/sdmimd/2014/2673 · Cited by 30
Klymkowsky, M. W. (2007) · CBE—Life Sciences Education · doi:10.1187/cbe.07-06-0038 · Cited by 28
Self-citationSeymour, J. (1993) · Cited by 26
Improving Student Learning in Higher Education Through Better Accountability and Assessment
McPherson, P., & Shulenburger, D. E. (2006) · KU ScholarWorks (The University of Kansas) · Cited by 14
Cited by
Gormally, C., Brickman, P., & Lutz, M. (2012) · CBE—Life Sciences Education · doi:10.1187/cbe.12-03-0026 · Cited by 437
Bottomley, S., & Denny, P. (2011) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.20526 · Cited by 102
Zhang, H., Perry, A., & Lee, I. (2025) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-024-00398-x · Cited by 75
Nehm, R. H. (2019) · Disciplinary and Interdisciplinary Science Education Research · doi:10.1186/s43031-019-0017-6 · Cited by 47
Trujillo, C. M., Anderson, T. R., & Pelaez, N. J. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-03-0051 · Cited by 19
Metadata
- Authors
- Garvin-Doxas, K., & Klymkowsky, M. W.
- Venue
- CBE—Life Sciences Education
- Published
- 2008-06
- Volume
- 7
- Issue
- 2
- Pages
- 227-233
- ISSN
- 1931-7913 (ISSN-L)
- OpenAlex
- W2144736543
- Cited by
- 216
- References
- 27
- FWCI
- 54.38
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.