The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Item feature effects in evolution assessment
Abstract
Despite concerted efforts by science educators to understand patterns of evolutionary reasoning in science students and teachers, the vast majority of evolution education studies have failed to carefully consider or control for item feature effects in knowledge measurement. Our study explores whether robust contextualization patterns emerge within particular evolutionary reasoning contexts, and the implications of these patterns for instruction, assessment, and models of cognition. We test four hypotheses regarding item feature effects on undergraduate biology majors' evolutionary reasoning using a sample of 1,200 open response explanations of evolutionary change across items differing in context and scale but standardized by taxon and trait. Evolutionary explanations were atomized into a series of scientific and naïve biological elements and tallied among prompts and their features. We documented clear, significant, and predictable item feature effects on evolutionary explanations. Tasks involving evolutionary trait loss elicited a significantly greater number of naïve biological elements than evolutionary trait gain tasks in all contexts, including: within species comparisons, between species comparisons, animal prompts, and plant prompts. Tasks involving between species evolutionary comparisons, regardless of gain or loss, animal or plant, always produced significantly more naïve biological explanatory elements than within species comparisons. For items prompting explanation of trait gain, the use of the core concepts of natural selection were not influenced by the hierarchical level of the task (within or between species). Explanations of trait gain were also the least sensitive to scale and context. Core concepts of natural selection were always deployed less frequently in cases of evolutionary trait loss (within and between species, in animals and plants). We discuss a series of implications of these findings for curriculum, instruction, and assessment. © 2010 Wiley Periodicals, Inc., Inc. J Res Sci Teach 48: 237–256, 2011
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Simulation, situated conceptualization, and prediction
Barsalou, L. W. (2009) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2008.0319 · Cited by 1,017
The Human Function Compunction: Teleological explanation in adults
Kelemen, D., & Rosset, E. (2009) · Cognition · doi:10.1016/j.cognition.2009.01.001 · Cited by 480
The relation between essentialist beliefs and evolutionary reasoning
Shtulman, A., & Schulz, L. (2008) · Cognitive Science · doi:10.1080/03640210801897864 · Cited by 214
Cited by
Promoting Student Metacognition
Tanner, K. D. (2012) · CBE—Life Sciences Education · doi:10.1187/cbe.12-03-0033 · Cited by 618
Nehm, R. H. (2019) · Disciplinary and Interdisciplinary Science Education Research · doi:10.1186/s43031-019-0017-6 · Cited by 47
Self-citation
Metadata
- Authors
- Nehm, R. H., & Ha, M.
- Venue
- Journal of Research in Science Teaching
- Publisher
- Wiley
- Published
- 2010-12-10
- Volume
- 48
- Issue
- 3
- Pages
- 237-256
- ISSN
- 0022-4308 (ISSN-L)
- 1098-2736
- OpenAlex
- W2120320346
- Cited by
- 239
- References
- 3
- FWCI
- 96.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Item feature effects in evolution assessment. https://app.cochat.ai/papers/10.1002/tea.20400
- The paper
- Nehm, R. H., & Ha, M. (2011). Item feature effects in evolution assessment. Journal of Research in Science Teaching. https://doi.org/10.1002/tea.20400
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.