Development and Validation of a Rubric for Diagnosing Students’ Experimental Design Knowledge and Difficulties
Open accessThe DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
It is essential to teach students about experimental design, as this facilitates their deeper understanding of how most biological knowledge was generated and gives them tools to perform their own investigations. Despite the importance of this area, surprisingly little is known about what students actually learn from designing biological experiments. In this paper, we describe a rubric for experimental design (RED) that can be used to measure knowledge of and diagnose difficulties with experimental design. The development and validation of the RED was informed by a literature review and empirical analysis of undergraduate biology students’ responses to three published assessments. Five areas of difficulty with experimental design were identified: the variable properties of an experimental subject; the manipulated variables; measurement of outcomes; accounting for variability; and the scope of inference appropriate for experimental findings. Our findings revealed that some difficulties, documented some 50 yr ago, still exist among our undergraduate students, while others remain poorly investigated. The RED shows great promise for diagnosing students’ experimental design knowledge in lecture settings, laboratory courses, research internships, and course-based undergraduate research experiences. It also shows potential for guiding the development and selection of assessment and instructional activities that foster experimental design.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Experimental Design and Data Analysis for Biologists
Quinn, G. P., & Keough, M. J. (2002) · doi:10.1017/cbo9780511806384 · Cited by 10,674
(2014) · doi:10.4324/9781315799681 · Cited by 2,174
When and where do we apply what we learn?: A taxonomy for far transfer
Barnett, S. M., & Ceci, S. J. (2002) · Psychological Bulletin · doi:10.1037/0033-2909.128.4.612 · Cited by 2,076 · cited 1×
“In other words, certain features might allow students to call on particular knowledge about experiments in one domain, but they may have trouble transferring what they know to a completely different domain (Chen and Klahr, 1999; Barnett and Ceci, 2002; Sternberg, 2003).”
BackgroundUndergraduate research experiences support science career decisions and active learning
Lopatto, D. (2007) · CBE—Life Sciences Education · doi:10.1187/cbe.07-06-0039 · Cited by 1,009
Survey of undergraduate research experiences (SURE): First findings
Lopatto, D. (2004) · Cell Biology Education · doi:10.1187/cbe.04-07-0045 · Cited by 969 · cited 1×
“Most of the studies rely on rubrics (Dolan and Grady, 2010; Feldon et al., 2010; Timmerman et al., 2011), surveys (Kardash, 2000; Lopatto, 2004, 2007; Laursen et al., 2010; Thiry et al., 2012; Kloser et al., 2013), and interviews (Gutwill-Wise, 2001; Thiry et al., 2012) to evaluate student learning…”
BackgroundAll Other Things Being Equal: Acquisition and Transfer of the Control of Variables Strategy
Chen, Z., & Klahr, D. (1999) · Child Development · doi:10.1111/1467-8624.00081 · Cited by 736
Kardash, C. M. (2000) · Journal of Educational Psychology · doi:10.1037/0022-0663.92.1.191 · Cited by 563 · cited 1×
“Most of the studies rely on rubrics (Dolan and Grady, 2010; Feldon et al., 2010; Timmerman et al., 2011), surveys (Kardash, 2000; Lopatto, 2004, 2007; Laursen et al., 2010; Thiry et al., 2012; Kloser et al., 2013), and interviews (Gutwill-Wise, 2001; Thiry et al., 2012) to evaluate student learning…”
BackgroundGormally, C., Brickman, P., & Lutz, M. (2012) · CBE—Life Sciences Education · doi:10.1187/cbe.12-03-0026 · Cited by 437
Belief revision in children: The role of prior knowledge and strategies for generating evidence
Schauble, L. (1990) · Journal of Experimental Child Psychology · doi:10.1016/0022-0965(90)90048-d · Cited by 420
Thiry, H., Weston, T. J., Laursen, S. L., & Hunter, A.-B. (2012) · CBE—Life Sciences Education · doi:10.1187/cbe.11-11-0098 · Cited by 257 · cited 2×
“, 2013), and interviews (Gutwill-Wise, 2001; Thiry et al., 2012) to evaluate student learning about research.”
Background
Cited by
Undergraduate research experiences: Impacts and opportunities
Linn, M. C., Palmer, E., Baranger, A., Gerard, E., & Stone, E. (2015) · Science · doi:10.1126/science.1261757 · Cited by 821
Corwin, L. A., Graham, M. J., & Dolan, E. L. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.14-10-0167 · Cited by 475
Clemmons, A. W., Timbrook, J., Herron, J. C., & Crowe, A. J. (2020) · CBE—Life Sciences Education · doi:10.1187/cbe.19-11-0259 · Cited by 122
Abdullah, C., Parris, J., Lie, R., Guzdar, A., & Tour, E. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.14-10-0180 · Cited by 46
“…was published that described a comprehensive review of the difficulties in experimental design that had been described in the K–12 and college education literature and that also provided a rubric of experimental design (RED) that targeted these identified difficulties (Dasgupta et al., 2014).”
BackgroundMethodInfluentialKenyon, K. L., Onorato, M. E., Gottesman, A. J., Hoque, J., & Hoskins, S. G. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-07-0146 · Cited by 32
Metadata
- Authors
- Dasgupta, A. P., Anderson, T. R., & Pelaez, N.
- Venue
- CBE—Life Sciences Education
- Published
- 2014-06
- Volume
- 13
- Issue
- 2
- Pages
- 265-284
- ISSN
- 1931-7913 (ISSN-L)
- OpenAlex
- W2162058357
- Cited by
- 99
- References
- 10
- FWCI
- 39.29
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.