CoChat

Design and Assessment of Online, Interactive Tutorials That Teach Science Process Skills

Open access
Kramer, Maxwell, Olson, Dalay, Walker, J. D. · 2018 · CBE—Life Sciences Education

The DOI matches its Crossref record; 45 of the 46 references it cites were found in a registry or an index, and 1 are not checked yet.

Abstract

Explicit emphasis on teaching science process skills leads to both gains in the skills themselves and, strikingly, deeper understanding of content. Here, we created and tested a series of online, interactive tutorials with the goal of helping undergraduate students develop science process skills. We designed the tutorials in accordance with evidence-based multimedia design principles and student feedback from usability testing. We then tested the efficacy of the tutorials in an introductory undergraduate biology class. On the basis of a multivariate ordinary least-squares regression model, students who received the tutorials are predicted to score 0.82 points higher on a 15-point science process skill assessment than their peers who received traditional textbook instruction on the same topic. This moderate but significant impact indicates that well-designed online tutorials can be more effective than traditional ways of teaching science process skills to undergraduate students. We also found trends that suggest the tutorials are especially effective for nonnative English-speaking students. However, due to a limited sample size, we were unable to confirm that these trends occurred due to more than just variation in the student group sampled.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1187/cbe.17-06-0109

Cites

45 of 46 references verified0 citation errors · 0 not checkable

Statistics

Figures

FIGURE 1. Example screenshots from “Experimental Design” interactive tutorial. Interactive tutorials were designed using consistently formatted interactions. These included module introductions (A), challenge questions (B), and specific feedback (C). Tutorials also include test tube graphics that allow students to track their progress through each module, review individual learning objectives (D), review entire modules (E), and review their progress through the entire tutorial (F). The test tube rack containing test tubes for all completed modules is accessible at any time during the tutorial by clicking on the small rack icon in the upper right corner of the tutorial interface. This allows students easy access for reviewing past content and tracking progress.
FIGURE 1. Example screenshots from “Experimental Design” interactive tutorial. Interactive tutorials were designed using consistently formatted interactions. These included module introductions (A), challenge questions (B), and specific feedback (C). Tutorials also include test tube graphics that allow students to track their progress through each module, review individual learning objectives (D), review entire modules (E), and review their progress through the entire tutorial (F). The test tube rack containing test tubes for all completed modules is accessible at any time during the tutorial by clicking on the small rack icon in the upper right corner of the tutorial interface. This allows students easy access for reviewing past content and tracking progress.CC BY-NC-SA · PubMed Central
FIGURE 2. Experimental design. Students enrolled in parallel sections of the same introductory biology course were given 2 weeks to complete either the online tutorials or the textbook reading. At the end of the two weeks, a 15-question multiple-choice quiz assessed students’ science process skills.
FIGURE 2. Experimental design. Students enrolled in parallel sections of the same introductory biology course were given 2 weeks to complete either the online tutorials or the textbook reading. At the end of the two weeks, a 15-question multiple-choice quiz assessed students’ science process skills.CC BY-NC-SA · PubMed Central
FIGURE 3. Mean scores for science process skills assessment after textbook (red) or online tutorial (purple) assignment. Comparison highlights difference between instructional approaches for native and nonnative English-speaking (NNES) students. While larger gains were observed for NNES students, statistical power was not sufficient to make a definitive conclusion due to the small number of NNES students enrolled in the study courses.
FIGURE 3. Mean scores for science process skills assessment after textbook (red) or online tutorial (purple) assignment. Comparison highlights difference between instructional approaches for native and nonnative English-speaking (NNES) students. While larger gains were observed for NNES students, statistical power was not sufficient to make a definitive conclusion due to the small number of NNES students enrolled in the study courses.CC BY-NC-SA · PubMed Central
FIGURE 4. Mean scores for science process skills assessment among native and nonnative English speakers. Comparison highlights the difference between the two groups when given textbook reading or online tutorials. While larger gaps were observed for NNES students in the textbook reading group, statistical power was not sufficient to make a definitive conclusion due to the small number of NNES students enrolled in the study courses.
FIGURE 4. Mean scores for science process skills assessment among native and nonnative English speakers. Comparison highlights the difference between the two groups when given textbook reading or online tutorials. While larger gaps were observed for NNES students in the textbook reading group, statistical power was not sufficient to make a definitive conclusion due to the small number of NNES students enrolled in the study courses.CC BY-NC-SA · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 4

  1. American Association for the Advancement of Science. (2011). Vision and change in undergraduate biology education: A call to action, Final report. Washington, DC Retrieved April 1, 2016, from http://visionandchange.org/files/2013/11/aaas-VISchange-web1113.pdf
  2. Bloom B. S. Engelhart M. D. Furst E. J. Hill W. H. Krathwohl D. R. (1956). Taxonomy of educational objectives: The classification of educational goals. New York: McKay.
  3. Kazeni M. M. M. (2005). Development and validation of a test of integrated science process skills for the further education and training learners (Unpublished master’s thesis). University of Pretoria, Pretoria, South Africa.
  4. Wiggins G. McTighe J. (2005). Understanding by design. expanded 2nd ed. Alexandria, VA: Association for Supervision and Curriculum Development.

Cited by

See all 37

Metadata

Authors
Kramer, M., Olson, D., & Walker, J. D.
Affiliations
University of Minnesota (US)
Corresponding author
Kramer, Maxwell
Venue
CBE—Life Sciences Education
Published
2018-06
Volume
17
Issue
2
Pages
ar19
ISSN
1931-7913 (ISSN-L)
OpenAlex
W2800053910
Cited by
31
References
45
Citations by year
2025: 3 · 2024: 5 · 2023: 7 · 2022: 6 · 2021: 5 · 2020: 4 · 2019: 1
FWCI
3.27
Type
journal article
Language
en
Open access
Licence
cc-by-nc-sa
Locations
  • CBE—Life Sciences Education (publishedVersion, cc-by-nc-sa)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-sa)
  • PubMed Central (publishedVersion, cc-by-nc-sa)
  • PubMed (publishedVersion)
Funders
  • Howard Hughes Medical Institute
  • University of Minnesota
  • Ministry of Education, India
  • UC Berkeley College of Chemistry
  • University of California Museum of Paleontology
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
  • Social Sciences › Education › Science Education and Pedagogy
  • Social Sciences › Education › Online and Blended Learning
Keywords
science process skills, multimedia learning design, usability testing, undergraduate biology education, introductory biology
MeSH terms
Educational Measurement, Humans, Research, Science, Students, Teaching, Least-Squares Analysis, Internet

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.