Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 72 of the 85 references it cites were found in a registry or an index; 5 of the 39 sources its claims cite were checked for support.

Increasing high school teachers self-efficacy for integrated STEM instruction through a collaborative community of practice

Open access
Kelley, Todd R., Knowles, J. Geoffery, Holland, Jeffrey D., Han, Jung · 2020 · International Journal of STEM Education

Abstract

Abstract Background Teachers can have a significant impact on student interest and learning in science, technology, engineering, and math (STEM) subjects and careers. Teacher self-efficacy can also significantly affect student learning. Researchers investigated the effects of teacher professional development and integrated STEM curriculum development on teacher self-efficacy. Participants in the study included high school science and engineering technology teachers enrolled in a National Science Foundation–ITEST project called Teachers and Researchers Advancing Integrated Lessons in STEM (TRAILS). The TRAILS program sought to prepare teachers to integrate STEM content using engineering design, biomimicry, science inquiry, and 3D printing as pedagogical approaches. Teachers learned within a community of practice working alongside industry partners and college faculty. The purpose of the study was to investigate the impact of the 70 h of professional development to train three cohorts of teachers over 3 years on teacher self-efficacy. The research design utilized a quasi-experimental nonequivalent control group approach, including an experimental group and an untreated control group. Results Measurements on beliefs about teacher self-efficacy were collected on pretest, posttest, and delayed posttest survey assessments. Researchers analyzed the T-STEM survey results for teaching self-efficacy using the Wilcoxson signed-rank test for detecting significant differences. Science teachers showed a significant increase in teacher self-efficacy comparing the pretest and delayed posttest scores after TRAILS professional development and STEM lesson implementation ( p = . 001, effect size = .95). Additionally, significant differences between groups (science experimental vs science control group teachers) using the Wilcoxon rank-sum test were detected from pretest to posttest ( p = .033, effect size = .46), posttest to delayed posttest ( p = .029, effect size = .47), and pretest to delayed posttest ( p = .005, effect size = .64). There were no significant differences detected in the control group. Engineering technology teachers showed no significant differences between the pretest, posttest, and delayed posttest self-efficacy scores. Conclusions The results indicate the science teachers’ self-efficacy increased after professional development and after lesson implementation. Potential implications from this research suggest that the science teacher participants benefited greatly from learning within a community of practice, engaging in science practices, and using science knowledge to solve a real-world problem (engineering design).

Overview

CoChat Summary

TL;DR

This quasi-experimental study found that a 70-hour integrated STEM professional development program (TRAILS) increased self-efficacy for high school science teachers, especially after they implemented the lessons they developed. Engineering/technology education teachers did not show significant self-efficacy gains, and the control group showed no significant differences.

Key findings

  • For science teachers in the experimental group, self-efficacy increased from pretest to delayed posttest with a large effect size: p = .001, effect size = .95.
  • For science teachers, significant gains were also found from posttest to delayed posttest (p = .0099, effect size = .71) and pretest to delayed posttest (p = .001475, effect size = .9451).
  • Between experimental and control groups, science teachers showed significant differences at pretest to posttest (p = .033, effect size = .46), posttest to delayed posttest (p = .029, effect size = .47), and pretest to delayed posttest (p = .005, effect size = .64).
  • Engineering technology education (ETE) teachers showed no significant differences across pretest, posttest, and delayed posttest measures; the control group also showed no significant differences.

Methods

  • The study used a quasi-experimental nonequivalent control group design with a delayed-treatment approach over 3 years and three cohorts of teachers.
  • Participants were high school science and engineering technology education teachers in the TRAILS NSF ITEST project; the text reports 69 total teachers in Table 2, with 30 experimental and 18 control teachers in the survey results table, and notes some attrition and returning teachers.
  • Teacher self-efficacy was measured with the T-STEM Survey using pretest, posttest, and delayed posttest data; analyses used Wilcoxon signed-rank tests within groups and Wilcoxon rank-sum tests between groups because the data were ordinal, small-sample, and nonnormal.

Limitations

  • The authors state the sample was limited to teachers who applied and were selected for TRAILS in a rural region of a Midwestern state, so it was not a random sample.
  • They note the study was constrained by funding, limiting the experimental group to a maximum of 15 participants each year; this likely reduced statistical power.
  • Evident from the text: the design included self-selecting control participants and some missing responses/attrition (“one teacher in the control group and seven teachers in the experimental group” did not complete responses; five experimental teachers dropped out), which may affect generalizability and completeness of the data.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1186/s40594-020-00211-w

Cites

72 of 72 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Verification

Claims the paper makes

5 Valid · 4 Not valid · 23 Not checked · 53 Own results and interpretations

29 more claims

Create a free account to see all 85 claims and to verify the 2 references still open.

See all claims — free account
  • Probably not a substantial claim. 30
  • It may state two separate claims as one. 26
  • Borderline: one of the tests for a substantial claim is unclear. 1
  • The quote only partly states this claim. 3

Create a free account to see these claims.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 85 references

Research works printed but not linked: 8

  1. Caliendo, J. (2015). Pre-service elementary teachers: scientific reasoning and attitudes toward STEM subjects (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3706494).
  2. Kelley, T. (2014a). Constructing an engineer’s notebook rubric. The Technology and Engineering Teacher, 73(5), 26–32.
  3. Knowles, J. G., Kelley, T., & Hurd, B. (2016). Innovate the intersection between entomology and technology. The Technology and Engineering Teacher, 76(1), 1–7.
  4. Meek, G., Ozgur, C., & Dunning, K. (2007). Does scale of measurement really make a difference in test selection? An empirical control of t test vs. Mann Whitney (pp. 951–953). Proceedings of the 2000 National Annual Meeting of the Decision Sciences Institute.
  5. National Research Council [NRC]. (2011). Successful K-12 STEM education: identifying effective approaches in science, technology, engineering, and mathematics. Washington, DC: National Academies Press.
  6. National Research Council [NRC]. (2012). A framework for K12 science education: practices, cross cutting concepts, and core ideas. Washington: National Academies Press.
  7. President’s Council of Advisors on Science and Technology (PCAST). (2010). Prepare and inspire: K–12 education in science, technology, engineering, and math (STEM) for America’s future. Washington, DC: Author.
  8. Rittmayer, A., & Beier, M. (2008). Overview: self-efficacy in STEM. Houston: SWE-AWE-CASEE ARP Resources, Rice University Retrieved from: http://www.AWEonline.org.

Cited by

See all 238

Metadata

Authors
Kelley, T. R., Knowles, J. G., Holland, J. D., & Han, J.
Affiliations
Purdue University West Lafayette (US)
Corresponding author
Kelley, Todd R.
Venue
International Journal of STEM Education
Published
2020-04-16
Volume
7
Issue
1
ISSN
2196-7822 (ISSN-L)
OpenAlex
W3031244974
Cited by
238
References
85
Citations by year
2026: 21 · 2025: 45 · 2024: 74 · 2023: 27 · 2022: 41 · 2021: 25 · 2020: 2
FWCI
42.75
Type
journal article
Language
en
Open access
Licence
Locations
  • International Journal of STEM Education (publishedVersion, cc-by)
  • Purdue e-Pubs (Purdue University System) (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
National Science Foundation (# DRL – 1513248)
Topics
  • Life Sciences › Agricultural and Biological Sciences › General Agricultural and Biological Sciences › Diverse Educational Innovations Studies
  • Social Sciences › Education › Science Education and Pedagogy
  • Social Sciences › Education › Innovative Teaching Methods
Keywords
teacher self-efficacy, teacher professional development, communities of practice, high school science teachers, engineering design, biomimetics, 3D printing, STEM curriculum development

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Increasing high school teachers self-efficacy for integrated STEM instruction through a collaborative community of practice. https://app.cochat.ai/papers/10.1186/s40594-020-00211-w
The paper
Kelley, T. R., Knowles, J. G., Holland, J. D., & Han, J. (2020). Increasing high school teachers self-efficacy for integrated STEM instruction through a collaborative community of practice. International Journal of STEM Education. https://doi.org/10.1186/s40594-020-00211-w

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.