The DOI matches its Crossref record; 72 of the 85 references it cites were found in a registry or an index; 5 of the 39 sources its claims cite were checked for support.
Increasing high school teachers self-efficacy for integrated STEM instruction through a collaborative community of practice
Open accessAbstract
Abstract Background Teachers can have a significant impact on student interest and learning in science, technology, engineering, and math (STEM) subjects and careers. Teacher self-efficacy can also significantly affect student learning. Researchers investigated the effects of teacher professional development and integrated STEM curriculum development on teacher self-efficacy. Participants in the study included high school science and engineering technology teachers enrolled in a National Science Foundation–ITEST project called Teachers and Researchers Advancing Integrated Lessons in STEM (TRAILS). The TRAILS program sought to prepare teachers to integrate STEM content using engineering design, biomimicry, science inquiry, and 3D printing as pedagogical approaches. Teachers learned within a community of practice working alongside industry partners and college faculty. The purpose of the study was to investigate the impact of the 70 h of professional development to train three cohorts of teachers over 3 years on teacher self-efficacy. The research design utilized a quasi-experimental nonequivalent control group approach, including an experimental group and an untreated control group. Results Measurements on beliefs about teacher self-efficacy were collected on pretest, posttest, and delayed posttest survey assessments. Researchers analyzed the T-STEM survey results for teaching self-efficacy using the Wilcoxson signed-rank test for detecting significant differences. Science teachers showed a significant increase in teacher self-efficacy comparing the pretest and delayed posttest scores after TRAILS professional development and STEM lesson implementation ( p = . 001, effect size = .95). Additionally, significant differences between groups (science experimental vs science control group teachers) using the Wilcoxon rank-sum test were detected from pretest to posttest ( p = .033, effect size = .46), posttest to delayed posttest ( p = .029, effect size = .47), and pretest to delayed posttest ( p = .005, effect size = .64). There were no significant differences detected in the control group. Engineering technology teachers showed no significant differences between the pretest, posttest, and delayed posttest self-efficacy scores. Conclusions The results indicate the science teachers’ self-efficacy increased after professional development and after lesson implementation. Potential implications from this research suggest that the science teacher participants benefited greatly from learning within a community of practice, engaging in science practices, and using science knowledge to solve a real-world problem (engineering design).
Overview
CoChat Summary
TL;DR
This quasi-experimental study found that a 70-hour integrated STEM professional development program (TRAILS) increased self-efficacy for high school science teachers, especially after they implemented the lessons they developed. Engineering/technology education teachers did not show significant self-efficacy gains, and the control group showed no significant differences.
Key findings
- For science teachers in the experimental group, self-efficacy increased from pretest to delayed posttest with a large effect size: p = .001, effect size = .95.
- For science teachers, significant gains were also found from posttest to delayed posttest (p = .0099, effect size = .71) and pretest to delayed posttest (p = .001475, effect size = .9451).
- Between experimental and control groups, science teachers showed significant differences at pretest to posttest (p = .033, effect size = .46), posttest to delayed posttest (p = .029, effect size = .47), and pretest to delayed posttest (p = .005, effect size = .64).
- Engineering technology education (ETE) teachers showed no significant differences across pretest, posttest, and delayed posttest measures; the control group also showed no significant differences.
Methods
- The study used a quasi-experimental nonequivalent control group design with a delayed-treatment approach over 3 years and three cohorts of teachers.
- Participants were high school science and engineering technology education teachers in the TRAILS NSF ITEST project; the text reports 69 total teachers in Table 2, with 30 experimental and 18 control teachers in the survey results table, and notes some attrition and returning teachers.
- Teacher self-efficacy was measured with the T-STEM Survey using pretest, posttest, and delayed posttest data; analyses used Wilcoxon signed-rank tests within groups and Wilcoxon rank-sum tests between groups because the data were ordinal, small-sample, and nonnormal.
Limitations
- The authors state the sample was limited to teachers who applied and were selected for TRAILS in a rural region of a Midwestern state, so it was not a random sample.
- They note the study was constrained by funding, limiting the experimental group to a maximum of 15 participants each year; this likely reduced statistical power.
- Evident from the text: the design included self-selecting control participants and some missing responses/attrition (“one teacher in the control group and seven teachers in the experimental group” did not complete responses; five experimental teachers dropped out), which may affect generalizability and completeness of the data.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
5 Valid · 4 Not valid · 23 Not checked · 53 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Often, the development of STEM instruction is not informed by research that has focused on integrated STEM teacher professional development approaches (Honey et al., 2014; Nadelson et al., 2012).”
What the sources say
- Not checked — no full text of the sourcecites Honey et al., 2014
- Partly supportedcites Nadelson et al., 2012Experimental — accuracy not yet measured
Our copy supports the underlying scarcity of empirical work on integrated STEM teacher professional development: the Abstract states 'there is no study we are aware of in which these variables have been attended to and assessed in the context of enhancing inservice teacher preparation to teach STEM', the Introduction frames 'the gathering of empirical data to establish its effectiveness' as the impetus for the i-STEM institute, and the Review of Literature concludes 'more research in this area is needed'. However, no passage states the claim's actual assertion — that the development of STEM instruction is (often) not informed by such integrated-STEM-PD research; the paper's gap concerns the absence of assessment of affective/cognitive variables in inservice STEM preparation, not how STEM instruction is developed. The frequency claim ('often') and the link to instructional development are therefore not attributable to this source. (LLM, conf=0.70)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
Every source the paper cites for this claim was checked and supports it.
In the paper
“Research indicates that teachers with limited knowledge in a subject outside of their area of expertise struggle to have confidence in teaching those subjects (Stohlmann et al., 2012).”
What the sources say
- Supportedcites Stohlmann et al., 2012 source
In “Teachers’ Comfort Level,” the paper reports that teachers from different subject backgrounds felt more comfortable with some parts of the curriculum than others. “Teaching” adds that uncertainty about their knowledge made teachers less comfortable and confident. Page numbers were not supplied. (LLM, conf=0.90)
hedgedstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“These presentations led to discussions helping teachers create authentic contexts for learning STEM content and practices (Brown et al., 1989; Bruner, 1996; Lave & Wenger, 1991).”
What the sources say
- Supportedcites Brown et al., 1989 source
The Cognitive Apprenticeship section describes teaching through authentic activity and social interaction, using mathematics classrooms as examples. Learning and Enculturation argues that students learn a subject by engaging with practitioners’ authentic problems and ways of thinking. The presentations and ensuing discussions are the citing authors’ own account, not an event attributed to Brown et al.; the paper supports the educational rationale for creating authentic learning contexts. (LLM, conf=0.86)
- Not checked — no full text of the sourcecites Bruner, 1996 source
- Not checked — no full text of the sourcecites Lave & Wenger, 1991 source
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Additionally, significant differences between groups (science experimental vs science control group teachers) using the Wilcoxon rank-sum test were detected from pretest to posttest ( p = .033, effect size = .46), posttest to delayed posttest ( p = .029, effect size = .47), and pretest to delayed posttest ( p = .005, effect size = .64).”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Science teachers showed a significant increase in teacher self-efficacy comparing the pretest and delayed posttest scores after TRAILS professional development and STEM lesson implementation ( p = . 001, effect size = .95).”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
29 more claims
Create a free account to see all 85 claims and to verify the 2 references still open.
- Probably not a substantial claim. 30
- It may state two separate claims as one. 26
- Borderline: one of the tests for a substantial claim is unclear. 1
- The quote only partly states this claim. 3
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“While much of the existing literature has focused on self-efficacy at the secondary and higher education levels, a significant gap remains in understanding these dynamics within primary education.”
From Fostering students’ motivation and self-efficacy in science, technology, engineering, and design through design thinking and making in project-based learning: a gender-perspective study in primary education (2025) · cites this paper as Kelley et al., 2020
Experimental — accuracy not yet measured
Citations
Cites
Self-efficacy: The exercise of control
Bandura, A., Freeman, W. H., & Lightsey, R. (1999) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.13.2.158 · Cited by 46,835
Situated Learning: Legitimate Peripheral Participation.
Bloch, M., Lave, J., & Wenger, E. (1994) · Man · doi:10.2307/2804509 · Cited by 39,454
Research Design: Qualitative, Quantitative, and Mixed Methods Approaches
Creswell, J. W. (1994) · Cited by 35,473
Situated Learning: Legitimate Peripheral Participation
Lave, J., & Wenger, E. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815355 · Cited by 35,324
Self-efficacy: the exercise of control
(1997) · Choice Reviews Online · doi:10.5860/choice.35-1826 · Cited by 24,281
Research methods for business: A skill building approach
(1993) · Long Range Planning · doi:10.1016/0024-6301(93)90168-f · Cited by 16,985 · cited 1×
“Since this data is self-reported by participants, some bias may exist (Sekaran & Bougie, 2009).”
Making sense of cronbach’s alpha.
Tavakol, M., & Dennick, R. (2011) · International Journal of Medical Education · doi:10.5116/ijme.4dfb.8dfd · Cited by 15,126 · cited 1×
“For all survey items, developers calculated Cronbach’s alpha at 0.95 (Friday Institute for Educational Innovation, T-STEM Survey, 2012b), indicating good internal reliability (Caliendo, 2015; Tavakol & Dennick, 2011).”
MethodInfluentialResearch Design: Qualitative, Quantitative, and Mixed Methods Approaches
Sloane-Seale, A. (2009) · Canadian Journal of University Continuing Education · doi:10.21225/d54s3d · Cited by 14,328
Situated Cognition and the Culture of Learning
Brown, J. S., Collins, A., & Duguid, P. (1989) · Educational Researcher · doi:10.3102/0013189x018001032 · Cited by 13,645
(2002) · Cited by 13,211
Research works printed but not linked: 8
- Caliendo, J. (2015). Pre-service elementary teachers: scientific reasoning and attitudes toward STEM subjects (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3706494).
- Kelley, T. (2014a). Constructing an engineer’s notebook rubric. The Technology and Engineering Teacher, 73(5), 26–32.
- Knowles, J. G., Kelley, T., & Hurd, B. (2016). Innovate the intersection between entomology and technology. The Technology and Engineering Teacher, 76(1), 1–7.
- Meek, G., Ozgur, C., & Dunning, K. (2007). Does scale of measurement really make a difference in test selection? An empirical control of t test vs. Mann Whitney (pp. 951–953). Proceedings of the 2000 National Annual Meeting of the Decision Sciences Institute.
- National Research Council [NRC]. (2011). Successful K-12 STEM education: identifying effective approaches in science, technology, engineering, and mathematics. Washington, DC: National Academies Press.
- National Research Council [NRC]. (2012). A framework for K12 science education: practices, cross cutting concepts, and core ideas. Washington: National Academies Press.
- President’s Council of Advisors on Science and Technology (PCAST). (2010). Prepare and inspire: K–12 education in science, technology, engineering, and math (STEM) for America’s future. Washington, DC: Author.
- Rittmayer, A., & Beier, M. (2008). Overview: self-efficacy in STEM. Houston: SWE-AWE-CASEE ARP Resources, Rice University Retrieved from: http://www.AWEonline.org.
Cited by
Han, J., Kelley, T., & Knowles, J. G. (2021) · Journal for STEM Education Research · doi:10.1007/s41979-021-00053-3 · Cited by 192
“The survey scores of teachers increased after the summer PD (Kelley et al., 2020), and with the increased teaching efficacy and expectancy beliefs, they taught students during the following school year.”
BackgroundInfluentialSelf-citationLi, T., Ji, Y., & Zhan, Z. (2024) · Asia Pacific Journal of Education · doi:10.1080/02188791.2024.2305163 · Cited by 133
“To overcome these barriers, the cross-boundary integration of multiple resources for STEM teacher education is emerging as a promising solution (Kelley et al., 2020; B. Kim & Bastani, 2017).”
BackgroundZhou, X., Shu, L., Xu, Z., & Padrón, Y. N. (2023) · International Journal of STEM Education · doi:10.1186/s40594-023-00422-x · Cited by 248
“A set of empirical studies support that providing STEM teachers with high-quality and ongoing professional development (PD) training is critical in improving STEM-TSE (Gardner et al., 2019; Kelley et al., 2020; Parker et al., 2020).”
BackgroundResultInfluentialNGSS-based teacher professional development to implement engineering practices in STEM instruction
Christian, K. B., Kelly, A. M., & Bugallo, M. F. (2021) · International Journal of STEM Education · doi:10.1186/s40594-021-00284-1 · Cited by 132
“As earlier research has shown, increased self-efficacy often leads to successful STEM integration in the classroom (Kelley et al. 2020).”
BackgroundYang, Y.-F., Tseng, C. C., & Lai, S.-C. (2024) · Teaching and Teacher Education · doi:10.1016/j.tate.2024.104582 · Cited by 91
Metadata
- Authors
- Kelley, T. R., Knowles, J. G., Holland, J. D., & Han, J.
- Affiliations
- Purdue University West Lafayette (US)
- Corresponding author
- Kelley, Todd R.
- Venue
- International Journal of STEM Education
- Published
- 2020-04-16
- Volume
- 7
- Issue
- 1
- ISSN
- 2196-7822 (ISSN-L)
- OpenAlex
- W3031244974
- Cited by
- 238
- References
- 85
- Citations by year
- 2026: 21 · 2025: 45 · 2024: 74 · 2023: 27 · 2022: 41 · 2021: 25 · 2020: 2
- FWCI
- 42.75
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Locations
- International Journal of STEM Education (publishedVersion, cc-by)
- Purdue e-Pubs (Purdue University System) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- National Science Foundation (# DRL – 1513248)
- Topics
- Life Sciences › Agricultural and Biological Sciences › General Agricultural and Biological Sciences › Diverse Educational Innovations Studies
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Education › Innovative Teaching Methods
- Keywords
- teacher self-efficacy, teacher professional development, communities of practice, high school science teachers, engineering design, biomimetics, 3D printing, STEM curriculum development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (qwen3.8-omni-flash and gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Increasing high school teachers self-efficacy for integrated STEM instruction through a collaborative community of practice. https://app.cochat.ai/papers/10.1186/s40594-020-00211-w
- The paper
- Kelley, T. R., Knowles, J. G., Holland, J. D., & Han, J. (2020). Increasing high school teachers self-efficacy for integrated STEM instruction through a collaborative community of practice. International Journal of STEM Education. https://doi.org/10.1186/s40594-020-00211-w
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.