Fidelity of Implementation of Research‐Based Instructional Strategies (RBIS) in Engineering Science Courses
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Background: Increasing attention is being paid to improvement in undergraduate science, technology, engineering, and mathematics (STEM) education through increased adoption of research‐based instructional strategies (RBIS), but high‐quality measures of faculty instructional practice do not exist to monitor progress. Purpose/Hypothesis: The measure of how well an implemented intervention follows the original is called fidelity of implementation. This theory was used to address the research questions: What is the fidelity of implementation of selected RBIS in engineering science courses? That is, how closely does engineering science classroom practice reflect the intentions of the original developers? Do the critical components that characterize an RBIS discriminate between engineering science faculty members who claimed use of the RBIS and those who did not? Design/Method: A survey of 387 U.S. faculty teaching engineering science courses (e.g., statics, circuits, thermodynamics) included questions about class time spent on 16 critical components and use of 11 corresponding RBIS. Fidelity was quantified as the percentage of RBIS users who also spent time on corresponding critical components. Discrimination between users and nonusers was tested using chi square. Results: Overall fidelity of the 11 RBIS ranged from 11% to 80% of users spending time on all required components. Fidelity was highest for RBIS with one required component: case‐based teaching, just‐in‐time teaching, and inquiry learning. Thirteen of 16 critical components discriminated between users and nonusers for all RBIS to which they were mapped. Conclusions: Results were consistent with initial mapping of critical components to RBIS. Fidelity of implementation is a potentially useful framework for future work in STEM undergraduate education.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Does Active Learning Work? A Review of the Research
Prince, M. (2004) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2004.tb00809.x · Cited by 7,334
Self-citationHake, R. R. (1998) · American Journal of Physics · doi:10.1119/1.18809 · Cited by 6,072
Peer Instruction: Ten years of experience and results
Crouch, C. H., & Mazur, E. (2001) · American Journal of Physics · doi:10.1119/1.1374249 · Cited by 2,682 · cited 1×
“Crouch and Mazur (2001) examined 10 years of data with physics students at Harvard comparing peer instruction to traditional lectures.”
BackgroundA conceptual framework for implementation fidelity
Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007) · Implementation Science · doi:10.1186/1748-5908-2-40 · Cited by 2,559
Nonresponse rates and nonresponse bias in household surveys
Groves, R. M. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfl033 · Cited by 2,420 · cited 2×
“…database to estimate response bias, a common method of estimating likelihood of response bias influencing results is to compare characteristics of the survey respondents to the general population and, if they are similar, conclude that the effects of response bias are reduced (Groves, 2006).”
MethodSpringer, L., Stanne, M. E., & Donovan, S. S. (1999) · Review of Educational Research · doi:10.3102/00346543069001021 · Cited by 1,943 · cited 1×
“Springer, Stanne, and Donovan (1997, 1999) found similar results from 37 studies of STEM students working in small groups.”
ResultCooperative Learning Returns To College What Evidence Is There That It Works?
Johnson, D. W., Johnson, R. T., & Smith, K. A. (1998) · Change: The Magazine of Higher Learning · doi:10.1080/00091389809602629 · Cited by 1,011
What We Say Is Not What We Do: Effective Evaluation of Faculty Professional Development Programs
Ebert-May, D., Derting, T. L., Hodder, J., Momsen, J. L., Long, T. M., & Jardeleza, S. E. (2011) · BioScience · doi:10.1525/bio.2011.61.7.9 · Cited by 420
Novak, G. M., Patterson, E. T., Gavrin, A. D., Christian, W., & Forinash, K. (1999) · American Journal of Physics · doi:10.1119/1.19159 · Cited by 384
Henderson, C., Dancy, M., & Niewiadomska-Bugaj, M. (2012) · Physical Review Special Topics - Physics Education Research · doi:10.1103/physrevstper.8.020104 · Cited by 322
Self-citation
Cited by
Getting Under the Hood: How and for Whom Does Increasing Course Structure Work?
Eddy, S. L., & Hogan, K. A. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.14-03-0050 · Cited by 553
“…across contexts cannot be assumed, as there is some evidence that the success of classroom interventions depends on the student populations in the classroom (Brownell et al., 2013), instructor classroom management style (Borrego et al., 2013), and the topics being taught (Andrews et al., 2011).”
BackgroundBorrego, M., & Henderson, C. (2014) · Journal of Engineering Education · doi:10.1002/jee.20040 · Cited by 463
Self-citationEddy, S. L., Converse, M., & Wenderoth, M. P. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.14-06-0095 · Cited by 182
“This result is not exclusive to biology, as it has also been seen in engineering (Borrego et al., 2013), physics (Henderson and Dancy, 2009), and extensively at the K–12 level (O’Donnell, 2008).”
BackgroundStains, M., & Vickrey, T. (2017) · CBE—Life Sciences Education · doi:10.1187/cbe.16-03-0113 · Cited by 177
ASPECT: A Survey to Assess Student Perspective of Engagement in an Active-Learning Classroom
Wiggins, B. L., Eddy, S. L., Wener-Fligner, L., Freisem, K., Grunspan, D. Z., Theobald, E. J., Timbrook, J., & Crowe, A. J. (2017) · CBE—Life Sciences Education · doi:10.1187/cbe.16-08-0244 · Cited by 125
Gender and teamwork: an analysis of professors’ perspectives and practices
Beddoes, K., & Panther, G. (2018) · European Journal of Engineering Education · doi:10.1080/03043797.2017.1367759 · Cited by 65
Huang-Saad, A., Stegemann, J., & Shea, L. (2020) · Annals of Biomedical Engineering · doi:10.1007/s10439-019-02427-6 · Cited by 24
Metadata
- Authors
- Borrego, M., Cutler, S., Prince, M., Henderson, C., & Froyd, J. E.
- Venue
- Journal of Engineering Education
- Publisher
- Wiley
- Published
- 2013-07
- Volume
- 102
- Issue
- 3
- Pages
- 394-425
- ISSN
- 1069-4730 (ISSN-L)
- 2168-9830
- OpenAlex
- W2144464951
- Cited by
- 155
- References
- 11
- FWCI
- 52.68
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.