The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Correlations between modes of student cognitive engagement and instructional practices in undergraduate STEM courses
Abstract
Background: Within STEM education, research on instructional practices has focused on ways to increase student engagement and thereby reap the associated benefits of increased learning, persistence, and academic success. These meaningful-learning goals have been tied most specifically to cognitive engagement, a construct that is often difficult for instructors to assess on their own. While it has been shown that certain instructional practices are tied to higher cognitive engagement in students, tools to measure instructional practices and student engagement have remained largely isolated in their development and use. Results: This research uses previously developed instruments to simultaneously assess modes of cognitive engagement in students (Student Course Cognitive Engagement Instrument [SCCEI]) and instructional practices (Postsecondary Instructional Practices Survey [PIPS]) within a course. A sample of 19 STEM courses was recruited to participate in this study, with instructors and students each self-reporting data. Results from the instructor and students in each course were scored, and ANOVA and partial correlation analysis were conducted on the sample. ANOVA indicated the significance of and classroom structure on student engagement. From the correlation analysis, a significant relationship was found between four student-reported modes of cognitive engagement and instructor-reported teaching practices. Conclusions: With an understanding of student engagement response to classroom structure, instructors may consider their teaching environment when implementing instructional practices. Moreover, Interactivity with Peers, the deepest mode of cognitive engagement suggested by previous research, was correlated with instructional practices in our study, suggesting that instructors may be able to shape their students’ learning by encouraging collaboration in the classroom. We also found that assessment played a role in students’ cognitive engagement; this indicates that instructors may wish to thoughtfully consider their methods of assessment to facilitate modes of cognitive engagement associated with deeper learning of course material. By understanding factor correlations, the PIPS and SCCEI can be used in tandem to understand impacts of instructional practices on student cognitive engagement within a course. We conclude that there is a need for ongoing research to study the interplay of instructional practices and student cognitive engagement as instruments are developed to measure such phenomena.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Engagement is crucial for enhancing students' learning experiences and is influenced by instructional approaches (Barlow & Brown, 2020).”
From Context-based problem-posing and solving instructional approach and students’ engagement in learning data handling (2024) · cites this paper as Barlow & Brown, 2020
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
An analysis of variance test for normality (complete samples)
SHAPIRO, S. S., & WILK, M. B. (1965) · Biometrika · doi:10.1093/biomet/52.3-4.591 · Cited by 23,480
School Engagement: Potential of the Concept, State of the Evidence
Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004) · Review of Educational Research · doi:10.3102/00346543074001059 · Cited by 12,581 · cited 3×
“Emotional engagement is defined by a student’s affective or emotional responses to an academic subject or course (Fredricks et al., 2004).”
BackgroundActive learning increases student performance in science, engineering, and mathematics
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1319030111 · Cited by 9,787
Does Active Learning Work? A Review of the Research
Prince, M. (2004) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2004.tb00809.x · Cited by 7,334 · cited 4×
“It has been shown that instructional practices often play a central role; the structure of exams, lectures, and student interactions have all been shown to influence the engagement of students (Nicol & Macfarlane-Dick, 2006; Prince, 2004; Wang, Yang, Wen, Koedinger, & Rosé, 2015).”
BackgroundInfluentialNicol, D. J., & Macfarlane‐Dick, D. (2006) · Studies in Higher Education · doi:10.1080/03075070600572090 · Cited by 5,846
Pekrun, R. (2006) · Educational Psychology Review · doi:10.1007/s10648-006-9029-9 · Cited by 5,566 · cited 1×
“Like behavioral engagement, some of these positive or negative emotional engagement choices are external (Pekrun, 2006) and can be observed as happiness, sadness, interest, or boredom (Fredricks et al., 2004).”
BackgroundMeasuring cognitive and psychological engagement: Validation of the Student Engagement Instrument
Appleton, J. J., Christenson, S. L., Kim, D., & Reschly, A. L. (2006) · Journal of School Psychology · doi:10.1016/j.jsp.2006.04.002 · Cited by 1,858
Anatomy of STEM teaching in North American universities
Stains, M., Harshman, J., Barker, M. K., Chasteen, S. V., Cole, R., DeChenne-Peters, S. E., Eagan, M. K., Esson, J. M., Knight, J. K., Laski, F. A., et al. (2018) · Science · doi:10.1126/science.aap8892 · Cited by 772
Research works printed but not linked: 34
- Barlow, A. J., Lutz, B. D., Pitterson, N. P., Hunsu, N., Adesope, O., & Brown, S. A. (n.d.). Development of the Student Course Cognitive Engagement Instrument (SCCEI). In press.
- Bathgate, M. E., Aragón, O. R., Cavanagh, A. J., Waterhouse, J. K., Frederick, J., & Graham, M. J. (2019). Perceived supports and evidence-based teaching in college STEM. International Journal of STEM Education, 6(1). https://doi.org/https://doi.org/10.1186/s40594-019-0166-3 · DOI
- Berg, B. L., & Lune, H. (2014). Qualitative research methods for the social sciences. In Qualitative Research (Vol. 8th). https://doi.org/https://doi.org/10.2307/1317652 · DOI · Paper page
- Chi, M. T. H. (2009). Active-Constructive-Interactive: A conceptual framework for differentiating learning activities. Topics in Cognitive Science, 1(1), 73–105. https://doi.org/https://doi.org/10.1111/j.1756-8765.2008.01005.x · DOI · Paper page
- Chi, M. T. H., & Wylie, R. (2014). The ICAP framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243. https://doi.org/https://doi.org/10.1080/00461520.2014.965823 · DOI · Paper page
- Cohen, J., Cohen, P., West, S., & Aiken, L. (2003). Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (Third). New York, NY: Routledge.
- Dancy, M. H., & Henderson, C. (2008). Barriers and promises in STEM reform. National Academies of Science Promising Practices Workshop.
- Dard, D. B., Lison, C., Dalle, D., & Boutin, N. L. (2010). Predictors of student’s engagement and persistence in an innovative PBL curriculum: Applications for engineering education. International Journal of Engineering Education, 26(3), 1–12. Retrieved from https://s3.amazonaws.com/academia.edu.documents/31938733/Ijee2307.pdf?AWSAccessKeyId=AKIAIWOWYYGZ2Y53UL3A&Expires=1522253621&Signature=CFx1Aykm%2F3%2F%2BDI51eZb5N7FRdSA%3D&response-content-disposition=inline%3B filename%3DPredictors_of_Student_s_Engagemen
- Edgell, S. E., & Noon, S. M. (1984). Effect of violation of normality on the t test of the correlation coefficient. Psychological Bulletin, 95(3), 576–583. https://doi.org/https://doi.org/10.1037/0033-2909.95.3.576 · doi:10.1037/0033-2909.95.3.576 · Paper page
- Felder, R. M., & Brent, R. (2005). Understanding student differences. Journal of Engineering Education, (January), 57. Retrieved from e:%5C02_11_2016 · DOI · Paper page
- Foote, K. T., Neumeyer, X., Henderson, C., Dancy, M. H., & Beichner, R. J. (2014). Diffusion of research-based instructional strategies: The case of SCALE-UP. International Journal of STEM Education, 1(1), 1–18. https://doi.org/https://doi.org/10.1186/s40594-014-0010-8 · DOI
- Heller, R. S., Beil, C., Dam, K., & Haerum, B. (2007). Student and faculty perceptions of engagement in engineering. Journal of Engineering Education, 253–262.
- Heller, R. S., Beil, C., Dam, K., & Haerum, B. (2010). Student and faculty perceptions of engagement in engineering. Journal of Engineering Education, 99(3), 253–261. https://doi.org/https://doi.org/10.1002/j.2168-9830.2010.tb01060.x · DOI
- Henderson, C., & Dancy, M. H. (2007). Barriers to the use of research-based instructional strategies: the influence of both individual and situational characteristics. Physical Review Special Topics - Physics Education Research, 3(2), 020102. https://doi.org/https://doi.org/10.1103/PhysRevSTPER.3.020102 · DOI · Paper page
- Hutchinson, J. R., & Huberman, M. (1994). Knowledge and dissemination and use in science and mathematics education: A literature review. Journal of Science Education and Technology, 3(1). · DOI
- Knaub, A. V., Foote, K. T., Henderson, C., Dancy, M., & Beichner, R. J. (2016). Get a room: the role of classroom space in sustained implementation of studio style instruction. International Journal of STEM Education, 3(1). https://doi.org/https://doi.org/10.1186/s40594-016-0042-3 · DOI
- Kowalski, C. J. (1972). On the effects of non-normality on the distribution of the sample product-moment correlation coefficient. Journal of the Royal Statistical Society, Series C (Applied Statistics), 21(1), 1–12.
- Kulasegaram, K., & Rangachari, P. K. (2018). Beyond “formative”: Assessments to enrich student learning. Advances in Physiology Education, 42(1), 5–14. https://doi.org/https://doi.org/10.1152/advan.00122.2017 · DOI
- Lindley, D. V. (1990). Regression and correlation analysis. In Time Series and Statistics (pp. 237–243). https://doi.org/https://doi.org/10.1007/978-1-349-20865-4_30 · DOI
- Lucas, P., & Ramsden, P. (1992). Learning to teach in higher education. British Journal of Educational Studies. https://doi.org/https://doi.org/10.2307/3120902 · DOI · Paper page
- Lund, T. J., Pilarz, M., Velasco, J. B., Chakraverty, D., Rosploch, K., Undersander, M., & Stains, M. (2015). The best of both worlds: Building on the COPUS and RTOP observation protocols to easily and reliably measure various levels of reformed instructional practice. CBE Life Sciences Education, 14(2), 1–12. https://doi.org/https://doi.org/10.1187/cbe.14-10-0168 · DOI
- Meece, J. L., Blumenfeld, P. C., & Hoyle, R. H. (1988). Students’ goal orientations and cognitive engagement in classroom activities. Journal of Educational Psychology, 80(4), 514–523. Retrieved from http://psycnet.apa.org.ezproxy.proxy.library.oregonstate.edu/fulltext/1989-17194-001.pdf · doi:10.1037/0022-0663.80.4.514 · Paper page
- Nefzger, M. D., & Drasgow, J. (1957). The needless assumption of normality in Pearson’s r. American Psychologist, 12(10), 623–625. https://doi.org/https://doi.org/10.1037/h0048216 · DOI
- Nokes-Malach, T. J., Richey, E., & Gadgil, S. (2015). When is it better to learn together? Insights from research on collaborative learning. Educ Psychol Rev, 27. https://doi.org/https://doi.org/10.1007/s10648-015-9312-8 · DOI · Paper page
- Ohland, M. W. (Purdue U., Sheppard, S. D. (Stanford U., Lichtenstein, G. (Stanford U., Eris, O. (Franklin W. O. C. of E., Chachra, D. (Franklin W. O. C. of E., & Layton, R. (Rose-H. I. of T. (2008). Persistence, engagement, and migration in engineering programs. Journal of Engineering Education, (December), 260–278. https://doi.org/https://doi.org/10.1002/j.2168-9830.2008.tb00978.x · DOI · Paper page
- Qualtrics. (2005). Qualtrics. Utah: Provo.
- Ramsey, F., & Schafer, D. (2002). The Statistical Sleuth. Pacific Grove, CA: DUXBURY.
- Razali, N. M., & Wah, Y. B. (2011). Power comparisons of Shapiro-Wilk, Kolmogorov-Smirnov, Lilliefors and Anderson-Darling tests. Journal of Statistical Modeling and Analytics, 2(1), 21–33. https://doi.org/doi:https://doi.org/10.1515/bile-2015-0008 · DOI · Paper page
- Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015). The challenges of defining and measuring student engagement in science. Educational Psychologist, 50(1), 1–13. https://doi.org/https://doi.org/10.1080/00461520.2014.1002924 · DOI · Paper page
- Smith, K. A., Sheppard, S. D., Johnson, D. W., & Johnson, R. T. (2005). Pedagogies of engagement: Classroom-based practices. Journal of Engineering Education, 94(1), 87–101. https://doi.org/https://doi.org/10.1002/j.2168-9830.2005.tb00831.x · DOI · Paper page
- Stump, G., Hilpert, J., Husman, J., Chung, W.-T., & Kim, W. (2011). Collaborative learning in engineering students: Gender and achievement. Journal of Engineering Education, 100(3), 475–497. · DOI · Paper page
- Walter, E. M., Henderson, C. R., Beach, A. L., & Williams, C. T. (2016). Introducing the Postsecondary Instructional Practices Survey (PIPS): A concise, interdisciplinary, and easy-to-score survey. CBE--Life Sciences Education, Winter 201(15: ar53). https://doi.org/https://doi.org/10.1187/cbe.15-09-0193 · DOI
- Wang, X., Yang, D., Wen, M., Koedinger, K., & Rosé, C. P. (2015). Investigating how student’s cognitive behavior in MOOC discussion forums affect learning gains. International Conference on Educational Data Mining. Retrieved from https://files.eric.ed.gov/fulltext/ED560568.pdf
- Williams, C. T., Walter, E. M., Henderson, C., & Beach, A. L. (2015). Describing undergraduate STEM teaching practices: a comparison of instructor self-report instruments. International Journal of STEM Education, 2(1), 18. https://doi.org/10.1186/s40594-015-0031-y · DOI
Cited by
Tesfaw, B. K., Ayele, M. A., & Wondimuneh, T. E. (2024) · Cogent Education · doi:10.1080/2331186x.2024.2389486 · Cited by 24
Metadata
- Authors
- Barlow, A., & Brown, S.
- Venue
- International Journal of STEM Education
- Published
- 2020-04-24
- Volume
- 7
- Issue
- 1
- ISSN
- 2196-7822
- Cited by
- 43
- References
- 8
- Language
- en
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
- Funders
- National Science Foundation (1544182, 1544103)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Correlations between modes of student cognitive engagement and instructional practices in undergraduate STEM courses. https://app.cochat.ai/papers/10.1186/s40594-020-00214-7
- The paper
- Barlow, A., & Brown, S. (2020). Correlations between modes of student cognitive engagement and instructional practices in undergraduate STEM courses. International Journal of STEM Education. https://doi.org/10.1186/s40594-020-00214-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.