Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 43

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Correlations between modes of student cognitive engagement and instructional practices in undergraduate STEM courses

Barlow, Allyson, Brown, Shane · 2020 · International Journal of STEM Education

Abstract

Background: Within STEM education, research on instructional practices has focused on ways to increase student engagement and thereby reap the associated benefits of increased learning, persistence, and academic success. These meaningful-learning goals have been tied most specifically to cognitive engagement, a construct that is often difficult for instructors to assess on their own. While it has been shown that certain instructional practices are tied to higher cognitive engagement in students, tools to measure instructional practices and student engagement have remained largely isolated in their development and use. Results: This research uses previously developed instruments to simultaneously assess modes of cognitive engagement in students (Student Course Cognitive Engagement Instrument [SCCEI]) and instructional practices (Postsecondary Instructional Practices Survey [PIPS]) within a course. A sample of 19 STEM courses was recruited to participate in this study, with instructors and students each self-reporting data. Results from the instructor and students in each course were scored, and ANOVA and partial correlation analysis were conducted on the sample. ANOVA indicated the significance of and classroom structure on student engagement. From the correlation analysis, a significant relationship was found between four student-reported modes of cognitive engagement and instructor-reported teaching practices. Conclusions: With an understanding of student engagement response to classroom structure, instructors may consider their teaching environment when implementing instructional practices. Moreover, Interactivity with Peers, the deepest mode of cognitive engagement suggested by previous research, was correlated with instructional practices in our study, suggesting that instructors may be able to shape their students’ learning by encouraging collaboration in the classroom. We also found that assessment played a role in students’ cognitive engagement; this indicates that instructors may wish to thoughtfully consider their methods of assessment to facilitate modes of cognitive engagement associated with deeper learning of course material. By understanding factor correlations, the PIPS and SCCEI can be used in tandem to understand impacts of instructional practices on student cognitive engagement within a course. We conclude that there is a need for ongoing research to study the interplay of instructional practices and student cognitive engagement as instruments are developed to measure such phenomena.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s40594-020-00214-7

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Research works printed but not linked: 34

  1. Barlow, A. J., Lutz, B. D., Pitterson, N. P., Hunsu, N., Adesope, O., & Brown, S. A. (n.d.). Development of the Student Course Cognitive Engagement Instrument (SCCEI). In press.
  2. Bathgate, M. E., Aragón, O. R., Cavanagh, A. J., Waterhouse, J. K., Frederick, J., & Graham, M. J. (2019). Perceived supports and evidence-based teaching in college STEM. International Journal of STEM Education, 6(1). https://doi.org/https://doi.org/10.1186/s40594-019-0166-3 · DOI
  3. Berg, B. L., & Lune, H. (2014). Qualitative research methods for the social sciences. In Qualitative Research (Vol. 8th). https://doi.org/https://doi.org/10.2307/1317652 · DOI · Paper page
  4. Chi, M. T. H. (2009). Active-Constructive-Interactive: A conceptual framework for differentiating learning activities. Topics in Cognitive Science, 1(1), 73–105. https://doi.org/https://doi.org/10.1111/j.1756-8765.2008.01005.x · DOI · Paper page
  5. Chi, M. T. H., & Wylie, R. (2014). The ICAP framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243. https://doi.org/https://doi.org/10.1080/00461520.2014.965823 · DOI · Paper page
  6. Cohen, J., Cohen, P., West, S., & Aiken, L. (2003). Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences (Third). New York, NY: Routledge.
  7. Dancy, M. H., & Henderson, C. (2008). Barriers and promises in STEM reform. National Academies of Science Promising Practices Workshop.
  8. Dard, D. B., Lison, C., Dalle, D., & Boutin, N. L. (2010). Predictors of student’s engagement and persistence in an innovative PBL curriculum: Applications for engineering education. International Journal of Engineering Education, 26(3), 1–12. Retrieved from https://s3.amazonaws.com/academia.edu.documents/31938733/Ijee2307.pdf?AWSAccessKeyId=AKIAIWOWYYGZ2Y53UL3A&Expires=1522253621&Signature=CFx1Aykm%2F3%2F%2BDI51eZb5N7FRdSA%3D&response-content-disposition=inline%3B filename%3DPredictors_of_Student_s_Engagemen
  9. Edgell, S. E., & Noon, S. M. (1984). Effect of violation of normality on the t test of the correlation coefficient. Psychological Bulletin, 95(3), 576–583. https://doi.org/https://doi.org/10.1037/0033-2909.95.3.576 · doi:10.1037/0033-2909.95.3.576 · Paper page
  10. Felder, R. M., & Brent, R. (2005). Understanding student differences. Journal of Engineering Education, (January), 57. Retrieved from e:%5C02_11_2016 · DOI · Paper page
  11. Foote, K. T., Neumeyer, X., Henderson, C., Dancy, M. H., & Beichner, R. J. (2014). Diffusion of research-based instructional strategies: The case of SCALE-UP. International Journal of STEM Education, 1(1), 1–18. https://doi.org/https://doi.org/10.1186/s40594-014-0010-8 · DOI
  12. Heller, R. S., Beil, C., Dam, K., & Haerum, B. (2007). Student and faculty perceptions of engagement in engineering. Journal of Engineering Education, 253–262.
  13. Heller, R. S., Beil, C., Dam, K., & Haerum, B. (2010). Student and faculty perceptions of engagement in engineering. Journal of Engineering Education, 99(3), 253–261. https://doi.org/https://doi.org/10.1002/j.2168-9830.2010.tb01060.x · DOI
  14. Henderson, C., & Dancy, M. H. (2007). Barriers to the use of research-based instructional strategies: the influence of both individual and situational characteristics. Physical Review Special Topics - Physics Education Research, 3(2), 020102. https://doi.org/https://doi.org/10.1103/PhysRevSTPER.3.020102 · DOI · Paper page
  15. Hutchinson, J. R., & Huberman, M. (1994). Knowledge and dissemination and use in science and mathematics education: A literature review. Journal of Science Education and Technology, 3(1). · DOI
  16. Knaub, A. V., Foote, K. T., Henderson, C., Dancy, M., & Beichner, R. J. (2016). Get a room: the role of classroom space in sustained implementation of studio style instruction. International Journal of STEM Education, 3(1). https://doi.org/https://doi.org/10.1186/s40594-016-0042-3 · DOI
  17. Kowalski, C. J. (1972). On the effects of non-normality on the distribution of the sample product-moment correlation coefficient. Journal of the Royal Statistical Society, Series C (Applied Statistics), 21(1), 1–12.
  18. Kulasegaram, K., & Rangachari, P. K. (2018). Beyond “formative”: Assessments to enrich student learning. Advances in Physiology Education, 42(1), 5–14. https://doi.org/https://doi.org/10.1152/advan.00122.2017 · DOI
  19. Lindley, D. V. (1990). Regression and correlation analysis. In Time Series and Statistics (pp. 237–243). https://doi.org/https://doi.org/10.1007/978-1-349-20865-4_30 · DOI
  20. Lucas, P., & Ramsden, P. (1992). Learning to teach in higher education. British Journal of Educational Studies. https://doi.org/https://doi.org/10.2307/3120902 · DOI · Paper page
  21. Lund, T. J., Pilarz, M., Velasco, J. B., Chakraverty, D., Rosploch, K., Undersander, M., & Stains, M. (2015). The best of both worlds: Building on the COPUS and RTOP observation protocols to easily and reliably measure various levels of reformed instructional practice. CBE Life Sciences Education, 14(2), 1–12. https://doi.org/https://doi.org/10.1187/cbe.14-10-0168 · DOI
  22. Meece, J. L., Blumenfeld, P. C., & Hoyle, R. H. (1988). Students’ goal orientations and cognitive engagement in classroom activities. Journal of Educational Psychology, 80(4), 514–523. Retrieved from http://psycnet.apa.org.ezproxy.proxy.library.oregonstate.edu/fulltext/1989-17194-001.pdf · doi:10.1037/0022-0663.80.4.514 · Paper page
  23. Nefzger, M. D., & Drasgow, J. (1957). The needless assumption of normality in Pearson’s r. American Psychologist, 12(10), 623–625. https://doi.org/https://doi.org/10.1037/h0048216 · DOI
  24. Nokes-Malach, T. J., Richey, E., & Gadgil, S. (2015). When is it better to learn together? Insights from research on collaborative learning. Educ Psychol Rev, 27. https://doi.org/https://doi.org/10.1007/s10648-015-9312-8 · DOI · Paper page
  25. Ohland, M. W. (Purdue U., Sheppard, S. D. (Stanford U., Lichtenstein, G. (Stanford U., Eris, O. (Franklin W. O. C. of E., Chachra, D. (Franklin W. O. C. of E., & Layton, R. (Rose-H. I. of T. (2008). Persistence, engagement, and migration in engineering programs. Journal of Engineering Education, (December), 260–278. https://doi.org/https://doi.org/10.1002/j.2168-9830.2008.tb00978.x · DOI · Paper page
  26. Qualtrics. (2005). Qualtrics. Utah: Provo.
  27. Ramsey, F., & Schafer, D. (2002). The Statistical Sleuth. Pacific Grove, CA: DUXBURY.
  28. Razali, N. M., & Wah, Y. B. (2011). Power comparisons of Shapiro-Wilk, Kolmogorov-Smirnov, Lilliefors and Anderson-Darling tests. Journal of Statistical Modeling and Analytics, 2(1), 21–33. https://doi.org/doi:https://doi.org/10.1515/bile-2015-0008 · DOI · Paper page
  29. Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015). The challenges of defining and measuring student engagement in science. Educational Psychologist, 50(1), 1–13. https://doi.org/https://doi.org/10.1080/00461520.2014.1002924 · DOI · Paper page
  30. Smith, K. A., Sheppard, S. D., Johnson, D. W., & Johnson, R. T. (2005). Pedagogies of engagement: Classroom-based practices. Journal of Engineering Education, 94(1), 87–101. https://doi.org/https://doi.org/10.1002/j.2168-9830.2005.tb00831.x · DOI · Paper page
  31. Stump, G., Hilpert, J., Husman, J., Chung, W.-T., & Kim, W. (2011). Collaborative learning in engineering students: Gender and achievement. Journal of Engineering Education, 100(3), 475–497. · DOI · Paper page
  32. Walter, E. M., Henderson, C. R., Beach, A. L., & Williams, C. T. (2016). Introducing the Postsecondary Instructional Practices Survey (PIPS): A concise, interdisciplinary, and easy-to-score survey. CBE--Life Sciences Education, Winter 201(15: ar53). https://doi.org/https://doi.org/10.1187/cbe.15-09-0193 · DOI
  33. Wang, X., Yang, D., Wen, M., Koedinger, K., & Rosé, C. P. (2015). Investigating how student’s cognitive behavior in MOOC discussion forums affect learning gains. International Conference on Educational Data Mining. Retrieved from https://files.eric.ed.gov/fulltext/ED560568.pdf
  34. Williams, C. T., Walter, E. M., Henderson, C., & Beach, A. L. (2015). Describing undergraduate STEM teaching practices: a comparison of instructor self-report instruments. International Journal of STEM Education, 2(1), 18. https://doi.org/10.1186/s40594-015-0031-y · DOI

Metadata

Authors
Barlow, A., & Brown, S.
Venue
International Journal of STEM Education
Published
2020-04-24
Volume
7
Issue
1
ISSN
2196-7822
Cited by
43
References
8
Language
en
Licence
Funders
National Science Foundation (1544182, 1544103)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Correlations between modes of student cognitive engagement and instructional practices in undergraduate STEM courses. https://app.cochat.ai/papers/10.1186/s40594-020-00214-7
The paper
Barlow, A., & Brown, S. (2020). Correlations between modes of student cognitive engagement and instructional practices in undergraduate STEM courses. International Journal of STEM Education. https://doi.org/10.1186/s40594-020-00214-7

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.