Investigating Instructor Talk in Novel Contexts: Widespread Use, Unexpected Categories, and an Emergent Sampling Strategy
Open accessAbstract
Instructor Talk—noncontent language used by instructors in classrooms—is a recently defined and promising variable for better understanding classroom dynamics. Having previously characterized the Instructor Talk framework within the context of a single course, we present here our results surrounding the applicability of the Instructor Talk framework to noncontent language used by instructors in novel course contexts. We analyzed Instructor Talk in eight additional biology courses in their entirety and in 61 biology courses using an emergent sampling strategy. We observed widespread use of Instructor Talk with variation in the amount and category type used. The vast majority of Instructor Talk could be characterized using the originally published Instructor Talk framework, suggesting the robustness of this framework. Additionally, a new form of Instructor Talk—Negatively Phrased Instructor Talk, language that may discourage students or distract from the learning process—was detected in these novel course contexts. Finally, the emergent sampling strategy described here may allow investigation of Instructor Talk in even larger numbers of courses across institutions and disciplines. Given its widespread use, potential influence on students in learning environments, and ability to be sampled, Instructor Talk may be a key variable to consider in future research on teaching and learning in higher education.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The head-and-heart elements are especially important for underrepresented students, who often struggle with underpreparation due to economic and educational disparities prior to college, as well as social and psychological barriers such as stereotype threat and microaggressions.
“We posit that these head-and-heart elements are especially important for underrepresented students, who often struggle with underpreparation due to economic and educational disparities prior to college (55), as well as social and psychological barriers such as stereotype threat and microaggressions (56, 57).”
From Active learning narrows achievement gaps for underrepresented students in undergraduate science, technology, engineering, and math (2020) · cites this paper as [56]
Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.
Experimental — accuracy not yet measuredThe use of noncontent Instructor Talk can build students' relationships with their instructors as well as students' self-efficacy.
“This use of noncontent Instructor Talk can build students’ relationships with their instructors as well as students’ self-efficacy (Seidel et al., 2015; Harrison et al., 2019).”
From Reading Primary Scientific Literature: Approaches for Teaching Students in the Undergraduate STEM Classroom (2023) · cites this paper as Harrison et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Stereotype threat and the intellectual test performance of African Americans.
Steele, C. M., & Aronson, J. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.5.797 · Cited by 8,181 · see citing works
Reducing the Gender Achievement Gap in College Science: A Classroom Study of Values Affirmation
Miyake, A., Kost-Smith, L. E., Finkelstein, N. D., Pollock, S. J., Cohen, G. L., & Ito, T. A. (2010) · Science · doi:10.1126/science.1195996 · Cited by 746 · see citing works
Getting Under the Hood: How and for Whom Does Increasing Course Structure Work?
Eddy, S. L., & Hogan, K. A. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.14-03-0050 · Cited by 553 · cited 1× · see citing works
“…threat” may be an underappreciated variable influencing classrooms widely, potentially driving achievement gaps that have been identified for some student populations in science, technology, engineering, and mathematics (STEM) courses (Lauer et al., 2013; Madsen et al., 2013; Eddy and Hogan, 2014).”
BackgroundTrujillo, G., & Tanner, K. D. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.13-12-0241 · Cited by 419 · see citing works
Self-citationEddy, S. L., Converse, M., & Wenderoth, M. P. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.14-06-0095 · Cited by 182 · cited 1× · see citing works
“In particular, such Instructor Talk sampling would complement information being collected with currently available classroom observation tools (e.g., Reformed Teaching Observation Protocol, Teaching Dimensions Observation Protocol, Classroom Observation Protocol for Undergraduate STEM, Practical Observation Rubric To…”
BackgroundSeidel, S. B., Reggi, A. L., Schinske, J. N., Burrus, L. W., & Tanner, K. D. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.15-03-0049 · Cited by 134 · see citing works
Self-citationSchinske, J. N., Balke, V. L., Bangera, M. G., Bonney, K. M., Brownell, S. E., Carter, R. S., Curran-Everett, D., Dolan, E. L., Elliott, S. L., Fletcher, L., et al. (2017) · CBE—Life Sciences Education · doi:10.1187/cbe.16-10-0289 · Cited by 86 · cited 1× · see citing works
“Additionally, this sample population was a benefit in terms of moving beyond a single 4-year university classroom and answering the recent call to broaden participation in biology education research to include more community college classrooms (Schinske et al., 2017).”
BackgroundSelf-citation
Flagged first, then by citations
Research works printed but not linked: 25
- Arum R. Roksa J. (2010). Academically adrift: Limited learning on college campuses. Chicago: University of Chicago Press.
- Bair A. N. Steele J. R. (2010). Examining the consequences of exposure to racism for the executive functioning of Black students. Journal of Experimental Social Psychology,, 127– 132.
- Croizet J. C. Claire T. (1998). Extending the concept of stereotype threat to social class: The intellectual underperformance of students from low socioeconomic backgrounds. Personality and Social Psychology Bulletin, (6), 588– 594.
- Estrada M. Eroy-Reveles A. Matsui J. (2018). The influence of affirming kindness and community on broadening participation in STEM career pathways. Social Issues and Policy Review, (1), 258– 297. 29657577 PMC5898245
- Finelli C. J. Nguyen K. DeMonbrun M. Borrego M. Prince M. Husman J.,... & Waters C. K. (2018). Reducing student resistance to active learning: Strategies for instructors. Journal of College Science Teaching, (5), 80– 91.
- Freeman S. Eddy S. L. McDonough M. Smith M. K. Okoroafor N. Jordt H. Wenderoth M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences USA, (23), 8410– 8415. PMC4060654 24821756
- Good J. M. (2000). A promising prospect for minority retention: Students becoming peer mentors. Journal of Negro Education, (4), 375– 383.
- Hake B. J. (1999). Lifelong learning in late modernity: The challenges to society, organizations, and individuals. Adult Education Quarterly, (2), 79– 90.
- Halloun E. A. Hestenes D. (1985). The initial knowledge state of college physics students. American Journal of Physics,, 1043– 1055.
- Harrison C. D. Tanner K. D. (2018). Language matters: Considering microaggressions in science. CBE—Life Sciences Education, (1), fe4. 10.1187/cbe.18-01-0011 29496676 PMC6007773 · DOI
- Jordt H. Eddy S. L. Brazil R. Lau I. Mann C. Brownell S. E., … & Freeman S. (2017). Values affirmation intervention reduces achievement gap between underrepresented minority and white students in introductory biology classes. CBE—Life Sciences Education, (3), ar41. 28710060 PMC5589421
- Lauer S. Momsen J. Offerdahl E. Kryjevskaia M. Christensen W. Montplaisir L. (2013). Stereotyped: Investigating gender in introductory science courses. CBE—Life Sciences Education, (1), 30– 38. 23463226 PMC3587853
- Lewis K. L. Stout J. G. Finkelstein N. D. Pollack S. J. Miyake A. Cohen G. L. Ito T. A. (2017). Fitting in to move forward: Belonging, gender, and persistence in the physical sciences, technology, engineering, and mathematics (pSTEM). Psychology of Women Quarterly, (4), 420– 435.
- Madsen A. McKagan S. B. Sayre E. C. (2013). Gender gap on concept inventories in physics: What is consistent, what is inconsistent, and what factors influence the gap? Physical Review Physics Education Research, (2), 020121.
- McClain S. Cokley K. (2017). Academic disidentification in Black college students: The role of teacher trust and gender. Cultural Diversity and Ethnic Minority Psychology, (1), 125– 133. 27845524
- McHugh M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica: Biochemia Medica, (3), 276– 282. 23092060 PMC3900052
- Mehrabian A. (1971). Silent messages. Oxford, UK: Wadsworth.
- Owens M. T. Seidel S. B. Wong M. Bejines T. E. Lietz S. Perez J. R., … & Tanner K. D. (2017). Classroom sound can be used to classify teaching practices in college science courses. Proceedings of the National Academy of Sciences USA, (12), 3085– 3090. PMC5373389 28265087
- Owens M. T. Tanner K. D. (2017). Teaching as brain changing: Exploring connections between neuroscience and innovative teaching. CBE—Life Sciences Education, (2), fe2. 28450442 PMC5459260
- Salvatore J. Shelton J. N. (2007). Cognitive costs of exposure to racial prejudice. Psychological Science, (9), 810– 815. 17760778
- Seidel S. B. Tanner K. D. (2013). “What if students revolt?”—considering student resistance: Origins, options, and opportunities for investigation. CBE—Life Sciences Education,, 586– 595. 24297286 PMC3846509
- Silverthorn D. U. (2006). Teaching and learning in the interactive class-room. Advances in Physiology Education,, 135– 140. 17108239
- Smith M. K. Jones F. H. M. Gilbert S. L. Wieman C. E. (2013). The Classroom Observation Protocol for Undergraduate STEM (COPUS): A new instrument to characterize university STEM classroom practices. CBE—Life Sciences Education, (4), 618– 627. 24297289 PMC3846513
- Spencer S. J. Steele C. M. Quinn D. M. (1999). Stereotype threat and women’s math performance. Journal of Experimental Social Psychology, (1), 4– 28.
- Strauss A. Corbin J. M. (1990). Basics of qualitative research: Grounded theory procedures and techniques. Thousand Oaks, CA: Sage Publications.
Cited by
Sorted by citations
Theobald, E. J., Hill, M. J., Tran, E., Agrawal, S., Arroyo, E. N., Behling, S., Chambwe, N., Cintrón, D. L., Cooper, J. D., Dunster, G., et al. (2020) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1916903117 · Cited by 1,387 · see citing works
“underpreparation due to economic and educational disparities prior to college (55), as well as social and psychological barriers such as stereotype threat and microaggressions (56, 57).”
Goudsouzian, L. K., & Hsu, J. L. (2023) · CBE - Life Sciences Education · doi:10.1187/cbe.22-10-0211 · Cited by 26 · see citing works
“This use of noncontent Instructor Talk can build students’ relationships with their instructors as well as students’ self-efficacy (Seidel et al., 2015; Harrison et al., 2019).”
Method
- Authors
- Harrison, C. D., Nguyen, T. A., Seidel, S. B., Escobedo, A. M., Hartman, C., Lam, K., Liang, K. S., Martens, M., Acker, G. N., Akana, S. F., Balukjian, B., Benton, H. P., Blair, J. R., Boaz, S. M., Boyer, K. E., Bram, J. B., Burrus, L. W., Byrd, D. T., Caporale, N., Carpenter, E. J., Chan, Y.-H. M., Chen, L., Chovnick, A., Chu, D. S., Clarkson, B. K., Cooper, S. E., Creech, C. J., de la Torre, J. R., Denetclaw, W. F., Duncan, K., Edwards, A. S., Erickson, K., Fuse, M., Gorga, J. J., Govindan, B., Green, L. J., Hankamp, P. Z., Harris, H. E., He, Z.-H., Ingalls, S. B., Ingmire, P. D., Jacobs, J. R., Kamakea, M., Kimpo, R. R., Knight, J. D., Krause, S. K., Krueger, L. E., Light, T. L., Lund, L., Márquez-Magaña, L. M., McCarthy, B. K., McPheron, L., Miller-Sims, V. C., Moffatt, C. A., Muick, P. C., Nagami, P. H., Nusse, G., Okimura, K. M., Pasion, S. G., Patterson, R., Pennings, P. S., Riggs, B., Romeo, J. M., Roy, S. W., Russo-Tait, T., Schultheis, L. M., Sengupta, L., Spicer, G. S., Swei, A., Wade, J. M., Willsie, J. K., Kelley, L. A., Owens, M. T., Trujillo, G., Domingo, C., Schinske, J. N., & Tanner, K. D.
- Affiliations
- Georgia Institute of Technology (US)
- San Francisco State University (US)
- Pacific Lutheran University (US)
- University of California, Los Angeles (US)
- University of Southern California (US)
- De Anza College (US)
- City College of San Francisco (US)
- Samuel Merritt University (US)
- Foothill College (US)
- Las Positas College (US)
- University of California San Diego (US)
- University of California, Davis (US)
- Diablo Valley College (US)
- Mt. Hood Community College (US)
- Department of Biology, San Francisco State University, San Francisco, CA 94132
- Cañada College (US)
- College of San Mateo (US)
- Chabot College (US)
- Palomar College (US)
- California State University, Sacramento (US)
- Los Medanos College (US)
- Berkeley City College (US)
- Contra Costa College (US)
- Holy Names University (US)
- College of Education, University of Texas at Austin, Austin, TX 78712
- Massachusetts College of Pharmacy and Health Sciences (US)
- Kelley, Petterson, and Associates, San Francisco, CA 94127
- Stanford University (US)
- Corresponding author
- Tanner, Kimberly D.
- ORCID
- Balukjian, Brad
- Boyer, Katharyn E.
- Burrus, Laura W.
- Byrd, Dana T.
- Caporale, Natalia
- Chan, Yee-Hung M.
- Chen, Lily
- Chu, Diana S.
- Creech, Catherine J.
- He, Zheng-Hui
- Kimpo, Rhea R.
- Márquez-Magaña, Leticia M.
- Pasion, Sally G.
- Pennings, Pleuni S.
- Riggs, Blake
- Roy, Scott W.
- Spicer, Greg S.
- Swei, Andrea
- Owens, Melinda T.
- Domingo, Carmen
- Venue
- CBE—Life Sciences Education
- Published
- 2019-09
- Volume
- 18
- Issue
- 3
- Pages
- ar47
- ISSN
- 1931-7913 (ISSN-L)
- PMC
- PMC6755320
- OpenAlex
- W2970977602
- Cited by
- 54
- References
- 7
- Citations by year
- 2026: 7 · 2025: 5 · 2024: 8 · 2023: 9 · 2022: 7 · 2021: 11 · 2020: 7
- FWCI
- 16.88
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by-nc-sa
- Locations
- CBE—Life Sciences Education (publishedVersion, cc-by-nc-sa)
- PubMed Central (publishedVersion, cc-by-nc-sa)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by-nc-sa)
- Funders
- National Science Foundation (1226361, 1226344)
- Howard Hughes Medical Institute (52007556)
- San Francisco State University
- Topics
- Social Sciences › Education › Evaluation of Teaching Practices
- Social Sciences › Psychology › Social Psychology › Communication in Education and Healthcare
- Social Sciences › Education › Innovative Teaching Methods
- Keywords
- biology course, classroom dynamics, university teaching
- MeSH terms
- Biology, Curriculum, Data Collection, Faculty, Humans, Learning, Students, Teaching
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review