Expert–Novice Comparison Reveals Pedagogical Implications for Students’ Analysis of Primary Literature
Open accessAbstract
Student engagement in the analysis of primary scientific literature increases critical thinking, scientific literacy, data evaluation, and science process skills. However, little is known about the process by which expertise in reading scientific articles develops. For this reason, we decided to compare how faculty experts and student novices engage with a research article. We performed think-aloud interviews of biology faculty and undergraduates as they read through a scientific article. We analyzed these interviews using qualitative methods. We grounded data interpretation in cognitive load theory and the ICAP (interactive, constructive, active, and passive) framework. Our results revealed that faculty have more complex schemas than students and that they reduce cognitive load through two main mechanisms: summarizing and note-taking. Faculty also engage with articles at a higher cognitive level, described as constructive by the ICAP framework, when compared with students. More complex schemas, effectively lowering cognitive load, and deeper engagement with the text may help explain why faculty encounter fewer comprehension difficulties than students in our study. Finally, faculty analyze and evaluate data more often than students when reading the text. Findings include a discussion of successful pedagogical approaches for instructors wishing to enhance undergraduates’ comprehension and analysis of research articles.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Learning to read PSL is a complex cognitive activity that is influenced by multiple factors.
“Learning to read PSL is a complex cognitive activity that is influenced by multiple factors (Nelms and Segura-Totten, 2019; Hubbard, 2021).”
From Reading Primary Scientific Literature: Approaches for Teaching Students in the Undergraduate STEM Classroom (2023) · cites this paper as Nelms and Segura-Totten, 2019
Expert readers of PSL rely on more complex schemas when reading PSL, thus lowering the cognitive load of reading such articles.
“For example, expert readers of PSL rely on more complex schemas—that is, mental structures and strategies for engaging with a cognitive task (Piaget, 2003)—when reading PSL, thus lowering the cognitive load of reading such articles (Nelms and Segura-Totten, 2019).”
From Reading Primary Scientific Literature: Approaches for Teaching Students in the Undergraduate STEM Classroom (2023) · cites this paper as Nelms and Segura-Totten, 2019
Faculty tend to reread sentences more frequently and are more likely to summarize and take notes when reading PSL than novice readers of PSL.
“Faculty tend to reread sentences more frequently and are more likely to summarize and take notes when reading PSL than novice readers of PSL (Nelms and Segura-Totten, 2019).”
From Reading Primary Scientific Literature: Approaches for Teaching Students in the Undergraduate STEM Classroom (2023) · cites this paper as Nelms and Segura-Totten, 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The Discovery of Grounded Theory; Strategies for Qualitative Research
Glaser, B. G., Strauss, A. L., & Strutzel, E. (1968) · Nursing Research · doi:10.1097/00006199-196807000-00014 · Cited by 39,449 · see citing works
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812 · see citing works
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · cited 1× · see citing works
“This may lead experts to have a higher cognitive-processing capacity (as has been shown for problem-solving in mathematics; Sweller, 1988) and, thus, a deeper understanding of the textual material.”
BackgroundCognitive Architecture and Instructional Design
Sweller, J., van Merrienboer, J. J. G., & Paas, F. G. W. C. (1998) · Educational Psychology Review · doi:10.1023/a:1022193728205 · Cited by 6,023 · see citing works
Chase, W. G., & Simon, H. A. (1973) · Cognitive Psychology · doi:10.1016/0010-0285(73)90004-2 · Cited by 4,479 · cited 2× · see citing works
“In fact, thousands of hours of practice are required to attain expertise in a certain domain (Chase and Simon, 1973; reviewed in Posner, 2014; Ericsson, 2018).”
Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. (2013) · Psychological Science in the Public Interest · doi:10.1177/1529100612453266 · Cited by 3,138 · see citing works
Cognitive Load Theory and Instructional Design: Recent Developments
Paas, F., Renkl, A., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_1 · Cited by 3,041 · see citing works
The ICAP framework: Linking cognitive engagement to active learning outcomes
Chi, M. T. H., & Wylie, R. (2014) · Educational Psychologist · doi:10.1080/00461520.2014.965823 · Cited by 2,911 · see citing works
Eliciting Self‐Explanations Improves Understanding
Chi, M. T. H., Leeuw, N. D., Chiu, M., & Lavancher, C. (1994) · Cognitive Science · doi:10.1016/0364-0213(94)90016-7 · Cited by 2,406 · see citing works
Cognitive Architecture and Instructional Design: 20 Years Later
Sweller, J., van Merriënboer, J. J. G., & Paas, F. (2019) · Educational Psychology Review · doi:10.1007/s10648-019-09465-5 · Cited by 2,337 · cited 4× · see citing works
“Another insight from studies of experts in diverse fields like chess, music, sports, and science is the importance of building expert-level skills through years of practice and study (reviewed in Posner, 2014; Sweller et al., 2019).”
BackgroundInfluentialEffects of beliefs about the nature of knowledge on comprehension.
Schommer, M. (1990) · Journal of Educational Psychology · doi:10.1037/0022-0663.82.3.498 · Cited by 2,215 · see citing works
Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_4 · Cited by 1,927 · see citing works
Self‐Explanations: How Students Study and Use Examples in Learning to Solve Problems
Chi, M. T. H., Bassok, M., Lewis, M. W., Reimann, P., & Glaser, R. (1989) · Cognitive Science · doi:10.1207/s15516709cog1302_1 · Cited by 1,714 · see citing works
Active‐Constructive‐Interactive: A Conceptual Framework for Differentiating Learning Activities
Michelene, T. H. (2009) · Topics in Cognitive Science · doi:10.1111/j.1756-8765.2008.01005.x · Cited by 1,608 · see citing works
Thinking aloud: reconciling theory and practice
Boren, T., & Ramey, J. A. (2000) · IEEE Transactions on Professional Communication · doi:10.1109/47.867942 · Cited by 849 · see citing works
Fatal attraction in rats infected with Toxoplasma gondii
Berdoy, M., Webster, J. P., & Macdonald, D. W. (2000) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2000.1182 · Cited by 731 · see citing works
Academic Language and the Challenge of Reading for Learning About Science
Snow, C. E. (2010) · Science · doi:10.1126/science.1182597 · Cited by 584 · see citing works
Chase, W. G., & Ericsson, K. A. (1982) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(08)60546-0 · Cited by 533 · see citing works
Gormally, C., Brickman, P., & Lutz, M. (2012) · CBE—Life Sciences Education · doi:10.1187/cbe.12-03-0026 · Cited by 437 · see citing works
Source Evaluation, Comprehension, and Learning in Internet Science Inquiry Tasks
Wiley, J., Goldman, S. R., Graesser, A. C., Sanchez, C. A., Ash, I. K., & Hemmerich, J. A. (2009) · American Educational Research Journal · doi:10.3102/0002831209333183 · Cited by 419 · see citing works
A Comparison of Concurrent and Retrospective Verbal Protocol Analysis
Kuusela, H., & Paul, P. (2000) · The American Journal of Psychology · doi:10.2307/1423365 · Cited by 408 · see citing works
Comprehending and Learning From Internet Sources: Processing Patterns of Better and Poorer Learners
Goldman, S. R., Braasch, J. L. G., Wiley, J., Graesser, A. C., & Brodowinska, K. (2012) · Reading Research Quarterly · doi:10.1002/rrq.027 · Cited by 342 · see citing works
Teaching the process of science: faculty perceptions and an effective methodology
Coil, D., Wenderoth, M. P., Cunningham, M., & Dirks, C. (2010) · CBE—Life Sciences Education · doi:10.1187/cbe.10-01-0005 · Cited by 282 · see citing works
Bråten, I., Strømsø, H. I., & Britt, M. A. (2009) · Reading Research Quarterly · doi:10.1598/rrq.44.1.1 · Cited by 255 · see citing works
Metacognitive activities in text-studying and problem-solving: Development of a taxonomy
Meijer, J. M., Veenman, M. V. J., & van Hout‐Wolters, B. H. A. M. (2006) · Educational Research and Evaluation · doi:10.1080/13803610500479991 · Cited by 227 · see citing works
Selective Use of the Primary Literature Transforms the Classroom Into a Virtual Laboratory
Hoskins, S. G., Stevens, L. M., & Nehm, R. H. (2007) · Genetics · doi:10.1534/genetics.107.071183 · Cited by 220 · see citing works
Hoskins, S. G., Lopatto, D., & Stevens, L. M. (2011) · CBE—Life Sciences Education · doi:10.1187/cbe.11-03-0027 · Cited by 207 · see citing works
Integrating Literacy and Science in Biology
Greenleaf, C. L., Litman, C., Hanson, T., Rosen, R., Boscardin, C., Herman, J. L., Schneider, S., Madden, S., & Jones, B. (2010) · American Educational Research Journal · doi:10.3102/0002831210384839 · Cited by 167 · see citing works
Kalyuga, S., Rikers, R. M. J. P., & PAAS, F. G. W. C. (2012) · Educational Psychology Review · doi:10.1007/s10648-012-9195-x · Cited by 135 · see citing works
Kozeracki, C. A., Carey, M. F., Colicelli, J., & Levis-Fitzgerald, M. (2006) · CBE—Life Sciences Education · doi:10.1187/cbe.06-02-0144 · Cited by 124 · see citing works
Gottesman, A. J., & Hoskins, S. G. (2013) · CBE—Life Sciences Education · doi:10.1187/cbe.12-11-0201 · Cited by 123 · cited 3× · see citing works
“Previous studies show that the analysis of research articles increases dimensions of scientific literacy and knowledge of the science process in undergraduate and graduate students (Choe and Drennan, 2001; Hoskins et al., 2007, 2011; Gottesman and Hoskins, 2013; Krontiris-Litowitz, 2013; Round and Campbell, 2013; Abdu…”
BackgroundReview and Process Effects of Spontaneous Note-Taking on Text Comprehension
Slotte, V., & Lonka, K. (1999) · Contemporary Educational Psychology · doi:10.1006/ceps.1998.0980 · Cited by 120 · see citing works
When Are Graphs Worth Ten Thousand Words? An Expert-Expert Study
Roth, W., & Bowen, G. M. (2003) · Cognition and Instruction · doi:10.1207/s1532690xci2104_3 · Cited by 118 · see citing works
Round, J. E., & Campbell, A. M. (2013) · CBE—Life Sciences Education · doi:10.1187/cbe.11-07-0057 · Cited by 110 · cited 11× · see citing works
“Two ways of teaching students how to take richer notes are to use an approach to reading primary literature that contains a note-taking component (Hoskins et al., 2007; Round and Campbell, 2013) and to model expert behavior in class.”
BackgroundInfluentialHubbard, K. E., & Dunbar, S. D. (2017) · PLoS ONE · doi:10.1371/journal.pone.0189753 · Cited by 108 · cited 1× · see citing works
“Further, undergraduates placed less value on methods and experimental results and their interpretation than individuals at later career stages (Hubbard and Dunbar, 2017).”
BackgroundEricsson, K. A. (2018) · Cambridge University Press eBooks · doi:10.1017/9781316480748.038 · Cited by 106 · see citing works
McNamara, D. S. (2015) · Discourse Processes · doi:10.1080/0163853x.2015.1101328 · Cited by 92 · see citing works
Dialogue Patterns in Peer Collaboration That Promote Learning
Michelene, T. H., & Menekşe, M. (2015) · American Educational Research Association eBooks · doi:10.3102/978-0-935302-43-1_21 · Cited by 86 · see citing works
Wiggins, B., Eddy, S. L., Grunspan, D. Z., & Crowe, A. J. (2017) · AERA Open · doi:10.1177/2332858417708567 · Cited by 82 · see citing works
Using Primary Literature to Teach Science Literacy to Introductory Biology Students
Krontiris-Litowitz, J. (2013) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.v14i1.538 · Cited by 62 · see citing works
Effects of self-regulatory instructional aids on self-directed study
Bednall, T. C., & Kehoe, E. J. (2009) · Instructional Science · doi:10.1007/s11251-009-9125-6 · Cited by 61 · see citing works
Sato, B. K., Kadandale, P., He, W., Murata, P. M. N., Latif, Y., & Warschauer, M. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.14-02-0025 · Cited by 58 · see citing works
Abdullah, C., Parris, J., Lie, R., Guzdar, A., & Tour, E. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.14-10-0180 · Cited by 46 · see citing works
McCartney, M. L., Childers, C., Baiduc, R. R., & Barnicle, K. (2018) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v19i1.1439 · Cited by 31 · see citing works
Lie, R., Abdullah, C., He, W., & Tour, E. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-09-0198 · Cited by 29 · cited 3× · see citing works
“Similarly, when master’s students were asked at the beginning of a course about their perceived difficulties with reading primary literature, they reported techniques and experimental data as challenges (Lie et al., 2016).”
BackgroundMethodInfluentialSegura‐Totten, M., & Dalman, N. (2013) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v14i2.506 · Cited by 29 · see citing works
Self-citationTeaching Mathematical Biology in High School Using Adapted Primary Literature
Norris, S. P., Stelnicki, N., & de Vries, G. (2011) · Research in Science Education · doi:10.1007/s11165-011-9215-8 · Cited by 27 · see citing works
Implementing Recommendations for Introductory Biology by Writing a New Textbook
Barsoum, M. J., SELLERS, P. J., Campbell, A. M., Heyer, L. J., & Paradise, C. J. (2013) · CBE—Life Sciences Education · doi:10.1187/cbe.12-06-0086 · Cited by 24 · see citing works
Gouvea, J. S. (2017) · CBE—Life Sciences Education · doi:10.1187/cbe.17-06-0110 · Cited by 11 · see citing works
Marsh, T. L., Guenther, M. F., & Raimondi, S. L. (2015) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v16i1.828 · Cited by 9 · see citing works
Gallo, M. A., & Rinaldo, V. J. (2012) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v13i2.493 · Cited by 8 · see citing works
Shorbagi, S. H., & Ashok, A. (2016) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v17i3.1110 · Cited by 4 · see citing works
Studies of Expertise from Psychological Perspectives: Historical Foundations and Recurrent Themes
Feltovich, P. J., Prietula, M. J., & Ericsson, K. A. (n.d.) · The Cambridge Handbook of Expertise and Expert Performance · doi:10.1017/9781316480748.006
Flagged first, then by citations
Research works printed but not linked: 14
- Chi, M. T. H. (1987). Representing knowledge and metaknowledge: Implications for interpreting metamemory research. In Weinert, F. E. Kluwe, R. (Eds.), Metacognition, motivation, and understanding (pp. 239– 266). Hillsdale, NJ: Erlbaum.
- Chi, M. T. H. Glaser, R. Rees, E. (1982). Expertise in problem solving. In Sternberg, R. J. (Ed.), Advances in the psychology of human intelligence (Vol. 1). Hillsdale, NJ: Erlbaum.
- Choe, S. W. T. Drennan, P. M. (2001). Analyzing scientific literature using a jigsaw group activity: Piecing together student discussions on environmental research. Journal of College Science Teaching, 30(5), 328– 330.
- Ericsson, K. A. Simon, H. A. (1993). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
- Glaser, R. Chi, M. T. H. (2014). Overview. In Chi, M. T. H. Glaser, R. Farr, M. J. (Eds.), The nature of expertise (pp. xv– xxviiix). London: Psychology Press.
- Jacques-Fricke, B. Hubert, A. Miller, S. (2009). A versatile module to improve understanding of scientific literature through peer instruction. Journal of College Science Teaching, 39(2), 24– 32.
- Janick-Buckner, D. (1997). Getting undergraduates to critically read and discuss primary literature. Journal of College Science Teaching, 27, 340– 347.
- National Research Council (NRC). (2003). BIO2010: Transforming undergraduate education for future research biologists. Washington, DC: National Academies Press. 20669482
- NRC. (2012). Discipline-based education research: Understanding and improving learning in undergraduate science and engineering. Washington, DC: National Academies Press.
- Newell, A. Simon, H. A. (1972). Human problem solving. Eglewood Cliffs, NJ: Prentice Hall.
- Posner, M. I. (2014). Introduction: What is it to be an expert? In Chi, M. T. H. Glaser, R. Farr, M. J. (Eds.), The nature of expertise (pp. xv– xxviii). London: Psychology Press.
- Simon, D. P. Simon, H. A. (1978). Individual differences in solving physics problems. In Siegler, R. S. (Ed.), Children’s thinking: What develops? (pp. 325– 348). Hillsdale, NJ: Erlbaum.
- Voss, J. F. Post, T. A. (2014). On the solving of ill-structured problems. In Chi, M. T. H. Glaser, R. Farr, M. J. (Eds.), The nature of expertise (pp. 261– 285). London: Psychology Press.
- Wenk, L. Tronsky, L. (2011). First-year students benefit from reading primary research articles. Journal of College Science Teaching, 40(4), 60– 67.
Cited by
Sorted by citations
Goudsouzian, L. K., & Hsu, J. L. (2023) · CBE - Life Sciences Education · doi:10.1187/cbe.22-10-0211 · Cited by 26 · see citing works
“Faculty tend to reread sentences more frequently and are more likely to summarize and take notes when reading PSL than novice readers of PSL (Nelms and Segura-Totten, 2019).”
BackgroundInfluentialInsights on biology student motivations and challenges when reading and analyzing primary literature
Howard, K. N., Stapleton, E. K., Nelms, A. A., Ryan, K. C., & Segura-Totten, M. (2021) · PLOS ONE · doi:10.1371/journal.pone.0251275 · Cited by 23 · see citing works
Self-citationHubbard, K. E., Dunbar, S. D., Peasland, E. L., Poon, J., & Solly, J. E. (2022) · International Journal of Science Education, Part B · doi:10.1080/21548455.2022.2078010 · Cited by 12 · see citing works
- Authors
- Nelms, A. A., & Segura-Totten, M.
- Affiliations
- University of North Georgia (US)
- Department of Biology, University of North Georgia, Dahlonega, GA 30597
- Venue
- CBE—Life Sciences Education
- Published
- 2019-12
- Volume
- 18
- Issue
- 4
- Pages
- ar56
- ISSN
- 1931-7913 (ISSN-L)
- PMC
- PMC6829068
- OpenAlex
- W2984772191
- Cited by
- 50
- References
- 53
- Citations by year
- 2026: 6 · 2025: 8 · 2024: 7 · 2023: 8 · 2022: 11 · 2021: 8 · 2020: 2
- FWCI
- 14.15
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Licence
- cc-by-nc-sa
- Locations
- CBE—Life Sciences Education (publishedVersion, cc-by-nc-sa)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-sa)
- PubMed Central (publishedVersion, cc-by-nc-sa)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- expert-novice comparison, faculty expertise, cognitive load, ICAP framework, schemas, summarization, note-taking, critical thinking, scientific literacy, undergraduate science education
- MeSH terms
- Biology, Faculty, Humans, Publications, Students, Thinking
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review