Figure Facts: Encouraging Undergraduates to Take a Data-Centered Approach to Reading Primary Literature
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index; 2 of the 2 sources its claims cite were checked for support.
Abstract
The ability to interpret experimental data is essential to understanding and participating in the process of scientific discovery. Reading primary research articles can be a frustrating experience for undergraduate biology students because they have very little experience interpreting data. To enhance their data interpretation skills, students used a template called "Figure Facts" to assist them with primary literature-based reading assignments in an advanced cellular neuroscience course. The Figure Facts template encourages students to adopt a data-centric approach, rather than a text-based approach, to understand research articles. Specifically, Figure Facts requires students to focus on the experimental data presented in each figure and identify specific conclusions that may be drawn from those results. Students who used Figure Facts for one semester increased the amount of time they spent examining figures in a primary research article, and regular exposure to primary literature was associated with improved student performance on a data interpretation skills test. Students reported decreased frustration associated with interpreting data figures, and their opinions of the Figure Facts template were overwhelmingly positive. In this paper, we present Figure Facts for others to adopt and adapt, with reflection on its implementation and effectiveness in improving undergraduate science education.
Overview
CoChat Summary
## TL;DR
Figure Facts is a structured reading template used in an undergraduate cellular neuroscience course to shift students’ attention from article text to data figures. In two course iterations, students spent more time on figures, improved on data-interpretation tests, and reported less stress and frustration reading primary literature.
## Key findings
- In the time-on-task assessment, students shifted from spending about 80% of their reading time on text and 20% on figures in week 1 to 60% on text and 40% on figures in week 15; this change was statistically significant (t(13) = 5.5, p < 0.001).
- In the handwritten-notes measure, students annotated 10% of printed figure panels in week 1 versus 38% in week 15, a nearly fourfold increase (t(15) = 4.4, p < 0.001).
- On the data-interpretation test, the average score improved from −1 in week 1 to +1 in week 9 (t(14) = 4.22, p < 0.001), and trended to +2 by week 15; the week 9 to week 15 change was not significant (t(1) = 0.94, p = 0.36).
- Student surveys reported that 80% agreed or strongly agreed Figure Facts helped structure reading, 90% said it helped them focus on data, and stress/frustration declined from 47%/58% in week 1 to 12%/19% by the end of the course.
## Methods
- The authors implemented Figure Facts in two iterations of Davidson College’s Cellular and Molecular Neuroscience (BIO 333) course, with 14 biology/neuroscience majors in Spring 2011 and 16 similar students in Spring 2012.
- Students completed a Microsoft Word template while reading primary research articles before class; the template guided them to identify broad topic, specific topic, what is known, experimental question, and for each figure panel, technique, result, and conclusion.
- Assessment used a three-part design: a time-on-task comparison, three ungraded skills tests with neuron images and graphs, and anonymous midsemester and pre/postcourse surveys; student data were analyzed with paired t tests.
## Limitations
- The paper states that the study used small, highly selected samples of students who had close interaction with a single instructor, so the authors say the results should be tested in larger and different classroom/campus settings before generalizing.
- The authors say the data interpretation skills tests should be regarded as preliminary because the assessment was small in scale.
- Evident from the text: the work was conducted in one course at one institution, and the outcomes rely largely on course-based assessments and self-reported surveys rather than external measures of transfer or long-term retention.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
2 Valid · 0 Not valid · 0 Not checked · 37 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Finally, 80% of students agreed or strongly agreed that the template made our classroom discussions more productive”
§ Figure Facts: Encouraging Undergraduates to Take a Data-Centered Approach to Reading Primary Literature > RESULTS AND CONCLUSIONS > Student Attitude Surveys
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Eighty percent of students agreed or strongly agreed that Figure Facts assignments encouraged them to read the paper more closely in preparation for class.”
§ Figure Facts: Encouraging Undergraduates to Take a Data-Centered Approach to Reading Primary Literature > RESULTS AND CONCLUSIONS > Student Attitude Surveys
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In week 9, after students had analyzed eight primary research papers in detail, the average score improved significantly (t(14) = 4.22, p < 0.001) to +1.”
§ Figure Facts: Encouraging Undergraduates to Take a Data-Centered Approach to Reading Primary Literature > RESULTS AND CONCLUSIONS > Data Interpretation Assessment
plainn = 16 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In week 1, students made notations on 10% of the printed figure panels, whereas in week 15, students marked 38% of the figure panels (t(15) = 4.4, p < 0.001).”
§ Figure Facts: Encouraging Undergraduates to Take a Data-Centered Approach to Reading Primary Literature > RESULTS AND CONCLUSIONS > Time-on-Task Assessment
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In week 15, after completing eight Figure Facts templates, students spent only 60% of their time reading the text, and doubled their time examining data to 40%.”
§ Figure Facts: Encouraging Undergraduates to Take a Data-Centered Approach to Reading Primary Literature > RESULTS AND CONCLUSIONS > Time-on-Task Assessment
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
13 more claims
Create a free account to see all 39 claims and every source verdict.
- Probably not a substantial claim. 8
- It may state two separate claims as one. 17
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“There have been many strategies and supporting resources developed to help inexperienced readers engage with the primary literature [6,8–14].”
From Perceptions of scientific research literature and strategies for reading papers depend on academic career stage (2017) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“Making sense of scientific papers can be therefore cognitively challenging, particularly for readers who may be unfamiliar with the terminology of the field [6].”
From Perceptions of scientific research literature and strategies for reading papers depend on academic career stage (2017) · cites this paper as [6]
The cited source says what the claim attributes to it.
In the citing paper
“A variety of teaching strategies for introducing papers undergraduate students have been described, many of which have been demonstrated to increase student confidence and skill in the use of research literature [6,11,15,16,30–32].”
From Perceptions of scientific research literature and strategies for reading papers depend on academic career stage (2017) · cites this paper as [6]
Statistics that don’t add up
Each reported p-value recomputed from its test statistic and degrees of freedom, each partial η² from its F, and each ratio, mean difference or B printed with a p checked against its own confidence interval.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“t(1) = 0.94, p = 0.36”
§ Figure Facts: Encouraging Undergraduates to Take a Data-Centered Approach to Reading Primary Literature > RESULTS AND CONCLUSIONS > Data Interpretation Assessment
Reported p = .36 · recomputed p = .520
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Doesn’t add upt(1) = 0.94reported p = .36 · recomputed p = .520
“t(1) = 0.94, p = .36”
- Consistentt(13) = 0.18reported p = .86 · recomputed p = .860
“t(13) = 0.18, p = .86”
- Consistentt(13) = 1.94reported p = .08 · recomputed p = .074
“t(13) = 1.94, p = .08”
- Consistentt(13) = 5.5reported p < .001 · recomputed p < .001
“t(13) = 5.5, p < .001”
- Consistentt(15) = 4.4reported p < .001 · recomputed p < .001
“t(15) = 4.4, p < .001”
1 more recomputed test
Create a free account to see every test the Stats check recomputed.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“We also administered the skills tests to a control group of 15 Davidson students who had completed the prerequisite course, BIO 111, and thus had experience with neurons, microscopic images, and graphs. Students who completed the tests in identical order in one sitting showed no significant improvement between the first and second test (t(13) = 0.18, p = 0.86) or the first and third test (t(13) = 1.94, p = 0.08).”
§ Figure Facts: Encouraging Undergraduates to Take a Data-Centered Approach to Reading Primary Literature > METHODS > Assessment Design
Reported 13 · recomputed 14
Citations
Cites
Pekrun, R., Goetz, T., Titz, W., & Perry, R. P. (2002) · Educational Psychologist · doi:10.1207/s15326985ep3702_4 · Cited by 3,931 · cited 5×
“A secondary goal of the template is to provide a structured reading experience that reduces the frustration and anxiety that may serve as a barrier to student learning (Pekrun et al., 2002).”
InfluentialHandelsman, J., Ebert-May, D., Beichner, R., Bruns, P., Chang, A., DeHaan, R., Gentile, J., Lauffer, S., Stewart, J., Tilghman, S. M., et al. (2004) · Science · doi:10.1126/science.1096022 · Cited by 928 · cited 1×
“…biology classroom is a hub of active learning in which students engage in the investigative process of scientific research rather than memorizing facts (National Research Council, 2003; Handelsman et al., 2004; Labov et al., 2009; American Association for the Advancement of Science, 2011).”
BIO2010 : Transforming Undergraduate Education for Future Research Biologists
Earth, D. O. (2003) · Cited by 855
Just-In-Time Teaching: Blending Active Learning with Web Technology
Novak, G. M., Gavrin, A. D., & Christian, W. (1999) · The Physics Video Demonstration Database (Cornell University) · Cited by 619
Novak, G. M., Patterson, E. T., Gavrin, A. D., Christian, W., & Forinash, K. (1999) · American Journal of Physics · doi:10.1119/1.19159 · Cited by 384 · cited 1×
“The upload requirement also follows the principles of just-in-time teaching (Novak et al., 1999), in that it allows the instructor to assess each student’s level of understanding prior to class and adjust group discussion to suit the students’ needs.”
Selective Use of the Primary Literature Transforms the Classroom Into a Virtual Laboratory
Hoskins, S. G., Stevens, L. M., & Nehm, R. H. (2007) · Genetics · doi:10.1534/genetics.107.071183 · Cited by 220 · cited 7×
“but also train students to evaluate data critically, improve their scientific writing, and follow the most recent advances in research (Levine, 2001; Kuldell, 2003; Hoskins et al., 2007).”
InfluentialHoskins, S. G., Lopatto, D., & Stevens, L. M. (2011) · CBE—Life Sciences Education · doi:10.1187/cbe.11-03-0027 · Cited by 207 · cited 2×
“Students are also advised to use short phrases and abbreviations, rather than complete sentences, to minimize distraction from reading and understanding the paper itself.”
Kozeracki, C. A., Carey, M. F., Colicelli, J., & Levis-Fitzgerald, M. (2006) · CBE—Life Sciences Education · doi:10.1187/cbe.06-02-0144 · Cited by 124 · cited 2×
“A common classroom method is the journal club approach, in which one or more students present an article that has been read by the group (Glazer, 2000; Edwards et al., 2001; Kozeracki et al., 2006).”
Edwards, R., White, M., Gray, J., & Fischbacher, C. (2001) · Medical Education · doi:10.1046/j.1365-2923.2001.00972.x · Cited by 96 · cited 1×
“A common classroom method is the journal club approach, in which one or more students present an article that has been read by the group (Glazer, 2000; Edwards et al., 2001; Kozeracki et al., 2006).”
Getting Undergraduates To Critically Read and Discuss Primary Literature.
Janick‐Buckner, D. (1997) · The journal of college science teaching · Cited by 80
Research works printed but not linked: 2
- American Association for the Advancement of Science Vision and Change in Undergraduate Biology Education: A Call to Action 2011 Washington, DC
- Smith GR Guided literature explorations J Coll Sci Teach 2001 30 465 469
Cited by
Brame, C. J. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.16-03-0125 · Cited by 1,124
“This strategy is often used to increase student learning from reading assignments (e.g., Tanner, 2012; Round and Campbell, 2013), and it can translate effectively to helping students learn from video.”
MethodHubbard, K. E., & Dunbar, S. D. (2017) · PLoS ONE · doi:10.1371/journal.pone.0189753 · Cited by 119
Buchanan, A. J., & Fisher, G. R. (2022) · CBE—Life Sciences Education · doi:10.1187/cbe.22-04-0069 · Cited by 146
“…data, Think of the next Experiment) method (Hoskins et al., 2011) and modifications of that method (Beck, 2019), as well as the Figure Facts method (Round and Campbell, 2013), and we encourage CURE authors to investigate these techniques for examples of how review of primary literature may be…”
MethodSato, B. K., Kadandale, P., He, W., Murata, P. M. N., Latif, Y., & Warschauer, M. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.14-02-0025 · Cited by 58
“CBE—Life Sciences Education 2013; Round and Campbell, 2013).”
Nelms, A. A., & Segura-Totten, M. (2019) · CBE—Life Sciences Education · doi:10.1187/cbe.18-05-0077 · Cited by 50
“Two ways of teaching students how to take richer notes are to use an approach to reading primary literature that contains a note-taking component (Hoskins et al., 2007; Round and Campbell, 2013) and to model expert behavior in class.”
BackgroundInfluentialAnnotated primary scientific literature: A pedagogical tool for undergraduate courses
Kararo, M., & McCartney, M. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000103 · Cited by 47
Hubbard, K. (2021) · Higher Education Pedagogies · doi:10.1080/23752696.2021.1882326 · Cited by 42
“Many published strategies for incorporating primary research papers into taught curricula come from the biosciences (Hoskins et al., 2007; Kozeracki et al., 2006; Lie et al., 2016; Round & Campbell, 2013; Willmott et al., 2003), reflecting the centrality of literature use in these disciplines.”
BackgroundMakarevitch, I., Frechette, C., & Wiatros, N. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.15-04-0081 · Cited by 45
“In framing graph analysis exercises in worksheet 5, we enhanced many of the ideas from Figure Facts (Round and Campbell, 2013) with the peer-to-peer presentations of the primary literature graphs and found this approach to be very effective.”
MethodZagallo, P., Meddleton, S., & Bolger, M. S. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-11-0239 · Cited by 36
“…several papers have reported instructional designs targeted at helping undergraduate students understand published biological data (Kozeracki et al., 2006; Hoskins et al., 2007; Round and Campbell, 2013; Van Lacum et al., 2014), very few have closely examined how students learn to interpret data.”
BackgroundInfluentialThrough the Eyes of Faculty: Using Personas as a Tool for Learner-Centered Professional Development
Zagallo, P., McCourt, J. S., Idsardi, R., Smith, M. K., Urban‐Lurain, M., Andrews, T. C., Haudek, K. C., Knight, J., MERRILL, J. E., Nehm, R. H., et al. (2019) · CBE—Life Sciences Education · doi:10.1187/cbe.19-06-0114 · Cited by 47
“This connection could be achieved by helping her learn to use evidence-based pedagogies like case-based learning (Borrego et al., 2013) or authentic data-interpretation tasks (Hoskins et al., 2007; Round and Campbell, 2013; Zagallo et al., 2016) that provide real-life problem-solving scenarios.”
BackgroundDoing peer review and receiving feedback: impact on scientific literacy and writing skills
Geithner, C. A., & Pollastro, A. N. (2016) · Advances in Physiology Education · doi:10.1152/advan.00071.2015 · Cited by 35
Matuk, C. F., Zhang, J., Uk, I., & Linn, M. C. (2019) · Journal of Research in Science Teaching · doi:10.1002/tea.21533 · Cited by 42
“All learners require a degree of graph literacy to construct and critique arguments, and to make informed decisions about personal and policy issues (e.g., Round & Campbell, 2013; Wiley et al., 2009).”
BackgroundImproving Exam Performance in Introductory Biology through the Use of Preclass Reading Guides
Lieu, R., Wong, A., Asefirad, A., & Shaffer, J. F. (2017) · CBE—Life Sciences Education · doi:10.1187/cbe.16-11-0320 · Cited by 44
McCartney, M. L., Childers, C., Baiduc, R. R., & Barnicle, K. (2018) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v19i1.1439 · Cited by 32
Lie, R., Abdullah, C., He, W., & Tour, E. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-09-0198 · Cited by 29
“Many studies have described the use of primary literature in the classroom (e.g., Janick-Buckner, 1997; Muench, 2000; Kozeracki et al., 2006; Hoskins et al., 2007; Krontiris-Litowitz, 2013; Round and Campbell, 2013; Sato et al., 2014; Van Lacum et al., 2014; Abdullah et al., 2015).”
BackgroundGoudsouzian, L. K., & Hsu, J. L. (2023) · CBE - Life Sciences Education · doi:10.1187/cbe.22-10-0211 · Cited by 26
Orndorf, H. C., Waterman, M. A., Lange, D., Kavin, D., Johnston, S. C., & Jenkins, K. P. (2022) · CBE—Life Sciences Education · doi:10.1187/cbe.21-09-0239 · Cited by 38
“Barriers in introductory biology include suboptimal pedagogical practices (Freeman et al., 2014); disciplinary communication style (Round and Campbell, 2013; Lieu et al., 2017); and a growing emphasis on quantitative skills, including data science, computation, and modeling (Gibson and Mourad,…”
BackgroundLaungani, R., Tanner, C. J., Brooks, T. D., Clement, B., Clouse, M. A., Doyle, E., Dworak, S., Elder, B., Marley, K., & Schofield, B. J. (2018) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v19i2.1517 · Cited by 27
“This is particularly relevant because research has shown that exposure to primary literature in a structured manner (as done in both CUREs) can lower barriers to understanding science that students often feel when presented with primary literature for the first time (27, 28).”
BackgroundThe Grass Isn’t Always Greener: Perceptions of and Performance on Open-Note Exams
Sato, B. K., He, W., Warschauer, M., & Kadandale, P. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.14-08-0121 · Cited by 28
“Figure Facts: encouraging undergraduates to take a data-centered approach to reading primary literature.”
Use of primary literature in the undergraduate analytical class
Kovarik, M. L. (2016) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-016-9467-2 · Cited by 23
“Students who have read primary literature change the way they approach articles in the future, spending more time examining figures and comprehending subsequent articles more completely [1, 3, 6].”
BackgroundInsights on biology student motivations and challenges when reading and analyzing primary literature
Howard, K. N., Stapleton, E. K., Nelms, A. A., Ryan, K. C., & Segura-Totten, M. (2021) · PLOS ONE · doi:10.1371/journal.pone.0251275 · Cited by 23
“It is popular because it develops important skills in undergraduates, like critical thinking, data interpretation and scientific thinking [4, 5, 7, 8, 51].”
BackgroundBiango‐Daniels, M. N., & Sarvary, M. A. (2020) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2020.1812512 · Cited by 26
“Comprehension and critical analysis of scientific information (Round and Campbell 2013), along with gaining scientific literacy and CONTACT Megan Biango-Daniels mnd24@cornell.edu Supplemental data for this article is available online at https://doi.org/10.1080/02602938.2020.1812512.”
BackgroundInfluentialUndergraduate Science Students’ Attitudes Toward and Approaches to Scientific Reading and Writing
Verkade, H. M., & Lim, S. H. (2016) · The journal of college science teaching · doi:10.2505/4/jcst16_045_04_83 · Cited by 20
Building a laboratory at a Primarily Undergraduate Institution (PUI)
Dahlberg, C. L., King‐Smith, C., & Riggs, B. (2021) · BMC Proceedings · doi:10.1186/s12919-021-00208-5 · Cited by 20
“Active learning strategies such as jigsaws, justin-time teaching, and exit slips [26, 27] and resources and protocols such as C.R.E.A.T.E. [28, 29], Figure Facts [30], and Genetics Primers [31] can be useful frameworks for discussions of papers early in an academic year, or when students could use more guidance.”
BackgroundSloane, J. D., & Wiles, J. R. (2020) · Ecology and Evolution · doi:10.1002/ece3.5960 · Cited by 15
“For these papers, as well as other papers assigned in the course, students were required to complete a Figure Facts template (Round & Campbell, 2013) prompting them to take a data-centric approach to reading the papers and to post a response to the papers in an online discussion.”
Hawkins, W. C., Goddard, K., & Favero, C. B. (2021) · CBE—Life Sciences Education · doi:10.1187/cbe.20-06-0117 · Cited by 20
“Student responses about study methods were analyzed for emergent themes (Rybczynski and Schussler, 2011) and categorized as active or passive (Roediger, 2013).”
Crowdsourcing biocuration: The Community Assessment of Community Annotation with Ontologies (CACAO)
Ramsey, J., McIntosh, B. K., Renfro, D. P., Aleksander, S., LaBonte, S. A., Ross, C., Zweifel, A. E., Liles, N. M., Farrar, S., Gill, J. J., et al. (2021) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1009463 · Cited by 16
Hunter, R. A., & Kovarik, M. L. (2022) · Journal of Chemical Education · doi:10.1021/acs.jchemed.1c00920 · Cited by 18
Collaborative Online Annotation: Pedagogy, Assessment and Platform Comparisons
Porter, G. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.852849 · Cited by 15
Lo, S. M., Luu, T. B., & Tran, J. (2020) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v21i1.1881 · Cited by 15
“Figure Facts assists students in understanding experimental data presented in papers and identifying conclusions from these data; students in an upper-division classroom course at a liberal arts college had improved performance in interpreting data and reported decreased frustration in examining primary literature fig…”
BackgroundSharing Notes Is Encouraged: Annotating and Cocreating with Hypothes.is and Google Docs †
Goller, C., Vandegrift, M., Cross, W., & Smyth, D. S. (2021) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v22i1.2135 · Cited by 14
Chatzikyriakidou, K., & McCartney, M. (2022) · International Journal of Science Education · doi:10.1080/09500693.2022.2073482 · Cited by 10
Exploring Primary Scientific Literature through the Lens of the 5 Core Concepts of Biology
Chatzikyriakidou, K., Manrique, C., Tacloban, M. J., & McCartney, M. L. (2021) · CourseSource · doi:10.24918/cs.2021.5 · Cited by 10
“Programs include journal clubs, data and figure exploration, tutorials on how to read PSL, annotated literature, and full courses being taught only with primary literature (5,11,14,18,19).”
BackgroundPrimary Literature in Undergraduate Science Courses: What are the Outcomes?
Sloane, J. D. (2021) · Journal of College Science Teaching · doi:10.1080/0047231x.2021.12290508 · Cited by 9
“…articles (Carter & Wiles, 2017; Gottesman & Hoskins, 2013; Hoskins et al., 2007; Hoskins et al., 2011; Kozeracki et al., 2006; Porter et al., 2010; Round & Campbell, 2013; Segura-Totten & Dalman, 2013; Stevens & Hoskins, 2014; Stover, 2016) and sorting based on the descriptions of the outcomes…”
BackgroundMorgan, D. E. (2024) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00132-24 · Cited by 14
Smith, K. G., & Paradise, C. J. (2022) · Ecology and Evolution · doi:10.1002/ece3.9644 · Cited by 17
Kulkarni, A., & Vartak, R. (2019) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21281 · Cited by 11
“As a final remark, we should clarify that this report on an intervention using a 3-day module cannot be compared with the much more comprehensive work cited earlier [12, 14], which involves primary literature reading over a full semester.”
BackgroundMethodInfluentialBimczok, D., & Graves, J. (2020) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21337 · Cited by 9
Marsh, T. L., Guenther, M. F., & Raimondi, S. L. (2015) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v16i1.828 · Cited by 11
“There is a dearth of research on the topic, however, and, in the case of the studies described above, none of them have examined changes in student comprehension and critical thinking skills over several years of an undergraduate career, focusing instead on one-course/one-term analyses (1, 7, 10, 15, 18).”
BackgroundMethodJust Figures: A Method to Introduce Students to Data Analysis One Figure at a Time
Massimelli, J., Denaro, K., Sato, B., Kadandale, P., & Boury, N. (2019) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe..v20i2.1690 · Cited by 8
Beck, C. W. (2019) · CourseSource · doi:10.24918/cs.2019.25 · Cited by 9
Using Scavenger Hunts to Familiarize Students with Scientific Journal Articles
Lijek, R. S., & Fankhauser, S. C. (2016) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v17i1.1005 · Cited by 9
“While many pedagogical approaches already exist to help students learn from primary literature (e.g., CREATE (5), Figure Facts (7), and others summarized in 7 and 6), most are geared toward using articles to teach college students scientific content and/or processes and require significant investments of classroom tim…”
BackgroundFerenc, J., Červenák, F., Birčák, E., Juríková, K., Goffová, I., Gorilák, P., Huraiová, B., Plavá, J., Demecsová, L., Ďuríková, N., et al. (2017) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21084 · Cited by 6
Boury, N. M., Alvarez, K. S., Costas, A. G., Knapp, G. S., & Seipelt-Thiemann, R. L. (2021) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v22i1.2433 · Cited by 13
“Reading and discussing primary scienti fi c literature has long been used to introduce students to the process of science and the structure of primary sources and the value of reading them (6 – 9), as well as demonstrating the relevance of course concepts.”
Lee, S., Zhong, M., Foster, C., Segura-Totten, M., & McCartney, M. (2022) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.00126-22 · Cited by 7
“Moreover, educational interventions using PSL at the undergraduate level are well documented and include journal clubs (5, 6), variations of consider, read, elucidate the hypotheses, analyze and interpret the data, and think of the next experiment (C.R.E.A.T.E.) (2, 7–12), circular response (13), process-oriented guid…”
BackgroundA Simple Activity to Enhance the Learning Experience of Reading Primary Literature
Liao, M.-K. (2017) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.v18i1.1211 · Cited by 7
The Literature Discussion: A Signature Pedagogy for Chemistry
Reisner, B. A., & Stewart, J. L. (2020) · ACS symposium series · doi:10.1021/bk-2020-1370.ch002 · Cited by 9
Stengel, A., Stanke, K. M., McPherson, M. R., & Drijber, R. A. (2021) · Natural sciences education · doi:10.1002/nse2.20051 · Cited by 11
Facilitating Engaging Journal Clubs in Online Upper-Level Undergraduate Courses †
Li, Y., & Jean, A. S. (2021) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v22i1.2637 · Cited by 7
“While there is no JC standard (2), different strategies for implementing JCs have been reported (10, 11).”
BackgroundO’Keeffe, G. W., & McCarthy, M. M. (2017) · PubMed Central · Cited by 8
Washburn, M. E., Shanks, R. A., McCartney, M. L., Robertson, C. L., & Segura‐Totten, M. (2023) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00154-22 · Cited by 14
de Vries, T. J. (2023) · Frontiers in Education · doi:10.3389/feduc.2023.1144010 · Cited by 6
Teaching from the primary inorganic literature: lessons from Richard Andersen
Stewart, J. L., Bentley, A. K., Johnson, A. R., Nataro, C., Reisner, B. A., & Watson, L. A. (2018) · Dalton Transactions · doi:10.1039/c8dt02669f · Cited by 7
Chatzikyriakidou, K., Tacloban, M. J., Concepcion, K., & McCartney, M. L. (2022) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00059-22 · Cited by 8
“To determine whether a 5CCs-based, semester-long intervention could shift student reading habits to more expert-like, we measured students’ (1) motivation for reading PSL, (2) Biology identity, and (3) attitudes toward research.”
BackgroundMethodA cost-free CURE: using bioinformatics to identify DNA-binding factors at a specific genomic locus
Schmidt, C. A., Hodkinson, L. J., Comstra, H. S., Khan, S., Torres, H., & Rieder, L. E. (2023) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00120-23 · Cited by 5
“For example, groups of students might complete a worksheet such as the Figure Facts template (30) that walks through a figure from a primary research article.”
BackgroundPreprint articles as a tool for teaching data analysis and scientific communication
Scheifele, L. Z., Tsotakos, N., & Wolyniak, M. J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0261622 · Cited by 7
Yusof, I. J. B. (2021) · Türk bilgisayar ve matematik eğitimi dergisi · doi:10.17762/turcomat.v12i5.1800 · Cited by 8
Lee, S., Foster, C. R., Zhong, M., Bruce‐Opris, H., Duenas, M., Parente, V., Reid, C., & McCartney, M. L. (2023) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00214-22 · Cited by 6
Using “Research Boxes” to Enhance Understanding of Primary Literature and the Process of Science
Carmichael, J. S., & Allison, L. A. (2019) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v20i2.1743 · Cited by 5
Wise, M. J. (2021) · Teaching and Teacher Education · doi:10.1016/j.tate.2021.103422 · Cited by 9
A case study to engage students in the research design and ethics of high-throughput metagenomics
Alexander, C. C., Gaudier‐Diaz, M. M., Kleinschmit, A. J., Dihle, P. J., Salger, S. A., Vega, N. M., & Robertson, S. D. (2024) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00074-23 · Cited by 4
Using ASM Podcasts to Excite Undergraduate Students about Current Microbiological Research
Lettini, S. E. (2014) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v15i2.796 · Cited by 4
Flowers, S., Holder, K. H., & Gardner, S. M. (2023) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00221-22 · Cited by 6
Bjorn, G. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1257747 · Cited by 6
Brief Training and Intensive Mentoring Guide Postdoctoral Scholars to Student-Centered Instruction
Price, R., Self, C. J., Young, W. C., Klein, E. R., Al‐Noori, S., Ma, E. Y., & DeMarais, A. A. (2021) · CBE—Life Sciences Education · doi:10.1187/cbe.21-03-0083 · Cited by 4
Improving Academic Literacy in the Management Classroom: Are Your Students Lost in Translation?
Taylor, V. F., Stickney, L. T., DeMarr, B. J., & Fender, C. M. (2020) · Management Teaching Review · doi:10.1177/2379298119900156 · Cited by 6
“In contrast, teaching students the skills needed to comprehend scholarly articles may increase reading compliance, help students to think critically (Round & Campbell, 2013), and aid in applying theory and empirical findings to content areas (Hoskins et al., 2007).”
BackgroundCrowdsourcing biocuration: the Community Assessment of Community Annotation with Ontologies (CACAO)Preprint
Ramsey, J., McIntosh, B. K., Renfro, D. P., Aleksander, S., LaBonte, S. A., Ross, C., Zweifel, A. E., Liles, N. M., Farrar, S., Gill, J. J., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.04.30.440339 · Cited by 4
Jablonski, G., & Grinath, A. S. (2023) · CBE—Life Sciences Education · doi:10.1187/cbe.22-11-0218 · Cited by 3
“Previous research has documented that the ways that students engage with the primary literature are varied, and many students feel overwhelmed, anxious, and intimidated by scientific research articles during their entire postsecondary experience (Round and Campbell, 2013).”
BackgroundMethodInfluentialUTILIZATION OF SCHOLARLY JOURNAL ARTICLES IN THE TEACHING AND LEARNING OF TEACHER EDUCATION COURSES
Gaylo, D. N., Caingcoy, M., & Mugot, D. C. (2020) · International Conference on Advances in Education (ADVED) · doi:10.47696/adved.202038 · Cited by 3
“Accordingly, research articles do not only depict the nature of the scientific process, but also train students to evaluate data critically, improve their scientific writing, and follow the most recent advances in research (Round & Campbell, 2013).”
BackgroundInfluentialFeedback and Discourse as a Critical Skill for the Development of Experimentation Competencies
Batzli, J., Harris, M. A., Lee, D. M., & Horn, H. A. (2022) · Contributions from biology education research · doi:10.1007/978-3-030-98592-9_12 · Cited by 3
Palavalli‐Nettimi, R., Fieldsend, T. W., Acosta, A., Catenazzi, A., & McCartney, M. L. (2022) · The American Biology Teacher · doi:10.1525/abt.2022.84.7.428 · Cited by 3
Zhang, J., Kim, H.-J., & Zhang, L. (2023) · Discover Education · doi:10.1007/s44217-023-00067-6 · Cited by 4
“The utilization of primary literature in undergraduate science courses is associated with a range of beneficial outcomes including improved content knowledge [43, 44], data analysis skills [45], critical thinking and experimental design skills [46].”
BackgroundFischer, K. M. (2021) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v22i1.2523 · Cited by 4
Research Literacy Level of Education Postgraduate Research Students using Rasch Measurement Model
(2019) · International Journal of Recent Technology and Engineering (IJRTE) · doi:10.35940/ijrte.c1242.1083s219 · Cited by 3
Vidal, G. S. (2020) · PubMed Central · Cited by 3
Méndez, Y. C. M., Listyg, B. S., Mardones-Segovia, C., Bowers, B., Cotto, K. M. C., Hilton, L., Koscik, I., Outlaw, B., Portner, S., Barekzi, N. A., et al. (2025) · CBE—Life Sciences Education · doi:10.1187/cbe.24-11-0271 · Cited by 3
“Tried-and-tested instructional approaches are available to support this, for both data interpretation and visualization (Angra and Gardner, 2016; 2017; 2018) and analyzing and discussing literature (Hoskins et al. , 2011; Round and Campbell, 2013; Sato et al. , 2014; Beck, 2021).”
CBE—Life Sciences Education: the story of a “great journal scientists might be caught reading”
Dolan, E. L. (2018) · Molecular Biology of the Cell · doi:10.1091/mbc.e18-06-0410 · Cited by 3
Integrating open education practices with data analysis of open science in an undergraduate course
Bakermans, M. H. (2024) · Ecology and Evolution · doi:10.1002/ece3.70129 · Cited by 3
“Others use a data-centric approach where they focus on interpreting data or figures (Hoskins et al., 2007; Hunter & Kovarik, 2022; Round & Campbell, 2013).”
Methodde Lima, M. S., Pozzer, L. L., & Queiroz, S. L. (2024) · Journal of Research in Science Teaching · doi:10.1002/tea.22001 · Cited by 4
Sequential Writing Assignments to Critically Evaluate Primary Scientific Literature
Wood, S. C. (2020) · Collected Essays on Learning and Teaching · doi:10.22329/celt.v13i0.6013 · Cited by 2
“Some particularly useful methods include Figure Facts (Round & Campbell, 2013), CREATE (Hoskins et al., 2007), structured reading questions (Van Camp & Van Camp, 2013), and New York Times style writing assignments (Brownell et al., 2013).”
MethodKao, R. M. (2018) · The American Biology Teacher · doi:10.1525/abt.2018.80.3.228 · Cited by 4
Introducing Immunology Research Literature to Understand B-cell Receptor Gene Expression
Morgan, D. E. (2022) · CourseSource · doi:10.24918/cs.2022.36 · Cited by 2
Grosser, M. R., & Hale, R. E. (2021) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v22i1.2389 · Cited by 2
“We incorporated elements of the “Figure Facts” approach (8) to literature discussion by emphasizing data interpretation over the article’s text narrative (Appendix 1).”
van Breukelen, N. A. (2023) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00177-22 · Cited by 2
“There is much support for the importance of incorporating primary literature in science courses (1), and various techniques can be employed to do so (2, 3).”
BackgroundA Model for a Data Analysis-and Literature-Intensive Undergraduate Course
Resendes, K. K. (2022) · The journal of college science teaching · doi:10.1080/0047231x.2022.12290580 · Cited by 2
A ChatGPT-Assisted Reading Protocol for Undergraduate Research Students
Sambar, M., Vázquez, G. R., Vázquez, A. V., & Vázquez, F. X. (2025) · The Biophysicist · doi:10.35459/tbp.2024.000281 · Cited by 5
An, R., Zhu, W., Zhao, Q., Laaksonen, A., & Lan, S. (2026) · Computers and Education Artificial Intelligence · doi:10.1016/j.caeai.2026.100591 · Cited by 2
Geithner, C. A., & Pollastro, A. N. (2015) · Journal of Applied Research in Higher Education · doi:10.1108/jarhe-04-2014-0053 · Cited by 3
Case Study: Writing a Journal Case Study
Prud’homme‐Généreux, A. (2016) · The journal of college science teaching · doi:10.2505/4/jcst16_045_06_65 · Cited by 1
Academic Literacy Skills of Instructors Teaching Turkish as a Foreign Language
Boylu, E., & Çevik, A. (2022) · International Journal of Education and Literacy Studies · doi:10.7575/aiac.ijels.v.10n.4p.131 · Cited by 2
Helping Students to Metacognitively Read Scientific Literature With Talking to the Text
McGray, H. G., Tour, E., & Tsang, T. K. (2023) · CourseSource · doi:10.24918/cs.2023.28 · Cited by 1
Lammers, A. (2020) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.145239082 · Cited by 1
Building a Laboratory at a Primarily Undergraduate Institution (PUI)Preprint
Dahlberg, C. L., King‐Smith, C., & Riggs, B. (2020) · Preprints.org · doi:10.20944/preprints202012.0221.v1 · Cited by 1
scientific literacy and writing skills Doing peer review and receiving feedback: impact on
Geithner, C. A., & Pollastro, A. N. (2016)
Kao, R. M. (2019) · Preprints.org · doi:10.20944/preprints201912.0236.v1
“In addition, these microlearning tools may be adaptable into existing inclusive and equitable active learning in-class teaching settings (Dewsbury and Brame 2019, Tanner 2007, Tanner 2013), such as figure facts (Round and Campbell 2013).”
BackgroundUsing Student Perceptions and Cooperative Learning to Unpack Primary Literature on Global Change
Forde, J. M. C., & Rugenski, A. T. (2020) · CourseSource · doi:10.24918/cs.2020.35
“We started with one group willing to share one of the boundaries they summarized; this group and all subsequent groups then used assigned group numbers (1-50) to choose another group at random.”
BackgroundMethodAn Approach to Asynchronous Virtual Scientific Paper Discussions
Debbink, K. M. (2021) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v22i1.2333
“However, the discussion part of Figure Facts relies on inperson/synchronous discussion and analysis of the paper, while the approach described here proposes a way to undertake the discussion portion in an asynchronous, online forum, providing greater flexibility for student participation.”
MethodKessler, C., Mazza, W., Christopher, K. J., & Kim, W. (2022) · CourseSource · doi:10.24918/cs.2022.24
PubNavigator as an undergraduate teaching toolPreprint
Marroquín-Flores, R. A., Campbell, M. A., Grimes, S., & Limeri, L. B. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.09.18.558293
How Do Students Interact With the Primary Scientific Literature in an Undergraduate Science Program?
Yi, H., Verkade, H. M., & DRIEL, J. H. V. (2023) · The journal of college science teaching · doi:10.1080/0047231x.2023.12290701 · Cited by 2
Metadata
- Authors
- Round, J. E., & Campbell, A. M.
- Affiliations
- Davidson College (US)
- Corresponding author
- Round, Jennifer E.
- ORCID
- Campbell, A. Malcolm
- Venue
- CBE—Life Sciences Education
- Published
- 2013-03
- Volume
- 12
- Issue
- 1
- Pages
- 39-46
- ISSN
- 1931-7913 (ISSN-L)
- PMC
- PMC3587854
- OpenAlex
- W2152069631
- Cited by
- 110
- References
- 20
- Citations by year
- 2026: 7 · 2025: 4 · 2024: 7 · 2023: 12 · 2022: 15 · 2021: 19 · 2020: 11 · 2019: 10 · 2018: 5 · 2017: 5 · 2016: 9 · 2015: 4 · 2014: 2
- FWCI
- 24.09
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-sa
- Locations
- CBE—Life Sciences Education (publishedVersion, cc-by-nc-sa)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-sa)
- PubMed Central (publishedVersion, cc-by-nc-sa)
- PubMed (publishedVersion)
- Funders
- National Science Foundation (1049768)
- Howard Hughes Medical Institute
- Topics
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Education › Innovative Teaching Methods
- Physical Sciences › Mathematics › Statistics and Probability › Statistics Education and Methodologies
- Keywords
- data interpretation skills, undergraduate biology students, reading comprehension, student frustration, student perceptions
- MeSH terms
- Attitude, Data Collection, Data Interpretation, Statistical, Humans, Neurosciences, Publications, Reading, Statistics as Topic, Students, Time Factors, Program Evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.