CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature
Open accessThe DOI matches its Crossref record; 47 of the 49 references it cites were found in a registry or an index, and 2 are not checked yet; 6 of the 20 sources its claims cite were checked for support.
Abstract
The Consider, Read, Elucidate hypotheses, Analyze and interpret data, Think of the next Experiment (CREATE) strategy for teaching and learning uses intensive analysis of primary literature to improve students' critical-thinking and content integration abilities, as well as their self-rated science attitudes, understanding, and confidence. CREATE also supports maturation of undergraduates' epistemological beliefs about science. This approach, originally tested with upper-level students, has been adapted in Introduction to Scientific Thinking, a new course for freshmen. Results from this course's initial semesters indicate that freshmen in a one-semester introductory course that uses a narrowly focused set of readings to promote development of analytical skills made significant gains in critical-thinking and experimental design abilities. Students also reported significant gains in their ability to think scientifically and understand primary literature. Their perceptions and understanding of science improved, and multiple aspects of their epistemological beliefs about science gained sophistication. The course has no laboratory component, is relatively inexpensive to run, and could be adapted to any area of scientific study.
Verified 2026-11-19 · 2 references not checked yet
Overview
CoChat Summary
## TL;DR
This paper reports a new one-semester CREATE-based freshman course at CCNY that uses analysis of scientific literature to teach scientific thinking. In a pilot study, students showed gains in critical thinking, experimental design, and several attitudes/beliefs about science and scientists.
## Key findings
- Fall CREATE Cornerstone students’ CAT scores improved significantly postcourse versus precourse, with a large effect size of 0.97; the largest gains were on items testing “evaluating and interpreting information.”
- Students in both cohorts showed significant gains on the EDAT, indicating improved experimental design ability; the paper states they cited more components of an “ideal” experimental design postcourse than precourse.
- SAAB results showed significant gains in freshmen’s self-rated skills/attitudes in all six categories and in four of seven epistemological categories.
- In the Spring email-response analysis (n = 15), 14/15 (93%) said they had assumed researchers were “straight-A” students, 13/15 (86%) said the emails changed their preconceptions, and 9/15 (60%) noted that passion mattered more than grades.
## Methods
- The study evaluated a semester-long elective course, Biology 10050: Introduction to Scientific Thinking, taught to first-year CCNY students in Fall 2011 and Spring 2012.
- Participants completed anonymous pre- and postcourse measures: the CAT (Fall cohort), EDAT (both cohorts), and SAAB (both cohorts; pooled SAAB sample 18 Fall + 13 Spring). A contemporaneous upper-level CREATE group (21 students) and a non-CREATE Organismic Biology group (23 students) also completed SAAB for comparison.
- Statistical analyses used Student’s t test for CAT, and Wilcoxon signed-rank tests for EDAT and SAAB; EDAT scoring used a 10-point rubric, and email-response comments were thematically coded.
## Limitations
- The authors explicitly note the small sample size and say the CAT findings must be interpreted with caution.
- The SAAB comparison with the Organismic Biology class was not a matched-control population because those students were not freshmen; this limits causal comparison, as stated in the paper.
- The text also makes evident that the study is a pilot in one institution and that the course and assessment data are anonymous pre/post observational data without random assignment (evident from the methods), so broader generalization is limited.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 0 Not valid · 13 Not checked · 59 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“We also found that undergraduates’ self-assessed science abilities, attitudes, and epistemological beliefs changed during the CREATE semester (Hoskins et al., 2011).”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > BACKGROUND
What the sources say
- Supportedcites Hoskins et al., 2011 matched to “The C.R.E.A.T.E. approach to primary literature shifts undergraduates’ self-assessed ability to read and analyze journal articles, attitudes about science, and epistemological beliefs” (2011) source
The Introduction reports that students’ confidence, attitudes, and epistemological beliefs shifted over the semester. The Discussion section on scientific abilities reports changes in self-rated abilities, and the Results section on epistemological beliefs reports significant pre- to postcourse gains in beliefs and attitudes. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These approaches also build students’ metacognition—the ability to track their own understanding (Tanner, 2012).”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > CURRICULAR DESIGN > CREATE Cornerstone Objectives and Selected Exercises Students learned to use CREATE tools, including concept mapping, paraphrasing, cartooning, annotating figures, applying templates to parse experimental logic, designing follow-up experiments, and participating in grant panels (Hoskins and Stevens, 2009). The CREATE techniques aim to sharpen students’ analytical skills and build critical-reading habits that can be used in new situations. These approaches also build students’ metacognition—the ability to track their own understanding (Tanner, 2012). To construct a concept map successfully, for example, students need to understand individual ideas and discern the relationships between them. To sketch a cartoon that shows what took place in the lab to generate the data presented in a particular figure, students must make sure they understand the relevant methodology. We applied concept mapping and cartooning along with other CREATE tools to a novel combination of readings. Articles selected for Biology 10050 were chosen because of their topicality, relatively simple methodology, and aspects of each that provoked controversy, exemplified the role of controls, and/or highlighted important distinctions between data and their interpretation. Goals for the Cornerstone students included learning: to read with skepticism, to critically analyze data and generate alternative interpretations, to recognize the malleability of scientific knowledge, and to develop and evaluate experiments with particular emphasis on controls and their roles. A final goal was for students to develop a more realistic view of research and researchers than the one often promoted in popular culture.
What the sources say
- Partly supportedcites Tanner, 2012 matched to “Promoting Student Metacognition” (2012) sourceExperimental — accuracy not yet measured
The Introducing Metacognition section defines metacognition in terms of monitoring and evaluating one’s own learning, and Building a Biology Classroom Culture Grounded in Metacognition describes ways to foster those habits. These passages support the definition and the general value of such teaching approaches, but do not establish that CREATE techniques specifically build students’ metacognition. Page numbers are unavailable in our copy. (LLM, conf=0.83)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Changing students’ negative views of researchers/research careers is a likely required first step, if such students are to be inspired to undertake undergraduate research experiences that can lead to research careers (Harrison et al., 2011).”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > DISCUSSION > Themes Highlighted in Readings
What the sources say
- Partly supportedcites Harrison et al., 2011 matched to “Classroom-Based Science Research at the Introductory Level: Changes in Career Choices and Attitude” (2011) sourceExperimental — accuracy not yet measured
The Results (Students Report a Change in Understanding about Research; page unavailable) report more positive attitudes toward science and research after students took a course-based research class. The paper does not establish that changing negative views is a required first step before students will undertake undergraduate research; in this study, the research experience preceded the change in attitudes. (LLM, conf=0.85)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This study shows that a one-semester course aimed at STEM-interested freshmen and focused on scientific literature analysis using the CREATE strategy can produce gains in thinking/design ability as well as epistemological maturation.”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This study shows that a one-semester course aimed at STEM-interested freshmen and focused on scientific literature analysis using the CREATE strategy can produce gains in thinking/design ability as well as epistemological maturation.”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
38 more claims
Create a free account to see all 78 claims and every source verdict.
- Probably not a substantial claim. 19
- It may state two separate claims as one. 19
Citations
Cites
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
At the Threshold: The Developing Adolescent
Feldman, S. S., & Elliott, G. R. (1990) · Cited by 3,226
Talking about Leaving: Why Undergraduates Leave the Sciences
Correll, S. J., Seymour, E., & Hewitt, N. M. (1997) · Contemporary Sociology · doi:10.2307/2655673 · Cited by 3,086
How Learning Works : Seven Research-Based Principles for Smart Teaching
Ambrose, S. A. (2010) · Cited by 2,413
Social evaluation by preverbal infants
Hamlin, J. K., Wynn, K., & Bloom, P. (2007) · Nature · doi:10.1038/nature06288 · Cited by 1,566 · cited 2×
““Social Evaluation by Preverbal Infants” (Hamlin et al., 2007), examines 6- and 10-mo-old babies’ abilities to discriminate between and react to helpful, neutral, and hindering “behaviors” by observed “characters.””
BackgroundAcademically Adrift: Limited Learning on College Campuses
Arum, R., & Roksa, J. (2011) · Cited by 1,457
Academically Adrift: Limited Learning on College Campuses
Conn, S., & Wymore, J. (2012) · Growth: The Journal of the Association for Christians in Student Development · Cited by 1,239
Knowing and reasoning in college: gender-related patterns in students' intellectual development
(1993) · Choice Reviews Online · doi:10.5860/choice.30-6288 · Cited by 1,199
Empathy and pro-social behavior in rats
Bartal, I. B.-A., Decety, J., & Mason, P. (2011) · Science · doi:10.1126/science.1210789 · Cited by 934
Critical Thinking: Why Is It so Hard to Teach?
Willingham, D. T. (2008) · Arts Education Policy Review · doi:10.3200/aepr.109.4.21-32 · Cited by 865
Research works printed but not linked: 8
- American Association for the Advancement of Science Vision and Change in Undergraduate Biology Education 2011 Washington, DC http://visionandchange.org/finalreport (accessed 27 June 2012)
- Angier N Insights from the minds of babes New York Times 1 May 2012 D1
- Arora PN Malhan PK Biostatistics 2010 Mumbai, India: Global Media (eBook accessed 25 September 2012 through CCNY library)
- Bloom BS Englehart MD Furst EJ Hill WH Krathwohl D Taxonomy of Educational Objectives: Cognitive Domain 1956 New York McKay
- Coe R It's the effect size, stupid. what effect size is and why it is important 2002 Paper presented at the British Educational Research Association Annual Conference, 12–14 September 2002, Exeter, UK. www.psych.yorku.ca/mcnelles/documents/ESguide.pdf (accessed 23 September 2012)
- Hoskins SG Meinwald J Hildebrand JG Teaching science for understanding: focusing on who, what and why Science and the Educated American: A Core Component of Liberal Education 2010b American Academy of Sciences Cambridge MA 151 179
- Lindstrom M You love your iPhone. Literally New York Times 1 October 2011 A21
- Perry W Forms of Intellectual Development in the College Years: A Scheme 1970 San Francisco, CA Jossey-Bass
Cited by
The Other Half of the Story: Effect Size Analysis in Quantitative Research
Maher, J. M., Markey, J. C., & Ebert-May, D. (2013) · CBE—Life Sciences Education · doi:10.1187/cbe.13-04-0082 · Cited by 625
“Gottesman and Hoskins (2013) applied Cohen’s d to compare pre/post means of data collected using an instrument measuring students’ critical thinking, experimental design ability, attitudes, and beliefs.”
MethodDomains and predictors of first-year student success: A systematic review
van der Zanden, P. J. A. C., Denessen, E., Cillessen, A. H. N., & Meijer, P. C. (2018) · Educational Research Review · doi:10.1016/j.edurev.2018.01.001 · Cited by 218
“In terms of institutional and organizational variables, it was found that inquiry-based learning environments contributed—with large effect sizes—to first-year students’ critical thinking skills (Gottesman & Hoskins, 2013; Gupta, Burke, Mehta, & Greenbowe, 2015; Hugerat & Kortam, 2014).”
BackgroundActive Learning in Flipped Life Science Courses Promotes Development of Critical Thinking Skills
Styers, M. L., Zandt, P. A. V., & Hayden, K. L. (2018) · CBE—Life Sciences Education · doi:10.1187/cbe.16-11-0332 · Cited by 213
Cargas, S., Williams, S. S., & Rosenberg, M. J. (2017) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2017.05.005 · Cited by 166
Hart, J. L. (2019) · Journal of Teaching and Learning for Graduate Employability · doi:10.21153/jtlge2019vol10no2art827 · Cited by 105
“There is evidence that positive gains can be made for critical thinking skills in science classes in one semester (Gasper & Gardner, 2013; Gottesman & Hoskins, 2013) however the single semester time-frame may not be optimal or realistic for the development of critical thinking skills (Grant &…”
BackgroundStevens, L. M., & Hoskins, S. G. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.13-12-0239 · Cited by 62
“…group of CCNY students in a semester-long physiology course with lab that was not taught using CREATE, those students did not self-assess as having made any significant gains either in the categories above or in any of the epistemological categories discussed below (Gottesman and Hoskins, 2013).”
BackgroundMethodInfluentialSelf-citationBruehl, M., Pan, D., & Ferrer‐Vinent, I. J. (2014) · Journal of Chemical Education · doi:10.1021/ed500412z · Cited by 62
Sato, B. K., Kadandale, P., He, W., Murata, P. M. N., Latif, Y., & Warschauer, M. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.14-02-0025 · Cited by 58
“…one of the most well-documented techniques to improve student primary literature reading abilities in biology education, with data showing that it is beneficial for students in various courses and at different educational levels (Hoskins et al. , 2007; Hoskins, 2008; Gottesman and Hoskins, 2013).”
Development of the Central Dogma Concept Inventory (CDCI) Assessment Tool
Newman, D. L., Snyder, C. W., Fisk, J. N., & Wright, L. K. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-06-0124 · Cited by 60
“Many recent educational reforms (e.g., Cooper and Klymkowsky, 2013; Gottesman and Hoskins, 2013; Couch et al., 2015b; Dolan and Collins, 2015) have focused on strategies that encourage students to employ higher-level cognitive skills such as synthesizing and evaluating problems, rather than…”
BackgroundTeaching students to read the primary literature using pogil activities
Murray, T. A. (2014) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.20765 · Cited by 52
“This type of course has been used successfully at both the advanced [13, 14] and introductory [15] undergraduate levels.”
BackgroundNelms, A. A., & Segura-Totten, M. (2019) · CBE—Life Sciences Education · doi:10.1187/cbe.18-05-0077 · Cited by 50
“Previous studies show that the analysis of research articles increases dimensions of scientific literacy and knowledge of the science process in undergraduate and graduate students (Choe and Drennan, 2001; Hoskins et al., 2007, 2011; Gottesman and Hoskins, 2013; Krontiris-Litowitz, 2013; Round and Campbell, 2013; Abdu…”
BackgroundAnnotated primary scientific literature: A pedagogical tool for undergraduate courses
Kararo, M., & McCartney, M. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000103 · Cited by 47
Abdullah, C., Parris, J., Lie, R., Guzdar, A., & Tour, E. (2015) · CBE—Life Sciences Education · doi:10.1187/cbe.14-10-0180 · Cited by 46
“…the effects of interventions aimed to enhance the skills of experimental design, because these studies were conducted in different levels of classes (introductory and nonmajor) and utilized different assessment methods (Sirum and Humburg, 2011; Gottesman and Hoskins, 2013; Brownell et al., 2014).”
BackgroundMethodResultInfluentialHeim, A. B., & Holt, E. A. (2019) · CBE—Life Sciences Education · doi:10.1187/cbe.18-09-0193 · Cited by 43
“Additionally, self-reported gains in critical-thinking skills by students involved in undergraduate research experiences have also been measured (Gottesman and Hoskins, 2013), though the National Academies of Sciences, Engineering, and Medicine (2017) called attention to the fact that measures of…”
BackgroundHubbard, K. (2021) · Higher Education Pedagogies · doi:10.1080/23752696.2021.1882326 · Cited by 42
“It was originally developed for advanced classes in genetics, but has been adapted in a variety of subjects (Stevens & Hoskins, 2014), including in introductory classes (Gottesman & Hoskins, 2013).”
BackgroundFriesem, Y. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-801873-6.00002-9 · Cited by 62
“Individually, adolescents also used the video production process to explore and play with their identity as Halverson (2010) showed by analyzing a short documentary made by Noeman Samdani who created a media representation of Muslim American teenagers as his own social identity.”
BackgroundMethodTargeting Critical Thinking Skills in a First-Year Undergraduate Research Course
Carson, S. D. B. (2015) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v16i2.935 · Cited by 40
Curriculum Alignment with Vision and Change Improves Student Scientific Literacy
Auerbach, A. J., & Schussler, E. E. (2017) · CBE—Life Sciences Education · doi:10.1187/cbe.16-04-0160 · Cited by 46
“Many researchers call for the inclusion of information literacy skills to enable students to achieve scientific literacy skills (Glynn and Muth, 1994; Firooznia and Andreadis, 2007), and others cite using primary literature as a way to build scientific thinking (Gottesman and Hoskins, 2013).”
BackgroundKenyon, K. L., Onorato, M. E., Gottesman, A. J., Hoque, J., & Hoskins, S. G. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-07-0146 · Cited by 32
“In previous work, CREATE courses produced cognitive and affective gains in students at a diverse group of 4-yr colleges/universities (Hoskins et al., 2007, 2011; Gottesman and Hoskins, 2013; Stevens and Hoskins, 2014).”
BackgroundMethodInfluentialSelf-citationDesign and assessment of online, interactive tutorials that teach science process skills
Kramer, M., Olson, D., & Walker, J. D. (2018) · CBE—Life Sciences Education · doi:10.1187/cbe.17-06-0109 · Cited by 31
“…yielded gains in critical thinking, gains in experimental design, and improved student attitudes about science in a broad range of postsecondary settings from community colleges to graduate programs (Hoskins et al., 2011; Gottesman and Hoskins, 2013; Stevens and Hoskins, 2014; Kenyon et al., 2016).”
BackgroundLie, R., Abdullah, C., He, W., & Tour, E. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-09-0198 · Cited by 29
“Initial interrater reliability for determining Bloom’s levels of the challenges was 0.65 (substantial agreement), while the interrater reliability for lower-order cognitive skills (LOCS) versus higher-order cognitive skills (HOCS) rating of challenges was 0.74 (substantial agreement as defined in Landis and Koch, 1977…”
BackgroundInfluentialAikens, M. L. (2020) · Bulletin of Mathematical Biology · doi:10.1007/s11538-020-00739-6 · Cited by 32
Almulla, M. (2018) · International Journal of Cognitive Research in Science Engineering and Education · doi:10.5937/ijcrsee1803015a · Cited by 28
“Two possible examples of the teaching practices associated with these dimensions are mentoring (one-to-one teaching) and initiating dialogues with the classroom with the aim of encouraging critical thinking (Gottesman and Hoskins, 2013).”
BackgroundZhu, X., Xiong, Z., Zheng, T., Li, L., Zhang, L., & Yang, F. (2020) · Nursing Open · doi:10.1002/nop2.642 · Cited by 46
“It is believed that the STEM education can contribute to increased problem-solving skills, critical thinking and analytical thinking in students and lead to better real-world connection in the curriculum (Gottesman & Hoskins, 2013; Weir et al., 2019).”
BackgroundKelly-Laubscher, R. F., Muna, N., & van der Merwe, M. (2017) · English for Specific Purposes · doi:10.1016/j.esp.2017.05.002 · Cited by 30
Library Value in the Classroom: Assessing Student Learning Outcomes from Instruction and Collections
Pan, D., Ferrer-Vinent, I. J., & Bruehl, M. (2014) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2014.04.011 · Cited by 33
“By doing so, students are being taught how to think like scientists, increase engagement, and could help with retention (Hoskins, Stevens, & Nehm, 2007; Gottesman & Hoskins, 2013).”
BackgroundGoudsouzian, L. K., & Hsu, J. L. (2023) · CBE - Life Sciences Education · doi:10.1187/cbe.22-10-0211 · Cited by 26
“Since then, the authors and others have revised and implemented the CREATE method in different contexts, with many publications discussing modifications of this approach, assessment of students’ cognitive and affective changes, as well as ways to train and support faculty in implementing this technique (Hoskins et al.…”
BackgroundMethodQuantifying Assessment Of Undergraduate Critical Thinking
Grant, M. C., & Smith, M. (2018) · Journal of College Teaching & Learning (TLC) · doi:10.19030/tlc.v15i1.10199 · Cited by 25
“…2012; Gasper & Gardner, 2013); in a science class concentrated on using "a narrowly focused set of readings to promote development of analytical skills" (Gottesman & Hoskins, 2013); and in a class structured around inquiry-driven Web 2.0 instruction activities (Frisch, Jackson, & Murray, 2013).”
BackgroundInfluentialUse of primary literature in the undergraduate analytical class
Kovarik, M. L. (2016) · Analytical and Bioanalytical Chemistry · doi:10.1007/s00216-016-9467-2 · Cited by 23
“A variation of this model, the CREATE method, is based on progressive analysis of a series of papers from the same research laboratory [7, 8].”
MethodInsights on biology student motivations and challenges when reading and analyzing primary literature
Howard, K. N., Stapleton, E. K., Nelms, A. A., Ryan, K. C., & Segura-Totten, M. (2021) · PLOS ONE · doi:10.1371/journal.pone.0251275 · Cited by 23
“It is popular because it develops important skills in undergraduates, like critical thinking, data interpretation and scientific thinking [4, 5, 7, 8, 51].”
BackgroundViews from academia and industry on skills needed for the modern research environment
Talgar, C. P., & Goodey, N. M. (2015) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.20883 · Cited by 21
“all of which emphasize the experiential component of education [4, 5].”
BackgroundTrujillo, C. M., Anderson, T. R., & Pelaez, N. J. (2016) · CBE—Life Sciences Education · doi:10.1187/cbe.15-03-0051 · Cited by 19
“Alternatively, an instructor may structure a curriculum with other approaches to encourage students to consider data and experiments, such as with the CREATE structure of Gottesman and Hoskins (2013). For Petunia, an emergent difficulty was observed, since she included all the MACH components after the intervention bu…”
MethodUndergraduate Science Students’ Attitudes Toward and Approaches to Scientific Reading and Writing
Verkade, H. M., & Lim, S. H. (2016) · The journal of college science teaching · doi:10.2505/4/jcst16_045_04_83 · Cited by 20
Training doctoral students in critical thinking and experimental design using problem-based learning
Schaller, M. D., Gencheva, M., Gunther, M. R., & Weed, S. A. (2023) · BMC Medical Education · doi:10.1186/s12909-023-04569-7 · Cited by 44
“Additional measures to assess the course goals in improving critical thinking, experimental design and self-efficacy in experimental design will be implemented using validated tests [22, 43–45].”
BackgroundMethodInvestigating Undergraduates’ Perceptions of Science in Courses Taught Using the CREATE Strategy
Hoskins, S. G., & Gottesman, A. J. (2018) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v19i1.1440 · Cited by 23
“We reported previously that first-year CREATE students made significant gains on the Critical-thinking Assessment Test (CAT) across a semester (10).”
BackgroundMethodResultInfluentialSelf-citationKenyon, K. L., Cosentino, B. J., Gottesman, A. J., Onorato, M. E., Hoque, J., & Hoskins, S. G. (2019) · BioScience · doi:10.1093/biosci/biy145 · Cited by 18
Self-citationMaking Primary Literature Come Alive in the Classroom.
Ak, H., Borchardt, J., & Bozer, A. L. H. (2017) · PubMed · Cited by 16
Exploring Science Literature: Integrating Chemistry Research with Chemical Education
Reyes, R. L. (2023) · Journal of Chemical Education · doi:10.1021/acs.jchemed.3c00101 · Cited by 16
Hoskins, S. G., & Krufka, A. (2015) · Microbe Magazine · doi:10.1128/microbe.10.108.1 · Cited by 18
Self-citationMini-review: CREATE-ive use of primary literature in the science classroom
Pugh-Bernard, A. E., & Kenyon, K. L. (2020) · Neuroscience Letters · doi:10.1016/j.neulet.2020.135532 · Cited by 14
Hunter, R. A., & Kovarik, M. L. (2022) · Journal of Chemical Education · doi:10.1021/acs.jchemed.1c00920 · Cited by 18
Lo, S. M., Luu, T. B., & Tran, J. (2020) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v21i1.1881 · Cited by 15
Feinkohl, I., Flemming, D., Creß, U., & Kimmerle, J. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4382 · Cited by 14
“Previously, scientific literacy, epistemological beliefs, and academic self-efficacy have all been associated with the ability to apply critical thinking in traditional psychological experiments [22,39,40].”
Think Before (and After) You Speak: Practice and Self-Reflection Bolster Oral Communication Skills
Sterling, E. J., Bravo, A., Porzecanski, A. L., Burks, R. L., Linder, J. M., Langen, T. A., Fernández, D. S., Ruby, D., & Bynum, N. (2016) · The journal of college science teaching · doi:10.2505/4/jcst16_045_06_87 · Cited by 18
Shanks, R. A., Robertson, C. L., Haygood, C. S., Herdliksa, A. M., Herdliska, H. R., & Lloyd, S. A. (2017) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v18i1.1194 · Cited by 18
Kuxhaus, L., & Corbiere, N. C. (2016) · Journal of Biomechanical Engineering · doi:10.1115/1.4032802 · Cited by 12
Holtzman, M. (2017) · Teaching Sociology · doi:10.1177/0092055x17729871 · Cited by 12
Krufka, A., Kenyon, K. L., & Hoskins, S. G. (2020) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v21i1.1905 · Cited by 14
“Students in CREATE courses have made a variety of cognitive and affective gains, in first-year (19, 20) and upper-level electives (18, 21) at a minorityserving institution, as well as in a variety of four-year (22, 23) and two-year (24) college/university settings.”
Self-citationSharing Notes Is Encouraged: Annotating and Cocreating with Hypothes.is and Google Docs †
Goller, C., Vandegrift, M., Cross, W., & Smyth, D. S. (2021) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v22i1.2135 · Cited by 14
Bodnar, R. J., Rotella, F. M., Loiacono, I., Coke, T., Olsson, K., Barrientos, A. C., Blachorsky, L., Warshaw, D., Buras, A., Sanchez, C. M., et al. (2016) · Europe PMC (PubMed Central) · Cited by 11
A Longitudinal Study Exploring Motivation Factors in Cornerstone and Capstone Design Courses
Kames, E., Shah, D., & Morkos, B. W. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--29692 · Cited by 11
Chatzikyriakidou, K., & McCartney, M. (2022) · International Journal of Science Education · doi:10.1080/09500693.2022.2073482 · Cited by 10
“PSL has also been shown to promote the development of creativity through study design assignments (Gottesman et al., 2013; Hoskins et al., 2007).”
BackgroundYang, F. (2015) · Springer eBooks · doi:10.1007/978-981-287-472-6_6 · Cited by 16
Using Case Studies to Promote Student Engagement in Primary Literature Data Analysis and Evaluation.
Cook-Snyder, D. R. (2017) · PubMed · Cited by 10
Exploring Primary Scientific Literature through the Lens of the 5 Core Concepts of Biology
Chatzikyriakidou, K., Manrique, C., Tacloban, M. J., & McCartney, M. L. (2021) · CourseSource · doi:10.24918/cs.2021.5 · Cited by 10
Case Study: An Introduction to Biological Research Course for Undergraduate Biology Students
Schmid, K. M., & Wiles, J. R. (2019) · The journal of college science teaching · doi:10.2505/4/jcst19_049_01_48 · Cited by 11
Primary Literature in Undergraduate Science Courses: What are the Outcomes?
Sloane, J. D. (2021) · Journal of College Science Teaching · doi:10.1080/0047231x.2021.12290508 · Cited by 9
“Scores on an Experimental Design Ability Test (EDAT) also improved significantly for the first-year students from pre- to postsemester (Gottesman & Hoskins, 2013).”
BackgroundMethodInfluentialKulkarni, A., & Vartak, R. (2019) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21281 · Cited by 11
“” In this approach, students read four consecutive publications (from the same biology research laboratory) over the course of a semester [3, 14].”
BackgroundHoskins, S. G., Gottesman, A. J., & Kenyon, K. L. (2017) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.v18i3.1365 · Cited by 9
“b Teaching notes in Gottesman and Hoskins, 2013 (38).”
BackgroundMethodSelf-citationHow do Chinese undergraduates understand critical thinking? A phenomenographic approach
Zhao, X., & Liu, X. (2022) · Frontiers in Education · doi:10.3389/feduc.2022.956428 · Cited by 11
“Researchers also endeavor to measure critical thinking skills, which heavily relies on standardized multiple-choice tests (Larsson, 2017).”
BackgroundUsing CREATE and Scientific Literature to Teach Chemistry
Perla, A. A., Hollar, S. M., Muzikar, K. A., & Liu, J. M. (2023) · Journal of Chemical Education · doi:10.1021/acs.jchemed.2c00781 · Cited by 11
Just Figures: A Method to Introduce Students to Data Analysis One Figure at a Time
Massimelli, J., Denaro, K., Sato, B., Kadandale, P., & Boury, N. (2019) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe..v20i2.1690 · Cited by 8
Beck, C. W. (2019) · CourseSource · doi:10.24918/cs.2019.25 · Cited by 9
“Similar effects were found in an introductory level course, in addition to gains in experimental design skills (16).”
ResultFerenc, J., Červenák, F., Birčák, E., Juríková, K., Goffová, I., Gorilák, P., Huraiová, B., Plavá, J., Demecsová, L., Ďuríková, N., et al. (2017) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21084 · Cited by 6
“For example, a so-called CREATE strategy is based on reading, sequentially, a series of papers published by a single laboratory, an approach that tracks the development of understanding in a particular scientific field [3].”
BackgroundGoodwin, E. C., Shapiro, C. A., Freise, A. C., Toven‐Lindsey, B., & Parker, J. M. (2023) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00055-23 · Cited by 10
Lee, S., Zhong, M., Foster, C., Segura-Totten, M., & McCartney, M. (2022) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.00126-22 · Cited by 7
Washburn, M. E., Shanks, R. A., McCartney, M. L., Robertson, C. L., & Segura‐Totten, M. (2023) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00154-22 · Cited by 14
Participation in Biology Education Research Influences Students’ Epistemic Development
Lee, D. M., Wright, M., Faber, C. J., Kennedy, C., & Dittrich-Reed, D. R. (2021) · CBE—Life Sciences Education · doi:10.1187/cbe.20-11-0255 · Cited by 8
“…from community college students, first-year students, and advanced students in 4-year colleges exhibited enhanced understanding of science epistemology after exposure to pedagogy involving analysis of scientific literature (Hoskins et al., 2011; Gottesman and Hoskins, 2013; Kenyon et al., 2016).”
BackgroundApplying a Linked-Course Model to Foster Inquiry & Integration in Large First Year Courses
Husband, B. C. (2015) · Canadian Journal of Higher Education · doi:10.47678/cjhe.v45i4.184783 · Cited by 6
Chatzikyriakidou, K., Tacloban, M. J., Concepcion, K., & McCartney, M. L. (2022) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00059-22 · Cited by 8
Using primary literature on SARS‐CoV‐2 to promote student learning about evolution
Hsu, J. L. (2020) · Ecology and Evolution · doi:10.1002/ece3.6501 · Cited by 6
“…of the next experiment) model, a published pedagogical technique for guiding students through reading primary literature that has been shown to increase student understanding and comprehension of the papers (Gottesman & Hoskins, 2013; Hoskins, Lopatto, & Stevens, 2011; Stevens & Hoskins, 2014).”
MethodReading Research for Writing: Co-Constructing Core Skills Using Primary Literature
Bjorn, G., Quaynor, L., & Burgasser, A. J. (2022) · Impacting Education Journal on Transforming Professional Practice · doi:10.5195/ie.2022.237 · Cited by 9
“…critical thinking skills using “think like a scientist” methods, such as the CREATE method that focuses on a learning sequence, Consider, Read, Elucidate hypotheses, Analyze and interpret data, Think of the next Experiment (Gottesman & Hoskins, 2013; Hoskins et al., 2007; Kararo & McCartney, 2019).”
MethodLarripa, K., & Mazzag, B. (2015) · PRIMUS · doi:10.1080/10511970.2015.1104524 · Cited by 5
Grindle, N., Jones, E., & Northrop, P. (2021) · Teaching Mathematics and its Applications: An International Journal of the IMA · doi:10.1093/teamat/hraa001 · Cited by 5
Using “Research Boxes” to Enhance Understanding of Primary Literature and the Process of Science
Carmichael, J. S., & Allison, L. A. (2019) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v20i2.1743 · Cited by 5
Wise, M. J. (2021) · Teaching and Teacher Education · doi:10.1016/j.tate.2021.103422 · Cited by 9
Using ASM Podcasts to Excite Undergraduate Students about Current Microbiological Research
Lettini, S. E. (2014) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v15i2.796 · Cited by 4
Raimondi, S. L., Marsh, T. L., & Guenther, M. F. (2020) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v21i1.2007 · Cited by 6
Teaching Science Students How to Think
McBain, B., Yardy, A., Martin, F. H., Phelan, L., van Altena, I., McKeowen, J., Pemberton, C., Tose, H., Fratus, L., & Bowyer, M. C. (2021) · International Journal of Innovation in Science and Mathematics Education · doi:10.30722/ijisme.28.02.003 · Cited by 12
“Implications for best practice science teaching Both the literature (Dowd et al., 2018; Gottersman & Hoskins, 2017; Rowe et al., 2015; Zimbardi et al., 2018) and the evaluation of this subject indicate that subjects in which students are taught about high quality scientific thinking and scientific…”
BackgroundGarzke, J., & Steinwand, B. (2024) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00079-23 · Cited by 3
“Specifically, CREATE activities help students cultivate the skills of scientists, improve students’ attitudes and beliefs about the nature of science, and increase students’confidence in their ability to do science (7, 9, 11–13).”
BackgroundMethodUTILIZATION OF SCHOLARLY JOURNAL ARTICLES IN THE TEACHING AND LEARNING OF TEACHER EDUCATION COURSES
Gaylo, D. N., Caingcoy, M., & Mugot, D. C. (2020) · International Conference on Advances in Education (ADVED) · doi:10.47696/adved.202038 · Cited by 3
“…articles are used also for content delivery (Swan & Locascio, 2008), for research purposes (Madhusudhan, 2008), to enhance student learning in high school and college courses (Grant, Gradwell, & Cimbricz, 2004) and increasing the critical thinking skills of the students (Gottesman & Hoskins, 2013).”
MethodA Modified CREATE Approach for Introducing Primary Literature Into Psychological Sciences Courses
Bozer, A. L. H. (2022) · Teaching of Psychology · doi:10.1177/00986283211049400 · Cited by 3
“In line with previous research (Beck, 2019; Gottesman & Hoskins, 2013; Hoskins et al., 2011), there were significant increases over time (pre- to post-survey) in self-reported student perceptions of primary literature regarding the CREATE factors decoding primary literature, interpreting data,…”
BackgroundResultPalavalli‐Nettimi, R., Fieldsend, T. W., Acosta, A., Catenazzi, A., & McCartney, M. L. (2022) · The American Biology Teacher · doi:10.1525/abt.2022.84.7.428 · Cited by 3
Zhang, J., Kim, H.-J., & Zhang, L. (2023) · Discover Education · doi:10.1007/s44217-023-00067-6 · Cited by 4
Using Primary Research Literature to Teach Critical Thinking in Pre-Service Teacher Education
Wei, W., Hudson, M., & Cook, A. E. (2018) · Advances in higher education and professional development book series · doi:10.4018/978-1-5225-7823-9.ch022 · Cited by 4
Fischer, K. M. (2021) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v22i1.2523 · Cited by 4
“This method was used in several science undergraduate single-semester courses to help students when reading and analyzing journal articles (2, 11, 13).”
MethodRodriguez, N. J. N. (2013) · Problems of Education in the 21st Century · doi:10.33225/pec/13.52.105 · Cited by 3
Hoskins, S. G., & Kenyon, K. L. (2014) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.v15i1.725 · Cited by 3
Self-citationCole, M. F., & Beck, C. W. (2022) · Contributions from biology education research · doi:10.1007/978-3-030-98592-9_3 · Cited by 2
Macea-Anaya, M., Jumbo, J. J. C., & Baena-Navarro, R. (2024) · Seminars in Medical Writing and Education · doi:10.56294/mw202485 · Cited by 12
Romaní, F., & Gutiérrez, C. A. (2023) · Investigación en Educación Médica · doi:10.22201/fm.20075057e.2023.45.22455 · Cited by 3
Pimiento, C. (2015) · Evolution Education and Outreach · doi:10.1186/s12052-015-0046-3 · Cited by 2
“These interactions with experts can result in gains in students’ science interest (Gottesman and Hoskins 2013).”
BackgroundImpact of the Siena College Tech Valley Scholars Program on Student Outcomes
Medsker, L., Allard, L., Tucker, L. J., O'Donnell, J. L., Sterne‐Marr, R., Bannon, J., Finn, R., & Weatherwax, A. T. (2016) · Journal of STEM education · Cited by 6
Replicating or franchising a STEM afterschool program model: core elements of programmatic integrity
Stevenson, N., Sommers, A. S., Grandgenett, N. F., Tapprich, W. E., McQuillan, J., Phillips, M., Jensen, R., & Cutucache, C. E. (2022) · International Journal of STEM Education · doi:10.1186/s40594-021-00320-0 · Cited by 2
“…not an easy institutional task; despite an emphasis on retention in higher education, many post-secondary students struggle to complete a degree in STEM fields (American Association for the Advancement of Science, 2011; Dolan, 2017; Eddy & Hogan, 2014; Egenrieder, 2010; Gottesman & Hoskins, 2013).”
BackgroundIntroducing Immunology Research Literature to Understand B-cell Receptor Gene Expression
Morgan, D. E. (2022) · CourseSource · doi:10.24918/cs.2022.36 · Cited by 2
“Finally, introducing research literature to an undergraduate course not only improves students’ ability to read and interpret research articles, it can change their perceptions of science identity and self-efficacy, and benefits a diverse set of students (8, 29, 30), suggesting that the introduction of research litera…”
BackgroundStocker, A. M., & Duncan, C. S. (2024) · Frontiers in Education · doi:10.3389/feduc.2024.1454788 · Cited by 2
Thieu, M. K., Foo, J. C., & Marvin, C. B. (2022) · The journal of college science teaching · doi:10.1080/0047231x.2022.12290554 · Cited by 1
Pearson, Y., Kruzic, A. P., Mattingly, S., Rahman, Z., & Frost, H. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--20721 · Cited by 1
Kim, Y. (2020) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--35625 · Cited by 1
“) method.(13)The instructor provided the students with feedback and comments at various stages of this problem-solving process to provide guidance as a facilitator rather than as a didactic instructor or source of knowledge.”
BackgroundDickson, K. A., & Stephens, B. W. (2015) · Victoria University Research Repository (Victoria University) · Cited by 2
Metadata
- Authors
- Gottesman, A. J., & Hoskins, S. G.
- Affiliations
- The Graduate Center, CUNY (US)
- Corresponding author
- Hoskins, Sally G.
- Venue
- CBE—Life Sciences Education
- Published
- 2013-03
- Volume
- 12
- Issue
- 1
- Pages
- 59-72
- ISSN
- 1931-7913 (ISSN-L)
- PMC
- PMC3587857
- OpenAlex
- W2165168316
- Cited by
- 123
- References
- 47
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 6 · 2023: 10 · 2022: 14 · 2021: 10 · 2020: 13 · 2019: 11 · 2018: 8 · 2017: 11 · 2016: 12 · 2015: 9 · 2014: 6 · 2013: 3
- FWCI
- 48.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-sa
- Locations
- CBE—Life Sciences Education (publishedVersion, cc-by-nc-sa)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-sa)
- PubMed Central (publishedVersion, cc-by-nc-sa)
- PubMed (publishedVersion)
- CUNY Academic Works (City University of New York) (submittedVersion, cc-by-nc-sa)
- Funders
- National Science Foundation (0942790)
- Carnegie Corporation of New York
- Tennessee Tech University
- Division of Undergraduate Education
- Topics
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Education › Education and Critical Thinking Development
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Keywords
- scientific thinking, critical thinking, epistemological beliefs, experimental design, attitudes toward science, undergraduate STEM education, scientific literacy
- MeSH terms
- Curriculum, Educational Measurement, Engineering, Humans, Mathematics, Publications, Science, Students, Technology, Thinking, Electronic Mail
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.