CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature
Open accessThe DOI matches its Crossref record; 47 of the 49 references it cites were found in a registry or an index, and 2 are not checked yet; 6 of the 20 sources its claims cite were checked for support.
Abstract
The Consider, Read, Elucidate hypotheses, Analyze and interpret data, Think of the next Experiment (CREATE) strategy for teaching and learning uses intensive analysis of primary literature to improve students' critical-thinking and content integration abilities, as well as their self-rated science attitudes, understanding, and confidence. CREATE also supports maturation of undergraduates' epistemological beliefs about science. This approach, originally tested with upper-level students, has been adapted in Introduction to Scientific Thinking, a new course for freshmen. Results from this course's initial semesters indicate that freshmen in a one-semester introductory course that uses a narrowly focused set of readings to promote development of analytical skills made significant gains in critical-thinking and experimental design abilities. Students also reported significant gains in their ability to think scientifically and understand primary literature. Their perceptions and understanding of science improved, and multiple aspects of their epistemological beliefs about science gained sophistication. The course has no laboratory component, is relatively inexpensive to run, and could be adapted to any area of scientific study.
Verified 2026-11-19 · 2 references not checked yet
Overview
CoChat Summary
## TL;DR
This paper reports a new one-semester CREATE-based freshman course at CCNY that uses analysis of scientific literature to teach scientific thinking. In a pilot study, students showed gains in critical thinking, experimental design, and several attitudes/beliefs about science and scientists.
## Key findings
- Fall CREATE Cornerstone students’ CAT scores improved significantly postcourse versus precourse, with a large effect size of 0.97; the largest gains were on items testing “evaluating and interpreting information.”
- Students in both cohorts showed significant gains on the EDAT, indicating improved experimental design ability; the paper states they cited more components of an “ideal” experimental design postcourse than precourse.
- SAAB results showed significant gains in freshmen’s self-rated skills/attitudes in all six categories and in four of seven epistemological categories.
- In the Spring email-response analysis (n = 15), 14/15 (93%) said they had assumed researchers were “straight-A” students, 13/15 (86%) said the emails changed their preconceptions, and 9/15 (60%) noted that passion mattered more than grades.
## Methods
- The study evaluated a semester-long elective course, Biology 10050: Introduction to Scientific Thinking, taught to first-year CCNY students in Fall 2011 and Spring 2012.
- Participants completed anonymous pre- and postcourse measures: the CAT (Fall cohort), EDAT (both cohorts), and SAAB (both cohorts; pooled SAAB sample 18 Fall + 13 Spring). A contemporaneous upper-level CREATE group (21 students) and a non-CREATE Organismic Biology group (23 students) also completed SAAB for comparison.
- Statistical analyses used Student’s t test for CAT, and Wilcoxon signed-rank tests for EDAT and SAAB; EDAT scoring used a 10-point rubric, and email-response comments were thematically coded.
## Limitations
- The authors explicitly note the small sample size and say the CAT findings must be interpreted with caution.
- The SAAB comparison with the Organismic Biology class was not a matched-control population because those students were not freshmen; this limits causal comparison, as stated in the paper.
- The text also makes evident that the study is a pilot in one institution and that the course and assessment data are anonymous pre/post observational data without random assignment (evident from the methods), so broader generalization is limited.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 0 Not valid · 13 Not checked · 59 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“We also found that undergraduates’ self-assessed science abilities, attitudes, and epistemological beliefs changed during the CREATE semester (Hoskins et al., 2011).”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > BACKGROUND
What the sources say
- Supportedcites Hoskins et al., 2011 matched to “The C.R.E.A.T.E. approach to primary literature shifts undergraduates’ self-assessed ability to read and analyze journal articles, attitudes about science, and epistemological beliefs” (2011) source
The Introduction reports that students’ confidence, attitudes, and epistemological beliefs shifted over the semester. The Discussion section on scientific abilities reports changes in self-rated abilities, and the Results section on epistemological beliefs reports significant pre- to postcourse gains in beliefs and attitudes. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These approaches also build students’ metacognition—the ability to track their own understanding (Tanner, 2012).”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > CURRICULAR DESIGN > CREATE Cornerstone Objectives and Selected Exercises Students learned to use CREATE tools, including concept mapping, paraphrasing, cartooning, annotating figures, applying templates to parse experimental logic, designing follow-up experiments, and participating in grant panels (Hoskins and Stevens, 2009). The CREATE techniques aim to sharpen students’ analytical skills and build critical-reading habits that can be used in new situations. These approaches also build students’ metacognition—the ability to track their own understanding (Tanner, 2012). To construct a concept map successfully, for example, students need to understand individual ideas and discern the relationships between them. To sketch a cartoon that shows what took place in the lab to generate the data presented in a particular figure, students must make sure they understand the relevant methodology. We applied concept mapping and cartooning along with other CREATE tools to a novel combination of readings. Articles selected for Biology 10050 were chosen because of their topicality, relatively simple methodology, and aspects of each that provoked controversy, exemplified the role of controls, and/or highlighted important distinctions between data and their interpretation. Goals for the Cornerstone students included learning: to read with skepticism, to critically analyze data and generate alternative interpretations, to recognize the malleability of scientific knowledge, and to develop and evaluate experiments with particular emphasis on controls and their roles. A final goal was for students to develop a more realistic view of research and researchers than the one often promoted in popular culture.
What the sources say
- Partly supportedcites Tanner, 2012 matched to “Promoting Student Metacognition” (2012) sourceExperimental — accuracy not yet measured
The Introducing Metacognition section defines metacognition in terms of monitoring and evaluating one’s own learning, and Building a Biology Classroom Culture Grounded in Metacognition describes ways to foster those habits. These passages support the definition and the general value of such teaching approaches, but do not establish that CREATE techniques specifically build students’ metacognition. Page numbers are unavailable in our copy. (LLM, conf=0.83)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Changing students’ negative views of researchers/research careers is a likely required first step, if such students are to be inspired to undertake undergraduate research experiences that can lead to research careers (Harrison et al., 2011).”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > DISCUSSION > Themes Highlighted in Readings
What the sources say
- Partly supportedcites Harrison et al., 2011 matched to “Classroom-Based Science Research at the Introductory Level: Changes in Career Choices and Attitude” (2011) sourceExperimental — accuracy not yet measured
The Results (Students Report a Change in Understanding about Research; page unavailable) report more positive attitudes toward science and research after students took a course-based research class. The paper does not establish that changing negative views is a required first step before students will undertake undergraduate research; in this study, the research experience preceded the change in attitudes. (LLM, conf=0.85)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This study shows that a one-semester course aimed at STEM-interested freshmen and focused on scientific literature analysis using the CREATE strategy can produce gains in thinking/design ability as well as epistemological maturation.”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This study shows that a one-semester course aimed at STEM-interested freshmen and focused on scientific literature analysis using the CREATE strategy can produce gains in thinking/design ability as well as epistemological maturation.”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
38 more claims
Create a free account to see all 78 claims and every source verdict.
- Probably not a substantial claim. 19
- It may state two separate claims as one. 19
Citations
Cites
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
At the Threshold: The Developing Adolescent
Feldman, S. S., & Elliott, G. R. (1990) · Cited by 3,226
Talking about Leaving: Why Undergraduates Leave the Sciences
Correll, S. J., Seymour, E., & Hewitt, N. M. (1997) · Contemporary Sociology · doi:10.2307/2655673 · Cited by 3,086
How Learning Works : Seven Research-Based Principles for Smart Teaching
Ambrose, S. A. (2010) · Cited by 2,413
Social evaluation by preverbal infants
Hamlin, J. K., Wynn, K., & Bloom, P. (2007) · Nature · doi:10.1038/nature06288 · Cited by 1,566 · cited 2×
““Social Evaluation by Preverbal Infants” (Hamlin et al., 2007), examines 6- and 10-mo-old babies’ abilities to discriminate between and react to helpful, neutral, and hindering “behaviors” by observed “characters.””
BackgroundAcademically Adrift: Limited Learning on College Campuses
Arum, R., & Roksa, J. (2011) · Cited by 1,457
Academically Adrift: Limited Learning on College Campuses
Conn, S., & Wymore, J. (2012) · Growth: The Journal of the Association for Christians in Student Development · Cited by 1,239
Knowing and reasoning in college: gender-related patterns in students' intellectual development
(1993) · Choice Reviews Online · doi:10.5860/choice.30-6288 · Cited by 1,199
Empathy and pro-social behavior in rats
Bartal, I. B.-A., Decety, J., & Mason, P. (2011) · Science · doi:10.1126/science.1210789 · Cited by 934
Critical Thinking: Why Is It so Hard to Teach?
Willingham, D. T. (2008) · Arts Education Policy Review · doi:10.3200/aepr.109.4.21-32 · Cited by 865
Research works printed but not linked: 8
- American Association for the Advancement of Science Vision and Change in Undergraduate Biology Education 2011 Washington, DC http://visionandchange.org/finalreport (accessed 27 June 2012)
- Angier N Insights from the minds of babes New York Times 1 May 2012 D1
- Arora PN Malhan PK Biostatistics 2010 Mumbai, India: Global Media (eBook accessed 25 September 2012 through CCNY library)
- Bloom BS Englehart MD Furst EJ Hill WH Krathwohl D Taxonomy of Educational Objectives: Cognitive Domain 1956 New York McKay
- Coe R It's the effect size, stupid. what effect size is and why it is important 2002 Paper presented at the British Educational Research Association Annual Conference, 12–14 September 2002, Exeter, UK. www.psych.yorku.ca/mcnelles/documents/ESguide.pdf (accessed 23 September 2012)
- Hoskins SG Meinwald J Hildebrand JG Teaching science for understanding: focusing on who, what and why Science and the Educated American: A Core Component of Liberal Education 2010b American Academy of Sciences Cambridge MA 151 179
- Lindstrom M You love your iPhone. Literally New York Times 1 October 2011 A21
- Perry W Forms of Intellectual Development in the College Years: A Scheme 1970 San Francisco, CA Jossey-Bass
Cited by
Items 101–126 of 126
Eggo, A. (2017) · TSpace (University of Toronto)
Online, Interactive Tutorials Provide Effective Instruction in Science Process SkillsPreprint
Kramer, M., Olson, D. M., & Walker, J. D. (2017) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/153015
“…yielded gains in critical thinking, gains in experimental design, and improved student attitudes about science in a broad range of postsecondary settings, from community colleges to graduate programs (Hoskins et al., 2011; Gottesman & Hoskins, 2013; Stevens & Hoskins, 2014; Kenyon et al., 2016).”
Incorporating Research Into Courses
Rovenolt, F. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-814702-3.00011-1
Nugent, M. L. (2019) · NCSU Libraries Repository (North Carolina State University Libraries) · Cited by 1
A Composite Textual Phenomenological Approach to CUREs versus Traditional Laboratory Experiences
Sommers, A. S., Richter-Egger, D. L., & Cutucache, C. E. (2021) · The Qualitative Report · doi:10.46743/2160-3715/2021.4454 · Cited by 1
Chatzikyriakidou, K., & McCartney, M. L. (2022) · Contributions from biology education research · doi:10.1007/978-3-030-98592-9_4 · Cited by 2
Garzke, J., & Steinwand, B. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.11.14.516496
“It also 92 differed from the CREATE Cornerstone approach for first-years (7), in which students analyzed a pair of popular 93 press articles on the same subject.”
BackgroundHow Do Students Interact With the Primary Scientific Literature in an Undergraduate Science Program?
Yi, H., Verkade, H. M., & DRIEL, J. H. V. (2023) · The journal of college science teaching · doi:10.1080/0047231x.2023.12290701 · Cited by 2
Peer-reviewed presentation exchange in an undergraduate classroom
Kiselyov, K. I., & Schunn, C. D. (2024) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00067-23 · Cited by 3
“C.R.E.A.T.E. ( consider, read, elucidate hypothesis, analyze and interpret data, think of the next experiment), which is a teaching strategy involving detailed analysis of primary research literature, may address some of these challenges (10, 11).”
BackgroundSchaller, M. D., Gencheva, M., Gunther, M. R., & Weed, S. A. (2023) · Figshare · doi:10.6084/m9.figshare.23972799
Schaller, M. D., Gencheva, M., Gunther, M. R., & Weed, S. A. (2023) · Figshare · doi:10.6084/m9.figshare.23972796
Schaller, M. D., Gencheva, M., Gunther, M. R., & Weed, S. A. (2023) · Figshare · doi:10.6084/m9.figshare.23972805
Schaller, M. D., Gencheva, M., Gunther, M. R., & Weed, S. A. (2023) · Figshare · doi:10.6084/m9.figshare.23972802
Fostering student authorship skills in synthetic biology
Roberts, L. A., & Farny, N. G. (2024) · Frontiers in Bioengineering and Biotechnology · doi:10.3389/fbioe.2024.1409763
The Capability Approach: Addressing learners' ability to pursue STEM interests and careers.
Polito, F. (2024) · doi:10.31274/td-20240617-65 · Cited by 1
Hannah, R. M., & Schaefer, J. E. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1481415 · Cited by 1
Rapid Prototyping Bridging Research and Industry in Silicon Photonics
Rani, J. (2025) · IGI Global eBooks · doi:10.4018/979-8-3373-0533-2.ch013
Strategies for navigating primary scientific literature in undergraduate immunology courses
Bergerson, R. J., Basta, H. A., Coleman, S. T., & Pandey, S. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1606578
Palka, M. V., Clarkston, B. E., & Steinwand, B. (2025) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00160-25 · Cited by 1
Suart, C., Zubyk, H. L., Ogrodnik, M., Mullarkey, C. E., & Vulcu, F. (2025) · FEBS Open Bio · doi:10.1002/2211-5463.70145 · Cited by 1
“Analysis of the SAAB instrument data followed protocols described by Hoskins and colleagues [27,28].”
InfluentialKong, Q., & Ye, J. (2026) · Journal of Chemical Education · doi:10.1021/acs.jchemed.5c01308
Montague, S. A. (2026) · The American Biology Teacher · doi:10.1525/abt.2026.88.6.333
Casey, J. R., Babu, D., Beurskens, M., Todorovska, M., & Boersma, A. J. (2026) · Journal of Microbiology and Biology Education · doi:10.1128/jmbe.00322-25
“After using CREATE, students tend to show a better understanding of scientific processes (14), including improved experimental design skills (12, 19).”
InfluentialWang, H., Zhou, X.-R., Zhang, W.-H., Sun, L.-H., Wu, G.-F., Kong, W.-B., Liang, J.-Y., Qiao, L., & Zhang, W. (2026) · Journal of Chemical Education · doi:10.1021/acs.jchemed.6c00718
Fankhauser, S. C., McDowell, G. S., Balgopal, M., & Lijek, R. S. (2026) · Journal of Microbiology & Biology Education · doi:10.1128/jmbe.00172-26
“For students who have limited experience with reading papers, this curriculum could be preceded by other curricula designed to introduce undergraduates to the primary scientific literature, e.g., the CREATE model (26).”
Metadata
- Authors
- Gottesman, A. J., & Hoskins, S. G.
- Affiliations
- The Graduate Center, CUNY (US)
- Corresponding author
- Hoskins, Sally G.
- Venue
- CBE—Life Sciences Education
- Published
- 2013-03
- Volume
- 12
- Issue
- 1
- Pages
- 59-72
- ISSN
- 1931-7913 (ISSN-L)
- PMC
- PMC3587857
- OpenAlex
- W2165168316
- Cited by
- 123
- References
- 47
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 6 · 2023: 10 · 2022: 14 · 2021: 10 · 2020: 13 · 2019: 11 · 2018: 8 · 2017: 11 · 2016: 12 · 2015: 9 · 2014: 6 · 2013: 3
- FWCI
- 48.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-sa
- Locations
- CBE—Life Sciences Education (publishedVersion, cc-by-nc-sa)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-sa)
- PubMed Central (publishedVersion, cc-by-nc-sa)
- PubMed (publishedVersion)
- CUNY Academic Works (City University of New York) (submittedVersion, cc-by-nc-sa)
- Funders
- National Science Foundation (0942790)
- Carnegie Corporation of New York
- Tennessee Tech University
- Division of Undergraduate Education
- Topics
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Education › Education and Critical Thinking Development
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Keywords
- scientific thinking, critical thinking, epistemological beliefs, experimental design, attitudes toward science, undergraduate STEM education, scientific literacy
- MeSH terms
- Curriculum, Educational Measurement, Engineering, Humans, Mathematics, Publications, Science, Students, Technology, Thinking, Electronic Mail
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.