The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index; 6 of the 20 sources its claims cite were checked for support.
CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature
Open accessAbstract
The Consider, Read, Elucidate hypotheses, Analyze and interpret data, Think of the next Experiment (CREATE) strategy for teaching and learning uses intensive analysis of primary literature to improve students' critical-thinking and content integration abilities, as well as their self-rated science attitudes, understanding, and confidence. CREATE also supports maturation of undergraduates' epistemological beliefs about science. This approach, originally tested with upper-level students, has been adapted in Introduction to Scientific Thinking, a new course for freshmen. Results from this course's initial semesters indicate that freshmen in a one-semester introductory course that uses a narrowly focused set of readings to promote development of analytical skills made significant gains in critical-thinking and experimental design abilities. Students also reported significant gains in their ability to think scientifically and understand primary literature. Their perceptions and understanding of science improved, and multiple aspects of their epistemological beliefs about science gained sophistication. The course has no laboratory component, is relatively inexpensive to run, and could be adapted to any area of scientific study.
Overview
CoChat Summary
## TL;DR
This paper reports a new one-semester CREATE-based freshman course at CCNY that uses analysis of scientific literature to teach scientific thinking. In a pilot study, students showed gains in critical thinking, experimental design, and several attitudes/beliefs about science and scientists.
## Key findings
- Fall CREATE Cornerstone students’ CAT scores improved significantly postcourse versus precourse, with a large effect size of 0.97; the largest gains were on items testing “evaluating and interpreting information.”
- Students in both cohorts showed significant gains on the EDAT, indicating improved experimental design ability; the paper states they cited more components of an “ideal” experimental design postcourse than precourse.
- SAAB results showed significant gains in freshmen’s self-rated skills/attitudes in all six categories and in four of seven epistemological categories.
- In the Spring email-response analysis (n = 15), 14/15 (93%) said they had assumed researchers were “straight-A” students, 13/15 (86%) said the emails changed their preconceptions, and 9/15 (60%) noted that passion mattered more than grades.
## Methods
- The study evaluated a semester-long elective course, Biology 10050: Introduction to Scientific Thinking, taught to first-year CCNY students in Fall 2011 and Spring 2012.
- Participants completed anonymous pre- and postcourse measures: the CAT (Fall cohort), EDAT (both cohorts), and SAAB (both cohorts; pooled SAAB sample 18 Fall + 13 Spring). A contemporaneous upper-level CREATE group (21 students) and a non-CREATE Organismic Biology group (23 students) also completed SAAB for comparison.
- Statistical analyses used Student’s t test for CAT, and Wilcoxon signed-rank tests for EDAT and SAAB; EDAT scoring used a 10-point rubric, and email-response comments were thematically coded.
## Limitations
- The authors explicitly note the small sample size and say the CAT findings must be interpreted with caution.
- The SAAB comparison with the Organismic Biology class was not a matched-control population because those students were not freshmen; this limits causal comparison, as stated in the paper.
- The text also makes evident that the study is a pilot in one institution and that the course and assessment data are anonymous pre/post observational data without random assignment (evident from the methods), so broader generalization is limited.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 0 Not valid · 13 Not checked · 59 Own results and interpretations
Every source the paper cites for this claim was checked and supports it.
In the paper
“We also found that undergraduates’ self-assessed science abilities, attitudes, and epistemological beliefs changed during the CREATE semester (Hoskins et al., 2011).”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > BACKGROUND
What the sources say
- Supportedcites Hoskins et al., 2011 source
The Introduction reports that students’ confidence, attitudes, and epistemological beliefs shifted over the semester. The Discussion section on scientific abilities reports changes in self-rated abilities, and the Results section on epistemological beliefs reports significant pre- to postcourse gains in beliefs and attitudes. (LLM, conf=0.94)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“These approaches also build students’ metacognition—the ability to track their own understanding (Tanner, 2012).”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > CURRICULAR DESIGN > CREATE Cornerstone Objectives and Selected Exercises Students learned to use CREATE tools, including concept mapping, paraphrasing, cartooning, annotating figures, applying templates to parse experimental logic, designing follow-up experiments, and participating in grant panels (Hoskins and Stevens, 2009). The CREATE techniques aim to sharpen students’ analytical skills and build critical-reading habits that can be used in new situations. These approaches also build students’ metacognition—the ability to track their own understanding (Tanner, 2012). To construct a concept map successfully, for example, students need to understand individual ideas and discern the relationships between them. To sketch a cartoon that shows what took place in the lab to generate the data presented in a particular figure, students must make sure they understand the relevant methodology. We applied concept mapping and cartooning along with other CREATE tools to a novel combination of readings. Articles selected for Biology 10050 were chosen because of their topicality, relatively simple methodology, and aspects of each that provoked controversy, exemplified the role of controls, and/or highlighted important distinctions between data and their interpretation. Goals for the Cornerstone students included learning: to read with skepticism, to critically analyze data and generate alternative interpretations, to recognize the malleability of scientific knowledge, and to develop and evaluate experiments with particular emphasis on controls and their roles. A final goal was for students to develop a more realistic view of research and researchers than the one often promoted in popular culture.
What the sources say
- Partly supportedcites Tanner, 2012 sourceExperimental — accuracy not yet measured
The Introducing Metacognition section defines metacognition in terms of monitoring and evaluating one’s own learning, and Building a Biology Classroom Culture Grounded in Metacognition describes ways to foster those habits. These passages support the definition and the general value of such teaching approaches, but do not establish that CREATE techniques specifically build students’ metacognition. Page numbers are unavailable in our copy. (LLM, conf=0.83)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Changing students’ negative views of researchers/research careers is a likely required first step, if such students are to be inspired to undertake undergraduate research experiences that can lead to research careers (Harrison et al., 2011).”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > DISCUSSION > Themes Highlighted in Readings
What the sources say
- Partly supportedcites Harrison et al., 2011 sourceExperimental — accuracy not yet measured
The Results (Students Report a Change in Understanding about Research; page unavailable) report more positive attitudes toward science and research after students took a course-based research class. The paper does not establish that changing negative views is a required first step before students will undertake undergraduate research; in this study, the research experience preceded the change in attitudes. (LLM, conf=0.85)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This study shows that a one-semester course aimed at STEM-interested freshmen and focused on scientific literature analysis using the CREATE strategy can produce gains in thinking/design ability as well as epistemological maturation.”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This study shows that a one-semester course aimed at STEM-interested freshmen and focused on scientific literature analysis using the CREATE strategy can produce gains in thinking/design ability as well as epistemological maturation.”
§ CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature > Abstract
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
38 more claims
Create a free account to see all 78 claims and every source verdict.
- Probably not a substantial claim. 19
- It may state two separate claims as one. 19
Citations
Cites
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
At the Threshold: The Developing Adolescent
Feldman, S. S., & Elliott, G. R. (1990) · Cited by 3,225
Talking about Leaving: Why Undergraduates Leave the Sciences
Correll, S. J., Seymour, E., & Hewitt, N. M. (1997) · Contemporary Sociology · doi:10.2307/2655673 · Cited by 3,086
How Learning Works : Seven Research-Based Principles for Smart Teaching
Ambrose, S. A. (2010) · Cited by 2,413
Social evaluation by preverbal infants
Hamlin, J. K., Wynn, K., & Bloom, P. (2007) · Nature · doi:10.1038/nature06288 · Cited by 1,566 · cited 2×
““Social Evaluation by Preverbal Infants” (Hamlin et al., 2007), examines 6- and 10-mo-old babies’ abilities to discriminate between and react to helpful, neutral, and hindering “behaviors” by observed “characters.””
BackgroundAcademically Adrift: Limited Learning on College Campuses
Arum, R., & Roksa, J. (2011) · Cited by 1,457
Academically Adrift: Limited Learning on College Campuses
Conn, S., & Wymore, J. (2012) · Growth: The Journal of the Association for Christians in Student Development · Cited by 1,239
Knowing and reasoning in college: gender-related patterns in students' intellectual development
(1993) · Choice Reviews Online · doi:10.5860/choice.30-6288 · Cited by 1,199
Empathy and pro-social behavior in rats
Bartal, I. B.-A., Decety, J., & Mason, P. (2011) · Science · doi:10.1126/science.1210789 · Cited by 934
Critical Thinking: Why Is It so Hard to Teach?
Willingham, D. T. (2008) · Arts Education Policy Review · doi:10.3200/aepr.109.4.21-32 · Cited by 865
Research works printed but not linked: 14
- American Association for the Advancement of Science, 2011, Vision and Change in Undergraduate Biology Education
- Angier N, 2012, New York Times 1 May, D1
- Arora PN, 2010, Biostatistics
- Bloom BS, 1956, Taxonomy of Educational Objectives: Cognitive Domain
- Gewin V, 2011, Nature, 480
- Hoskins SG, 2010, Science and the Educated American: A Core Component of Liberal Education, 151
- Koenig K, 2012, J Coll Sci Teach, 41, 23
- Lindstrom M, 2011, New York Times 1 October, A21
- Perry W, 1970, Forms of Intellectual Development in the College Years: A Scheme
- Rybarczyk, 2011, J Coll Sci Teach, 41, 106
- Shi J, 2011, Int J Sch Teach Learn, 5, 1
- Sirum K, 2011, Bioscene, 37, 8
- Talbot M, 2006, The New Yorker, 82, 90
- Willingham DT, 2007, Am Educ, 31, 8
Cited by
The Other Half of the Story: Effect Size Analysis in Quantitative Research
Maher, J. M., Markey, J. C., & Ebert-May, D. (2013) · CBE—Life Sciences Education · doi:10.1187/cbe.13-04-0082 · Cited by 625
“Gottesman and Hoskins (2013) applied Cohen’s d to compare pre/post means of data collected using an instrument measuring students’ critical thinking, experimental design ability, attitudes, and beliefs.”
MethodDomains and predictors of first-year student success: A systematic review
van der Zanden, P. J. A. C., Denessen, E., Cillessen, A. H. N., & Meijer, P. C. (2018) · Educational Research Review · doi:10.1016/j.edurev.2018.01.001 · Cited by 218
“In terms of institutional and organizational variables, it was found that inquiry-based learning environments contributed—with large effect sizes—to first-year students’ critical thinking skills (Gottesman & Hoskins, 2013; Gupta, Burke, Mehta, & Greenbowe, 2015; Hugerat & Kortam, 2014).”
BackgroundActive Learning in Flipped Life Science Courses Promotes Development of Critical Thinking Skills
Styers, M. L., Zandt, P. A. V., & Hayden, K. L. (2018) · CBE—Life Sciences Education · doi:10.1187/cbe.16-11-0332 · Cited by 211
Cargas, S., Williams, S. S., & Rosenberg, M. J. (2017) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2017.05.005 · Cited by 146
Hart, J. L. (2019) · Journal of Teaching and Learning for Graduate Employability · doi:10.21153/jtlge2019vol10no2art827 · Cited by 85
“There is evidence that positive gains can be made for critical thinking skills in science classes in one semester (Gasper & Gardner, 2013; Gottesman & Hoskins, 2013) however the single semester time-frame may not be optimal or realistic for the development of critical thinking skills (Grant &…”
Background
Metadata
- Authors
- Gottesman, A. J., & Hoskins, S. G.
- Affiliations
- The Graduate Center, CUNY (US)
- Corresponding author
- Hoskins, Sally G.
- Venue
- CBE—Life Sciences Education
- Published
- 2013-03
- Volume
- 12
- Issue
- 1
- Pages
- 59-72
- ISSN
- 1931-7913 (ISSN-L)
- PMC
- PMC3587857
- OpenAlex
- W2165168316
- Cited by
- 123
- References
- 47
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 6 · 2023: 10 · 2022: 14 · 2021: 10 · 2020: 13 · 2019: 11 · 2018: 8 · 2017: 11 · 2016: 12 · 2015: 9 · 2014: 6 · 2013: 3
- FWCI
- 48.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-sa
- Locations
- CBE—Life Sciences Education (publishedVersion, cc-by-nc-sa)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc-sa)
- PubMed Central (publishedVersion, cc-by-nc-sa)
- PubMed (publishedVersion)
- CUNY Academic Works (City University of New York) (submittedVersion, cc-by-nc-sa)
- Funders
- National Science Foundation (0942790)
- Carnegie Corporation of New York
- Tennessee Tech University
- Division of Undergraduate Education
- Topics
- Social Sciences › Education › Science Education and Pedagogy
- Social Sciences › Education › Education and Critical Thinking Development
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Keywords
- scientific thinking, critical thinking, epistemological beliefs, experimental design, attitudes toward science, undergraduate STEM education, scientific literacy
- MeSH terms
- Curriculum, Educational Measurement, Engineering, Humans, Mathematics, Publications, Science, Students, Technology, Thinking, Electronic Mail
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature. https://app.cochat.ai/papers/10.1187/cbe.12-11-0201
- The paper
- Gottesman, A. J., & Hoskins, S. G. (2013). CREATE Cornerstone: Introduction to Scientific Thinking, a New Course for STEM-Interested Freshmen, Demystifies Scientific Thinking through Analysis of Scientific Literature. CBE—Life Sciences Education. https://doi.org/10.1187/cbe.12-11-0201
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.