Students’ Civic Online Reasoning: A National Portrait
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Are today’s students able to discern quality information from sham online? In the largest investigation of its kind, we administered an assessment to 3,446 high school students. Equipped with a live internet connection, the students responded to six constructed-response tasks. The students struggled on all of them. Asked to investigate a site claiming to “disseminate factual reports” on climate science, 96% never learned about the organization’s ties to the fossil fuel industry. Two thirds were unable to distinguish news stories from ads on a popular website’s home page. More than half believed that an anonymously posted Facebook video, shot in Russia, provided “strong evidence” of U.S. voter fraud. Instead of investigating the organization or group behind a site, students were often duped by weak signs of credibility: a website’s “look,” its top-level domain, the content on its About page, and the sheer quantity of information it provided. The study’s sample reflected the demographic profile of high school students in the United States, and a multilevel regression model explored whether scores varied by student characteristics. Findings revealed differences in student abilities by grade level, self-reported grades, locality, socioeconomic status, race, maternal education, and free/reduced-price lunch status. Taken together, these findings reveal an urgent need to prepare students to thrive in a world in which information flows ceaselessly across their screens.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For instance, among more than 3,000 US high school students and undergraduates, 96% did not know how to evaluate the trustworthiness of websites (100).”
From The impact of generative artificial intelligence on socioeconomic inequalities and policy making (2024) · cites this paper as [100]
Citations
Cites
National Center for Education Statistics
(2008) · Encyclopedia of Educational Psychology · doi:10.4135/9781412963848.n192 · Cited by 4,546
Gigerenzer, G., & Gaissmaier, W. (2011) · Annual Review of Psychology · doi:10.1146/annurev-psych-120709-145346 · Cited by 4,037
Social and Heuristic Approaches to Credibility Evaluation Online
Metzger, M. J., Flanagin, A. J., & Medders, R. B. (2010) · Journal of Communication · doi:10.1111/j.1460-2466.2010.01488.x · Cited by 1,394
In Google We Trust: Users’ Decisions on Rank, Position, and Relevance
Pan, B., Hembrooke, H., Joachims, T., Lorigo, L., Gay, G., & Granka, L. (2007) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2007.00351.x · Cited by 715 · cited 2×
“Are they equipped to do so? Evidence suggests that young people, like many Americans, struggle to evaluate online sources (Gasser et al., 2012; Hargittai et al., 2010; Lurie & Mustafaraj, 2018; McGrew et al., 2018; Pan et al., 2007).”
Background(2010) · Issue Lab (Candid) · Cited by 701
Why race and culture matter in schools: closing the achievement gap in America's classrooms
(2011) · Choice Reviews Online · doi:10.5860/choice.49-2208 · Cited by 562
Can Students Evaluate Online Sources? Learning From Assessments of Civic Online Reasoning
McGrew, S., Breakstone, J., Ortega, T., Smith, M., & Wineburg, S. (2018) · Theory & Research in Social Education · doi:10.1080/00933104.2017.1416320 · Cited by 533
Self-citationCommon Core State Standards Initiative: (509442010-006)
(2009) · PsycEXTRA Dataset · doi:10.1037/e509442010-006 · Cited by 496
Citizens Versus the Internet: Confronting Digital Challenges With Cognitive Tools
Kozyreva, A., Lewandowsky, S., & Hertwig, R. (2020) · Psychological Science in the Public Interest · doi:10.1177/1529100620946707 · Cited by 479 · cited 2×
“When browsing the internet is how we become informed citizens, traditional ways of reading are not merely ineffective (Gigerenzer & Gaissmaier, 2011; Hertwig & Engel, 2016; Kozyreva et al., 2020), they’re dangerous (Caulfield, 2018; Warzel, 2021).”
BackgroundHandbook of Research in Education Finance and Policy
Ladd, H. F. (2014) · Routledge eBooks · doi:10.4324/9780203788684 · Cited by 415
Wineburg, S., & McGrew, S. (2019) · Teachers College Record: The Voice of Scholarship in Education · doi:10.1177/016146811912101102 · Cited by 394 · cited 2×
“Today, when advertisers, corporations, lobbyists, clickbait sites, conspiracy theorists, hate groups, and foreign governments work overtime to hijack attention, often the wisest thing to do is not to read but to preserve attention by practicing strategic ignoring (Wineburg & McGrew, 2019).”
BackgroundSelf-citationHow students evaluate information and sources when searching the World Wide Web for information
Walraven, A., Brand-Gruwel, S., & Boshuizen, H. P. A. (2009) · Computers & Education · doi:10.1016/j.compedu.2008.08.003 · Cited by 300
Media Literacy as a Core Competency for Engaged Citizenship in Participatory Democracy
Mihailidis, P., & Thevenin, B. (2013) · American Behavioral Scientist · doi:10.1177/0002764213489015 · Cited by 262
Homo Ignorans: Deliberately Choosing Not to Know
Hertwig, R., & Engel, C. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616635594 · Cited by 245
Epistemic Thinking in Action: Evaluating and Integrating Online Sources
Barzilai, S., & Zohar, A. (2012) · Cognition and Instruction · doi:10.1080/07370008.2011.636495 · Cited by 239
Developing a News Media Literacy Scale
Ashley, S., Maksl, A., & Craft, S. (2013) · Journalism & Mass Communication Educator · doi:10.1177/1077695812469802 · Cited by 227
Lateral reading: Reading less and learning more when evaluating digital information
Wineburg, S., & McGrew, S. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3048994 · Cited by 198
Self-citationThe Internet of Us: Knowing More and Understanding Less in the Age of Big Data
Lynch, M. P. (2016) · Cited by 193
Learning to evaluate: An intervention in civic online reasoning
McGrew, S. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103711 · Cited by 179
Youth and Digital Media: From Credibility to Information QualityPreprint
Gasser, U., Cortesi, S., Malik, M. M., & Lee, A. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2005272 · Cited by 158
Why we need a new approach to teaching digital literacy
Breakstone, J., McGrew, S., Smith, M., Ortega, T., & Wineburg, S. (2018) · Phi Delta Kappan · doi:10.1177/0031721718762419 · Cited by 134
Self-citationImproving university students’ web savvy: An intervention study
McGrew, S., Smith, M., Breakstone, J., Ortega, T., & Wineburg, S. (2019) · British Journal of Educational Psychology · doi:10.1111/bjep.12279 · Cited by 131
Self-citationInvestigating Criteria That Seventh Graders Use to Evaluate the Quality of Online Information
Coiro, J., Coscarelli, C., Maykel, C., & Forzani, E. (2015) · Journal of Adolescent & Adult Literacy · doi:10.1002/jaal.448 · Cited by 126
Lateral reading: College students learn to critically evaluate internet sources in an online course.
Breakstone, J., Smith, M., Connors, P., Ortega, T., Kerr, D., & Wineburg, S. (2021) · Harvard Kennedy School Misinformation Review · doi:10.37016/mr-2020-56 · Cited by 91
Self-citationWhy librarians can’t fight fake news
Sullivan, M. C. (2019) · Journal of Librarianship and Information Science · doi:10.1177/0961000618764258 · Cited by 88
Kohnen, A. M., Mertens, G. E., & Boehm, S. M. (2020) · Journal of Media Literacy Education · doi:10.23860/jmle-2020-12-2-6 · Cited by 64
Intergenerational family predictors of the Black–White achievement gap.
Mandara, J., Varner, F. A., Greene, N., & Richman, S. B. (2009) · Journal of Educational Psychology · doi:10.1037/a0016644 · Cited by 54
Lurie, E., & Mustafaraj, E. (2018) · ACM Web Science Conference (WebSci) · doi:10.1145/3201064.3201095 · Cited by 49
The future of the First Amendment: 2018 survey of high school students and teachers
Dautrich, K. (2018) · Issue Lab (Candid) · Cited by 6
Bartlett, J., & Miller, C. (2012) · Cited by 1
Patterns and Trends in Racial/Ethnic and Socioeconomic Academic Achievement Gaps
Reardon, S. F., & Robinson, J. P. (n.d.) · Handbook of Research in Education Finance and Policy · doi:10.4324/9780203961063.ch28
Research works printed but not linked: 6
- Brodsky J., 2019, [Paper presentation]. Technology, Mind, & Society, an American Psychological Association Conference
- Diamond L., 2020, Ill winds: Saving democracy from Russian rage, Chinese ambition, and American complacency
- Hargittai E., 2010, International Journal of Communication, 4, 468
- Kahne J., 2012, International Journal of Communication, 6, 1
- Leu D. J., 2012, [Paper presentation]. Literacy Research Association 62nd Annual Conference
- Levitsky S., 2018, How democracies die
Cited by
The impact of generative artificial intelligence on socioeconomic inequalities and policy making
Capraro, V., Lentsch, A., Acemoglu, D., Akgun, S., Akhmedova, A., Bilancini, E., Bonnefon, J.-F., Brañas-Garza, P., Butera, L., Douglas, K. M., et al. (2024) · PNAS Nexus · doi:10.1093/pnasnexus/pgae191 · Cited by 371
“For instance, among more than 3,000 US high school students and undergraduates, 96% did not know how to evaluate the trust-worthiness of websites (100).”
Combating disinformation in a social media age
Shu, K., Bhattacharjee, A., Alatawi, F., Nazer, T. H., Ding, K., Karami, M., & Liu, H. (2020) · WIREs Data Mining and Knowledge Discovery · doi:10.1002/widm.1385 · Cited by 198
Science education in an age of misinformation
Osborne, J., & Pimentel, D. (2023) · Science Education · doi:10.1002/sce.21790 · Cited by 181
Science literacy in the twenty-first century: informed trust and the competent outsider
Osborne, J., & Allchin, D. (2025) · International Journal of Science Education · doi:10.1080/09500693.2024.2331980 · Cited by 134
“In addition, research shows that they are poor at evaluating the credibility of such sources (Breakstone et al., 2021b).”
Hamilton, J. L., Nesi, J., & Choukas-Bradley, S. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211014189 · Cited by 110
Metadata
- Authors
- Breakstone, J., Smith, M., Wineburg, S., Rapaport, A., Carle, J., Garland, M., & Saavedra, A.
- Affiliations
- Stanford University (US)
- Gibson Consulting Group, Austin, TX
- University of Southern California (US)
- Corresponding author
- Breakstone, Joel
- Venue
- Educational Researcher
- Published
- 2021-05-26
- Volume
- 50
- Issue
- 8
- Pages
- 505-515
- ISSN
- 0013-189X (ISSN-L)
- 1935-102X
- OpenAlex
- W3164656280
- Semantic Scholar
- 8d2ab177bf29c2e0231a83dd04b2f0b70beac6f2
- Cited by
- 267
- References
- 31
- Citations by year
- 2026: 52 · 2025: 52 · 2024: 55 · 2023: 43 · 2022: 29 · 2021: 26
- FWCI
- 56.11
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Educational Researcher (publishedVersion)
- SSRN Electronic Journal (publishedVersion)
- Funders
- William and Flora Hewlett Foundation (2017-5939)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Strategies and Epistemologies
- Social Sciences › Education › Literacy, Media, and Education
- Social Sciences › Sociology and Political Science › Misinformation and Its Impacts
- Keywords
- high school students, information literacy, misinformation, fossil fuel industry, voter fraud, Facebook, socioeconomic status, grade level differences, digital citizenship
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.