Electronic Publication and the Narrowing of Science and Scholarship
The DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Online journals promise to serve more information to more dispersed audiences and are more efficiently searched and recalled. But because they are used differently than print—scientists and scholars tend to search electronically and follow hyperlinks rather than browse or peruse—electronically available journals may portend an ironic change for science. Using a database of 34 million articles, their citations (1945 to 2005), and online availability (1998 to 2005), I show that as more journal issues came online, the articles referenced tended to be more recent, fewer journals and articles were cited, and more of those citations were to fewer journals and articles. The forced browsing of print archives may have stretched scientists and scholars to anchor findings deeply into past and present scholarship. Searching online is more efficient and following hyperlinks quickly puts researchers in touch with prevailing opinion, but this may accelerate consensus and narrow the range of findings and ideas built upon.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In our own investigations (102), we find minimal changes when correcting for marginals bias, which counters previous findings that show a narrowing of citation distributions (103, 104), but this result varies across disciplines.”
From Misinformation in and about science (2021) · cites this paper as [103]
In the citing paper
“Algorithms designed to recommend information and products in line with supposed individual preferences can create runaway feedback wherein both the user’s information preferences and subsequent exposure to content become more extreme over time”
From Stewardship of global collective behavior (2021) · cites this paper as [126]
Citations
Cites
Emergence of Scaling in Random Networks
Barabási, A.-L., & Albert, R. (1999) · Science · doi:10.1126/science.286.5439.509 · Cited by 36,135
The Matthew Effect in Science: The reward and communication systems of science are considered.
Merton, R. K. (1968) · Science · doi:10.1126/science.159.3810.56 · Cited by 6,720
(1968) · PubMed · Cited by 4,803
Econometric Models for Count Data with an Application to the Patents-R & D Relationship
Hausman, J., Hall, B. H., & Griliches, Z. (1984) · Econometrica · doi:10.2307/1911191 · Cited by 3,393
Price, D. J. D. S. (1965) · Science · doi:10.1126/science.149.3683.510 · Cited by 3,122
ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS
SIMON, H. A. (1955) · Biometrika · doi:10.1093/biomet/42.3-4.425 · Cited by 2,771
Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market
Salganik, M. J., Dodds, P. S., & Watts, D. J. (2006) · Science · doi:10.1126/science.1121066 · Cited by 2,231
Use and Users of Electronic Library Resources: An Overview and Analysis of Recent Research Studies
Tenopir, C. (2003) · Zenodo · doi:10.5281/zenodo.7779277 · Cited by 361
Going, Going, Gone: Lost Internet References
Dellavalle, R. P., Hester, E. J., Heilig, L. F., Drake, A. L., Kuntzman, J. W., Graber, M., & Schilling, L. M. (2003) · Science · doi:10.1126/science.1088234 · Cited by 172
Measuring use patterns of online journals and databases.
Groote, S. L. D., & Dorsch, J. L. (2003) · Europe PMC (PubMed Central) · Cited by 161
Research works printed but not linked: 5
- M. McLuhan Understanding Media (McGraw-Hill New York 1964) chap. 1.
- S. Black, Libr. Resour. Tech. Serv.49, 19 (2005).
- S. L. De Groote, J. L. Dorsch, J. Med. Libr. Assoc.91, 231 (2003).
- C. Tenopir, D. W. King, A. Bush, J. Med. Libr. Assoc.92, 233 (2004).
- C. Manning H. Schütz Foundations of Natural Language Processing (MIT Press Cambridge MA 1999).
Cited by
Items 301–400 of 449
Citing for High ImpactPreprint
Shi, X., Leskovec, J., & McFarland, D. A. (2010) · arXiv (Cornell University) · doi:10.48550/arxiv.1004.3351 · Cited by 3
Richardson, R., Tejedor Navarro, H., Amaral, L. A. N., & Stoeger, T. (2024) · eLife · doi:10.7554/elife.93429.3 · Cited by 2
Методологічні виклики штучного інтелекту в політичній науці: епістемологічний аналіз
Kornienko, V. A. (2025) · Political Studies · doi:10.53317/2786-4774-2025-2-1 · Cited by 2
Khan, N. T., Tahir, H., Mohammed, A., Ghaithan, A. M., Tayyab, M., & Ferik, S. E. (2026) · Results in Engineering · doi:10.1016/j.rineng.2026.109542 · Cited by 2
PEMNetwork: Barriers and Enablers to Collaboration and Multimedia Education in the Digital Age
Lumba‐Brown, A., Tat, S. T., Auerbach, M. A., Kessler, D. O., Alletag, M. J., Grover, P., Schnadower, D., Macias, C. G., & Chang, T. P. (2016) · Pediatric Emergency Care · doi:10.1097/pec.0000000000000885 · Cited by 2
The global relevance of Canadian public administration? A bibliometric research note
Zeemering, E. S. (2018) · Canadian Public Administration · doi:10.1111/capa.12292 · Cited by 2
Субъективные оценки нестабильной занятости: так ли уж плохо быть нестабильным?
Gasiukova, E. N., & Петрова, А. (2021) · Journal of Economic Sociology · doi:10.17323/1726-3247-2021-3-39-70 · Cited by 2
CULTURE‐BOUND CONCEPTS OF ADDICTION—STILL A POTENT INFLUENCE
Kalant, H. (2008) · Addiction · doi:10.1111/j.1360-0443.2008.02365.x · Cited by 2
Bátiz‐Lazo, B., Eskandari, R., & Goddard, J. A. (2014) · Investigaciones de Historia Económica · doi:10.1016/j.ihe.2014.07.010 · Cited by 2
Brumback, R. A. (2011) · Journal of Child Neurology · doi:10.1177/0883073810392230 · Cited by 2
Doing the Reading. Technology’s Role in Reshaping Reading in the Academy
Baron, N. S. (2017) · Digilit · doi:10.14220/9783737007450.191 · Cited by 2
Looting matters: blogging in a research context
Gill, D. (2014) · UEA Digital Repository (University of East Anglia) · Cited by 2
Online Accessibility of Academic Articles and the Diversity of EconomicsPreprint
Boppart, T., & Staub, K. E. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2060979 · Cited by 2
Trends and Directions in the Accounting, Business and Economic History of Spain, 1997-2011Preprint
Bátiz‐Lazo, B., & Eskandari, R. (2013) · RePEc: Research Papers in Economics · Cited by 2
Research Project: Text Engineering Tool for Ontological ScientometryPreprint
Tagiew, R. (2015) · arXiv (Cornell University) · doi:10.13140/rg.2.1.1619.1847 · Cited by 2
Which scientific elite? On the concentration of funding, productivity and citations
Macaluso, B. (2009) · Cited by 2
Essays on Collaboration, Innovation, and Network Change in Organizations.
Funk, R. J. (2014) · Deep Blue (University of Michigan) · Cited by 2
Publishing Research Support Documents in Open Access Platform to Improve Research ImpactPreprint
Ebrahim, N. A., & Bong, Y. B. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3347341 · Cited by 2
Science Hard and Soft: An Empirical Approach to Evaluating Scientific Consensus with Big DataPreprint
Cook, G. G., & Xie, Y. (2023) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/zu4bm · Cited by 2
Okamura, K., & Koshiba, H. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.5803961 · Cited by 2
Infographics as a communication tool in pharmacy and pharmaceutical sciences
Sasser, C. W., Chu, J., Curigliano, M., George, E., Murray, C., Tan, J., & Nicolla, S. N. (2025) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2025.03.008 · Cited by 1
Las publicaciones científicas argentinas
Kotsias, B. A. (2013) · CONICET Digital (CONICET) · Cited by 1
Savary, P. (2025) · Current Landscape Ecology Reports · doi:10.1007/s40823-025-00109-9 · Cited by 1
The diverging effect of prestige and experience on the use of artificial intelligence knowledge
Zhao, N., & Li, L. (2026) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.70068 · Cited by 1
A Weight-Activated Main Path Analysis of Policing and Life Course Scholarship
Smith, T. B., Stoffel, A. C. A., Lopes, V. D. F., Novak, A. S., & Boutwell, B. B. (2024) · Journal of Developmental and Life-Course Criminology · doi:10.1007/s40865-026-00320-0 · Cited by 1
Open questions for systems ecology
Saavedra, S., & Kéfi, S. (2026) · Systems Ecology · doi:10.67837/2341 · Cited by 1
Mapping the Scientific Literature on Sheep and Goat Research: Country-Level Bibliometric Analysis
Vaitsi, G. A., Bourganou, M. V., Vasileiou, N. G. C., Katsarou, E. I., Liagka, D. V., Gougoulis, D. A., Mavrogianni, V. S., & Fthenakis, G. C. (2026) · Geographies · doi:10.3390/geographies6040105 · Cited by 1
The Impact Factor: Implications of Open Access on Quality
Grozanick, S. E. (2010) · Public & Access Services Quarterly · doi:10.1080/15228959.2010.482335 · Cited by 1
Information Literacy: 21st Century Library Research Methods for African Studies
Reboussin, D. A. (2011) · Africa Bibliography · doi:10.1017/s0266673111000031 · Cited by 1
Alcune analisi comportamentali degli utenti dell'Emeroteca Virtuale
Scarnò, M. (2009) · E-LIS Repository (University of Naples Federico II) · Cited by 1
Stankus, T. (2009) · The Serials Librarian · doi:10.1080/03615260802669128 · Cited by 1
Ogle, A., & Ying, L. L. T. (2015) · Research Online (Edith Cowan University) · Cited by 1
Networks and globalization policies
White, D. R. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511842481.011 · Cited by 1
Vieira, G. N. (2017) · Em Tempo de Histórias · doi:10.26512/emtempos.v0i30.14727 · Cited by 1
Rational Economics and the Administrative Theory of Management
Monahan, K. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-813531-0.00002-9 · Cited by 1
Plagiarism and Ethical Issues: A Literature Review on Academic Misconduct
Montoneri, B. (2018) · Advances in higher education and professional development book series · doi:10.4018/978-1-5225-5837-8.ch001 · Cited by 1
Synergy of knowledge and empathy in interventional cytopathology
Wiles, A. B., Powers, C. N., & Kaminsky, D. (2019) · Cancer Cytopathology · doi:10.1002/cncy.22113 · Cited by 1
4. The Impact of Digital Resources
Warwick, C., & Ross, C. (2020) · Open Book Publishers · doi:10.11647/obp.0192.04 · Cited by 1
O’Donnell, D. P. (2020) · Open Book Publishers · doi:10.11647/obp.0192.08 · Cited by 1
Гибкие паттерны перемещения на работу и обратно у современных жителей Челябинска
Krasilnikova, N. (2021) · Journal of Economic Sociology · doi:10.17323/1726-3247-2021-3-104-128 · Cited by 1
User’s Behaviour inside a Digital Library
Scarnò, M. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-1746-9.ch011 · Cited by 1
The Uneven Spread of Citations
Wright, K. (2023) · Physics · doi:10.1103/physics.16.15 · Cited by 1
Discovery of the Witwatersrand goldfields—contrasting opinions after 100 years
Phillips, N. G., & McCarthy, T. S. (2025) · Australian Journal of Earth Sciences · doi:10.1080/08120099.2025.2479681 · Cited by 1
La questione della tecnica in Stiegler. Un confronto con Husserl e con la postfenomenologia
Buongiorno, F. (2023) · Philosophy Kitchen · doi:10.13135/2385-1945/9373 · Cited by 1
When Ideas Go Viral: Measuring Scholarly Novelty and Viral Influence via Citation Network Analysis
Hang, C. N., Yu, P.-D., Tan, C. W., & Chiu, D. M. (2025) · Globecom · doi:10.1109/globecom59602.2025.11431837 · Cited by 1
Erren, T. C., Cullen, P., & Erren, M. (2009) · Medical Hypotheses · doi:10.1016/j.mehy.2008.12.005 · Cited by 1
Crossland, J. (2012) · Sussex Research Online (University of Sussex) · Cited by 1
Editorial: Where is scientific publishing heading?
Nielsen, J. (2017) · FEMS Yeast Research · doi:10.1093/femsyr/fox075 · Cited by 1
Reynolds, C. (2018) · University of Huddersfield Repository (University of Huddersfield) · Cited by 1
The Intellectual Organisation of History
Colavizza, G. (2018) · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · doi:10.5075/epfl-thesis-8537 · Cited by 1
Success Factors of Academic Journals in the Digital AgePreprint
Dilger, A., & Klus, M. F. (2019) · SSRN Electronic Journal · doi:10.2139/ssrn.3412799 · Cited by 1
Increasing the Reach, Usage, and Impact of Scholarly Content
Kudlow, P. A. (2020) · TSpace (University of Toronto) · Cited by 1
Cope, B., & Phillips, A. (2014) · Elsevier eBooks · doi:10.1533/9781780634647.1 · Cited by 1
Phillips, A., & Cope, B. (2009) · Elsevier eBooks · doi:10.1016/b978-1-84334-416-2.50001-x · Cited by 1
Do "bad" citations have "good" effects?Preprint
Bao, H., & Teplitskiy, M. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2304.06190 · Cited by 1
Serendipity in SciencePreprint
Nahm, P., Murciano-Goroff, R., Park, M. K., & Funk, R. J. (2023) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.2308.07519 · Cited by 1
There and back again? Law, culture, and scholarly publishing
Steuer, M. D., & Weigelt, T. (2023) · Jindal Global Law Review · doi:10.1007/s41020-023-00216-w · Cited by 1
Frey, B. S. (2009) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-51860 · Cited by 1
Bovenberg, D. (2023) · eScholarship (California Digital Library) · Cited by 1
When AI Writes, Who Gets Cited? Evidence of Citation Monoculture Across Language ModelsPreprint
Alemohammad, S., Zhang, D., Tang, B., Qin, A., Mai, G., Abbasi, A., Baraniuk, R. G., & Wang, Z. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.19230 · Cited by 1
Richardson, R. A., Navarro, H. T., Nunes Amaral, L. A., & Stoeger, T. (2024) · doi:10.7554/elife.93429.2
Peltokangas, P. (2015) · Tampere University Institutional Repository (Tampere University)
Toward a Computationally Unified Behavioral-Economic Model of Addiction
Mueller, E. T., Carter, L. P., & Bickel, W. K. (2011) · Springer eBooks · doi:10.1007/978-1-4614-0751-5_10
Ángulo-Bazán, Y. (2010) · Redalyc (Universidad Autónoma del Estado de México)
Danner, R. A. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1945215
Who says the Internet broadens your horizons?
Ball, P. (2008) · Nature · doi:10.1038/news.2008.960
Replying the comment from Ms. Nobuko Miyairi
Kotaro, N. A. W. A. (2009) · Journal of Information Processing and Management · doi:10.1241/johokanri.52.115
Miller, K. (2008) · IEEE Technology and Society Magazine · doi:10.1109/mts.2008.929775
Srikrishna, D., & Coram, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024920
Hewitt, D. A., Link, J. S., Wahl, D. H., Cooke, S. J., & Mather, M. E. (2009) · Fisheries · doi:10.1577/1548-8446-34.12.598
The editor-referee system and publication an editor's view of the process
Shore, S. N. (2011) · EAS Publications Series · doi:10.1051/eas/1149003
3. Academic Publishing: New Opportunities for the Culture of Supply and the Nature of Demand
Edmond, J., & Romary, L. (2020) · Open Book Publishers · doi:10.11647/obp.0192.03
Differences in Received Citations over Time and Across Fields in China.
Yang, S., Qiu, J., Ding, J., & Yu, H. (2015) · ISSI
Bantawa, B. (2014) · Oxford University Research Archive (ORA) (University of Oxford) · doi:10.5287/ora-zbampjr90
Perceptions and attitudes of Arab information technology researchers toward open access publishing
Seliaman, M. E., Salim, E. I. E., & Eldow, M. E. Y. (2012) · IEEE Colloquium on Humanities, Science and Engineering · doi:10.1109/chuser.2012.6504304
Internet, Mind and Communication: New Perspectives and Challenges
Araújo, J. R. (2016) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-46068-0_2
Mechanisms driving the formation and success of collaborations between scientists in biomedicine
Fegley, B. D. (2016) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign)
From codex to kindle: exploring the technological mediation of words in the digital era
Harnett, M. (2014) · Minerva Access (University of Melbourne)
Analysis of Cumulative and Temporal Patterns in Science
Parolo, P. D. B. (2017) · Aaltodoc (Aalto University)
Z szacunku do... Z doświadczeń badań transdyscyplinarnych
Kuncewicz, D. K., & Kruszewski, W. (2017) · Roczniki Humanistyczne · doi:10.18290/rh.2017.65.1-10
New Insights into Food Safety Research Teams
Sattari, R., Lane, J. I., & Owen-Smith, J. D. (2017) · Cambridge University Press eBooks · doi:10.1017/9781316671788.008
Assessing the role of marketing in the provision of library and information services
Nyameti, E. M. (2019) · IP Indian Journal of Library Science and Information Technology · doi:10.18231/2456-9623.2018.0018
The Impact of Technology on Work Practices
Kim, L. (2018) · ResearchWorks at the University of Washington (University of Washington)
The (Internet) Information Inequality Machine?Preprint
Greenberg, J. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3252458
Printed Scholarly Monographs : pronounced dead prematurely?
Pannekoek, H. (2018) · Leiden Repository (Leiden University)
de Santana, D. S. (2020) · Institutional Repository of the Federal University of Sergipe (Universidade Federal de Sergipe)
A note from the 1960s: science communication as a solution to complex science.
Leach, J. (2017) · Journal and proceedings of the Royal Society of New South Wales · doi:10.5962/p.361784
Социальный капитал в модернизирующемся обществе: пример Дагестана
Ситкевич, Д. А. (2021) · Journal of Economic Sociology · doi:10.17323/1726-3247-2021-3-11-38
McCabe, M. J., & Snyder, C. M. (2020) · National Bureau of Economic Research · doi:10.3386/w28128
Конец бюрократии? Новые организационные формы, социальные сети и миллениалы
Asaturian, D. (2021) · Journal of Economic Sociology · doi:10.17323/1726-3247-2021-3-158-169
Ler uma biblioteca nas inscrições de leitores, espaço e Internet
Sequeiros, P. (2010) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
Tong, D., & Tzabbar, D. (2019) · iDEA - Drexel University Institutional Repository · doi:10.17918/aaex-v428
Valenti, J. M. (2008) · Science Communication · doi:10.1177/1075547008324829
Bilton, C., & Cummings, S. P. (2012) · Wiley eBooks · doi:10.1002/9781119208280.refs
Cummings, S. P., & Angwin, D. (2015) · Wiley eBooks · doi:10.1002/9781119166696.notes
Google Scholar as the Co-Producer of Scholarly Knowledge
van Dijck, J. (2015) · IGI Global eBooks · doi:10.4018/978-1-4666-8632-8.ch044
User’s Behaviour inside a Digital Library
Scarnò, M. (2012) · IGI Global eBooks · doi:10.4018/978-1-4666-2455-9.ch067
Truitt, M. (2008) · Information Technology and Libraries · doi:10.6017/ital.v27i3.3242
Authors, V. (2012) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v13i4.1392
Metadata
- Authors
- Evans, J. A.
- Affiliations
- University of Chicago (US)
- Corresponding author
- Evans, James A.
- ORCID
- Evans, James A.
- Venue
- Science
- Published
- 2008-07-18
- Volume
- 321
- Issue
- 5887
- Pages
- 395-399
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- OpenAlex
- W2125660293
- Cited by
- 364
- References
- 16
- Citations by year
- 2026: 12 · 2025: 13 · 2024: 15 · 2023: 20 · 2022: 14 · 2021: 12 · 2020: 25 · 2019: 13 · 2018: 16 · 2017: 23 · 2016: 11 · 2015: 25 · 2014: 20 · 2013: 16 · 2012: 20
- FWCI
- 40.84
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- Repozytorium Uniwersytetu im. Adama Mickiewicza (Adam Mickiewicz University in Poznań) (submittedVersion)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- electronic journals, online publication, citation patterns, scholarly communication, scholarly consensus, print archives
- MeSH terms
- Abstracting and Indexing, Libraries, Periodicals as Topic, Publishing, Bibliometrics, Information Storage and Retrieval, Internet, Libraries, Digital
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.