Unavailability of online supplementary scientific information from articles published in major journals
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Printed articles increasingly rely on online supplements to store critical scientific information, but such data may eventually become unavailable. We checked the current availability of online supplementary scientific information published in six top‐cited scientific journals ( Science, Nature, Cell, New England Journal of Medicine, Lancet, Proceedings of the National Academy of Sciences USA ). Here we show that in 4.7% and 9.6% of articles with online supplementary material, some of the supplements became unavailable within 2 and 5 years of their publication, respectively.—Evangelou, E., Trikalinos, T. A., Ioannidis, J. P. A. Unavailability of online supplementary scientific information from articles published in major journals. FASEB J. 19, 1943–1944 (2005)
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“there is some evidence that such systems cannot be relied upon as ‘broken links’ proliferate over time, rendering research resources unavailable [38].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [38]
Citations
Cites
Combining mapping and citation analysis for evaluative bibliometric purposes: A bibliometric study
Noyons, E. C. M., Moed, H. F., & Luwel, M. (1999) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(1999)50:2<115::aid-asi3>3.0.co;2-j · Cited by 448
Web page change and persistence—A four‐year longitudinal study
Koehler, W. (2002) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.10018 · Cited by 205
Going, Going, Gone: Lost Internet References
Dellavalle, R. P., Hester, E. J., Heilig, L. F., Drake, A. L., Kuntzman, J. W., Graber, M., & Schilling, L. M. (2003) · Science · doi:10.1126/science.1088234 · Cited by 172
An analysis of web page and web site constancy and permanence
Koehler, W. (1999) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(1999)50:2<162::aid-asi7>3.0.co;2-b · Cited by 168
Markwell, J. P., & Brooks, D. W. (2003) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.2003.494031010165 · Cited by 65
Standardized retrieval of side effects data for meta-analysis of safety outcomes
Ioannidis, J. P. A., Chew, P. W., & Lau, J. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00393-1 · Cited by 44 · cited 1×
“It should not be taken for granted that investigators would be able to furnish again this unavailable information (3, 7).”
BackgroundSelf-citationPleasing both authors and readers
Delamothe, T., Müllner, M., & Smith, R. (1999) · BMJ · doi:10.1136/bmj.318.7188.888 · Cited by 36
Research works printed but not linked: 1
- 2003, Institute for Scientific Information (ISI) Journal Citation Reports: JCR Science Edition
Cited by
Sharing Detailed Research Data Is Associated with Increased Citation Rate
Piwowar, H. A., Day, R. S., & Fridsma, D. B. (2007) · PLoS ONE · doi:10.1371/journal.pone.0000308 · Cited by 881
“Further, it is sometimes complicated to decide where to best publish data, since supplementary information and laboratory sites are transient[23,24] Beyond a time investment, releasing data can induce fear.”
BackgroundSwedberg, R. (2020) · The Production of Knowledge · doi:10.1017/9781108762519.002 · Cited by 293
Publication Bias in the Organizational Sciences
Kepes, S., Banks, G. C., McDaniel, M., & Whetzel, D. L. (2012) · Organizational Research Methods · doi:10.1177/1094428112452760 · Cited by 398
“Yet, journals in the medical sciences may provide such information online (Evangelou et al., 2005).”
BackgroundPublic Availability of Published Research Data in High-Impact Journals
Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024357 · Cited by 363
“Moreover, while all data web links of full primary datasets were verified as functioning in our analysis, this may reflect the temporal proximity of our analysis to the publication date of the articles, and some of these links may become unavailable a few years later [20].”
BackgroundSelf-citationHardwicke, T. E., Mathur, M. B., MacDonald, K., Nilsonne, G., Banks, G. C., Kidwell, M. C., Hofelich Mohr, A., Clayton, E., Yoon, E. J., Henry Tessler, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.180448 · Cited by 336
Reproducible Research Practices and Transparency across the Biomedical Literature
Iqbal, S. A., Wallach, J. D., Khoury, M. J., Schully, S. D., & Ioannidis, J. P. A. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002333 · Cited by 310
Self-citationData archiving in ecology and evolution: best practices
Whitlock, M. C. (2011) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2010.11.006 · Cited by 282
Evans, J. A., & Foster, J. G. (2011) · Science · doi:10.1126/science.1201765 · Cited by 252
A Practical Guide for Transparency in Psychological Science
Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Mohr, A. H., IJzerman, H., Nilsonne, G., Vanpaemel, W., & Frank, M. C. (2018) · Collabra: Psychology · doi:10.1525/collabra.158 · Cited by 233
Kepes, S., McDaniel, M. A., Brannick, M. T., & Banks, G. C. (2013) · Journal of Business and Psychology · doi:10.1007/s10869-013-9300-2 · Cited by 220
“Journals should also start to provide supplemental information online, such as results of subgroup analyses and related descriptive statistics (Evangelou et al. 2005).”
BackgroundHardwicke, T. E., Thibault, R. T., Kosie, J. E., Wallach, J. D., Kidwell, M. C., & Ioannidis, J. P. A. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691620979806 · Cited by 187
Self-citationCitations increase with manuscript length, author number, and references cited in ecology journals
Fox, C. W., Paine, C. E. T., & Sauterey, B. (2016) · Ecology and Evolution · doi:10.1002/ece3.2505 · Cited by 159
The Production of Knowledge: Enhancing Progress in Social Science
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519 · Cited by 241
Publication Bias in Strategic Management Research
Harrison, J. S., Banks, G. C., Pollack, J. M., O’Boyle, E. H., & Short, J. (2017) · Journal of Management · doi:10.1177/0149206314535438 · Cited by 141
How Trustworthy Is the Scientific Literature in Industrial and Organizational Psychology?
Kepes, S., & McDaniel, M. A. (2013) · Industrial and Organizational Psychology · doi:10.1111/iops.12045 · Cited by 124
Avoiding Bias in Publication Bias Research: The Value of “Null” Findings
Kepes, S., Banks, G. C., & Oh, I. (2012) · Journal of Business and Psychology · doi:10.1007/s10869-012-9279-0 · Cited by 143
Publication Bias: A call for improved meta‐analytic practice in the organizational sciences
Banks, G. C., Kepes, S., & McDaniel, M. A. (2012) · International Journal of Selection and Assessment · doi:10.1111/j.1468-2389.2012.00591.x · Cited by 91
Publication Bias: The Antagonist of Meta-Analytic Reviews and Effective Policymaking
Banks, G. C., Kepes, S., & Banks, K. P. (2012) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373712446144 · Cited by 81
“…prevention of publication bias include more thorough systematic searches to obtain more relevant samples (see Rothstein, in press), providing supplemental results online on journal websites (see Evangelou et al., 2005), and conducting prospective meta-analytic reviews (see Berlin & Ghersi, 2005).”
BackgroundDeveloping a Research Data Policy Framework for All Journals and Publishers
Hrynaszkiewicz, I., Simons, N., Hussain, A. R., Grant, R. A., & Goudie, S. (2020) · Data Science Journal · doi:10.5334/dsj-2020-005 · Cited by 88
Haidich, A., Birtsou, C., Dardavessis, T., Tirodimos, I., & Arvanitidou, M. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.005 · Cited by 90
“Nowadays, critical scientific information can be provided in online supplements because of limited space in printed articles [23,24].”
BackgroundThe Dawn of Open Access to Phylogenetic Data
Magee, A. F., May, M. R., & Moore, B. R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110268 · Cited by 62
“As in previous studies [49,50], our results indicate that data availability decreases markedly over time.”
ResultNot the time or the place: the missing spatio‐temporal link in publicly available genetic data
Pope, L. C., Liggins, L., Keyse, J., Carvalho, S. B., & Riginos, C. (2015) · Molecular Ecology · doi:10.1111/mec.13254 · Cited by 54
Aronsky, D., Madani, S., Carnevale, R. J., Duda, S. N., & Feyder, M. T. (2007) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m2243 · Cited by 50
“6% after five years of an article’s initial publication.(11) In a study that examined the URLs listed in MEDLINE® abstracts, 12% were incorrectly formatted or misspelled.”
BackgroundA practical guide for transparency in psychological sciencePreprint
Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Mohr, A. H., IJzerman, H. R., Nilsonne, G., Vanpaemel, W., & Frank, M. C. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/rtygm · Cited by 46
A cross disciplinary study of link decay and the effectiveness of mitigation techniques
Hennessey, J., & Ge, X. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-s14-s5 · Cited by 44
Reporting of Human Genome Epidemiology (HuGE) association studies: An empirical assessment
Yesupriya, A., Evangelou, E., Kavvoura, F. K., Patsopoulos, N. A., Clyne, M., Walsh, M. C., Lin, B. K., Yu, W., Gwinn, M., Ioannidis, J. P., et al. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-31 · Cited by 44
Self-citationThe Validity of Conscientiousness Is Overestimated in the Prediction of Job Performance
Kepes, S., & McDaniel, M. A. (2015) · PLOS ONE · doi:10.1371/journal.pone.0141468 · Cited by 33
“If space considerations in journals prohibit detailed reporting of results, they should be made available on journal websites as supplementary information, a practice that is common in the medical sciences [68] and cross-disciplinary journals such as PLoS ONE.”
The Missing Link: Assessing the Reliability of Internet Citations in History Journals
Russell, E., & Kane, J. (2008) · Technology and Culture · doi:10.1353/tech.0.0028 · Cited by 35
Use of reproducible research practices in public health: A survey of public health analysts
Harris, J. K., Johnson, K. J., Carothers, B. J., Combs, T., Luke, D. A., & Wang, X. (2018) · PLoS ONE · doi:10.1371/journal.pone.0202447 · Cited by 40
Practices, Policies, and Persistence: A Study of Supplementary Materials in Crop Science Journals
Williams, S. C. P. (2016) · Journal of Agricultural & Food Information · doi:10.1080/10496505.2015.1120213 · Cited by 30
“A study by Evangelou et al. (2005) provides additional evidence that broken links to supplementary materials are a problem.”
BackgroundResultPre-registration and Results-Free Review in Observational and Qualitative Research
Jacobs, A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.009 · Cited by 34
Policies regarding public availability of published research data in pediatrics journals
Aleixandre‐Benavent, R., Ferrer-Sapena, A., Ferrer, S. C., Peset, F., & García-García, A. (2019) · Scientometrics · doi:10.1007/s11192-018-2978-1 · Cited by 30
Digital Slide Repositories for Publications: Lessons Learned From the Microarray Community
Hipp, J., Lucas, D. R., Emmert‐Buck, M. R., Compton, C. C., & Balis, U. J. (2011) · The American Journal of Surgical Pathology · doi:10.1097/pas.0b013e31821946b6 · Cited by 28
The Past Web: Exploring Web Archives
Rogers, R., Gomes, D., Demidova, E., Winters, J., & Risse, T. (2021) · Springer eBooks · doi:10.1007/978-3-030-63291-5 · Cited by 32
Field Experimentation and the Study of Law and Policy
GREEN, D. P., & Thorley, D. (2014) · Annual Review of Law and Social Science · doi:10.1146/annurev-lawsocsci-110413-030936 · Cited by 23
A Visual Approach to Query Formulation for Systematic Search
Russell‐Rose, T., Chamberlain, J., & Shokraneh, F. (2019) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3295750.3298919 · Cited by 21
Piwowar, H. (2010) · D-Scholarship@Pitt (University of Pittsburgh) · Cited by 27
The Wayback Machine: notes on a re-enchantment
Bowyer, S. (2020) · Archival Science · doi:10.1007/s10502-020-09345-w · Cited by 18
“The problem persists across all disciplines (Kumar et al. 2015; Russell and Kane 2008; Evangelou et al. 2005; Hester et al. 2004; Crichlow and Winbush 2004; Dellavalle et al. 2003).”
Nichols, D. M., & Twidale, M. B. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23741 · Cited by 20
“…studies focussing on reproducibility have highlighted the inaccessibility of underlying data across several domains (Anderson, Greene, McCullough & Vinod, 2008; Wicherts, Borsboom, Kats, & Molenaar, 2006; Evangelou, Trikalinos & Ioannidis, 2005; Alsheikh-Ali, Qureshi, Al-Mallah, & Ioannidis, 2011).”
BackgroundEnhanced display of scientific articles using extended metadataPreprint
Page, R. (2009) · Nature Precedings · doi:10.1038/npre.2009.3173.1 · Cited by 17
Yanai, R. D., Mann, T. A., Hong, S. D., Pu, G., & Zukswert, J. M. (2021) · Ecosphere · doi:10.1002/ecs2.3535 · Cited by 16
“This is worse than was found in a survey of top journals conducted in 2005, in which papers published 2 and 5 yr previously had failure rates of 5% and 10%, respectively, in sharing supplemental materials (Evangelou et al. 2005).”
ResultMaking Research Data Accessible
Kapiszewski, D., & Karcher, S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.008 · Cited by 16
Going Digital: Persistent Identifiers for Research Samples, Resources and Instruments
Plomp, E. (2020) · Data Science Journal · doi:10.5334/dsj-2020-046 · Cited by 18
The Use of the World Wide Web by Medical Journals in 2003 and 2005: An Observational Study
Schriger, D. L., Ouk, S., & Altman, D. G. (2007) · PEDIATRICS · doi:10.1542/peds.2006-1538 · Cited by 15
“22 Mechanisms must be developed to notify Web users that they are reading material that has been altered after its initial posting and to make the original posting available for perusal.”
BackgroundMaag, J. W., & Losinski, M. L. (2015) · Advances in Social Sciences Research Journal · doi:10.14738/assrj.24.1044 · Cited by 12
Krell, F. (2009) · Aquatic Insects · doi:10.1080/01650420903083393 · Cited by 12
“The impermanence of URLs (i.e. web pages) is a widely recognised phenomenon (Evangelou et al. 2005; Aronsky et al. 2007; Wren 2008).”
BackgroundGee, B. M. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.06.22.496729 · Cited by 11
“…reviewed during peer review; lower readership compared to the primary article; separation from the main text; and undercounting of citations (e.g., Evangelou et al., 2005; Maunsell, 2010; Borowski, 2011; Kenyon and Sprague, 2014, 2016; Pop and Salzberg, 2015; Moore and Beckerman, 2016; Shutler…”
BackgroundIreland, M., Algarabel, G., Steventon, M., & Munafo, M. R. (2023) · Seismica · doi:10.26443/seismica.v2i1.278 · Cited by 9
Rockembach, M., & Serrano, A. (2021) · Records Management Journal · doi:10.1108/rmj-11-2020-0039 · Cited by 6
Reliability of Inference: Analogs of Replication in Qualitative Research
Fairfield, T., & Charman, A. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.012 · Cited by 6
Major, D. (2021) · Springer eBooks · doi:10.1007/978-3-030-63291-5_1 · Cited by 6
Gerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.001 · Cited by 6
DOIs for DICOM Raw Images: Enabling Science Reproducibility
Bourne, P. E. (2015) · Radiology · doi:10.1148/radiol.15150144 · Cited by 5
Replication for Quantitative Research
Freese, J., & Peterson, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.010 · Cited by 4
Transparency and Reproducibility: Conceptualizing the Problem
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.006 · Cited by 4
Measurement Replication in Qualitative and Quantitative Studies
Reiter, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.011 · Cited by 4
The Five Stars of Online Journal Articles – an article evaluation frameworkPreprint
Shotton, D. M. (2011) · Nature Precedings · doi:10.1038/npre.2011.6542.1 · Cited by 4
Gerring, J., Karcher, S., & Apfeld, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.015 · Cited by 3
What’s Wrong with Replicating the Old Boys’ Networks?
Teele, D. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.016 · Cited by 2
Trends, costs, benefits, challenges, and prognoses for supplementary materials
Dave Shutler, A., & Murray, A. (2016) · The Auk · doi:10.1642/auk-16-92.1 · Cited by 2
Transparency and Reproducibility: Potential Solutions
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.007 · Cited by 3
Arquivamento da web e preservação digital
Rockembach, M., & Pavão, C. M. G. (2024) · Pimenta Cultural eBooks · doi:10.31560/pimentacultural/2024.98119 · Cited by 4
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.013 · Cited by 2
Lieberman, E. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.003 · Cited by 3
Visualising a scientific articlePreprint
Page, R., & Page, R. (2008) · Nature Precedings · doi:10.1038/npre.2008.2579.1 · Cited by 2
(2015) · Radiology · doi:10.1148/radiol.2753201506 · Cited by 2
Kutnyánszky, A., Szabó, G., Tomcsik, A., & Verle, I. (2023) · Magyar Tudomány · doi:10.1556/2065.184.2023.7.5 · Cited by 1
“Mások arra hívják fel a figyelmet, hogy az adatokat inkább intézményi adat - tárakban, mint egyéni weboldalakon kell elhelyezni, mivel tapasztalatok szerint az utóbbiak néhány éven belül elérhetetlenné válhatnak (Evangelou et al., 2005).”
Gupta, R., & Mantri, S. S. (2016) · Frontiers in Genetics · doi:10.3389/fgene.2016.00046 · Cited by 1
“Furthermore, the online unavailability of the supplementary material is a great setback for information extraction process (Evangelou et al., 2005).”
BackgroundDecay of URL References cited in DESIDOC Journal of Library & Information Technology
Bansal, S. (2021) · Lincoln (University of Nebraska) · Cited by 1
Gerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.018 · Cited by 2
Gerring, J., & Cojocaru, L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.005 · Cited by 1
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.014 · Cited by 2
Gross, N., & Robertson, C. T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.017 · Cited by 2
Estimating the reproducibility & transparency of smoking cessation behaviour change interventionsPreprint
Norris, E., He, Y., Loh, R., West, R., & Michie, S. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/n4fty · Cited by 1
keyse, J. (2015) · The University of Queensland · doi:10.14264/uql.2015.899
An Exploratory Study on the Analysis of Academic Websites Co-Citation
Yang, S., & Xiong, Z. (2009) · International Conference on Management and Service Science (MASS) · doi:10.1109/icmss.2009.5303329
Eysenbach, G. (2008) · Elpub digital library
HotDataSpider, an ETL tool for supplementary data of biomedical journals
Xu, Q., & Guo, J. X. (2009) · International Conference on Future BioMedical Information Engineering · doi:10.1109/fbie.2009.5405918
Research in Emotional or Behavioral Disorders: Does it Examine Study Quality and Null Results?
Losinski, M. L., & Maag, J. W. (2018) · Journal of Education Society and Behavioural Science · doi:10.9734/jesbs/2018/42940
زکريا, م. ش. (2020) · Al-Mağallah Al-ʿilmiyyaẗ Lil-Maktabāt wa Al-Waṯā'iq wa Al-Ma'lūmāt · doi:10.21608/jslmf.2020.67406
Comparative analysis of historical scholarly and educational media sites
Tarkhanov, I. (2020) · nauka me · doi:10.18254/s207987840013121-2
HotDataSpider, an ETL Tool for Supplementary Data of Biomedical Journals
Wu, H., & HUST-RRes, C.-U. (2009)
Enhanced Display of Scientific Articles Using Extended MetadataPreprint
Page, R. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3199472
Liao, T. F. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.004
Elman, C., Gerring, J., & Mahoney, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.019
Cranston, P. S., & Krell, F. (2006) · Systematic Entomology · doi:10.1111/j.1365-3113.2006.00340.x
Badgett, R. G., Berkwits, M., & Mulrow, C. D. (2006) · Annals of Internal Medicine · doi:10.7326/0003-4819-145-1-200607040-00016
Examining the availability/findability of stimuli employed in social media and body image research
Smailes, D., Aleksandra, A., Coakley, M., Mair, S., & Ventress, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0324514
“However, it should be noted that there are limitations to this approach of sharing URLs, as they may be affected by ‘link rot’ [28], where once-usable links become unavailable over time.”
Lyu, P., Zhang, M., Cao, C., & Ngai, E. W. T. (2025) · Journal of Information Science · doi:10.1177/01655515251362329
Pope, L. C., Liggins, L., Keyse, J., Carvalho, S. B., & Riginos, C. (2015) · Data Archiving and Networked Services (DANS) · doi:10.5061/dryad.kg943.1
Metadata
- Authors
- Evangelou, E., Trikalinos, T. A., & Ioannidis, J. P. A.
- Affiliations
- Department of Hygiene and Epidemiology University of Ioannina School of Medicine Ioannina Greece
- Tufts Medical Center (US)
- Venue
- The FASEB Journal
- Publisher
- Wiley
- Published
- 2005-12
- Volume
- 19
- Issue
- 14
- Pages
- 1943-1944
- ISSN
- 0892-6638 (ISSN-L)
- 1530-6860
- OpenAlex
- W2023223848
- Cited by
- 92
- References
- 6
- Citations by year
- 2025: 2 · 2024: 1 · 2023: 2 · 2022: 2 · 2021: 6 · 2020: 26 · 2019: 2 · 2018: 6 · 2017: 1 · 2016: 6 · 2015: 7 · 2014: 3 · 2013: 3 · 2012: 4
- FWCI
- 7.27
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The FASEB Journal (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- data unavailability, scientific journals, data loss, research data preservation, data archiving
- MeSH terms
- Information Services, Libraries, Medical, Online Systems, Periodicals as Topic, Publishing, Research, Databases, Bibliographic, Databases, Factual, Journalism, Medical, Internet, Access to Information
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.