Public Availability of Published Research Data in High-Impact Journals
Open accessThe DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
BACKGROUND: There is increasing interest to make primary data from published research publicly available. We aimed to assess the current status of making research data available in highly-cited journals across the scientific literature. METHODS AND RESULTS: We reviewed the first 10 original research papers of 2009 published in the 50 original research journals with the highest impact factor. For each journal we documented the policies related to public availability and sharing of data. Of the 50 journals, 44 (88%) had a statement in their instructions to authors related to public availability and sharing of data. However, there was wide variation in journal requirements, ranging from requiring the sharing of all primary data related to the research to just including a statement in the published manuscript that data can be available on request. Of the 500 assessed papers, 149 (30%) were not subject to any data availability policy. Of the remaining 351 papers that were covered by some data availability policy, 208 papers (59%) did not fully adhere to the data availability instructions of the journals they were published in, most commonly (73%) by not publicly depositing microarray data. The other 143 papers that adhered to the data availability instructions did so by publicly depositing only the specific data type as required, making a statement of willingness to share, or actually sharing all the primary data. Overall, only 47 papers (9%) deposited full primary raw data online. None of the 149 papers not subject to data availability policies made their full primary data publicly available. CONCLUSION: A substantial proportion of original research papers published in high-impact journals are either not subject to any data availability policies, or do not adhere to the data availability instructions in their respective journals. This empiric evaluation highlights opportunities for improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“The policies of journals and professional societies, such as the American Psychological Association, often fall short of imposing mandatory data-sharing requirements on researchers, and merely recommend that data be ‘available upon request’, if they make any recommendation at all [7,15].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [7]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“raw data are still rarely available (Alsheikh-Ali, Qureshi, Al-Mallah, & Ioannidis, 2011).”
From The prevalence of statistical reporting errors in psychology (1985–2013) (2016) · cites this paper as Alsheikh-Ali, Qureshi, Al-Mallah, & Ioannidis, 2011
The cited source says what the claim attributes to it.
In the citing paper
“However, assessment of analytic reproducibility is typically precluded by poor access to research data [7–14].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“In the absence of stringent community norms or regulations, scientific claims are regularly published without public release of the research data upon which they are based [7,9,14].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [7]
The cited source says what the claim attributes to it.
In the citing paper
“However, these policies are uncommonly adhered to 95 , and thus the ability for independent experts to repeat published analysis remains low 96 .”
From Power failure: why small sample size undermines the reliability of neuroscience (2013) · cites this paper as [95]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Why data-sharing policies matter
Guttmacher, A. E., Nabel, E. G., & Collins, F. S. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0910378106 · Cited by 34 · cited 1×
“Reproduction of research findings and further exploration of related hypotheses require access to these primary data, and their public availability has been a concern for all stakeholders of the scientific process, including regulatory and funding agencies, journal editors, individual researchers, and patients [2,3,4,…”
BackgroundRetractedWithholding Research Results in Academic Life Science: Evidence From a National Survey of Faculty
Blumenthal, D. (1997) · JAMA · doi:10.1001/jama.1997.03540390054035 · Cited by 576
Repeatability of published microarray gene expression analyses
Ioannidis, J. P. A., Allison, D. B., Ball, C. A., Coulibaly, I., Cui, X., Culhane, A. C., Falchi, M., Furlanello, C., Game, L., Jurman, G., et al. (2009) · Nature Genetics · doi:10.1038/ng.295 · Cited by 551 · cited 2×
“Even when data are publicly available, published results are often not reproducible by independent investigators due to incomplete annotation or specification of data processing and analyses [14].”
BackgroundSelf-citationThe poor availability of psychological research data for reanalysis.
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006) · American Psychologist · doi:10.1037/0003-066x.61.7.726 · Cited by 543 · cited 1×
“Recent analyses have empirically highlighted deficiencies in the practice of making primary data and protocols available in peerreviewed publications[14,15,16].”
BackgroundWhy Current Publication Practices May Distort Science
Young, N. S., Ioannidis, J. P. A., & Al-Ubaydli, O. (2008) · PLoS Medicine · doi:10.1371/journal.pmed.0050201 · Cited by 502 · cited 1×
“The observations of scientists as coded in their primary data constitute a central commodity in the scientific enterprise [1].”
BackgroundSelf-citationData Withholding in Academic Genetics: Evidence From a National Survey
Campbell, E. G., Clarridge, B. R., Gokhale, M., Birenbaum, L., Hilgartner, S., Holtzman, N. A., & Blumenthal, D. (2002) · JAMA · doi:10.1001/jama.287.4.473 · Cited by 489 · cited 1×
“Empirical studies suggest that data withholding is not uncommon in the scientific community and may be influenced by industry relationships, perceptions of proprietary information and scientific priority, lack of resources, and personal investigator training and stances towards data sharing[17,18,19].”
BackgroundEmpirical Study of Data Sharing by Authors Publishing in PLoS Journals
Savage, C. J., & Vickers, A. J. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007078 · Cited by 411 · cited 2×
“Recent analyses have empirically highlighted deficiencies in the practice of making primary data and protocols available in peerreviewed publications[14,15,16].”
BackgroundData Withholding in Genetics and the Other Life Sciences: Prevalences and Predictors
Blumenthal, D., Campbell, E. G., Gokhale, M., Yucel, R., Clarridge, B., Hilgartner, S., & Holtzman, N. A. (2006) · Academic Medicine · doi:10.1097/00001888-200602000-00008 · Cited by 211 · cited 1×
“Empirical studies suggest that data withholding is not uncommon in the scientific community and may be influenced by industry relationships, perceptions of proprietary information and scientific priority, lack of resources, and personal investigator training and stances towards data sharing[17,18,19].”
BackgroundWhose data set is it anyway? Sharing raw data from randomized trials
Vickers, A. J. (2006) · Trials · doi:10.1186/1745-6215-7-15 · Cited by 149 · cited 1×
“Recently, efforts have converged to encourage making data, protocols, and analytical codes available, as part of the growing movement of reproducible research [8,9,10].”
BackgroundHrynaszkiewicz, I., Norton, M. L., Vickers, A. J., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c181 · Cited by 146
Cited by
Items 101–200 of 354
Quantifying the use of bioresources for promoting their sharing in scientific research
BRIF working group, Mabile, L., Dalgleish, R. W. M., Þórisson, G. Á., Deschênes, M., Hewitt, R. E., Carpenter, J. E., Bravo, E., Filocamo, M., Gourraud, P., et al. (2013) · GigaScience · doi:10.1186/2047-217x-2-7 · Cited by 61
“Therefore, it is important to develop incentives that will support and promote this sharing if we are to realize the vision which funders hope to encourage [10,11].”
Mine, Yours, Ours? Sharing Data on Human Genetic Variation
Milia, N., Congiu, A., Anagnostou, P., Montinaro, F., Capocasa, M., Sanna, E., & Bisol, G. D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0037552 · Cited by 52
“As shown by a recent study carried out on a selection of 500 studies published in the 50 research journals with the highest impact factor, 30% of papers were not subject to any data availability policy, but an even higher percentage (58%) did not adhere to the existing data sharing guidelines [19].”
BackgroundPsychology, replication & beyond
Laws, K. R. (2016) · BMC Psychology · doi:10.1186/s40359-016-0135-2 · Cited by 59
“[1] reported that a substantial proportion of papers published in high-impact journals “.”
BackgroundLiu, D. M., & Salganik, M. J. (2019) · Socius Sociological Research for a Dynamic World · doi:10.1177/2378023119849803 · Cited by 47
Transdisciplinary synthesis for ecosystem science, policy and management: The Australian experience
Lynch, A. J. J., Thackway, R., Specht, A., Beggs, P. J., Brisbane, S., Burns, E. L., Byrne, M. M., Capon, S. J., Casanova, M. T., Clarke, P. A., et al. (2015) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2015.04.100 · Cited by 56
“However, data are often not shared and statistical codes not reported, evenwhen data sharing is required as part of publishing conditions (Savage andVickers, 2009; Alsheikh-Ali et al., 2011).”
BackgroundGlobus Data Publication as a Service: Lowering Barriers to Reproducible Science
Chard, K., Pruyne, J., Blaiszik, B. J., Ananthakrishnan, R., Tuecke, S. J., & Foster, I. T. (2015) · IEEE International Conference on eScience · doi:10.1109/escience.2015.68 · Cited by 47
“Many studies (e.g., [1], [2]) have shown that current research data management and publication practices are inadequate.”
BackgroundKrafczyk, M. S., Shi, A., Bhaskar, A., Marinov, D., & Stodden, V. (2021) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2020.0069 · Cited by 61
“With recent efforts showing some high profile works failing to reproduce [40–42], attempts have been made to determine why such works fail to reproduce [43,44], what policies can be taken to decrease reproduction failures [36,45] and whether such policies are effective [11,42,46].”
BackgroundCeli, L. A., Citi, L., Ghassemi, M., & Pollard, T. J. (2019) · PLOS ONE · doi:10.1371/journal.pone.0210232 · Cited by 45
Computational Reproducibility in The Wildlife Society's Flagship Journals
ArchMiller, A. A., Johnson, A. D., Nolan, J., Edwards, M., Elliott, L. H., Ferguson, J. M., Iannarilli, F., Vélez, J., Vitense, K., Johnson, D. H., et al. (2020) · Journal of Wildlife Management · doi:10.1002/jwmg.21855 · Cited by 47
“Similarly, Alsheikh ‐ Ali et al. (2011) reported that authors from only 9% of 351 studies published in high ‐ impact journals with data ‐ sharing requirements shared raw data on - line.”
BackgroundNarvaez-Montoya, C., Mahlknecht, J., Torres-Martínez, J. A., Mora, A., & Bertrand, G. (2022) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2022.160933 · Cited by 47
Perspectives on Open Science and scientific data sharing:an interdisciplinary workshop.
Destro‐Bisol, G., Anagnostou, P., Capocasa, M., Bencivelli, S., Cerroni, A., Contreras, J. L., Enke, N., Fantini, B., Greco, P., Heeney, C., et al. (2014) · PubMed · doi:10.4436/jass.92006 · Cited by 46
A manifesto for reproducible science.
Munafo, M. R., Nosek, B. A., Bishop, D., Button, K. S., Chambers, C., du Sert, N. P., Simonsohn, U., Wagenmakers, E., Ware, J. J., & Ioannidis, J. P. A. (2024) · American Psychological Association eBooks · doi:10.1037/0000409-041 · Cited by 42
Self-citationCodifying Collegiality: Recent Developments in Data Sharing Policy in the Life Sciences
Kanter, G. P., Ƶinner, D. E., & Campbell, E. G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0108451 · Cited by 42
“This scenario is consistent with previous work by Alsheikh-Ali et al [5].”
ResultPanel on use of proprietary data
Callan, J., & Moffat, A. (2012) · ACM SIGIR Forum · doi:10.1145/2422256.2422258 · Cited by 12
Interpreting t-Statistics Under Publication Bias: Rough Rules of Thumb
Winship, C., & Zhuo, X. (2018) · Journal of Quantitative Criminology · doi:10.1007/s10940-018-9387-8 · Cited by 46
Single-case experimental research designs.
Kazdin, A. E. (2015) · Methodological issues and strategies in clinical research (4th ed.). · doi:10.1037/14805-029 · Cited by 39
Pinto, J. A., Araujo, J. M., Cardenas, N. K., Morante, Z., Doimi, F. D., Vidaurre, T., Balko, J. M., & Gómez, H. (2016) · npj Genomic Medicine · doi:10.1038/npjgenmed.2015.15 · Cited by 40
“Lack of important information in public data sets despite journal requirements has been previously addressed.(21) To overcome this issue, we selected patients with residual disease from data sets profiled with a different platform (affymetrix microarrays) and with samples taken prior NAC for our validation cohort.”
MethodCatalá-López, F., Aleixandre-Benavent, R., Caulley, L., Hutton, B., Tabarés-Seisdedos, R., Moher, D., & Alonso-Arroyo, A. (2020) · Trials · doi:10.1186/s13063-019-3944-9 · Cited by 38
Verma, M., Khoury, M. J., & Ioannidis, J. P. A. (2013) · Cancer Epidemiology, Biomarkers & Prevention · doi:10.1158/1055-9965.epi-12-1263 · Cited by 38
Self-citationChin, J. M., Ribeiro, G., & Rairden, A. (2019) · Journal of Law and the Biosciences · doi:10.1093/jlb/lsz009 · Cited by 44
Sizing the Problem of Improving Discovery and Access to NIH-Funded Data: A Preliminary Study
Read, K. B., Sheehan, J. R., Huerta, M. F., Knecht, L. S., Mork, J. G., Humphreys, B. L., & NIH Big Data Annotator Group (2015) · PLOS ONE · doi:10.1371/journal.pone.0132735 · Cited by 34
“In one study, only 9% of articles from high-impact journals deposited their full dataset (including raw data) online [12].”
BackgroundFerté, C., Trister, A. D., Huang, E. S., Bot, B. M., Guinney, J., Commo, F., Sieberts, S. K., André, F., Besse, B., Soria, J., et al. (2013) · Clinical Cancer Research · doi:10.1158/1078-0432.ccr-12-3937 · Cited by 36
“assessment of published models mandates that authors make data and code available (60).”
BackgroundAleixandre‐Benavent, R., Moreno-Solano, L., Ferrer-Sapena, A., & Sánchez-Pérez, E. A. (2016) · Scientometrics · doi:10.1007/s11192-016-1868-7 · Cited by 40
“Previous studies have analysed this possibility in journals with high impact factor (Alsheikh-Ali et al. 2011), in substance abuse journals (Aleixandre-Benavent et al. 2014) and in Library Science and Information Science journals (Borrego and Garcia 2013).”
BackgroundHarmel, R. D., Baffaut, C., & Douglas‐Mankin, K. R. (2018) · Transactions of the ASABE · doi:10.13031/trans.12806 · Cited by 38
Leonti, M., Cabras, S., Castellanos, M. E., Challenger, A., Gertsch, J., & Casu, L. (2013) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2013.02.012 · Cited by 37
Predictors of clinical trial data sharing: exploratory analysis of a cross-sectional survey
Rathi, V. K., Strait, K. M., Gross, C. P., Hrynaszkiewicz, I., Joffe, S., Krumholz, H. M., Dzara, K., & Ross, J. S. (2014) · Trials · doi:10.1186/1745-6215-15-384 · Cited by 35
“These characteristics were selected based on a review of the literature, which, among other reasons, identified trialists’ motivation to publish [8,33,35], the protection of proprietary interests [32], ineffective journal-mandated policies [35,40], and concern for patient confidentiality [32] as potential barriers to…”
BackgroundData sharing in orthodontic research
Papageorgiou, S. N., & Cobourne, M. T. (2018) · Journal of Orthodontics · doi:10.1080/14653125.2018.1440792 · Cited by 35
Making open data work for plant scientists
Leonelli, S., Smirnoff, N., Moore, J. D., Cook, C. M., & Bastow, R. (2013) · Journal of Experimental Botany · doi:10.1093/jxb/ert273 · Cited by 32
“Despite the clear demand for data-sharing and the strength of the motivations for it, its implementation is still limited (Alsheikh-Ali et al., 2011).”
BackgroundCurrent and planned adoption of data sharing policies by editors of Korean scholarly journals
Kim, S. Y., Yi, H. J., & Huh, S. Y. (2019) · Science Editing · doi:10.6087/kcse.151 · Cited by 31
“Besides the data sharing policies of specific research groups or funding agencies, a 2011 report described the adoption of data sharing policies by high-impact factor journals [5].”
BackgroundA Duty to Describe: Better the Devil You Know Than the Devil You Don’t
Brown, S. D., Furrow, D. R., Hill, D. F., Gable, J. C., Porter, L. P., & Jacobs, W. J. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614551749 · Cited by 34
Managing the data commons: Controlled sharing of scholarly data
Eschenfelder, K. R., & Johnson, A. M. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23086 · Cited by 34
Dudda, L., Kormann, E., Kozula, M., DeVito, N. J., Klebel, T., Dewi, A. P. M., Spijker, R., Stegeman, I., Van den Eynden, V., Ross-Hellauer, T., et al. (2025) · Royal Society Open Science · doi:10.1098/rsos.242057 · Cited by 28
“Twenty-five investigated journal policies or author instructions about data sharing [31,43,45,57,60,68,71,72,75,84,87,92,94– 96, 99, Policy guidelines by funders or government agencies ( n = 3): two studies investigated policy issued by funders, more precisely the requirement of the National…”
Research Data Sharing in Spain: Exploring Determinants, Practices, and Perceptions
Aleixandre‐Benavent, R., Vidal‐Infer, A., Alonso‐Arroyo, A., Peset, F., & Ferrer-Sapena, A. (2020) · Data · doi:10.3390/data5020029 · Cited by 34
Hamilton, D. G., Page, M. J., Finch, S. J., Everitt, S., & Fidler, F. M. (2022) · BMC Medicine · doi:10.1186/s12916-022-02644-2 · Cited by 51
“Furthermore, while we also noted a strong relationship between mandatory data sharing policies and actual data availability, we unfortunately also observed similarly sub-optimal compliance with these policies too; a finding that has been noted by other studies both inside and outside of medicine [28, 53, 54].”
ResultGigaDB: promoting data dissemination and reproducibility
Sneddon, T. P., Zhe, X. S., Edmunds, S., Li, P., Goodman, L., & Hunter, C. (2014) · Database · doi:10.1093/database/bau018 · Cited by 28
“Despite the majority of high-impact journals setting out editorial policies relating to the public availability and sharing of data, one study showed that <10% of papers deposited full raw data (6).”
BackgroundForgotten treasures: the fate of data in animal behaviour studies
Caetano, D. S., & Aisenberg, A. (2014) · Animal Behaviour · doi:10.1016/j.anbehav.2014.09.025 · Cited by 29
“Savage and Vickers (2009) asked authors of articles published in the PLoS journals to share their datasets and, contrary to the journal, an impressive portion of authors refused to do so (see also Wicherts et al., 2006; Alsheikh-Ali et al., 2011).”
BackgroundA community-led initiative for training in reproducible research
Auer, S., Haelterman, N. A. T., Weissgerber, T. L., Erlich, J. C., Susilaradeya, D., Julkowska, M., Gazda, M. A., Schwessinger, B., Jadavji, N. M., Reproducibility for Everyone Team, et al. (2021) · eLife · doi:10.7554/elife.64719 · Cited by 28
Reproducibility in Computing Research: An Empirical Study
Raghupathi, W., Raghupathi, V., & Ren, J. (2022) · IEEE Access · doi:10.1109/access.2022.3158675 · Cited by 43
“In other words, it provides ex ante support as opposed to other models (e.g., code testing) that are ex post [49], [50], [53].”
ResultSowing the Seeds of Future Research: Data Sharing, Citation and Reuse in Archaeobotany
Lodwick, L. (2019) · Open Quaternary · doi:10.5334/oq.62 · Cited by 26
Public availability of research data in dentistry journals indexed in Journal Citation Reports
Vidal-Infer, A., Tarazona, B., Alonso-Arroyo, A., & Aleixandre-Benavent, R. (2018) · Clinical Oral Investigations · doi:10.1007/s00784-017-2108-0 · Cited by 25
“[29] that aimed to assess the current status of making research data available in highly cited journals—and therefore edited by leading multinational publishers—across the scientific literature, only 9% of papers deposited full primary raw data online.”
BackgroundResultPush button replication: Is impact evaluation evidence for international development verifiable?
Wood, B. D. K., Müller, R., & Brown, A. N. (2018) · PLOS ONE · doi:10.1371/journal.pone.0209416 · Cited by 24
Data publication consensus and controversies
Kratz, J. E., & Strasser, C. A. (2014) · F1000Research · doi:10.12688/f1000research.3979.1 · Cited by 29
Ki MoSys: a web-based repository of experimental data for KInetic MOdels of biological SYStems
Costa, R. S., Veríssimo, A., & Vinga, S. (2014) · BMC Systems Biology · doi:10.1186/s12918-014-0085-3 · Cited by 26
“Despite all resources and tools, there is a growing requirement for disseminate of experimental data and related protocols [38], kinetic models, as well as applications to support the construction of large-scale kinetic models for the wider systems biology community.”
BackgroundKnowledge Representation and Management: a Linked Data Perspective
Barros, M., & Couto, F. M. (2016) · Yearbook of Medical Informatics · doi:10.15265/iy-2016-022 · Cited by 26
“Public funding agencies and journals may enforce data-sharing policies, but adherence is most of the times inconsistent and scarce [51].”
Schofield, P. N., Kulka, U., Tapio, S., & Grosche, B. (2019) · International Journal of Radiation Biology · doi:10.1080/09553002.2019.1589026 · Cited by 24
“…longer regarded as an adequate repository for primary data, as many of these repositories are unstructured, unstable – data is often lost (Anderson et al. 2006; Alsheikh-Ali et al. 2011), undiscoverable or not actually submitted, in contradiction to explicit journal policies (Federer et al. 2018).”
BackgroundVickers, A. J. (2016) · Trials · doi:10.1186/s13063-016-1369-2 · Cited by 26
“We have seen papers developing data standards for clinical trials in narrow fields (for instance, polycystic kidney disease [13] and spinal cord injury [14]); technical papers on deidentification [15]; numerous surveys about the practice of or attitudes to data sharing [16–21]; discussion of ethical issues [22] (inclu…”
Anticipating consequences of sharing raw data and code and of awarding badges for sharing
Ioannidis, J. P. A. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.04.015 · Cited by 25
Self-citationAccelerating Scientists’ Knowledge Turns
Goble, C., Roure, D. D., & Bechhofer, S. (2013) · Communications in computer and information science · doi:10.1007/978-3-642-37186-8_1 · Cited by 32
Forero, D. A., Curioso, W. H., & Patrinos, G. P. (2021) · BMC Research Notes · doi:10.1186/s13104-021-05817-z · Cited by 26
“An analysis of 500 articles from 50 high-impact journals found that only a small fraction deposited their full raw data online [16].”
BackgroundUse of publication procedures to improve research integrity by addiction journals
Gorman, D. M. (2019) · Addiction · doi:10.1111/add.14604 · Cited by 24
A game theoretic analysis of research data sharing
Pronk, T. E., Wiersma, P. H., van Weerden, A., & Schieving, F. (2015) · PeerJ · doi:10.7717/peerj.1242 · Cited by 31
Policies regarding public availability of published research data in pediatrics journals
Aleixandre‐Benavent, R., Ferrer-Sapena, A., Ferrer, S. C., Peset, F., & García-García, A. (2019) · Scientometrics · doi:10.1007/s11192-018-2978-1 · Cited by 30
Catalá-López, F., Ridao-López, M., Tejedor-Romero, L., Caulley, L., Hutton, B., Husereau, D., Alonso‐Arroyo, A., Bernal‐Delgado, E., Drummond, M., & Moher, D. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.10.024 · Cited by 21
Theoretical and technological building blocks for an innovation accelerator
van Harmelen, F., KAMPIS, G., Börner, K., van den Besselaar, P., Schultes, E., Goble, C., Groth, P., Mons, B., Anderson, S., Decker, S., et al. (2012) · The European Physical Journal Special Topics · doi:10.1140/epjst/e2012-01692-1 · Cited by 22
“energy on reviewing without producing reliable quality; puts the credibility of scientic results at risk for basing on wrong reputation mechanisms. To further motivate these claims: a recent review [2] found that 44 of 50 leading scientic journals instructed their authors on sharing data, but fewer than 30 percent of…”
ResultAn interactive atlas for marine biodiversity conservation in the Coral Triangle
Asaad, I., Lundquist, C. J., Erdmann, M. V., & Costello, M. J. (2019) · Earth system science data · doi:10.5194/essd-11-163-2019 · Cited by 21
“, 2011) and more than 57 % of the papers in environmental biology publications examined in a 2011 review had not released their data (Alsheikh-Ali et al., 2011).”
BackgroundResearch waste‐related editorial policies of leading dental journals: Situation 2018
Almaqrami, B. S., Hua, F., Liu, Y., & He, H. (2020) · Oral Diseases · doi:10.1111/odi.13257 · Cited by 22
Imker, H. J., Luong, H., Mischo, W. H., Schlembach, M. C., & Wiley, C. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2021.102369 · Cited by 27
Rotteveel, L., Heubach, F., & Sterling, S. (2022) · Earth system science data · doi:10.5194/essd-14-4667-2022 · Cited by 23
What Should Be the Data Sharing Policy of Cognitive Science?
Pitt, M. A., & Tang, Y. (2013) · Topics in Cognitive Science · doi:10.1111/tops.12006 · Cited by 24
van den Brink, D., Lutomski, J. E., Li, Q., den Elzen, W. P. J., Kempen, G. I. J. M., Krabbe, P. F. M., Steyerberg, E. W., Muntinga, M. E., van Charante, E. P. M., Bleijenberg, N., et al. (2015) · Tijdschrift voor Gerontologie en Geriatrie · doi:10.1007/s12439-015-0127-3 · Cited by 22
The Changing Nature of Scientific Sharing and Withholding in Academic Life Sciences Research
Ƶinner, D. E., Kanter, G. P., & Campbell, E. G. (2015) · Academic Medicine · doi:10.1097/acm.0000000000001028 · Cited by 21
Helderop, E., Grubesic, T. H., & Alizadeh, T. (2019) · The Information Society · doi:10.1080/01972243.2019.1574528 · Cited by 21
“In academia, as detailed by Alsheikh-Ali et al. (2011), peer-reviewed journals often require the data be available in a certain format, while the funding agency sponsoring the research may require a completely different one.”
BackgroundAssigning credit to scientific datasets using article citation networks
Zeng, T., Wu, L., Bratt, S., & Acuna, D. E. (2020) · Journal of Informetrics · doi:10.1016/j.joi.2020.101013 · Cited by 23
“First, datasets cost time and labor to prepare and to share, resulting in some articles failing to provide datasets (Alsheikh-Ali et al., 2011).”
BackgroundWhat senior academics can do to support reproducible and open research: a short, three-step guide
Kowalczyk, O. S., Lautarescu, A., Blok, E., Dall’Aglio, L., & Westwood, S. J. (2022) · BMC Research Notes · doi:10.1186/s13104-022-05999-0 · Cited by 28
Public availability of HIV-1 drug resistance sequence and treatment data: a systematic review
Rhee, S., Kassaye, S., Jordan, M. R., Kouamou, V., Katzenstein, D. A., & Shafer, R. W. (2022) · The Lancet Microbe · doi:10.1016/s2666-5247(21)00250-0 · Cited by 23
Data is not available upon requestPreprint
Hussey, I. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/jbu9r · Cited by 24
Experiences in integrated data and research object publishing using GigaDB
Edmunds, S., Li, P., Hunter, C., Zhe, X. S., Davidson, R., Nogoy, N., & Goodman, L. (2016) · International Journal on Digital Libraries · doi:10.1007/s00799-016-0174-6 · Cited by 20
Sixto-Costoya, A., Robinson‐García, N., van Leeuwen, T. N., & Costas, R. (2021) · Scientometrics · doi:10.1007/s11192-021-04043-5 · Cited by 25
Enabling scientific data sharing and re-use
Darby, R., Lambert, S. C., Matthews, B., Wilson, M., Gitmans, K., Dallmeier-Tiessen, S., Mele, S., & Suhonen, J. (2012) · IEEE International Conference on eScience · doi:10.1109/escience.2012.6404475 · Cited by 18
Knowledge Integration in Cancer: Current Landscape and Future Prospects
Ioannidis, J. P. A., Schully, S. D., Lam, T. K., & Khoury, M. J. (2012) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-12-1144 · Cited by 20
“…have policies that require delineating some plan of making raw data, protocols, and analysis codes publicly available, routinely or after request to the authors; public deposition of such information is often a prerequisite for publication, but these policies are not necessarily enforced (14, 15).”
Self-citationGivechian, K. B., Garner, C. P., Garbán, H., Rabizadeh, S., & Soon‐Shiong, P. (2018) · Oncotarget · doi:10.18632/oncotarget.25701 · Cited by 20
Availability of Research Data in High-Impact Addiction Journals with Data Sharing Policies
Gorman, D. M. (2020) · Science and Engineering Ethics · doi:10.1007/s11948-020-00203-7 · Cited by 20
Reproducibility of biomedical research – The importance of editorial vigilance
Bustin, S. A., & Huggett, J. F. (2017) · Biomolecular Detection and Quantification · doi:10.1016/j.bdq.2017.01.002 · Cited by 19
Nichols, D. M., & Twidale, M. B. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23741 · Cited by 20
DataPipe: Born-open data collection for online experiments
de Leeuw, J. R. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02161-x · Cited by 18
“…have adopted data sharing policies that require open data (Nosek et al., 2015)—though the enforcement of and follow-through on such policies is sometimes lax (Alsheikh-Ali et al., 2011; Hussey, 2023)—and/or recognition for articles that elect to include open data (e.g., Kidwell et al., 2016).”
Reconstructing past thermal conditions in beach microclimates
Laloë, J., Chivers, W., Esteban, N., & Hays, G. C. (2021) · Global Change Biology · doi:10.1111/gcb.15903 · Cited by 16
Selective outcome reporting and sponsorship in randomized controlled trials in IVF and ICSI
Braakhekke, M., Scholten, I., Mol, F., Limpens, J., Mol, B. W., & van der Veen, F. (2017) · Human Reproduction · doi:10.1093/humrep/dex273 · Cited by 18
Data sharing policies in scholarly publications: interdisciplinary comparisons
Tal-Socher, M., & Ziderman, A. (2020) · Prometheus · doi:10.13169/prometheus.36.2.0116 · Cited by 17
Discoveries and advances in plant and animal genomics
Appels, R., Nystrom, J., Webster, H., & Keeble‐Gagnère, G. (2015) · Functional & Integrative Genomics · doi:10.1007/s10142-015-0434-3 · Cited by 17
“An important aspect of this was that high impact journals should take a greater role in ensuring compliance to the uploading of datasets into the digital environments (Alsheikh-Ali et al. 2011; Bourne 2013).”
BackgroundRegistered Randomized Trials Comparing Generic and Brand-Name Drugs: A Survey
Flacco, M. E., Manzoli, L., Boccia, S., Puggina, A., Rosso, A., Marzuillo, C., Scaioli, G., Gualano, M. R., Ricciardi, W., Villari, P., et al. (2016) · Mayo Clinic Proceedings · doi:10.1016/j.mayocp.2016.04.032 · Cited by 17
Self-citationDjalalinia, S., Kelishadi, R., Qorbani, M., Peykari, N., Kasaeian, A., Moghaddam, S. S., Gohari, K., Larijani, B. A., & Farzadfar, F. (2014) · PubMed · Cited by 15
Improving average ranking precision in user searches for biomedical research datasets
Teodoro, D., Mottin, L., Gobeill, J., Gaudinat, A., Vachon, T., & Ruch, P. (2017) · Database · doi:10.1093/database/bax083 · Cited by 14
“Transparent and integrated access to research datasets is also paramount for asserting reproducibility and reliability of research outcomes (2, 4).”
BackgroundMethodInfluentialMarwick, B., & Birch, S. E. P. (2018) · Advances in Archaeological Practice · doi:10.1017/aap.2018.25 · Cited by 13
Krypotos, A., Mertens, G., Klugkist, I. G., & Engelhard, I. M. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_15 · Cited by 13
Gestión de datos de investigación: infraestructuras para su difusión
González, L.-M., Saorín, T., Ferrer-Sapena, A., Aleixandre‐Benavent, R., & Peset, F. (2013) · El Profesional de la Informacion · doi:10.3145/epi.2013.sep.06 · Cited by 13
A Systems Approach to Understanding and Improving Research Integrity
Gorman, D. M., Elkins, A. D., & Lawley, M. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9986-z · Cited by 14
An assessment of transparency and reproducibility‐related research practices in otolaryngology
Johnson, A., Torgerson, T., Skinner, M., Hamilton, T., Tritz, D., & Vassar, M. B. (2019) · The Laryngoscope · doi:10.1002/lary.28322 · Cited by 14
“Similarly, an evaluation of 50 high-impact-factor journals in 2009 revealed that only 9% of studies supplied access to the full data online, and 59% did not fully adhere to the data availability policy requirements.(28) Such lack of access to raw data and access to materials hinders most efforts at reproducing a study.”
BackgroundData Management in Astrobiology: Challenges and Opportunities for an Interdisciplinary Community
Aydınoğlu, A. U., Suomela, T., & Malone, J. (2014) · Astrobiology · doi:10.1089/ast.2013.1127 · Cited by 14
“In another study published in PLoS One (Alsheikh-Ali et al., 2011), the activity of authors of 500 papers in 50 highimpact journals was examined to determine publishing policies of underlying scientific data sets.”
BackgroundMa, W. (2006) · Biodiversity Science · doi:10.1360/biodiv.050146 · Cited by 13
Research accomplishments that are too good to be true
Ioannidis, J. P. A. (2014) · Intensive Care Medicine · doi:10.1007/s00134-013-3100-z · Cited by 12
“This is already happening as a prerequisite for publication for many types of research in many major journals [12], but there is large heterogeneity.”
BackgroundSelf-citationWang, P., Loignon, A. C., Shrestha, S., Banks, G. C., & Oswald, F. L. (2024) · Journal of Business and Psychology · doi:10.1007/s10869-024-09997-w · Cited by 15
“For example, Alsheikh-Ali et al. (2011) found that high-impact journals do not always ensure the public availability of research data, with only 9% depositing full primary raw data online.”
Connections in pharmacology: innovation serving translational medicine
Montero‐Melendez, T., & Perretti, M. (2013) · Drug Discovery Today · doi:10.1016/j.drudis.2013.11.022 · Cited by 14
Enabling scientific data sharing and re-use
Darby, R., Lambert, S., Matthews, B., Wilson, M., Gitmans, K., Dallmeier-Tiessen, S., Mele, S., & Suhonen, J. (2012) · IEEE International Conference on eScience · doi:10.1109/escience.2012.6404476 · Cited by 12
Sansone, S., & Rocca‐Serra, P. (2012) · GigaScience · doi:10.1186/2047-217x-1-10 · Cited by 12
“A similar scenario is found in the publishing world, where a substantial proportion of original research papers published in high-impact journals are either not subject to any data availability policies or do not adhere to the data availability instructions in their respective journals [8].”
BackgroundFor long-term sustainable software in bioinformatics
Coelho, L. P. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1011920 · Cited by 13
Briney, K. A. (2024) · PLoS ONE · doi:10.1371/journal.pone.0304781 · Cited by 13
A Selective Review of Literature on Research Data Management in Academic Libraries
Payal, Awasthi, S., & Tripathi, M. (2019) · DESIDOC Journal of Library & Information Technology · doi:10.14429/djlit.39.06.14451 · Cited by 15
Data, Open Science and libraries – The Data Deluge Column
Frederick, D. E. (2016) · Library Hi Tech News · doi:10.1108/lhtn-09-2016-0040 · Cited by 11
Primary data are the basis of all science!
Verpoorte, R. (2011) · Journal of Ethnopharmacology · doi:10.1016/j.jep.2011.09.054 · Cited by 11
Kuntz, R. E. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-12-201306180-00011 · Cited by 11
“Concerns of specious multiplicity of secondary data analyses, groundless litigation (2), exposure of confidential information for industry (3), and the desire for proprietary access to data in academia (3, 4) hinder the potential to improve public health and augment patient safety by sharing and pooling data sets resi…”
Background
Metadata
- Authors
- Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A.
- Affiliations
- Tufts University (US)
- Henry Ford Hospital (US)
- Wayne State University (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2011-09-07
- Volume
- 6
- Issue
- 9
- Pages
- e24357
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3168487
- OpenAlex
- W2031739072
- Cited by
- 363
- References
- 26
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 12 · 2023: 14 · 2022: 22 · 2021: 57 · 2020: 21 · 2019: 24 · 2018: 24 · 2017: 27 · 2016: 28 · 2015: 33 · 2014: 39 · 2013: 27 · 2012: 19
- FWCI
- 81.70
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Sociology and Political Science › Data Analysis and Archiving
- Keywords
- research data availability, data sharing policy, author guidelines, high-impact journals, microarray data, open data
- MeSH terms
- Periodicals as Topic, Publishing, Access to Information, Journal Impact Factor
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
