Populating the data ark: An attempt to retrieve, preserve, and liberate data from the most highly-cited psychology and psychiatry articles.
Open accessThe DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Abstract
The vast majority of scientific articles published to-date have not been accompanied by concomitant publication of the underlying research data upon which they are based. This state of affairs precludes the routine re-use and re-analysis of research data, undermining the efficiency of the scientific enterprise, and compromising the credibility of claims that cannot be independently verified. It may be especially important to make data available for the most influential studies that have provided a foundation for subsequent research and theory development. Therefore, we launched an initiative-the Data Ark-to examine whether we could retrospectively enhance the preservation and accessibility of important scientific data. Here we report the outcome of our efforts to retrieve, preserve, and liberate data from 111 of the most highly-cited articles published in psychology and psychiatry between 2006-2011 (n = 48) and 2014-2016 (n = 63). Most data sets were not made available (76/111, 68%, 95% CI [60, 77]), some were only made available with restrictions (20/111, 18%, 95% CI [10, 27]), and few were made available in a completely unrestricted form (15/111, 14%, 95% CI [5, 22]). Where extant data sharing systems were in place, they usually (17/22, 77%, 95% CI [54, 91]) did not allow unrestricted access. Authors reported several barriers to data sharing, including issues related to data ownership and ethical concerns. The Data Ark initiative could help preserve and liberate important scientific data, surface barriers to data sharing, and advance community discussions on data stewardship.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Authors may raise concerns about participant confidentiality and data security, 51 but many data sets in health collect anonymised data and authors need not commit to openly sharing their data or sharing any variables that include personal information.”
From Automated detection of over- and under-dispersion in baseline tables in randomised controlled trials. (2022) · cites this paper as [51]
The cited source says what the claim attributes to it.
In the citing paper
“However, assessment of analytic reproducibility is typically precluded by poor access to research data [7–14].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“In a recent attempt [8] to obtain data for some of the most highly cited articles in psychology and psychiatry published over the last decade, the majority of datasets were not made available (76/111, 68%).”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [8]
The cited source says what the claim attributes to it.
In the citing paper
“Psychological science, in particular, has a poor record on data sharing [8,12,13], and is currently engaged in a field-wide conversation regarding credibility and scientific practices [17].”
From Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition (2018) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Two-sided confidence intervals for the single proportion: comparison of seven methods
Newcombe, R. G. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980430)17:8<857::aid-sim777>3.0.co;2-e · Cited by 5,107
The Sociology of Science: Theoretical and Empirical Investigations
Kaplan, N., Merton, R. K., & Storer, N. W. (1974) · Technology and Culture · doi:10.2307/3102264 · Cited by 4,005
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Self-citationPromoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
(1973) · Cited by 1,638
How to increase value and reduce waste when research priorities are set
Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62229-1 · Cited by 1,436
Self-citationData Sharing by Scientists: Practices and Perceptions
Tenopir, C., Allard, S., Douglass, K., Aydinoglu, A. U., Wu, L., Read, E., Manoff, M., & Frame, M. (2011) · PLoS ONE · doi:10.1371/journal.pone.0021101 · Cited by 1,432
How to Make More Published Research True
Ioannidis, J. P. A. (2014) · PLoS Medicine · doi:10.1371/journal.pmed.1001747 · Cited by 760
Self-citationKidwell, M. C., Lazarević, L. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L.-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002456 · Cited by 700
Self-citationWhy Science Is Not Necessarily Self-Correcting
Ioannidis, J. P. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612464056 · Cited by 563
Self-citation
Cited by
The relationship between burnout, depression, and anxiety: a systematic review and meta-analysis.
Koutsimani, P., Montgomery, A., & Georganta, K. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00284 · Cited by 1,091
“The problems of finding appropriate data to conduct analyses and the reluctance/inability of authors to provide such data when directly contacted has been identified within the literature as a significant barrier to conducting comprehensive meta-analysis (Hardwicke and Ioannidis, 2018).”
BackgroundData sharing practices and data availability upon request differ across scientific disciplines
Tedersoo, L., Küngas, R., Oras, E., Köster, K., Eenmaa, H., Leijen, Ä., Pedaste, M., Raju, M., Astapova, A., Lukner, H., et al. (2021) · Scientific Data · doi:10.1038/s41597-021-00981-0 · Cited by 387
Hardwicke, T. E., Mathur, M. B., MacDonald, K., Nilsonne, G., Banks, G. C., Kidwell, M. C., Hofelich Mohr, A., Clayton, E., Yoon, E. J., Henry Tessler, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.180448 · Cited by 336
Self-citationHardwicke, T. E., Wallach, J. D., Kidwell, M. C., Bendixen, T., Crüwell, S., & Ioannidis, J. P. A. (2020) · Royal Society Open Science · doi:10.1098/rsos.190806 · Cited by 217
Self-citationHardwicke, T. E., Thibault, R. T., Kosie, J. E., Wallach, J. D., Kidwell, M. C., & Ioannidis, J. P. A. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691620979806 · Cited by 187
Self-citationRahnev, D., Desender, K., Lee, A. L. F., Adler, W. T., Aguilar-Lleyda, D., Akdoğan, B., Arbuzova, P., Atlas, L. Y., Balcı, F., Bang, J. W., et al. (2020) · Nature Human Behaviour · doi:10.1038/s41562-019-0813-1 · Cited by 151
The dire disregard of measurement invariance testing in psychological science.
Maassen, E., D'Urso, E. D., van Assen, M. A. L. M., Nuijten, M. B., Roover, K. D., & Wicherts, J. M. (2023) · Psychological Methods · doi:10.1037/met0000624 · Cited by 151
Hardwicke, T. E., Bohn, M., MacDonald, K., Hembacher, E., Nuijten, M. B., Peloquin, B. N., deMayo, B. E., Long, B., Yoon, E. J., & Frank, M. C. (2021) · Royal Society Open Science · doi:10.1098/rsos.201494 · Cited by 108
Self-citationCalibrating the Scientific Ecosystem Through Meta-Research
Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041104 · Cited by 98
“…to request research resources directly from researchers, particularly raw data, are often unsuccessful (Naudet et al. 2018, Rowhani-Farid & Barnett 2016, Vanpaemel et al. 2015, Vines et al. 2014, Wicherts et al. 2006), even for some of the most influential studies (Hardwicke & Ioannidis 2018b).”
InfluentialSelf-citationHamilton, D. G., Hong, K., Fraser, H., Rowhani-Farid, A., Fidler, F., & Page, M. J. (2023) · BMJ · doi:10.1136/bmj-2023-075767 · Cited by 86
López‐Nicolás, R., López-López, J. A., Rubio‐Aparicio, M., & Sánchez‐Meca, J. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01644-z · Cited by 80
Three steps to open science for qualitative research in psychology
Branney, P., Brooks, J., Kilby, L., Newman, K. L., Norris, E., Pownall, M., Talbot, C., Treharne, G., & Whitaker, C. (2023) · Social & Personality Psychology Compass · doi:10.1111/spc3.12728 · Cited by 39
Examining the generalizability of research findings from archival data
Delios, A., Clemente, E. G., Wu, T., Tan, H., Wang, Y., Gordon, M., Viganola, D., Chen, Z., Dreber, A., Johannesson, M., et al. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2120377119 · Cited by 84
Industry Involvement and Transparency in the Most Cited Clinical Trials, 2019-2022
Siena, L. M., Papamanolis, L., Siebert, M., Bellomo, R. K., & Ioannidis, J. P. A. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.43425 · Cited by 75
Self-citationThe Brazilian Reproducibility Initiative
Amaral, O. B., Neves, K., Wasilewska-Sampaio, A. P., & Carneiro, C. F. (2019) · eLife · doi:10.7554/elife.41602 · Cited by 49
Reproducible research practices and transparency across linguistics
Bochynska, A., Keeble, L., Halfacre, C., Casillas, J., Champagne, I.-A., Chen, K., Röthlisberger, M., Buchanan, E., & Roettger, T. B. (2023) · Glossa Psycholinguistics · doi:10.5070/g6011239 · Cited by 12
Liu, D. M., & Salganik, M. J. (2019) · Socius Sociological Research for a Dynamic World · doi:10.1177/2378023119849803 · Cited by 47
Data management and sharing: Practices and perceptions of psychology researchers
Borghi, J. A., & Gulick, A. E. V. (2020) · PLoS ONE · doi:10.1371/journal.pone.0252047 · Cited by 44
Medical journal requirements for clinical trial data sharing: Ripe for improvement
Naudet, F., Siebert, M., Pellen, C., Gaba, J., Axfors, C., Cristea, I., Danchev, V., Mansmann, U., Ohmann, C., Wallach, J. D., et al. (2021) · PLOS Medicine · doi:10.1371/journal.pmed.1003844 · Cited by 43
“For instance, the Data Ark initiative was unable to retrieve data from the majority of the most widely cited studies published between 2006 and 2016 in the fields of psychology and psychiatry [16].”
MethodSelf-citationEstimating the reproducibility of social learning research published between 1955 and 2018
Minocher, R., Atmaca, S., Bavero, C., McElreath, R. L., & Beheim, B. (2021) · Royal Society Open Science · doi:10.1098/rsos.210450 · Cited by 48
Basic statistical considerations for physiology: The journal Temperature toolbox
Caldwell, A. R., & Cheuvront, S. N. (2019) · Temperature · doi:10.1080/23328940.2019.1624131 · Cited by 40
“However, the evidence is clear that, when possible, data and the code used to analyse the data should be shared to facilitate future analyses and aide potential error detection [154].”
BackgroundHardwicke, T., Thibault, R. T., Clarke, B., Moodie, N., Crüwell, S., Schiavone, S., Handcock, S., Nghiem, K. A., Mody, F., Eerola, T., et al. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241283477 · Cited by 25
“…studies have repeatedly demonstrated that such requests are often rejected or ignored, with the likelihood of obtaining data progressively declining after publication (Hardwicke & Ioannidis, 2018; Minocher et al., 2021; Tedersoo et al., 2021; Vanpaemel et al., 2015; Vines et al., 2014).”
Self-citationSchofield, P. N., Kulka, U., Tapio, S., & Grosche, B. (2019) · International Journal of Radiation Biology · doi:10.1080/09553002.2019.1589026 · Cited by 24
“In a retrospective study on the 111 most influential articles in psychology and psychiatry, data could only be retrieved in 34% of cases and of these it was often incomplete or otherwise carried restrictions on use or analysis (Hardwicke and Ioannidis 2018).”
BackgroundSeven steps toward transparency and replicability in psychological science.
Lindsay, D. S. (2020) · Canadian Psychology/Psychologie canadienne · doi:10.1037/cap0000222 · Cited by 26
“Wicherts (2006) emailed requests for data to authors of articles in APA journals; only 27% eventually complied (see also Hardwicke & Ioannidis, 2018).”
MethodImker, H. J., Luong, H., Mischo, W. H., Schlembach, M. C., & Wiley, C. (2021) · The Journal of Academic Librarianship · doi:10.1016/j.acalib.2021.102369 · Cited by 27
Sharing is caring: Ethical implications of transparent research in psychology.
Bosma, C. M., & Granger, A. M. (2022) · American Psychologist · doi:10.1037/amp0001002 · Cited by 24
Care to share? Experimental evidence on code sharing behavior in the social sciences
Krähmer, D., Schächtele, L., & Schneck, A. (2023) · PLoS ONE · doi:10.1371/journal.pone.0289380 · Cited by 20
Neves, K., Carneiro, C. F. D., Wasilewska‐Sampaio, A. P., de Abreu, M. B., Valério‐Gomes, B., Tan, P. B., & Amaral, O. B. (2020) · Memórias do Instituto Oswaldo Cruz · doi:10.1590/0074-02760200328 · Cited by 11
“According to the experiences of previous studies, contact with authors for information takes time and is not always successful.(22) Moreover, even when the original authors are willing to help, the amount of information provided is variable, as details of published articles are often lost due to our bad track record i…”
BackgroundJohnson, A. L., Anderson, J. M., Bouvette, M., Pinero, I., Rauh, S., Johnson, B., Kee, M., Heigle, B., Tricco, A. C., Page, M. J., et al. (2023) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2022.11.009 · Cited by 11
Liu, D. M., & Salganik, M. (2019) · Sage Journals Data · doi:10.25384/sage.c.4663025 · Cited by 11
Data Management and Sharing: Practices and Perceptions of Psychology ResearchersPreprint
Borghi, J., & Gulick, A. E. V. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7g3ae · Cited by 10
Reproducibility failure in biomedical research: problems and solutions
Haven, T. L., & Ioannidis, J. P. A. (2026) · Annual Review of Medicine · doi:10.1146/annurev-med-050124-050859 · Cited by 9
Self-citationTransparent and Reproducible Research Practices in the Surgical Literature
Hughes, T., Niemann, A., Tritz, D., Boyer, K., Robbins, H. I., & Vassar, M. B. (2022) · Journal of Surgical Research · doi:10.1016/j.jss.2021.09.024 · Cited by 8
Renbarger, R., Adelson, J. L., Rosenberg, J. M., Stegenga, S. M., Lowrey, O., Buckley, P. R., & Zhang, Q. (2023) · Gifted Child Quarterly · doi:10.1177/00169862231184575 · Cited by 9
Barnett, A. (2022) · F1000Research · doi:10.12688/f1000research.123002.1 · Cited by 7
Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track
Schaeffer, R., Kazdan, J., Denisov-Blanch, Y., Miranda, B., Gerstgrasser, M., Zhang, S., Haupt, A. A., Gupta, I., Obbad, E., Dodge, J., et al. (2025) · neural information processing systems · doi:10.52202/085713-3359 · Cited by 12
Developments in Open Data Norms
Evans, T. R. (2022) · Journal of Open Psychology Data · doi:10.5334/jopd.60 · Cited by 8
“Whilst the availability of data dramatically varies across journals and fields [30], recovering older datasets is increasingly problematic [33] even despite initiatives like the Data Ark [13].”
BackgroundBasic statistical considerations for physiology: The journal Temperature toolboxPreprint
Caldwell, A. R., & Cheuvront, S. N. (2020) · SportRxiv (OSF Preprints) · doi:10.31236/osf.io/rt4bp · Cited by 7
Chin, J. M., Zeiler, K., Dilevski, N., Holcombe, A. O., Gatfield-Jeffries, R., Bishop, R., Vazire, S., & Schiavone, S. R. (2023) · F1000Research · doi:10.12688/f1000research.127563.1 · Cited by 8
Evaluating the reproducibility of research in obstetrics and gynecology
Rauh, S. L., Bowers, A., Rorah, D., Tritz, D., Pate, H., Frye, L., & Vassar, M. B. (2021) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2021.12.021 · Cited by 6
Les pratiques de recherche ouvertes en psychologie
Lantian, A. (2020) · Psychologie Française · doi:10.1016/j.psfr.2020.09.001 · Cited by 6
A review of reproducible and transparent research practices in urology publications from 2014 to2018
Rauh, S. L., Johnson, B. S., Bowers, A., Tritz, D., & Vassar, B. M. (2022) · BMC Urology · doi:10.1186/s12894-022-01059-8 · Cited by 6
Godwin, H., Dewis, H., Darch, P., Hout, M. C., Ernst, D., Broadbent, P., Papesh, M., & Wolfe, J. M. (2025) · Behavior Research Methods · doi:10.3758/s13428-025-02759-3 · Cited by 4
“…from psychology papers published in the year 2022, and found that, despite all of the efforts to improve sharing of scientific outputs, that sharing practices had only increased by a small degree compared to their earlier examinations of the literature (see also Hardwicke & Ioannidis, 2018).”
InfluentialRDA Professionalising Data Stewardship - Data Stewardship Landscape Initial Report
Wildgaard, L., & Rantasaari, J. (2022) · Research at the University of Copenhagen (University of Copenhagen) · doi:10.15497/rda00076 · Cited by 5
Gomes, D. G. E. (2025) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2024.1515 · Cited by 5
Cristea, I. A., Georgescu, R., & Ioannidis, J. P. A. (2021) · Clinical Psychological Science · doi:10.1177/21677026211049366 · Cited by 5
“Investigations of HC articles in the social and behavioral sciences have been limited and mostly restricted to surveying content and design (Price et al., 2011) or the availability and sharing of the data underlying their findings in HC articles (Hardwicke & Ioannidis, 2018).”
MethodSelf-citationCOVID-19: A Catalyst for Transforming Randomized Trials
Lee, J., Price, J. C., Jackson, W. M., Whittington, R. A., & Ioannidis, J. P. A. (2021) · Journal of Neurosurgical Anesthesiology · doi:10.1097/ana.0000000000000804 · Cited by 4
Self-citationDulitzki, C., Crane, S., Hardwicke, T., & Ioannidis, J. (2024) · Royal Society Open Science · doi:10.1098/rsos.240016 · Cited by 2
Self-citationEvans, S., Fladie, I. A., Anderson, J. M., Tritz, D. J., & Vassar, M. (2019) · bioRxiv · doi:10.1101/773473 · Cited by 5
Perceptions and Opinions Towards Data-Sharing: A Survey of Addiction Journal Editorial Board Members
Anderson, J. M., Johnson, A., Rauh, S. L., Johnson, B. S., Bouvette, M. J., Pinero, I., Beaman, J., & Vassar, M. B. (2022) · The Journal of Scientific Practice and Integrity · doi:10.35122/001c.35597 · Cited by 3
A Perspective Towards Using Aggregated Data in ResearchPreprint
Bahrami, M. (2023) · doi:10.31219/osf.io/k268q · Cited by 3
Wood, J., & van Schalkwyk, I. (2025) · Journal of Transportation Technologies · doi:10.4236/jtts.2025.151010 · Cited by 4
An Individual Participant Data Meta-Analysis Method Primer for Psychology
Fritz, T., & Göritz, A. S. (2026) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000614 · Cited by 2
Reproducible research practices and transparency across linguisticsPreprint
Bochyńska, A., Keeble, L., Halfacre, C. A. E., Casillas, J. V., Champagne, I.-A., Chen, K., Röthlisberger, M., Buchanan, E. M., & Roettger, T. B. (2023) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/rcews · Cited by 4
Martinou, E., & Angelidi, A. M. (2022) · F1000Research · doi:10.12688/f1000research.127179.1 · Cited by 1
Replication code as a cornerstone of the credibility revolution 2.0
Marcus, J. (2025) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2025.102410 · Cited by 1
Casillas, J., Constantin-Dureci, G., Rascón, I. A., Shao, J., Rodriguez, S. A., Gadamsetty, A., Minetti, A., Laungani, K., Thatcher, J., Gardere, R.-T., et al. (2025) · Linguistics · doi:10.1515/ling-2023-0249 · Cited by 2
Data and code (Un)availability in sports meta-analysis studies
Wolff, P. A., Sainani, K. L., & Borg, D. N. (2026) · Annals of Epidemiology · doi:10.1016/j.annepidem.2026.110126 · Cited by 1
“It makes sense to me”: Examining data file column names in the visual cognitive literature
Sordo, G. C. D., Dewis, H., Darch, P., Hout, M. C., & Godwin, H. (2026) · Behavior Research Methods · doi:10.3758/s13428-026-03104-y · Cited by 1
“Greater openness also maximizes the return on research investments by enabling reuse, such as supporting secondary analyses, meta-analyses, and novel applications, thus amplifying the lifespan and impact of the original data (Cole et al., 2024; Hardwicke & Ioannidis, 2018; Roche et al., 2015).”
Klettke, E. E., Holmes, M. D., Meyer, T. D., & Jones, G. H. (2023) · Personalized Medicine in Psychiatry · doi:10.1016/j.pmip.2023.100112 · Cited by 1
Neves, K., Carneiro, C. F. D., Wasilewska‐Sampaio, A. P., Abreu, M., Valério‐Gomes, B., Tan, P. B., & Amaral, O. B. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/njs6k · Cited by 1
Mikytuck, A. M., Nusser, S. M., & Korkmaz, G. (2022) · doi:10.31222/osf.io/yp3ct · Cited by 1
The Brazilian Reproducibility Initiative: a systematic assessment of Brazilian biomedical sciencePreprint
Amaral, O. B., Neves, K., Wasilewska‐Sampaio, A. P., & Carneiro, C. F. D. (2018) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/ahf7t
“While we feel this is a worthy endeavor, the rate of response to calls for sharing protocols, data or code is erratic (Hardwicke & Ioannidis, 2018; Stodden et al., 2018; Wicherts et al., 2011).”
BackgroundTransparency and replication in alcohol research
Drax, K., & Munafo, M. R. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-816720-5.00005-0
Cristea, I. A., Ioannidis, J. P. A., & Georgescu, R. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6t7pw
Self-citationReproducible research practices and transparency across linguisticsPreprint
Bochyńska, A., Keeble, L., Halfacre, C. A. E., Casillas, J. V., Champagne, I.-A., Chen, K., Röthlisberger, M., Buchanan, E. M., & Roettger, T. B. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/naf8t
Exploring and mitigating analytical variability in fMRI results using representation learning
Germani, É. (2024) · theses.fr (ABES) · doi:10.70675/db89c27fz099cz492fz9785zd2f9c74ed664 · Cited by 1
Ethical Issues in Psychological Science: Studying Humans, Analyzing Data, Publishing Findings
Crandall, C., Giner‐Sorolla, R., & Biernat, M. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123.003
How Transparent and Reproducible Are Studies That Use Animal Models of Opioid Addiction?
Blackwell, J. C., Beitner, J., & Holcombe, A. O. (2025) · Addiction Biology · doi:10.1111/adb.70027
Casillas, J. V., Constantin-Dureci, G., Rascón, I. A., Shao, J., Rodríguez, S. A., Gadamsetty, A., Minetti, A., Laungani, K., Thatcher, J., Gardere, R.-T., et al. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/spz4w_v2
Restructuring scientific papers for human and AI readersPreprint
Lin, Z. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/c46hs_v4
Rauh, S. L., Johnson, B. S., Bowers, A., Tritz, D., & Vassar, B. M. (2022) · Figshare · doi:10.6084/m9.figshare.20294494
Rauh, S. L., Johnson, B. S., Bowers, A., Tritz, D., & Vassar, B. M. (2022) · Figshare · doi:10.6084/m9.figshare.20294497
Comparative analysis of Registered Reports and the standard research literature
O'Mahony, A. (2023) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 3
Investigating Data Sharing Practices in Teaching Effectiveness Research
Sajjad, T., Hartig, J., Lösch, T., & Köhler, C. (2026) · AERA Open · doi:10.1177/23328584251409658
Impact et faisabilité du partage des données individuelles issues de la recherche clinique
Pellen, C. (2024) · theses.fr (ABES) · doi:10.70675/ef81f3a2z0c0cz4757za338z831065d04fdc
Data Availability Statement: A Tool for Enhancing Research Trust
Тихонова, Е. В., & Mekeko, N. (2024) · Journal of Employment and Career · doi:10.56414/jeac.2024.2.72
Müller, V. I., Ficco, L., Hoffstaedter, F., Küppers, V., Kraljević, N., Gell, M., Tyralla, S., Nofal, M. K., Koslowski, R., Eickhoff, S. B., et al. (2026) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2026.106693
A Guide to Reanalyzing Data From Psychology Articles for Verification, Meta‐Analysis, and Reuse
Wicherts, J. M. (2026) · Social and Personality Psychology Compass · doi:10.1111/spc3.70152
Restructuring Scientific Papers for Human and AI Readers
Lin, Z. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261480685 · Cited by 1
Metadata
- Authors
- Hardwicke, T. E., & Ioannidis, J. P. A.
- Affiliations
- Stanford University (US)
- Corresponding author
- Hardwicke, Tom E.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2018-08-02
- Volume
- 13
- Issue
- 8
- Pages
- e0201856
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC6072126
- OpenAlex
- W2885658721
- Cited by
- 78
- References
- 33
- Citations by year
- 2026: 7 · 2025: 7 · 2024: 5 · 2023: 14 · 2022: 13 · 2021: 14 · 2020: 8 · 2019: 8 · 2018: 2
- FWCI
- 12.87
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion, cc-by)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Funders
- Laura and John Arnold Foundation
- Topics
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Social Sciences › Sociology and Political Science › Data Analysis and Archiving
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- research data sharing, data preservation, data accessibility, highly cited papers, psychology, psychiatry, barriers to data sharing, data ownership, research ethics, data stewardship
- MeSH terms
- Scholarly Communication, Humans, Ownership, Periodicals as Topic, Psychiatry, Psychology, Publishing, Bibliometrics, Information Dissemination, Datasets as Topic, Data Curation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.