The effect of data sources on the measurement of open access: A comparison of Dimensions and the Web of Science
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
With the growing number of open access (OA) mandates, the accurate measurement of OA publishing is an important policy issue. Existing studies have provided estimates of the prevalence of OA publications ranging from 27.9% to 53.7%, depending on the data source and period of investigation. This paper aims at providing a comparison of the proportion of OA publishing as represented in two major bibliometric databases, Web of Science (WoS) and Dimensions, and assesses how the choice of database affects the measurement of OA across different countries. Results show that a higher proportion of publications indexed in Dimensions are OA than those indexed by WoS, and that this is particularly true for publications originating from outside North America and Europe. The paper concludes with a discussion of the cause and consequences of these differences, motivating the use of more inclusive databases when examining OA, especially for publications originating beyond North America and Europe.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures




Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Yet, high-end estimates place the percentage of open access publications around 50% [118]”
From Open Science 2.0: Towards a truly collaborative research ecosystem (2023) · cites this paper as [118]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., et al. (2019) · Journal of Open Source Software · doi:10.21105/joss.01686 · Cited by 22,138
The journal coverage of Web of Science and Scopus: A comparative analysis
Mongeon, P., & Paul-Hus, A. (2016) · Scientometrics · doi:10.1007/s11192-015-1765-5 · Cited by 5,274
Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas
Garfield, E. (1955) · Science · doi:10.1126/science.122.3159.108 · Cited by 2,334
Martín-Martín, A., Orduna-Malea, E., Thelwall, M., & Delgado López-Cózar, E. (2018) · Journal of Informetrics · doi:10.1016/j.joi.2018.09.002 · Cited by 1,990
Martín-Martín, A., Orduna-Malea, E., Thelwall, M., & López-Cózar, E. D. (2018) · doi:10.31235/osf.io/42nkm · Cited by 1,990
A tale of two databases: the use of Web of Science and Scopus in academic papers
Zhu, J., & Liu, W. (2020) · Scientometrics · doi:10.1007/s11192-020-03387-8 · Cited by 1,556
The state of OA: a large-scale analysis of the prevalence and impact of Open Access articles
Piwowar, H., Priem, J., Larivière, V., Alperin, J. P., Matthias, L., Norlander, B., Farley, A., West, J., & Haustein, S. (2018) · PeerJ · doi:10.7717/peerj.4375 · Cited by 1,223
Self-citationInteractive Web-Based Data Visualization with R, plotly, and shiny
Sievert, C. (2020) · Chapman & Hall/CRC eBooks · doi:10.1201/9780429447273 · Cited by 1,031
Martín-Martín, A., Thelwall, M., Orduna-Malea, E., & Delgado López-Cózar, E. (2021) · Scientometrics · doi:10.1007/s11192-020-03690-4 · Cited by 1,018
Martín‐Martín, A., Thelwall, M. A., Orduña‐Malea, E., & Delgado López-Cózar, E. (2020) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 916
Visser, M., van Eck, N. J., & Waltman, L. (2021) · Quantitative Science Studies · doi:10.1162/qss_a_00112 · Cited by 865
Dynamic Documents with R and knitr
Xie, Y. (2016) · Chapman & Hall/CRC eBooks · doi:10.1201/b15166 · Cited by 746
Coverage analysis of Scopus: A journal metric approach
de Moya-Anegón, F., Chinchilla-Rodríguez, Z., Vargas-Quesada, B., Corera-Álvarez, E., Muñoz-Fernández, F. J., González-Molina, A., & Herrero-Solana, V. (2007) · Scientometrics · doi:10.1007/s11192-007-1681-4 · Cited by 380
Open Access and Global Participation in Science
Evans, J. A., & Reimer, J. (2009) · Science · doi:10.1126/science.1154562 · Cited by 258
Dimensions: Bringing down barriers between scientometricians and data
Herzog, C., Hook, D., & Konkiel, S. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00020 · Cited by 219 · cited 9×
“Just as OA aims to provide visibility and access to research publications beyond toll-access journals, Dimensions provides a lens to investigate a broader number of publications, as opposed to only those that are considered to be the most relevant or core by Western-centric data sources such as WoS or Scopus.”
BackgroundMethodInfluentialMeasuring Research: What Everyone Needs to Know®
Sugimoto, C. R., & Larivière, V. (2018) · doi:10.1093/wentk/9780190640118.001.0001 · Cited by 184
Self-citationGuerrero‐Bote, V. P., Chinchilla‐Rodríguez, Z., Mendoza, A., & Anegón, F. D. M. (2021) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2020.593494 · Cited by 158
Evaluating the impact of open access policies on research institutions
Huang, C., Neylon, C., Hosking, R., Montgomery, L., Wilson, K., Ozaygen, A., & Brookes-Kenworthy, C. (2020) · eLife · doi:10.7554/elife.57067 · Cited by 131
The Next Generation of Scientists in Africa
Beaudry, C., Mouton, J., & Prozesky, H. (2018) · African Minds eBooks · doi:10.47622/978-1-928331-93-3 · Cited by 119
Iyandemye, J., & Thomas, M. P. (2019) · PLoS ONE · doi:10.1371/journal.pone.0220229 · Cited by 110
Comparison of bibliographic data sources: Implications for the robustness of university rankings
Huang, C.-K. (., Neylon, C., Brookes-Kenworthy, C., Hosking, R., Montgomery, L., Wilson, K., & Ozaygen, A. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00031 · Cited by 106
A Review of Open Access Self-Archiving Mandate Policies
Xia, J., Gilchrist, S. B., Smith, N. X. P., Kingery, J. A., Radecki, J. R., Wilhelm, M. L., Harrison, K. C., Ashby, M. L., & Mahn, A. J. (2012) · portal: Libraries and the Academy · doi:10.1353/pla.2012.0000 · Cited by 105
Do authors comply when funders enforce open access to research?
Larivière, V., & Sugimoto, C. R. (2018) · Nature · doi:10.1038/d41586-018-07101-w · Cited by 101
Self-citationDocument categories in the ISI Web of Knowledge: Misunderstanding the Social Sciences?
Harzing, A.-W. K. (2012) · Scientometrics · doi:10.1007/s11192-012-0738-1 · Cited by 97
The state of broadband 2015: Broadband as a foundation for sustainable development
Biggs, P. (2015) · Cited by 89
Basson, I., Blanckenberg, J. P., & Prozesky, H. (2020) · Scientometrics · doi:10.1007/s11192-020-03734-9 · Cited by 87
Self-citationThe State of OA: A large-scale analysis of the prevalence and impact of Open Access articlesPreprint
Piwowar, H., Priem, J. R., Larivière, V., Alperín, J. P., Matthias, L., Norlander, B., Farley, A., West, J. D., & Haustein, S. (2017) · doi:10.7287/peerj.preprints.3119 · Cited by 87
Self-citationVisser, M. S., van Eck, N. J., & Waltman, L. (2020) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.3837427 · Cited by 58
Yang, L. Y., Yue, T. R., Ding, J., et al. (2012) · Scientometrics · doi:10.1007/s11192-012-0695-8 · Cited by 55
Aksnes, D. W., van Leeuwen, T. N., & Sivertsen, G. (2014) · Scientometrics · doi:10.1007/s11192-014-1245-3 · Cited by 45
Open access publishers: The new players
Rodrigues, R., Abadal, E., & de Araújo, B. K. H. (2020) · PLoS ONE · doi:10.1371/journal.pone.0233432 · Cited by 44
The diverse niches of megajournals: Specialism within generalism
Siler, K., Larivière, V., & Sugimoto, C. R. (2019) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.24299 · Cited by 31
Self-citationGreat expectations: The role of Open Access in improving countries’ recognition
Sotudeh, H., & Horri, A. (2008) · Scientometrics · doi:10.1007/s11192-007-1890-x · Cited by 14
Evaluating institutional open access performance: Methodology, challenges and assessment
Huang, C.-K., Neylon, C., Hosking, R., Montgomery, L., Wilson, K., Ozaygen, A., & Brookes-Kenworthy, C. (2020) · doi:10.1101/2020.03.19.998336 · Cited by 6
Basson, I., Simard, M., & Larivière, V. (2022) · Figshare · doi:10.6084/m9.figshare.18319238 · Cited by 1
Self-citation
Research works printed but not linked: 4
- Simard M-A, Ghiasi G, Mongeon P, Larivière V. Geographic Differences in the Uptake of Open Access. Proceedings of the 18th International Conference on Scientometrics and Informetrics (ISSI 2021). 2021. pp. 1033–1038. https://issi2021.org/proceedings/
- Norris M, Oppenheim C, Rowland F. Open access citation rates and developing countries. ELPUB 2008 Conference on Electronic Publishing. Toronto; 2008. pp. 335–342. https://elpub.architexturez.net/system/files/pdf/335_elpub2008.content.pdf
- Y. Xie, 2014, Implementing Reproducible Computational Research
- Basson I, Simard M-A, Ouangré ZA, Sugimoto CR, Larivière V. Data sources and their effects on the measurement of open access. Comparing Dimensions with the Web of Science. Proceedings of the 18th International Conference on Scientometrics and Informetrics (ISSI 2021). Leuven; 2021. pp. 93–98. https://issi2021.org/proceedings/
Cited by
Open Science 2.0: Towards a truly collaborative research ecosystem
Thibault, R. T., Amaral, O. B., Argolo, F., Bandrowski, A. E., Davidson, A. R., & Drude, N. I. (2023) · PLOS Biology · doi:10.1371/journal.pbio.3002362 · Cited by 72
Metadata
- Authors
- Basson, I., Simard, M.-A., Ouangré, Z. A., Sugimoto, C. R., & Larivière, V.
- Affiliations
- Stellenbosch University (ZA)
- Université de Montréal (CA)
- Georgia Institute of Technology (US)
- Corresponding author
- Basson, Isabel
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2022-03-31
- Volume
- 17
- Issue
- 3
- Pages
- e0265545
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC8970383
- OpenAlex
- W4221006456
- Cited by
- 62
- References
- 35
- Citations by year
- 2026: 7 · 2025: 17 · 2024: 17 · 2023: 18 · 2022: 3
- FWCI
- 8.28
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Papyrus : Institutional Repository (Université de Montréal) (submittedVersion, cc-by)
- Funders
- International Development Research Centre (109272)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Library and Information Sciences › Library Science and Information
- Keywords
- open access, Dimensions database, Web of Science, bibliometric databases, data source bias, open access mandates, cross-national comparison, scholarly publishing
- MeSH terms
- Abstracting and Indexing, Bibliometrics, Databases, Factual, Access to Information, Open Access Publishing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.