Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 4

The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.

Open access publications drive few visits from Google Search results to institutional repositories

Orduña-Malea, Enrique, Font-Julián, Cristina I., Serrano-Cobos, Jorge · 2024 · Scientometrics

Abstract

Given the importance of Google Search in generating visits to institutional repositories (IR), a lack of visibility in search engine results pages can hinder the possibility of their publications being found, read, downloaded, and, eventually, cited. To address this, institutions need to evaluate the visibility of their repositories to determine what actions might be implemented to enhance them. However, measuring the search engine optimization (SEO) visibility of IRs requires a highly accurate, technically feasible method. This study constitutes the first attempt to design such a method, specifically applied here to measuring the IR visibility of Spain’s national university system in Google Search based on a set of SEO-based metrics derived from the Ubersuggest SEO tool. A comprehensive dataset spanning three months and comprising 217,589 bibliographic records and 316,899 organic keywords is used as a baseline. Our findings show that many records deposited in these repositories are not ranked among the top positions in Google Search results, and that the most visible records are mainly academic works (theses and dissertations) written in Spanish in the Humanities and Social Sciences. However, most visits are generated by a small number of records. All in all, our results call into question the role played by IRs in attracting readers via Google Search to the institutions’ scientific heritage and serve to underscore the prevailing emphasis within IRs on preservation as opposed to online dissemination. Potential improvements might be achieved using enhanced metadata schemes and normalized description practices, as well as by adopting other actionable insights that can strengthen the online visibility of IRs. This study increases understanding of the role played by web indicators in assessing the web-based impact of research outputs deposited in IRs, and should be of particular interest for a range of stakeholders, including open access and open science advocates, research agencies, library practitioners, repository developers, and website administrators.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s11192-024-05175-0

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Research works printed but not linked: 56

  1. Abadal, E., Ollé Castellà, C., García, M. F. A., & Melero, R. M. (2013). Políticas de acceso abierto a la ciencia en las universidades españolas. Revista Española De Documentación Científica, 36(2), e007. https://doi.org/10.3989/redc.2013.2.933 · doi:10.3989/redc.2013.2.933
  2. Aguillo, I. F. (2020). Altmetrics of the Open Access Institutional Repositories: A webometrics approach. Scientometrics, 123(3), 1181–1192. https://doi.org/10.1007/s11192-020-03424-6 · DOI
  3. Aguillo, I. F., Ortega, J. L., Fernández, M., & Utrilla, A. M. (2010). Indicators for a webometric ranking of open access repositories. Scientometrics, 82(3), 477–486. https://doi.org/10.1007/s11192-010-0183-y · DOI
  4. Alhuay-Quispe, J., Quispe-Riveros, D., Bautista-Ynofuente, L., & Pacheco-Mendoza, J. (2017). Metadata quality and academic visibility associated with document type coverage in institutional repositories of Peruvian universities. Journal of Web Librarianship, 11(3–4), 241–254. https://doi.org/10.1080/19322909.2017.1382427 · doi:10.1080/19322909.2017.1382427
  5. Arlitsch, K., & O’Brien, P. S. (2012). Invisible institutional repositories: Addressing the low indexing ratios of IRs in Google Scholar. Library Hi Tech, 30(1), 60–81. https://doi.org/10.1108/07378831211213210 · DOI
  6. Badgett, R. G., Dylla, D. P., Megison, S. D., & Harmon, E. G. (2015). An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions. PeerJ, 3, e913. https://doi.org/10.7717/peerj.913 · DOI
  7. Bar-Ilan, J. (2004). The use of web search engines in information science research. Annual Review of Information Science and Technology, 38(1), 231–288. https://doi.org/10.1002/aris.1440380106 · DOI
  8. Beel, J., & Gipp, B. (2010). Academic search engine spam and Google Scholar’s resilience against it. The Journal of Electronic Publishing. https://doi.org/10.3998/3336451.0013.305 · DOI
  9. Beel, J., Gipp, B., & Wilde, E. (2010). Academic search engine optimization (ASEO) optimizing scholarly literature for Google Scholar & Co. Journal of Scholarly Publishing, 41(2), 176–190. https://doi.org/10.3138/jsp.41.2.176 · DOI · Paper page
  10. Borrego, Á. (2017). Institutional repositories versus ResearchGate: The depositing habits of Spanish researchers. Learned Publishing, 30(3), 185–192. https://doi.org/10.1002/leap.1099 · DOI
  11. Coates, M. (2014). Search engine queries used to locate electronic theses and dissertations. Library Hi Tech, 32(4), 667–686. https://doi.org/10.1108/lht-02-2014-0022 · DOI
  12. Dadkhah, M., Rahimnia, F., & Memon, A. R. (2022). How frequent is the use of misleading metrics? A case study of business journals. The Serials Librarian, 83(2), 197–204. https://doi.org/10.1080/0361526x.2022.2145414 · doi:10.1080/0361526x.2022.2145414
  13. Davis, H. (2006). Search engine optimization. O’Reilly Media.
  14. De Filippo, D., & Mañana-Rodriguez, J. (2022). The practical implementation of open access policies and mandates in Spanish public universities. Scientometrics, 127(12), 7147–7167. https://doi.org/10.1007/s11192-021-04261-x · DOI
  15. Enge, E., Spencer, S., & Stricchiola, J. (2015). The art of SEO: Mastering search engine optimization. O’Reilly Media, Inc.
  16. European Commission. (2016). Online platforms: Report. European Commission. https://doi.org/10.2759/937517 · doi:10.2759/937517
  17. Fan, W. (2015). Contribution of the institutional repositories of the Chinese Academy of Sciences to the webometric indicators of their home institutions. Scientometrics, 105(3), 1889–1909. https://doi.org/10.1007/s11192-015-1758-4 · DOI
  18. Fernández, T. F. (2018). Los repositorios institucionales: evolución y situación actual en España. In J. A. Merlo Vega (Ed.), Ecosistemas del Acceso Abierto (pp. 39–84). Ediciones Universidad de Salamanca. Retrieved 8 June, 2024, from https://gredos.usal.es/handle/10366/138583
  19. Font-Julian, C. I., Ontalba-Ruipérez, J. A., & Orduña-Malea, E. (2018). Hit count estimate variability for website-specific queries in search engines. Aslib Journal of Information Management, 70(2), 192–213. https://doi.org/10.1108/ajim-10-2017-0226 · DOI
  20. González-Alonso, J.., & Pérez-González, Y. (2015). Presencia en Google Scholar y en la WEB de la Revista Cubana de Plantas Medicinales. Revista Cubana de Plantas Medicinales, 20(1), 1–13. Retrieved 8 June, 2024, from https://www.medigraphic.com/pdfs/revcubplamed/cpm-2015/cpm151a.pdf
  21. Gonzalez-Llinares, J., Font-Julian, C. I., & Orduña-Malea, E. (2020). Universidades en Google: Hacia un modelo de análisis multinivel del posicionamiento web académico. Revista Española De Documentación Científica, 43(2), e260. https://doi.org/10.3989/redc.2020.2.1691 · DOI
  22. Griffiths, J. R., & Brophy, P. (2005). Student searching behavior and the web: Use of academic resources and Google. Library Trends, 53(4), 539–554.
  23. Haglund, L., & Olsson, P. (2008). The Impact on university libraries of Changes in information Behavior among academic researchers: A multiple case study. The Journal of Academic Librarianship, 34(1), 52–59. https://doi.org/10.1016/j.acalib.2007.11.010 · DOI · Paper page
  24. Höchstötter, N., & Lewandowski, D. (2009). What users see—Structures in search engine results pages. Information Sciences, 179(12), 1796–1812. https://doi.org/10.1016/j.ins.2009.01.028 · DOI
  25. Jones, R. E., Andrew, T., & MacColl, J. (2006). The institutional repository. Elsevier. · DOI
  26. Kaur, S., Kaur, K., & Kaur, P. (2016). An empirical performance evaluation of universities website. International Journal of Computer Applications, 146(15), 10–16. https://doi.org/10.5120/ijca2016910922 · DOI
  27. Ledford, J. L. (2015). Search engine optimization bible. Wiley.
  28. Lewandowski, D. (2023). Understanding search engines. Springer. https://doi.org/10.1007/978-3-031-22789-9 · DOI
  29. Lewandowski, D., & Mayr, P. (2006). Exploring the academic invisible web. Library Hi Tech, 24(4), 529–539. https://doi.org/10.1108/07378830610715392 · DOI
  30. Lopezosa, C., & Vállez, M. (2023). Audiencias amplias y visibilidad web: Posicionamiento de revistas académicas de comunicación en Google. Index.comunicación, 13(1), 153–171. · DOI
  31. Lynch, C. A. (2003). Institutional Repositories: Essential infrastructure for scholarship in the digital age. Portal: Libraries and the Academy, 3(2), 327–336. https://doi.org/10.1353/pla.2003.0039 · DOI · Paper page
  32. Ma, L. (2022). Metrics and epistemic injustice. Journal of Documentation, 78(7), 392–404. https://doi.org/10.1108/jd-12-2021-0240 · DOI
  33. Ma, L. (2023). Information, platformized. Journal of the Association for Information Science and Technology, 74(2), 273–282. https://doi.org/10.1002/asi.24713 · DOI
  34. Malaga, R. A. (2008). Worst practices in search engine optimization. Communications of the ACM, 51(12), 147–150. https://doi.org/10.1145/1409360.1409388 · DOI
  35. Markland, M. (2006). Institutional repositories in the UK: What can the Google user find there? Journal of Librarianship and Information Science, 38(4), 221–228. https://doi.org/10.1177/0961000606070587 · DOI
  36. Martín-Martín, A., Orduna-Malea, E., Harzing, A., & Delgado López-Cózar, E. (2017). Can we use Google Scholar to identify highly-cited documents? Journal of Informetrics, 11(1), 152–163. https://doi.org/10.1016/j.joi.2016.11.008 · DOI · Paper page
  37. Olaleye, S. A., Sanusi, I. T., Ukpabi, D. C., & Okunoye, A. (2018). Evaluation of Nigeria Universities websites quality: A comparative analysis. Library Philosophy and Practice, 1717, 1–14.
  38. Orduña-Malea, E. (2013). Aggregation of the web performance of internal university units as a method of quantitative analysis of a university system: The case of Spain. Journal of the American Society for Information Science and Technology, 64(10), 2100–2114. https://doi.org/10.1002/asi.22912 · doi:10.1002/asi.22912
  39. Orduña-Malea, E., Alonso-Arroyo, A., Ontalba-Ruipérez, J. A., & Catalá-López, F. (2023). Evaluating the online impact of reporting guidelines for randomised trial reports and protocols: A cross-sectional web-based data analysis of CONSORT and SPIRIT initiatives. Scientometrics, 128(1), 407–440. https://doi.org/10.1007/s11192-022-04542-z · DOI
  40. Orduña-Malea, E., & Delgado López-Cózar, E. (2015). The dark side of open access in Google and Google Scholar: The case of Latin-American repositories. Scientometrics, 102(1), 829–846. https://doi.org/10.1007/s11192-014-1369-5 · DOI
  41. Park, M. (2018). SEO for an open access scholarly information system to improve user experience. Information Discovery and Delivery, 46(2), 77–82. https://doi.org/10.1108/idd-08-2017-0060 · doi:10.1108/idd-08-2017-0060
  42. Pinfield, S., Salter, J., Bath, P. A., Hubbard, B., Millington, P., Anders, J. H., & Hussain, A. (2014). Open-access repositories worldwide, 2005–2012: Past growth, current characteristics, and future possibilities. Journal of the Association for Information Science and Technology, 65(12), 2404–2421. https://doi.org/10.1002/asi.23131 · doi:10.1002/asi.23131
  43. Rovira, C., Codina, L., Guerrero-Solé, F., & Lopezosa, C. (2019). Ranking by relevance and citation counts, a comparative study: Google Scholar, Microsoft Academic. WOS and Scopus. Future Internet, 11(9), 202. https://doi.org/10.3390/fi11090202 · DOI
  44. Rovira, C., Codina, L., & Lopezosa, C. (2021). Language bias in the Google Scholar ranking algorithm. Future Internet, 13(2), 31. https://doi.org/10.3390/fi13020031 · DOI
  45. Ruiz-Conde, E., & Calderón-Martínez, A. (2014). University institutional repositories: Competitive environment and their role as communication media of scientific knowledge. Scientometrics, 98(2), 1283–1299. https://doi.org/10.1007/s11192-013-1159-5 · DOI
  46. Scolari, C. (2008). Online brands: Branding, possible worlds, and interactive grammars. Semiotica, 2008(169), 169–188. https://doi.org/10.1515/SEM.2008.030 · doi:10.1515/sem.2008.030
  47. Serrano-Cobos, J. (2015). SEO: Introducción a la disciplina del posicionamiento en buscadores. UOC Publishing.
  48. Serrano-Vicente, R., Melero, R., & Abadal, E. (2018). Evaluation of Spanish institutional repositories based on criteria related to technology, procedures, content, marketing and personnel. Data Technologies and Applications, 52(3), 384–404. https://doi.org/10.1108/dta-10-2017-0074 · doi:10.1108/dta-10-2017-0074
  49. Smith, A. G. (2012). Webometric evaluation of institutional repositories. Proceedings of the 8th International Conference on Webometrics Informetrics and Scientometrics & 13th Collnet Meeting (pp. 722–729). Seoul (Korea). Retrieved 8 June, 2024, from https://ir.wgtn.ac.nz/handle/123456789/18727
  50. Smith, A. G. (2013). Web Based Impact Measures for Institutional Repositories. Proceedings of the ISSI 2013 conference (pp. 1806–1816). Viena (Austria). Retrieved 8 June, 2024, from https://ir.wgtn.ac.nz/handle/123456789/18790
  51. Van den Bosch, A., Bogers, T., & De Kunder, M. (2016). Estimating search engine index size variability: A 9-year longitudinal study. Scientometrics, 107(2), 839–856. https://doi.org/10.1007/s11192-016-1863-z · DOI · Paper page
  52. Van Dijck, J. (2010). Search engines and the production of academic knowledge. International Journal of Cultural Studies, 13(6), 574–592. https://doi.org/10.1177/1367877910376582 · DOI
  53. Van Dijck, J., Poell, T., & De Waal, M. (2018). The platform society: Public values in a connective world. Oxford University Press. · DOI · Paper page
  54. Xia, J. (2008). A comparison of subject and institutional repositories in self-archiving practices. The Journal of Academic Librarianship, 34(6), 489–495. https://doi.org/10.1016/j.acalib.2008.09.016 · DOI
  55. Yang, L. (2016). Making search engines notice: An exploratory study on discoverability of DSpace metadata and PDF files. Journal of Web Librarianship, 10(3), 147–160. https://doi.org/10.1080/19322909.2016.1172539 · doi:10.1080/19322909.2016.1172539
  56. Zuccala, A., Oppenheim, C., & Dhiensa, R. (2008). Managing and evaluating digital repositories. Information Research: An International Electronic Journal, 13(1), 3.

Metadata

Authors
Orduña-Malea, E., Font-Julián, C. I., & Serrano-Cobos, J.
Venue
Scientometrics
Published
2024-10-12
Volume
129
Issue
11
Pages
7131-7152
ISSN
  • 0138-9130
  • 1588-2861
Cited by
4
References
4
Language
en
Licence
Funders
  • Ministerio de Ciencia, Innovación y Universidades (PID2022-142569NA-I00)
  • Generalitat Valenciana (GV/2021/141)
  • Universitat Politècnica de València

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Open access publications drive few visits from Google Search results to institutional repositories. https://app.cochat.ai/papers/10.1007/s11192-024-05175-0
The paper
Orduña-Malea, E., Font-Julián, C. I., & Serrano-Cobos, J. (2024). Open access publications drive few visits from Google Search results to institutional repositories. Scientometrics. https://doi.org/10.1007/s11192-024-05175-0

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.