Selecting and implementing overview methods: implications from five exemplar overviews
Open accessThe DOI matches its Crossref record; 56 of the 57 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Overviews of systematic reviews are an increasingly popular method of evidence synthesis; there is a lack of clear guidance for completing overviews and a number of methodological challenges. At the UK Cochrane Symposium 2016, methodological challenges of five overviews were explored. Using data from these five overviews, practical implications to support methodological decision making of authors writing protocols for future overviews are proposed. METHODS: Methods, and their justification, from the five exemplar overviews were tabulated and compared with areas of debate identified within current literature. Key methodological challenges and implications for development of overview protocols were generated and synthesised into a list, discussed and refined until there was consensus. RESULTS: Methodological features of three Cochrane overviews, one overview of diagnostic test accuracy and one mixed methods overview have been summarised. Methods of selection of reviews and data extraction were similar. Either the AMSTAR or ROBIS tool was used to assess quality of included reviews. The GRADE approach was most commonly used to assess quality of evidence within the reviews. Eight key methodological challenges were identified from the exemplar overviews. There was good agreement between our findings and emerging areas of debate within a recent published synthesis. Implications for development of protocols for future overviews were identified. CONCLUSIONS: Overviews are a relatively new methodological innovation, and there are currently substantial variations in the methodological approaches used within different overviews. There are considerable methodological challenges for which optimal solutions are not necessarily yet known. Lessons learnt from five exemplar overviews highlight a number of methodological decisions which may be beneficial to consider during the development of an overview protocol.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“Our search strategy retrieved 119 unique records, and the forward citation searching retrieved 92 citations (Fig. 2). After deduplication 199 remained, and after screening abstracts and full text, seven were included [17–19, 28–31]. One additional conference citation was found through expert knowledge on the topic [32], and one paper recently published was included after completion of the first”
From Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews (2021) · cites this paper as [18]
Experimental — accuracy not yet measuredIn the citing paper
“Since publication of the MOoR framework, methods for overlap have been published [17–19].”
From Managing overlap of primary study results across systematic reviews: practical considerations for authors of overviews of reviews (2021) · cites this paper as [18]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2014) · Medical Entomology and Zoology · Cited by 17,633
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826
Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews
Shea, B. J., Grimshaw, J. M., Wells, G. A., Boers, M., Andersson, N., Hamel, C., Porter, A. C., Tugwell, P., Moher, D., & Bouter, L. M. (2007) · BMC Medical Research Methodology · doi:10.1186/1471-2288-7-10 · Cited by 4,374
Aromataris, E., Fernandez, R., Godfrey, C. M., Holly, C., Khalil, H., & Tungpunkom, P. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000055 · Cited by 2,587 · cited 2×
“These include the QUality Of Reporting Of Meta-analyses (QUOROM) statement [31], Methodological Expectations of Cochrane Intervention Reviews guidance (MECIR) [32] and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, as well as the growing body of guidance specific to overviews […”
MethodROBIS: A new tool to assess risk of bias in systematic reviews was developed
Whiting, P., Savović, J., Higgins, J. P. T., Caldwell, D. M., Reeves, B. C., Shea, B., Davies, P., Kleijnen, J., & Churchill, R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.005 · Cited by 2,272
Three techniques for integrating data in mixed methods studies
O'Cathain, A., Murphy, E., & Nicholl, J. (2010) · BMJ · doi:10.1136/bmj.c4587 · Cited by 1,584 · cited 14×
“Using five recently completed or ongoing overviews of reviews, we have explored the methodological features of overviews and the key methodological challenges which are reported by the overview authors and have systematically compared these findings with synthesised evidence relating to current guidance for overview m…”
ResultInfluentialThe Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Systematic review finds overlapping reviews were not mentioned in every other overview
Pieper, D., Antoine, S.-L., Mathes, T., Neugebauer, E. A. M., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.11.007 · Cited by 1,318
Methodology in conducting a systematic review of systematic reviews of healthcare interventions
Smith, V., Devane, D., Begley, C. M., & Clarke, M. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-15 · Cited by 1,227
The STARD Statement for Reporting Studies of Diagnostic Accuracy: Explanation and Elaboration
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Moher, D., Rennie, D., de Vet, H. C. W., & Lijmer, J. G. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00012-w1 · Cited by 1,124
Interventions for improving upper limb function after stroke
Pollock, A., Farmer, S. E., Brady, M. C., Langhorne, P., Mead, G. E., Mehrholz, J., & van Wijck, F. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010820.pub2 · Cited by 909 · cited 19×
“Pollock M, Fernandes R, Becker L, Featherstone R, Hartling L.”
BackgroundMethodResultInfluentialSelf-citationTriangulation: Validity and empirically-based hypothesis construction
Erzberger, C., & Prein, G. (1997) · Quality and Quantity · doi:10.1023/a:1004249313062 · Cited by 251
A descriptive analysis of overviews of reviews published between 2000 and 2011.
Hartling, L., Chisholm, A., Thomson, D., & Dryden, D. M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049667 · Cited by 241
Pollock, M., Fernandes, R. M., Pieper, D., Tricco, A. C., Gates, M., Gates, A., & Hartling, L. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1252-9 · Cited by 228 · cited 1×
“These include summaries of guidance relating to overview methods [5], descriptions and debate relating to the use of GRADE [10–12] and AMSTAR [13], the development of a new tool to assess risk of bias (ROBIS [14]), and protocols for ongoing work in this field [15, 16].”
MethodBoote, J., Wong, R., & Booth, A. (2015) · Health Expectations · doi:10.1111/hex.12007 · Cited by 216
Overviews of reviews often have limited rigor: a systematic review
Pieper, D., Buechter, R., Jerinic, P., & Eikermann, M. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.06.015 · Cited by 213 · cited 3×
“Keywords: Challenges, Methods, Overviews, Quality assessment, Synthesis Background Overviews of systematic reviews are an increasingly popular method of evidence synthesis [1, 2], and there are a growing number of resources, including guidelines, recommendations, descriptions and systematic reviews, relating to overvi…”
BackgroundMethodTodhunter‐Brown, A., Hazelton, C., Campbell, P., Elders, A., Hagen, S., & McClurg, D. (2022) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012337.pub2 · Cited by 199
Self-citationPollock, M., Fernandes, R. M., Becker, L. A., Featherstone, R., & Hartling, L. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0367-5 · Cited by 195 · cited 4×
“While there are some areas of agreement in relation to optimal overview methods, particularly in the early stages of overview completion [5], there remains considerable uncertainty around some key areas of methodology [3, 5, 7, 8] and a need for clearer standards and reporting guidance, supported by research evidence,…”
BackgroundMethodInfluentialPollock, A., Farmer, S. E., Brady, M. C., Langhorne, P., Mead, G. E., Mehrholz, J., van Wijck, F., & Wiffen, P. J. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.08.013 · Cited by 181
Self-citationBallard, M., & Montgomery, P. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1229 · Cited by 136
Presenting the Results of Cochrane Systematic Reviews to a Consumer Audience: A Qualitative Study
Glenton, C., Santesso, N., Rosenbaum, S., Nilsen, E. S., Rader, T., Ciapponi, A., & Dilkes, H. (2010) · Medical Decision Making · doi:10.1177/0272989x10375853 · Cited by 123
Faggion, C. M. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0062-6 · Cited by 109
Pollock, M., Fernandes, R. M., & Hartling, L. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0325-5 · Cited by 107
Burda, B. U., Holmer, H. K., & Norris, S. L. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0237-1 · Cited by 93
Consumer involvement in systematic reviews of comparative effectiveness research
Kreis, J., Puhan, M. A., Schünemann, H. J., & Dickersin, K. (2013) · Health Expectations · doi:10.1111/j.1369-7625.2011.00722.x · Cited by 88
Serrano-Aguilar, P., Trujillo-Martín, M. M., Ramos-Goñi, J. M., Mahtani‐Chugani, V., Perestelo‐Pérez, L., & de la Paz, M. P. (2009) · Social Science & Medicine · doi:10.1016/j.socscimed.2009.07.005 · Cited by 85
Resuming the discussion of AMSTAR: What can (should) be made better?
Wegewitz, U. E., Weikert, B., Fishta, A., Jacobs, A., & Pieper, D. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0183-6 · Cited by 83
Caird, J., Sutcliffe, K., Kwan, I., Dickson, K., & Thomas, J. (2015) · Evidence & Policy · doi:10.1332/174426514x13988609036850 · Cited by 81 · cited 1×
“While there are some areas of agreement in relation to optimal overview methods, particularly in the early stages of overview completion [5], there remains considerable uncertainty around some key areas of methodology [3, 5, 7, 8] and a need for clearer standards and reporting guidance, supported by research evidence,…”
BackgroundProphylactic versus selective blood transfusion for sickle cell disease in pregnancy
Okusanya, B. O., & Oladapo, O. T. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010378.pub3 · Cited by 76
Up-to-dateness of reviews is often neglected in overviews: a systematic review
Pieper, D., Antoine, S.-L., Neugebauer, E. A. M., & Eikermann, M. (2014) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.08.008 · Cited by 65
Blood transfusion for preventing primary and secondary stroke in people with sickle cell disease
Wang, W. C., & Dwan, K. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003146.pub2 · Cited by 65
Quality and transparency of overviews of systematic reviews
Li, L., Tian, J., Tian, H., Sun, R., Liu, Y., & Yang, K. (2012) · Journal of Evidence-Based Medicine · doi:10.1111/j.1756-5391.2012.01185.x · Cited by 62
Blood transfusions for treating acute chest syndrome in people with sickle cell disease
Dastgiri, S., & Dolatkhah, R. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007843.pub3 · Cited by 62
Preoperative blood transfusions for sickle cell disease
Estcourt, L. J., Fortin, P. M., Trivella, M., & Hopewell, S. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003149.pub3 · Cited by 56
Self-citationLunny, C., Brennan, S. E., McDonald, S., & McKenzie, J. E. (2016) · Systematic Reviews · doi:10.1186/s13643-015-0178-0 · Cited by 53
Pollock, A., Campbell, P., Struthers, C., Synnot, A., Nunn, J., Hill, S., Goodare, H., Watts, C., & Morley, R. (2017) · Research Involvement and Engagement · doi:10.1186/s40900-017-0060-4 · Cited by 50
Self-citationInterventions for treating leg ulcers in people with sickle cell disease
Martí-Carvajal, A. J., Knight‐Madden, J., & Martínez‐Zapata, M. J. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008394.pub3 · Cited by 49
Blood transfusion for preventing primary and secondary stroke in people with sickle cell disease
Estcourt, L. J., Kohli, R., Hopewell, S., Trivella, M., & Wang, W. C. (2020) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003146.pub4 · Cited by 49
Self-citationMorley, R. F., Norman, G., Golder, S., & Griffith, P. (2016) · Research Involvement and Engagement · doi:10.1186/s40900-016-0049-4 · Cited by 46
Methodological approaches in conducting overviews: current state in HTA agencies
Pieper, D., Antoine, S., Morfeld, J., Mathes, T., & Eikermann, M. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1107 · Cited by 39
Estcourt, L. J., Fortin, P. M., Hopewell, S., & Trivella, M. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012082 · Cited by 39
Self-citationBlood transfusion for preventing primary and secondary stroke in people with sickle cell disease
Estcourt, L. J., Fortin, P. M., Hopewell, S., Trivella, M., & Wang, W. C. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003146.pub3 · Cited by 37
Self-citationInterventions for preventing silent cerebral infarcts in people with sickle cell disease
Estcourt, L. J., Fortin, P. M., Hopewell, S., Trivella, M., Doree, C. J., & Abboud, M. R. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012389.pub2 · Cited by 36
Self-citationMcClurg, D., Pollock, A., Campbell, P., Hazelton, C., Elders, A., Hagen, S., & Hill, D. C. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012337 · Cited by 34
Self-citationInterventions for chronic kidney disease in people with sickle cell disease
Roy, N. B. A., Fortin, P. M., Bull, K. R., Doree, C. J., Trivella, M., Hopewell, S., & Estcourt, L. J. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012380.pub2 · Cited by 29
Self-citationThomson, D., Foisy, M., Oleszczuk, M., Wingert, A., Chisholm, A., & Hartling, L. (2013) · Evidence-Based Child Health: A Cochrane Review Journal · doi:10.1002/ebch.1897 · Cited by 22
Estcourt, L. J., Fortin, P. M., Hopewell, S., Trivella, M., Hambleton, I. R., & Cho, G. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008360.pub4 · Cited by 18
Self-citationRating the quality of evidence is by necessity a matter of judgment
Murad, M. H., Mustafa, R. A., Morgan, R. L., Sultan, S., Falck-Ytter, Y. T., & Dahm, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.11.018 · Cited by 17
WJNR Welcomes Umbrella Reviews
Conn, V. S., & Sells, T. G. C. (2014) · Western Journal of Nursing Research · doi:10.1177/0193945913506968 · Cited by 15
Prophylactic versus selective blood transfusion for sickle cell disease in pregnancy
Okusanya, B. O., & Oladapo, O. T. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010378.pub2 · Cited by 12
Interventions for chronic kidney disease in people with sickle cell disease
Roy, N. B. A., Fortin, P. M., Bull, K. R., Doree, C. J., Trivella, M., Hopewell, S., & Estcourt, L. J. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012380 · Cited by 11
Self-citationInterventions for preventing silent cerebral infarcts in people with sickle cell disease
Estcourt, L. J., Fortin, P. M., Hopewell, S., Trivella, M., Doree, C. J., & Abboud, M. R. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012389 · Cited by 10
Self-citationPollock, A., Brady, M., Farmer, S., Langhorne, P., Mead, G. E., Mehrholz, J., Wiffen, P. J., & van Wijck, F. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.001 · Cited by 5
Self-citationGionfriddo, M. R. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.11.019 · Cited by 5
Interventions for preventing silent cerebral infarcts in peoplewith sickle cell disease (Protocol)
Estcourt, L. J., Fortin, P. M., Hopewell, S., Trivella, M., Doree, C. J., & Abboud, M. R. (2016) · Cochrane Database of Systematic Reviews · Cited by 1
Self-citation
Research works printed but not linked: 10
- Pollock A Hunt H Campbell P Estcourt L Brunton G Cochrane overviews of reviews: exploring the methods and challenges 2016 Birmingham UK and Ireland Cochrane Symposium
- Hunt H, Kuzma E, C H: A review of existing systematic reviews summarising the accuracy of brief cognitive assessments for identifying dementia, particularly for use in primary care. Protocol..In PROSPERO PROSPERO online; 2016.
- Brunton G Dickson K Khatwa M Caird J Oliver S Hinds K Thomas J Developing evidence-informed, employer-led workplace health 2016 London EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London
- INVOLVE Public involvement in systematic reviews: Supplement to the briefing notes for researchers 2012 Eastleigh INVOLVE
- MECIR The Methodological Expectations of Cochrane Intervention Reviews (MECIR).Standards for Cochrane new reviews of interventions and their updates 2017
- Becker L, Oxman A: Chapter 22: Overviews of reviews. In Cochrane Handbook for Systematic Reviews of Interventions Version 510 (JPT H, S G eds.): The Cochrane Collaboration; 2011. Available from www.handbook.cochrane.org.
- PSTF U.S. Preventive Services Task Force. Procedure Manual AHRQ publication no 08-05118-EF 2008 Rockville U.S. Preventive Services Task Force
- NICE National Institute for Health and Clinical Excellence. The Guidelines Manual 2006 London National Institute for Health and Clinical Excellence
- CCN: What is a systematic review? http://consumers.cochrane.org/what-systematic-review: Cochrane consumers network (CCN); 2017.
- EPOC Effective Practice and Organisation of Care (EPOC): reporting the effects of an intervention in EPOC reviews. Section 24. How to report the effects of an intervention EPOC Resources for review authors 2016 Oslo Norwegian Knowledge Centre for the Health Services
Cited by
Meeting the review family: exploring review types and associated information retrieval requirements
Sutton, A., Clowes, M., Preston, L., & Booth, A. (2019) · Health Information & Libraries Journal · doi:10.1111/hir.12276 · Cited by 570
Adverse Outcomes of Polypharmacy in Older People: Systematic Review of Reviews
Davies, L. E., Spiers, G., Kingston, A., Todd, A., Adamson, J., & Hanratty, B. (2020) · Journal of the American Medical Directors Association · doi:10.1016/j.jamda.2019.10.022 · Cited by 544
Klaic, M., Kapp, S., Hudson, P., Chapman, W., Denehy, L., Story, D., & Francis, J. J. (2022) · Implementation Science · doi:10.1186/s13012-021-01171-7 · Cited by 394
Hunt, H., Pollock, A., Campbell, P., Estcourt, L., & Brunton, G. (2018) · Systematic Reviews · doi:10.1186/s13643-018-0695-8 · Cited by 314
Self-citationLunny, C., Pieper, D., Thabet, P., & Kanji, S. (2021) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01269-y · Cited by 252
Metadata
- Authors
- Pollock, A., Campbell, P., Brunton, G., Hunt, H., & Estcourt, L.
- Affiliations
- Glasgow Caledonian University (GB)
- University College London (GB)
- University of Exeter (GB)
- John Radcliffe Hospital (GB)
- Corresponding author
- Pollock, Alex
- Venue
- Systematic Reviews
- Published
- 2017-07-18
- Volume
- 6
- Issue
- 1
- Pages
- 145-145
- ISSN
- 2046-4053 (ISSN-L)
- PMC
- PMC5516331
- OpenAlex
- W2738509363
- Cited by
- 134
- References
- 57
- Citations by year
- 2026: 5 · 2025: 9 · 2024: 20 · 2023: 28 · 2022: 15 · 2021: 11 · 2020: 19 · 2019: 16 · 2018: 9 · 2017: 1
- FWCI
- 10.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Systematic Reviews (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Open Research Exeter (University of Exeter) (publishedVersion, cc-by)
- ResearchOnline (Glasgow Caledonian University) (acceptedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- Scottish Government
- National Institute for Health and Care Research (13/89/09)
- Physiotherapy Research Foundation
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- overviews of systematic reviews, methodological issues, evidence synthesis, AMSTAR, ROBIS, GRADE, review quality assessment
- MeSH terms
- Data Accuracy, Decision Making, Humans, Publications, Research Design, Review Literature as Topic, Evidence-Based Medicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.