Randomised controlled trials evaluating endometrial scratching: assessment of methodological issues
The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
STUDY QUESTION: Do randomised controlled trials (RCTs) evaluating endometrial scratching suffer from methodological issues including insufficient trial registration, statistical errors or irreproducibility, randomisation errors or miscellaneous issues? SUMMARY ANSWER: The majority of RCTs investigating endometrial scratching have methodological issues. WHAT IS KNOWN ALREADY: A large number of small RCTs investigating the effectiveness of endometrial scratching prior to in vitro fertilisation (IVF) and intrauterine insemination (IUI)/intercourse have reported favourable findings. Subsequently, systematic reviews incorporating these RCTs yielded meta-analyses in favour of endometrial scratching. Endometrial scratching has been widely adopted by infertility specialists around the world. Recently, an international RCT including 1364 women reported no benefit from endometrial scratching before IVF. STUDY DESIGN, SIZE, DURATION: We evaluated several methodological issues of RCTs investigating the effectiveness of endometrial scratching prior to IVF and IUI/intercourse. We identified 25 RCTs for IVF and 12 RCTs for IUI/intercourse with full-text publication. PARTICIPANTS/MATERIALS, SETTING, METHODS: We assessed the RCTs on the following criteria: adequacy of trial registration, statistical issues (description of statistical methods and reproducibility of univariable statistical analysis), excessive similarity or difference in baseline characteristics that is not compatible with chance (Monte Carlo simulations and Kolmogorov–Smirnov test) and miscellaneous methodological issues. MAIN RESULTS AND THE ROLE OF CHANCE: Of 25 RCTs evaluating endometrial scratching prior to IVF, only eight (32%) had adequate trial registration. In total, 10 (40%) RCTs had issues regarding statistical methods. Nine (69%, 13 applicable) RCTs had at least one inconsistency between reported and reproduced univariable statistical analysis for categorical baseline/intermediate characteristics. Statistical results of at least one outcome were not reproducible in 14 (74%, 19 applicable) RCTs. Only two (8%) RCTs had none of the above issues. Suggested by the simulations, these RCTs did not significantly violate the null hypothesis that the baseline characteristics were the results of a properly conducted randomisation process (P = 0.4395). Of 12 IUI/intercourse RCTs, only 2 (17%) had adequate trial registration. In total, five (42%) studies had issues of statistical methods. Inconsistency between reported and reproduced univariable analysis for baseline/intermediate categorical variable(s) was found in four (57%, 7 applicable) RCTs. Statistical analysis was not reproducible for at least one outcome in eight (80%, 10 applicable) studies. All RCTs had at least one of the above issues. These RCTs were inconsistent with the null hypothesis that their baseline characteristics were the results of proper randomised allocation (P = 1.659*10−7). LIMITATIONS, REASONS FOR CAUTION: We were unable to assess RCTs which were not published as full-text papers. We could not analyse individual participant data to investigate possible reasons for statistical inconsistencies. The method to infer the likelihood of proper random sampling rests on assumptions including independent baseline characteristics, simple randomisation and no publication bias. WIDER IMPLICATIONS OF THE FINDINGS: The methodological issues common to RCTs evaluating endometrial scratching may have biased the results of the trials. Further development and validation of these novel methods may be helpful for the critical appraisal of RCTs. STUDY FUNDING/COMPETING INTEREST(S): No external funding was sought to support this work. B.W.M. is supported by a National Health Medical Research Council (NHMRC) Practitioner Fellowship (GNT1082548). B.W.M. reports consultancy for ObsEva, Merck and Guerbet. D.W. is supported by a grant from the Paracelsus Medical University Salzburg, Austria (PMU Research Fund—PMU FFF Number: L-18/02/006-WET) and by Drs Haackert Foundation, Germany. S.L. is an author of a trial included in this study, an author of an included systematic review and a Cochrane editor. All other authors have no conflicts of interest. TRIAL REGISTRATION NUMBER: N/A
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, fabricated data tend to be perfect in terms of no or few missing values, whereas, in real trials, 100% follow-up is extremely rare.35”
From Assessing Research Misconduct in Randomized Controlled Trials (2021) · cites this paper as [35]
Citations
Cites
5 retracted
Shohayeb, A., & El-Khayat, W. M. (2012) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2012.06.029 · Cited by 115
RetractedMaged, A. M., Rashwan, H., Abdelaziz, S., Ramadan, W., Mostafa, W. A. I., Metwally, A. A., & Katta, M. A. (2017) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.12355 · Cited by 38
RetractedThe effect of endometrial injury on first cycle IVF/ICSI outcome: A randomized controlled trial
Mahran, A., Ibrahim, M., & Bahaa, H. A. (2016) · International Journal of Reproductive BioMedicine (IJRM) · doi:10.29252/ijrm.14.3.193 · Cited by 37
RetractedEl-Khayat, W. M., ElSadek, M. M., & Saber, W. (2015) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2015.08.025 · Cited by 33
RetractedRETRACTED: A randomized trial of local endometrial injury during ovulation induction cycles
Helmy, M. E. E., Maher, M. A., Elkhouly, N. I., & Ramzy, M. (2017) · International Journal of Gynecology & Obstetrics · doi:10.1002/ijgo.12178 · Cited by 13
RetractedMoher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · BMC Medical Research Methodology · doi:10.1186/1471-2288-1-2 · Cited by 2,755
Full publication of results initially presented in abstracts.
Scherer, R. W., Langenberg, P., & von Elm, E. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000005.pub3 · Cited by 997
(2016) · Cochrane Database of Systematic Reviews · Cited by 985
Barash, A., Dekel, N., Fieldust, S., Segal, I., Schechtman, E., & Granot, I. (2003) · Fertility and Sterility · doi:10.1016/s0015-0282(03)00345-5 · Cited by 483
Cumulative Live-Birth Rates after In Vitro Fertilization
Malizia, B. A., Hacker, M. R., & Penzias, A. S. (2009) · New England Journal of Medicine · doi:10.1056/nejmoa0803072 · Cited by 476
Jørgensen, A. W., Hilden, J., & Gøtzsche, P. C. (2006) · BMJ · doi:10.1136/bmj.38973.444699.0b · Cited by 444
Clinical trial registration: a statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P., et al. (2004) · The Lancet · doi:10.1016/s0140-6736(04)17034-7 · Cited by 408
Full publication of results initially presented in abstracts
Scherer, R. W., Meerpohl, J. J., Pfeifer, N., Schmucker, C., Schwarzer, G., & von Elm, E. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000005.pub4 · Cited by 307
Endometrial injury in women undergoing assisted reproductive techniques
Nastri, C., Lensen, S., Gibreel, A., Raine-Fenning, N., Ferriani, R., Bhattacharya, S., & Martins, W. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009517.pub3 · Cited by 289
Self-citationCumulative Birth Rates with Linked Assisted Reproductive Technology Cycles
Luke, B., Brown, M. B., Wantman, E., Lederman, A., Gibbons, W., Schattman, G. L., Lobo, R. A., Leach, R. E., & Stern, J. E. (2012) · New England Journal of Medicine · doi:10.1056/nejmoa1110238 · Cited by 224
A Randomized Trial of Endometrial Scratching before In Vitro Fertilization
Lensen, S., Osavlyuk, D., Armstrong, S., Stadelmann, C., Hennes, A., Napier, E., Wilkinson, J., Sadler, L., Gupta, D., Strandell, A., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1808737 · Cited by 198
Self-citationNarvekar, S., Gupta, N., Shetty, N., Kottur, A., Srinivas, M., & Rao, K. (2010) · Journal of Human Reproductive Sciences · doi:10.4103/0974-1208.63116 · Cited by 159
Karimzadeh, M., ROZBAHANI, M. A., & Tabibnejad, N. (2009) · Australian and New Zealand Journal of Obstetrics and Gynaecology · doi:10.1111/j.1479-828x.2009.01076.x · Cited by 154
Yeung, T. W. Y., Chai, J., Li, R. H. W., Lee, V. C. Y., Ho, P. C., & Ng, E. H. Y. (2014) · Human Reproduction · doi:10.1093/humrep/deu213 · Cited by 152
Karimzade, M. A., Oskouian, H., Ahmadi, S., & Oskouian, L. (2009) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-009-1166-1 · Cited by 135
Sharing and Reporting the Results of Clinical Trials
Hudson, K. L., & Collins, F. S. (2015) · JAMA · doi:10.1001/jama.2014.10716 · Cited by 132
Nastri, C. O., Ferriani, R. A., Raine‐Fenning, N., & Martins, W. P. (2013) · Ultrasound in Obstetrics & Gynecology · doi:10.1002/uog.12539 · Cited by 130
Endometrial scratching for subfertility: everyone's doing it
Lensen, S. F., Sadler, L. C., & Farquhar, C. M. (2016) · Human Reproduction · doi:10.1093/humrep/dew053 · Cited by 104
Self-citationXu, B., Zhang, Q., Hao, J., Xu, D., & Li, Y. (2014) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2014.12.006 · Cited by 96
Carlisle, J. B., Dexter, F., Pandit, J. J., Shafer, S. L., & Yentis, S. M. (2015) · Anaesthesia · doi:10.1111/anae.13126 · Cited by 87
Baum, M., Yerushalmi, G. M., Maman, E., Kedem, A., Machtinger, R., Hourvitz, A., & Dor, J. (2012) · Gynecological Endocrinology · doi:10.3109/09513590.2011.650750 · Cited by 87
Gibreel, A., Badawy, A., El‐Refai, W., & El‐Adawi, N. (2013) · Journal of Obstetrics and Gynaecology Research · doi:10.1111/j.1447-0756.2012.02016.x · Cited by 85
Vitagliano, A., Noventa, M., Saccone, G., Gizzo, S., Vitale, S. G., Laganà, A. S., Litta, P., Saccardi, C., Nardelli, G. B., & Sardo, A. D. S. (2017) · Fertility and Sterility · doi:10.1016/j.fertnstert.2017.09.021 · Cited by 78
Mak, J. S. M., Chung, C. H. S., Chung, J. P. W., Kong, G. W. S., Saravelos, S. H., Cheung, L. P., & Li, T. C. (2017) · Reproductive BioMedicine Online · doi:10.1016/j.rbmo.2017.04.004 · Cited by 76
van Hoogenhuijze, N. E., Kasius, J. C., Broekmans, F. J., Bosteels, J., & Torrance, H. L. (2018) · Human Reproduction Open · doi:10.1093/hropen/hoy025 · Cited by 73
Simón, C., & Bellver, J. (2014) · Human Reproduction · doi:10.1093/humrep/deu126 · Cited by 69
Endometrial scratching for women with previous IVF failure undergoing IVF treatment
Gibreel, A., Eladawi, N., Elgindy, E. A., Al-Inany, H. G., Allakkany, N. S., & Tournaye, H. J. (2015) · Gynecological Endocrinology · doi:10.3109/09513590.2014.994603 · Cited by 65
Spencer, E. A., Mahtani, K. R., Goldacre, B. M., & Heneghan, C. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-013940 · Cited by 62
Nastri, C. O., Ferriani, R. A., Raine‐Fenning, N. J., & Martins, W. P. (2013) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.12638 · Cited by 61
Endometrial injury for pregnancy following sexual intercourse or intrauterine insemination
Lensen, S. F., Manders, M., Nastri, C. O., Gibreel, A., Martins, W. P., Templer, G. E., & Farquhar, C. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011424.pub2 · Cited by 56
Self-citationDal-Ré, R., Ross, J. S., & Marušić, A. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.01.017 · Cited by 55
Liu, W., Tal, R., Chao, H., Liu, M., & Liu, Y. (2017) · Reproductive Biology and Endocrinology · doi:10.1186/s12958-017-0296-8 · Cited by 52
Elia, N., von Elm, E., Chatagner, A., Pöpping, D. M., & Tramèr, M. R. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010442 · Cited by 49
Huang, S., Wang, R., Li, R., Wang, H., Qiao, J., & Mol, B. W. (2018) · Fertility and Sterility · doi:10.1016/j.fertnstert.2018.01.008 · Cited by 49
Self-citationSingh, N., Toshyan, V., Kumar, S., Vanamail, P., & Madhu, M. (2015) · Journal of Human Reproductive Sciences · doi:10.4103/0974-1208.170401 · Cited by 47
Güven, S., Kart, C., Unsal, M. A., Yildirim, O., Odacı, E., & Yuluğ, E. (2013) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2013.11.005 · Cited by 46
Granot, I., Dekel, N., Bechor, E., Segal, I., Fieldust, S., & Barash, A. (2000) · Fertility and Sterility · doi:10.1016/s0015-0282(99)00531-2 · Cited by 44
Parsanezhad, M. E., Dadras, N., Maharlouei, N., Neghahban, L., Keramati, P., & Amini, M. (2013) · Europe PMC (PubMed Central) · Cited by 44
Maged, A. M., Al-Inany, H. G., Salama, K. M., Souidan, I. I., Ragab, H. M. A., & El‐Nassery, N. (2015) · Reproductive Sciences · doi:10.1177/1933719115602776 · Cited by 42
The effects of endometrial injury on intrauterine insemination outcome: A randomized clinical trial.
Zarei, A., Alborzi, S., Dadras, N., & Azadi, G. (2014) · Europe PMC (PubMed Central) · Cited by 40
Frantz, S., Parinaud, J., Krêt, M., Rocher-Escriva, G., Papaxanthos-Roche, A., Creux, H., Chansel‐Debordeaux, L., Bénard, A., & Hocké, C. (2018) · Human Reproduction · doi:10.1093/humrep/dey334 · Cited by 40
Tk, A., Singhal, H., Premkumar, P. S., Acharya, M., Kamath, M. S., & George, K. (2017) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2017.05.005 · Cited by 37
The Importance — and the Complexities — of Data Sharing
Drazen, J. M., Morrissey, S., Malina, D., Hamel, M. B., & Campion, E. W. (2016) · New England Journal of Medicine · doi:10.1056/nejme1611027 · Cited by 36
Abdelhamid, A. M. S. (2013) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-013-2785-0 · Cited by 34
Shahrokh-Tehraninejad, E., Dashti, M., Rashidi, B. H., Aziminekoo, E., Haghollahi, F., & Kalantari, V. (2016) · PubMed Central · Cited by 31
Wadhwa, L., Pritam, A., Gupta, T., Gupta, S., Arora, S., & Chandoke, R. K. (2015) · Journal of Human Reproductive Sciences · doi:10.4103/0974-1208.165144 · Cited by 29
Goel, T., Mahey, R., Bhatla, N., Kalaivani, M., Pant, S., & Kriplani, A. (2017) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-017-0949-8 · Cited by 29
Ashrafi, M., Tehraninejad, E. S., Haghiri, M., Masomi, M., Sadatmahalleh, S. J., & Arabipoor, A. (2017) · Journal of obstetrics and gynaecology research · doi:10.1111/jog.13401 · Cited by 29
Eskew, A. M., Reschke, L. D., Woolfolk, C., Schulte, M. B., Boots, C. E., Broughton, D. E., Jimenez, P. T., Omurtag, K. R., Keller, S. L., Ratts, V. S., et al. (2018) · Journal of Assisted Reproduction and Genetics · doi:10.1007/s10815-018-1356-5 · Cited by 29
Soliman, B. S., & Harira, M. M. (2016) · Middle East Fertility Society Journal · doi:10.1016/j.mefs.2016.06.006 · Cited by 27
Aflatoonian, A., Bagheri, R. B., & Hosseinisadat, R. (2016) · International Journal of Reproductive BioMedicine (IJRM) · doi:10.29252/ijrm.14.7.3 · Cited by 27
Klentzeris, L. D., Li, T. C., Dockery, P., & Cooke, I. D. (1992) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/0028-2243(92)90227-p · Cited by 25
Safdarian, L., Movahedi, S., Aleyasine, A., Aghahosaini, M., Fallah, P., & Rezaiian, Z. (2011) · Europe PMC (PubMed Central) · Cited by 24
El-Din, A. M. B., Abdelmaabud, K. H., Laban, M., Hassanin, A. S., Tharwat, A. A., Raafat, T. A., Elbohoty, A. E. H., El-Sayed, H. M., Ibrahim, A. M., IBRAHIM, M. E., et al. (2016) · Reproductive Sciences · doi:10.1177/1933719116638191 · Cited by 21
İnal, H. A., İnal, Z. H. Ö., & Görkemli, H. (2012) · Electronic Journal of General Medicine · doi:10.29333/ejgm/82435 · Cited by 20
Cochrane: the unfinished symphony of research synthesis
Roberts, I., & Ker, K. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0290-9 · Cited by 19
Gui, J., Xu, W., Yang, J., Feng, L., & Jia, J. (2018) · Journal of obstetrics and gynaecology research · doi:10.1111/jog.13854 · Cited by 16
Hilton, J., Liu, K. E., Laskin, C. A., & Havelock, J. C. (2019) · Archives of Gynecology and Obstetrics · doi:10.1007/s00404-019-05044-9 · Cited by 16
Seeking and reporting apparent research misconduct: errors and integrity
Kharasch, E. D., & Houle, T. T. (2018) · Anaesthesia · doi:10.1111/anae.14147 · Cited by 15
Sherif, A., Abou‐Talib, Y., Ibrahim, M. I., & Arafat, R. (2018) · Middle East Fertility Society Journal · doi:10.1016/j.mefs.2018.02.001 · Cited by 9
Financial conflicts of interest and outcomes and quality of systematic reviews
Nejstgaard, C. H., Lundh, A., Rasmussen, K., Gøtzsche, P. C., & Hróbjartsson, A. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000047 · Cited by 8
Seeking and reporting apparent research misconduct: errors and integrity – a reply
Carlisle, J. B. (2017) · Anaesthesia · doi:10.1111/anae.14148 · Cited by 6
Research works printed but not linked: 2
- Funabiki, 2017, Technique with intrauterine fiberscope and curettage of the endometrium (IFCE) improves the pregnancy rate for infertile patients with repeated embryo implantation failures-a randomized controlled trial, Hum Reprod, 335
- Nuojua-Huttunen, 1999, Hum Reprod, 698
Cited by
The precise determination of the window of implantation significantly improves ART outcomes
Enciso, M., Aizpurúa, J., Rodriguez-Estrada, B., Jurado, I., Ferrández-Rives, M., Rodríguez, E., Pérez-Larrea, E., Climent, A. B., Marron, K., & Sarasa, J. (2021) · Scientific Reports · doi:10.1038/s41598-021-92955-w · Cited by 84
Approaches to Improve Endometrial Receptivity in Case of Repeated Implantation Failures
Makrigiannakis, A., Makrygiannakis, F., & Vrekoussis, T. (2021) · Frontiers in Cell and Developmental Biology · doi:10.3389/fcell.2021.613277 · Cited by 77
Data integrity of 35 randomised controlled trials in women' health
Bordewijk, E. M., Wang, R., Askie, L. M., Gurrin, L. C., Thornton, J. G., van Wely, M., Li, W., & Mol, B. W. (2020) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2020.04.016 · Cited by 66
Self-citationEndometrial injury in women undergoing in vitro fertilisation (IVF)
Lensen, S. F., Armstrong, S., Gibreel, A., Nastri, C. O., Raine‐Fenning, N., & Martins, W. P. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009517.pub4 · Cited by 71
Self-citationvan Hoogenhuijze, N. E., Mol, F., Laven, J. S. E., Groenewoud, E. R., Traas, M. A. F., Janssen, C. A. H., Teklenburg, G., de Bruin, J. P., van Oppenraaij, R. H. F., Maas, J. W. M., et al. (2020) · Human Reproduction · doi:10.1093/humrep/deaa268 · Cited by 63
“…high risk of bias was also confirmed by a recent study that assessed methodological issues in RCTs on endometrial scratching in IVF/ICSI treatments (Li et al. , 2019): they concluded that almost all of the RCTs (23/25) suffered from at least one issue regarding trial registration, statistical…”
Metadata
- Authors
- Li, W., Suke, S., Wertaschnigg, D., Lensen, S., Wang, R., Gurrin, L., & Mol, B. W.
- Affiliations
- Monash University (AU)
- Paracelsus Medical University (AT)
- University of Auckland (NZ)
- The University of Melbourne (AU)
- Monash Health (AU)
- Corresponding author
- Mol, Ben W
- Venue
- Human Reproduction
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-12-01
- Volume
- 34
- Issue
- 12
- Pages
- 2372-2380
- ISSN
- 0268-1161 (ISSN-L)
- 1460-2350
- OpenAlex
- W2994804923
- Cited by
- 36
- References
- 68
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 1 · 2023: 4 · 2022: 5 · 2021: 10 · 2020: 10 · 2019: 1
- FWCI
- 4.35
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Human Reproduction (publishedVersion)
- PubMed (publishedVersion)
- Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
- Funders
- National Health Medical Research Council (GNT1082548)
- Paracelsus Medical University Salzburg, Austria (L-18/02/006-WET)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Reproductive Medicine › Reproductive Health and Technologies
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Keywords
- endometrial scratching, clinical trial registration, statistical errors, baseline characteristics, in vitro fertilization, intrauterine insemination, infertility treatment, publication bias
- MeSH terms
- Endometrium, Female, Fertilization in Vitro, Humans, Infertility, Female, Gynecologic Surgical Procedures, Meta-Analysis as Topic, Randomized Controlled Trials as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.