CoChat

Randomised controlled trials evaluating endometrial scratching: assessment of methodological issues

The DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.

Abstract

STUDY QUESTION: Do randomised controlled trials (RCTs) evaluating endometrial scratching suffer from methodological issues including insufficient trial registration, statistical errors or irreproducibility, randomisation errors or miscellaneous issues? SUMMARY ANSWER: The majority of RCTs investigating endometrial scratching have methodological issues. WHAT IS KNOWN ALREADY: A large number of small RCTs investigating the effectiveness of endometrial scratching prior to in vitro fertilisation (IVF) and intrauterine insemination (IUI)/intercourse have reported favourable findings. Subsequently, systematic reviews incorporating these RCTs yielded meta-analyses in favour of endometrial scratching. Endometrial scratching has been widely adopted by infertility specialists around the world. Recently, an international RCT including 1364 women reported no benefit from endometrial scratching before IVF. STUDY DESIGN, SIZE, DURATION: We evaluated several methodological issues of RCTs investigating the effectiveness of endometrial scratching prior to IVF and IUI/intercourse. We identified 25 RCTs for IVF and 12 RCTs for IUI/intercourse with full-text publication. PARTICIPANTS/MATERIALS, SETTING, METHODS: We assessed the RCTs on the following criteria: adequacy of trial registration, statistical issues (description of statistical methods and reproducibility of univariable statistical analysis), excessive similarity or difference in baseline characteristics that is not compatible with chance (Monte Carlo simulations and Kolmogorov–Smirnov test) and miscellaneous methodological issues. MAIN RESULTS AND THE ROLE OF CHANCE: Of 25 RCTs evaluating endometrial scratching prior to IVF, only eight (32%) had adequate trial registration. In total, 10 (40%) RCTs had issues regarding statistical methods. Nine (69%, 13 applicable) RCTs had at least one inconsistency between reported and reproduced univariable statistical analysis for categorical baseline/intermediate characteristics. Statistical results of at least one outcome were not reproducible in 14 (74%, 19 applicable) RCTs. Only two (8%) RCTs had none of the above issues. Suggested by the simulations, these RCTs did not significantly violate the null hypothesis that the baseline characteristics were the results of a properly conducted randomisation process (P = 0.4395). Of 12 IUI/intercourse RCTs, only 2 (17%) had adequate trial registration. In total, five (42%) studies had issues of statistical methods. Inconsistency between reported and reproduced univariable analysis for baseline/intermediate categorical variable(s) was found in four (57%, 7 applicable) RCTs. Statistical analysis was not reproducible for at least one outcome in eight (80%, 10 applicable) studies. All RCTs had at least one of the above issues. These RCTs were inconsistent with the null hypothesis that their baseline characteristics were the results of proper randomised allocation (P = 1.659*10−7). LIMITATIONS, REASONS FOR CAUTION: We were unable to assess RCTs which were not published as full-text papers. We could not analyse individual participant data to investigate possible reasons for statistical inconsistencies. The method to infer the likelihood of proper random sampling rests on assumptions including independent baseline characteristics, simple randomisation and no publication bias. WIDER IMPLICATIONS OF THE FINDINGS: The methodological issues common to RCTs evaluating endometrial scratching may have biased the results of the trials. Further development and validation of these novel methods may be helpful for the critical appraisal of RCTs. STUDY FUNDING/COMPETING INTEREST(S): No external funding was sought to support this work. B.W.M. is supported by a National Health Medical Research Council (NHMRC) Practitioner Fellowship (GNT1082548). B.W.M. reports consultancy for ObsEva, Merck and Guerbet. D.W. is supported by a grant from the Paracelsus Medical University Salzburg, Austria (PMU Research Fund—PMU FFF Number: L-18/02/006-WET) and by Drs Haackert Foundation, Germany. S.L. is an author of a trial included in this study, an author of an included systematic review and a Cochrane editor. All other authors have no conflicts of interest. TRIAL REGISTRATION NUMBER: N/A

Overview

Integrity signals

Registry

Crossref · 10.1093/humrep/dez207

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

5 retracted

Research works printed but not linked: 2

  1. Funabiki, 2017, Technique with intrauterine fiberscope and curettage of the endometrium (IFCE) improves the pregnancy rate for infertile patients with repeated embryo implantation failures-a randomized controlled trial, Hum Reprod, 335
  2. Nuojua-Huttunen, 1999, Hum Reprod, 698

Cited by

See all 36

Metadata

Authors
Li, W., Suke, S., Wertaschnigg, D., Lensen, S., Wang, R., Gurrin, L., & Mol, B. W.
Affiliations
  • Monash University (AU)
  • Paracelsus Medical University (AT)
  • University of Auckland (NZ)
  • The University of Melbourne (AU)
  • Monash Health (AU)
Corresponding author
Mol, Ben W
Venue
Human Reproduction
Published
2019-12-01
Volume
34
Issue
12
Pages
2372-2380
ISSN
  • 0268-1161 (ISSN-L)
  • 1460-2350
OpenAlex
W2994804923
Cited by
36
References
68
Citations by year
2026: 2 · 2025: 3 · 2024: 1 · 2023: 4 · 2022: 5 · 2021: 10 · 2020: 10 · 2019: 1
FWCI
4.35
Type
journal article
Language
en
Open access
closed
Locations
  • Human Reproduction (publishedVersion)
  • PubMed (publishedVersion)
  • Adelaide Research & Scholarship (AR&S) (University of Adelaide) (submittedVersion)
Funders
  • National Health Medical Research Council (GNT1082548)
  • Paracelsus Medical University Salzburg, Austria (L-18/02/006-WET)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Health Sciences › Medicine › Reproductive Medicine › Reproductive Health and Technologies
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
Keywords
endometrial scratching, clinical trial registration, statistical errors, baseline characteristics, in vitro fertilization, intrauterine insemination, infertility treatment, publication bias
MeSH terms
Endometrium, Female, Fertilization in Vitro, Humans, Infertility, Female, Gynecologic Surgical Procedures, Meta-Analysis as Topic, Randomized Controlled Trials as Topic

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.