Evaluating Meta-analyses in the General Surgical Literature: A Critical Appraisal
Open accessAbstract
OBJECTIVE: To assess the methodologic quality of meta-analyses of general surgery topics published in peer-reviewed journals. SUMMARY BACKGROUND DATA: Systematic reviews and meta-analysis are used to seek, summarize, and interpret primary studies on a given topic. Accordingly, systematic reviews and meta-analyses of high-quality primary studies may be the highest level of evidence for issues of prevention and treatment in evidence-based medicine. However, not all published meta-analyses are rigorously performed. METHODS: We searched MEDLINE (from January 1, 1997, to September 1, 2002) and reference lists and solicited general surgery specialists to identify relevant meta-analyses. Inclusion criteria were use of meta-analytic methods to pool the results of primary studies in general surgery on issues of diagnosis, causation, prognosis, or treatment. Our search strategies identified 487 potentially relevant articles. After excluding articles based on a priori criteria, 51 meta-analyses fulfilled eligibility criteria. In duplicate and independently, 2 reviewers assessed the quality of these meta-analyses using a 10-item index called the Overview Quality Assessment Questionnaire. RESULTS: Overall concordance between 2 independent reviewers was good (interobserver agreement 81%, and a kappa of 0.62 (95% CI 0.55-0.69). Of 51 relevant articles, 38 were published in surgical journals. Most studies had major methodologic flaws (median score of 3.3, scale of 1-7). Factors associated with low overall scientific quality included the absence of any prior meta-analyses publications by authors and meta-analyses produced by surgical department members without external collaboration. CONCLUSIONS: This critical appraisal of meta-analyses published in the general surgery literature demonstrates frequent methodologic flaws. The quality of these reports limits the validity of the findings and the inferences that can be made about the primary studies reviewed. To improve the quality of future meta-analyses, we recommend following guidelines for the optimal conduct and reporting of meta-analyses in general surgery.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The quality of the conduct and reporting of systematic reviews remains well short of ideal.
“However, despite advances, the quality of the conduct and reporting of systematic reviews remains well short of ideal [3],[4],[5],[6].”
From The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration (2009) · cites this paper as [4]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722 · see citing works
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634 · see citing works
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826 · see citing works
Self-citationMoher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560 · see citing works
Self-citationSystematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,312 · see citing works
Gluud, L. L., Villumsen, J., & Gluud, C. N. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,262 · see citing works
Klinge, U., Park, J.-K., & Klosterhalfen, B. (2013) · Pathobiology · doi:10.1159/000348446 · Cited by 1,791 · see citing works
Meta-Analyses of Randomized Controlled Trials
Sacks, H. S., Berrier, J., Reitman, D., Ancona-Berk, V. A., & Chalmers, T. C. (1987) · New England Journal of Medicine · doi:10.1056/nejm198702193160806 · Cited by 1,253 · see citing works
Discrepancies between Meta-Analyses and Subsequent Large Randomized, Controlled Trials
LeLorier, J., Grégoire, G., Benhaddad, A. A., Lapierre, J., & Derderian, F. (1997) · New England Journal of Medicine · doi:10.1056/nejm199708213370806 · Cited by 1,171 · see citing works
Lewis, S. J., Egger, M., Sylvester, P. A., & Thomas, S. (2001) · BMJ · doi:10.1136/bmj.323.7316.773 · Cited by 858 · see citing works
Users' Guides to the Medical Literature: IX. A Method for Grading Health Care Recommendations
Guyatt, G. H. (1995) · JAMA · doi:10.1001/jama.1995.03530220066035 · Cited by 846 · see citing works
Validation of an index of the quality of review articles
Oxman, A. D., & Guyatt, G. H. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90160-b · Cited by 788 · see citing works
Renehan, A. G., Egger, M., Saunders, M. P., & O'Dwyer, S. T. (2002) · BMJ · doi:10.1136/bmj.324.7341.813 · Cited by 651 · see citing works
Mismetti, P., Laporte, S., Darmon, J.-Y., Buchmuller, A., & Decousus, H. (2001) · British journal of surgery · doi:10.1046/j.0007-1323.2001.01800.x · Cited by 648 · see citing works
Transthoracic versus transhiatal resection for carcinoma of the esophagus: a meta-analysis.
Hulscher, J., Tijssen, J. G., Obertop, H., & van Lanschot, J. V. (2001) · Annals of Thoracic Surgery · doi:10.1016/s0003-4975(00)02570-4 · Cited by 582 · see citing works
Jadad, A. R., Cook, D. J., Jones, A., Klassen, T. P., Tugwell, P., Moher, M., & Moher, D. (1998) · JAMA · doi:10.1001/jama.280.3.278 · Cited by 534 · see citing works
Self-citationEnteral Nutritional Supplementation With Key Nutrients in Patients With Critical Illness and Cancer
Heys, S. D., Walker, L. G., Smith, I., & Eremin, O. (1999) · Annals of Surgery · doi:10.1097/00000658-199904000-00004 · Cited by 483 · see citing works
Balk, E. M. (2002) · JAMA · doi:10.1001/jama.287.22.2973 · Cited by 478 · see citing works
Assessing the Quality of Randomized Controlled Trials:<i>Current Issues and Future Directions</i>
Moher, D., Jadad, A. R., & Tugwell, P. (1996) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462300009570 · Cited by 436 · see citing works
Sewnath, M. E., Karsten, T. M., Prins, M. H., Rauws, E. A., Obertop, H., & Gouma, D. J. (2002) · Annals of Surgery · doi:10.1097/00000658-200207000-00005 · Cited by 417 · see citing works
Repair of Groin Hernia With Synthetic Mesh
The EU Hernia Trialists Collaboration (2002) · Annals of Surgery · doi:10.1097/00000658-200203000-00003 · Cited by 414 · see citing works
Sterne, J. A. C., Jüni, P., Schulz, K. F., Altman, D. G., Bartlett, C., & Egger, M. (2002) · Statistics in Medicine · doi:10.1002/sim.1184 · Cited by 382 · see citing works
Orr, R. K. (1999) · Annals of Surgical Oncology · doi:10.1007/s10434-999-0109-1 · Cited by 342 · see citing works
The Search for an Ideal Method of Abdominal Fascial Closure
Hodgson, N. C. F., Malthaner, R. A., & Østbye, T. (2000) · Annals of Surgery · doi:10.1097/00000658-200003000-00018 · Cited by 321 · see citing works
Agreement among reviewers of review articles
Oxman, A. D., Guyatt, G. H., Singer, J., Goldsmith, C. H., Hutchison, B. G., MILNER, R. A., & Streiner, D. L. (1991) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(91)90205-n · Cited by 283 · see citing works
The Efficacy of Thyroidectomy for Graves' Disease: A Meta-analysis
Palit, T. K., Miller, C. C., & Miltenburg, D. M. (2000) · Journal of Surgical Research · doi:10.1006/jsre.2000.5875 · Cited by 246 · see citing works
Issues in Comparisons Between Meta-analyses and Large Trials
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.14.1089 · Cited by 246 · see citing works
Colon and Rectal Anastomoses Do Not Require Routine Drainage
Urbach, D. R., Kennedy, E. D., & Cohen, M. M. (1999) · Annals of Surgery · doi:10.1097/00000658-199902000-00003 · Cited by 242 · see citing works
The art of quality assessment of RCTs included in systematic reviews
Verhagen, A. P., de Vet, H. C. W., de Bie, R. A., Boers, M., & van den Brandt, P. A. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00360-7 · Cited by 237 · see citing works
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (2000) · Oncology Research and Treatment · doi:10.1159/000055014 · Cited by 235 · see citing works
Self-citationStrengths and limitations of meta-analysis: Larger studies may be more reliable
Flather, M. D., Farkouh, M. E., Pogue, J. M., & Yusuf, S. (1997) · Controlled Clinical Trials · doi:10.1016/s0197-2456(97)00024-x · Cited by 233 · see citing works
Risks and Benefits of Preoperative High Dose Methylprednisolone in Surgical Patients
Sauerland, S., Nagelschmidt, M., Mallmann, P. K., & Neugebauer, E. A. M. (2000) · Drug Safety · doi:10.2165/00002018-200023050-00007 · Cited by 227 · see citing works
Minimizing the Three Stages of Publication Bias
Chalmers, T. C. (1990) · JAMA · doi:10.1001/jama.1990.03440100104016 · Cited by 226 · see citing works
Predictive ability of meta-analyses of randomised controlled trials
Villar, J., Carroli, G., & Belizán, J. M. (1995) · The Lancet · doi:10.1016/s0140-6736(95)90646-0 · Cited by 222 · see citing works
Handsewn vs. stapled anastomoses in colon and rectal surgery
MacRae, H., & McLeod, R. S. (1998) · Diseases of the Colon & Rectum · doi:10.1007/bf02238246 · Cited by 206 · see citing works
Meta-analysis of randomized controlled trials comparing laparoscopic and open appendectomy.
Garbutt, J. M., Soper, N. J., Shannon, W. D., Botero, A. C., & Littenberg, B. (1999) · PubMed · Cited by 198 · see citing works
Follow-up of colorectal cancer
Rosen, M. J., Chan, L. S., Beart, R. W., Vukasin, P., & Anthone, G. J. (1998) · Diseases of the Colon & Rectum · doi:10.1007/bf02239433 · Cited by 195 · see citing works
Lewis, R. T. (2002) · PubMed · Cited by 190 · see citing works
Laparoscopic-Assisted Resection of Colorectal Malignancies
Chapman, A. E., Levitt, M. D., Hewett, P. J., Woods, R. J., Sheiner, H. J., & Maddern, G. J. (2001) · Annals of Surgery · doi:10.1097/00000658-200111000-00003 · Cited by 162 · see citing works
Morris, A. D., Morris, R. D., Wilson, J. F., White, J., Steinberg, S., Okunieff, P. G., Arriagada, R., Lê, M. G., Blichert-Toft, M., & van Dongen, J. A. (1997) · PubMed · Cited by 160 · see citing works
Ludwig, K., Bernhardt, J., Steffen, H., & Lorenz, D. (2002) · Surgical Endoscopy · doi:10.1007/s00464-001-9183-6 · Cited by 157 · see citing works
Temple, L. K. F., Litwin, D., & McLeod, R. S. (1999) · PubMed · Cited by 154 · see citing works
What is the role of mechanical bowel preparation in patients undergoing colorectal surgery?
Platell, C., & Hall, J. C. (1998) · Diseases of the Colon & Rectum · doi:10.1007/bf02235369 · Cited by 153 · see citing works
Diagnostic accuracy of large-core needle biopsy for nonpalpable breast disease: a meta-analysis
Verkooijen, H. M., Peeters, P. H. M., Buskens, E., Koot, V. C. M., Rinkes, I. H. M. B., Mali, W. P. T. M., & van Vroonhoven, T. J. M. V. (2000) · British Journal of Cancer · doi:10.1054/bjoc.1999.1036 · Cited by 151 · see citing works
Koch, A., Bouges, S., Ziegler, S., Dinkel, H., Daurès, J., & Victor, N. (1997) · PubMed · doi:10.1046/j.1365-2168.1998.00844.x · Cited by 150 · see citing works
Bariatric Surgery for Morbid Obesity
Monteforte, M. J., & Turkelson, C. M. (2000) · Obesity Surgery · doi:10.1381/096089200321594246 · Cited by 145 · see citing works
Closure of the Abdominal Midline Fascia: Meta-Analysis Delineates the Optimal Technique
Rucinski, J. C., Margolis, M. A., Panagopoulos, G., & Wise, L. (2001) · The American Surgeon · doi:10.1177/000313480106700507 · Cited by 140 · see citing works
Strictureplasty for Crohn's disease
Tichansky, D. S., Cagir, B., Yoo, E. Y., Marcus, S. M., & Fry, R. D. (2000) · Diseases of the Colon & Rectum · doi:10.1007/bf02237350 · Cited by 139 · see citing works
Elevated serum levels of transforming growth factor-?1 in patients with colorectal carcinoma
Shim, K. S., Kim, K. H., Han, W. S., & Park, E. B. (1999) · Cancer · doi:10.1002/(sici)1097-0142(19990201)85:3 · Cited by 137 · see citing works
Chung, R. S. K., & Rowland, D. Y. (1999) · Surgical Endoscopy · doi:10.1007/s004649901074 · Cited by 137 · see citing works
McAlister, F. A., Clark, H. D., Wells, P. S., & Laupacis, A. (1998) · British journal of surgery · doi:10.1046/j.1365-2168.1998.00698.x · Cited by 131 · see citing works
Taylor, M. C., McLeod, R. S., & Langer, B. (2000) · Liver Transplantation · doi:10.1053/lv.2000.5196 · Cited by 131 · see citing works
Meta-analysis of operative techniques for fissure-in-ano
Nelson, R. L. (1999) · Diseases of the Colon & Rectum · doi:10.1007/bf02235041 · Cited by 120 · see citing works
Choosing the best abdominal closure by meta-analysis
Weiland, D. E., Bay, R. C., & Sordi, S. D. (1998) · The American Journal of Surgery · doi:10.1016/s0002-9610(98)00277-3 · Cited by 116 · see citing works
Vanek, V. W. (1998) · PubMed · Cited by 111 · see citing works
Urschel, J. D., Blewett, C. J., Bennett, W. F., Miller, J. D., & Young, J. E. M. (2001) · Diseases of the Esophagus · doi:10.1046/j.1442-2050.2001.00187.x · Cited by 109 · see citing works
Groin hernia surgery: a systematic review.
Cheek, C., Black, N., Devlin, H. B., Kingsnorth, A. N., Taylor, R. S., & Watkin, D. F. L. (1998) · PubMed · Cited by 102 · see citing works
Clarke, M. J. (2000) · The Lancet · doi:10.1016/s0140-6736(05)72172-3 · Cited by 100 · see citing works
Transjugular Intrahepatic Portosystemic Shunt
Burroughs, A. K., & Patch, D. (1999) · Seminars in Liver Disease · doi:10.1055/s-2007-1007132 · Cited by 100 · see citing works
Elective Lymph Node Dissection in Patients With Melanoma
Lens, M. B., Dawes, M. G., Goodacre, T., & Newton‐Bishop, J. (2002) · Archives of Surgery · doi:10.1001/archsurg.137.4.458 · Cited by 95 · see citing works
Koch, A., Bouges, S., Ziegler, S., Dinkel, H.-P., Daurès, J., & Victor, N. (1997) · British journal of surgery · doi:10.1002/bjs.1800840605 · Cited by 93 · see citing works
Urschel, J. D., Urschel, D. M., Miller, J. D., Bennett, W. F., & Young, J. E. M. (2001) · The American Journal of Surgery · doi:10.1016/s0002-9610(01)00763-2 · Cited by 91 · see citing works
Meta-analysis of randomized trials comparing laparoscopic versus open appendectomy
Garbutt, J. (1999) · Medical Entomology and Zoology · Cited by 89 · see citing works
QUALITY OF LIFE AFTER BREAST CONSERVATION OR MASTECTOMY: A SYSTEMATIC REVIEW
Irwig, L., & Bennetts, A. (1997) · Australian and New Zealand Journal of Surgery · doi:10.1111/j.1445-2197.1997.tb04573.x · Cited by 87 · see citing works
Carless, P., Anthony, D., & Henry, D. A. (2002) · British journal of surgery · doi:10.1046/j.1365-2168.2002.02098.x · Cited by 83 · see citing works
Voyles, C. R., Hamilton, B. J., Johnson, W. D., & Kano, N. (2002) · The American Journal of Surgery · doi:10.1016/s0002-9610(02)00878-4 · Cited by 81 · see citing works
Wound Recurrences Following Laparoscopic-Assisted Colectomy for Cancer
Stocchi, L. (2000) · Archives of Surgery · doi:10.1001/archsurg.135.8.948 · Cited by 81 · see citing works
Evaluating the quality of systematic reviews in the emergency medicine literature
Kelly, K. D., Travers, A. H., Dorgan, M., Slater, L., & Rowe, B. H. (2001) · Annals of Emergency Medicine · doi:10.1067/mem.2001.115881 · Cited by 79 · see citing works
Homeopathy for Postoperative Ileus?
Barnes, J., Resch, K., & Ernst, E. K. (1997) · Journal of Clinical Gastroenterology · doi:10.1097/00004836-199712000-00016 · Cited by 77 · see citing works
Examining the Evidence in Anesthesia Literature: A Critical Appraisal of Systematic Reviews
Choi, P. T.-L., Halpern, S. H., Malik, N., Jadad, A. R., Tramèr, M. R., & Walder, B. (2001) · Anesthesia & Analgesia · doi:10.1097/00000539-200103000-00029 · Cited by 75 · see citing works
Palmer, A. J., Schramm, W., Kirchhof, B., & Bergemann, R. (2009) · Haemostasis · doi:10.1159/000217436 · Cited by 60 · see citing works
Examining the Evidence in Anesthesia Literature: A Critical Appraisal of Systematic Reviews
Choi, P. T.-L., Halpern, S. H., Malik, N., Jadad, A. R., Tramèr, M. R., & Walder, B. (2001) · Anesthesia & Analgesia · doi:10.1213/00000539-200103000-00029 · Cited by 58 · see citing works
Rucinski, J. C., Fabian, T., Panagopoulos, G., Schein, M., & Wise, L. (2000) · Surgery · doi:10.1067/msy.2000.101151 · Cited by 56 · see citing works
Discrepancies among megatrials
Furukawa, T. A., Streiner, D. L., & Hori, S. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(00)00250-x · Cited by 49 · see citing works
A ten-year analysis of surgical education research
Derossis, A. M., DaRosa, D. A., Dutta, S., & Dunnington, G. L. (2000) · The American Journal of Surgery · doi:10.1016/s0002-9610(00)00420-7 · Cited by 47 · see citing works
Rosenberg, L., MacNeil, P., & Turcotte, L. (1999) · Journal of Gastrointestinal Surgery · doi:10.1016/s1091-255x(99)80064-x · Cited by 42 · see citing works
Surgical treatment for carcinoma of the oesophagus in Chinese language publications.
Li, H., & Yao, S. (1997) · PubMed · Cited by 22 · see citing works
Quality of reporting of meta-analyses: the QUOROM statement. Will it help?
Christensen, E. (2001) · Journal of Hepatology · doi:10.1016/s0168-8278(00)00002-7 · Cited by 20 · see citing works
Miltenburg, D. M., Prost, H. M., Graviss, E. A., & Arem, R. (2000) · Surgery · doi:10.1067/msy.2000.109962 · Cited by 17 · see citing works
Surgical treatment for carcinoma of the oesophagus in Chinese language publications
Li, H., & Yao, S. (1997) · British journal of surgery · doi:10.1002/bjs.1800840635 · Cited by 16 · see citing works
Colorectal cancer after gastric surgery: a meta-analysis.
Munnangi, S., & Sonnenberg, A. (1997) · PubMed · Cited by 6 · see citing works
Flagged first, then by citations
8 of the 89 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- [41]Boyages J, Delaney G, Taylor R. Predictors of local recurrence after treatment of ductal carcinoma in situ: a meta-analysis. Cancer. 1999;85:616–628. [PubMed] [Google Scholar]
- [51]Wiseman DM, Trout JR, Franklin RR, et al. Meta-analysis of the safety and efficacy of an adhesion barrier (Interceed TC7) in laparotomy. J Reprod Med. 1999;44:325–331. [PubMed] [Google Scholar]
Cited by
Sorted by citations
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000100 · Cited by 28,164 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · BMJ · doi:10.1136/bmj.b2700 · Cited by 17,648 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.006 · Cited by 10,578 · see citing works
Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P. A., Clarke, M., Devereaux, P. J., Kleijnen, J., & Moher, D. (2009) · Annals of Internal Medicine · doi:10.7326/0003-4819-151-4-200908180-00136 · Cited by 10,349 · see citing works
Systematic Review and Meta-analysis
Garg, A. X., Hackam, D. G., & Tonelli, M. A. (2008) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.01430307 · Cited by 2,252 · see citing works
The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483 · see citing works
Yan, T. D., Black, D. A., Sugarbaker, P. H., Zhu, J. C., Yonemura, Y., Petrou, G., & Morris, D. L. (2007) · Annals of Surgical Oncology · doi:10.1245/s10434-007-9487-4 · Cited by 341 · see citing works
Meta-Analysis: Audit and Feedback Features Impact Effectiveness on Care Quality
Hysong, S. J. (2009) · Medical Care · doi:10.1097/mlr.0b013e3181893f6b · Cited by 306 · see citing works
Seiler, C. M., Bruckner, T. M., Diener, M. K., Papyan, A., Golcher, H., Seidlmayer, C., Franck, A., Kieser, M., Büchler, M. W., & Knaebel, H. (2009) · Annals of Surgery · doi:10.1097/sla.0b013e31819ec6c8 · Cited by 243 · see citing works
The Physical Environment and Physical Activity
Gebel, K., Bauman, A. E., & Petticrew, M. P. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.020 · Cited by 193 · see citing works
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/35 · Cited by 186 · see citing works
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/819 · Cited by 168 · see citing works
Koesters, M., Becker, T., Kilian, R., Fegert, J., & Weinmann, S. (2009) · Journal of Psychopharmacology · doi:10.1177/0269881108092338 · Cited by 142 · see citing works
A systematic evaluation of the quality of meta-analyses in the critical care literature
Delaney, A. P., Bagshaw, S. M., Ferland, A., Manns, B., Laupland, K. B., & Doig, C. J. (2005) · Critical Care · doi:10.1186/cc3803 · Cited by 142 · see citing works
Self-citationMinimally Invasive Colorectal Resection Outcomes: Short-term Comparison with Open Procedures
Noel, K., Fahrbach, K. R., Estok, R. P., Cella, C., Frame, D., Linz, H., Cima, R. R., Dozois, E. J., & Senagore, A. J. (2006) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2006.10.002 · Cited by 124 · see citing works
Reporting and Methodological Quality of Systematic Reviews in the Orthopaedic Literature
Gagnier, J. J., & Kellam, P. J. (2013) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.l.00597 · Cited by 112 · see citing works
Pouch vs. No Pouch Following Total Gastrectomy: Meta-Analysis and Systematic Review
Gertler, R., Rosenberg, R., Feith, M., Schuster, T., & Frieß, H. (2009) · The American Journal of Gastroenterology · doi:10.1038/ajg.2009.456 · Cited by 111 · see citing works
Zhang, X., Tan, R., Lam, W. C., Yao, L., Wang, X., Cheng, C. W., Liu, F., Chan, J. C. P., Aixinjueluo, Q.-Y., Lau, C. T., et al. (2020) · The American Journal of Chinese Medicine · doi:10.1142/s0192415x20500639 · Cited by 112 · see citing works
Delaney, A., Bagshaw, S. M., Ferland, A., Laupland, K., Manns, B., & Doig, C. (2007) · Critical Care Medicine · doi:10.1097/01.ccm.0000253394.15628.fd · Cited by 112 · see citing works
Self-citationMechanick, J. I., Camacho, P. M., Cobin, R. H., Garber, A. J., Garber, J. R., Gharib, H., Petak, S. M., Rodbard, H. W., & Trence, D. (2010) · Endocrine Practice · doi:10.4158/ep.16.2.270 · Cited by 96 · see citing works
Current practice of abdominal wall closure in elective surgery – Is there any consensus?
Rahbari, N. N., Knebel, P., Diener, M. K., Seidlmayer, C., Ridwelski, K., Stöltzing, H., & Seiler, C. M. (2009) · BMC Surgery · doi:10.1186/1471-2482-9-8 · Cited by 85 · see citing works
Twenty Years of Meta-Analyses in Orthopaedic Surgery: Has Quality Kept Up with Quantity?
Dijkman, B. G., Abouali, J., Dr. Bauke Kooistra, O. S., Conter, H. J., Poolman, R. W., Kulkarni, A. V., Tornetta, P., & Bhandari, M. (2010) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.i.00251 · Cited by 82 · see citing works
Yang, S. H., Dou, K. F., Sharma, N., & Song, W. J. (2011) · World Journal of Surgery · doi:10.1007/s00268-011-1159-7 · Cited by 72 · see citing works
Smith, C. A., & Cochrane, S. (2009) · Birth · doi:10.1111/j.1523-536x.2009.00329.x · Cited by 64 · see citing works
Ng, T. T. (2006) · Archives of Surgery · doi:10.1001/archsurg.141.11.1125 · Cited by 63 · see citing works
Quality and transparency of overviews of systematic reviews
Li, L., Tian, J., Tian, H., Sun, R., Liu, Y., & Yang, K. (2012) · Journal of Evidence-Based Medicine · doi:10.1111/j.1756-5391.2012.01185.x · Cited by 60 · see citing works
Methodology and reporting of meta-analyses in the neurosurgical literature
Klimo, P., Thompson, C. J., Ragel, B. T., & Boop, F. A. (2014) · Journal of neurosurgery · doi:10.3171/2013.11.jns13195 · Cited by 60 · see citing works
Wu, X., Zhang, J., He, X., Wang, C., Lian, L., Liu, H., Wang, J., & Lan, P. (2011) · Journal of Gastrointestinal Surgery · doi:10.1007/s11605-011-1682-8 · Cited by 55 · see citing works
Comparison of search strategies in systematic reviews of adverse effects to other systematic reviews
Golder, S., Loke, Y. K., & Zorzela, L. (2014) · Health Information & Libraries Journal · doi:10.1111/hir.12041 · Cited by 57 · see citing works
Tam, W., Lo, K. K.-H., & Khalechelvam, P. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-013905 · Cited by 55 · see citing works
Lewin, S. A., Oxman, A. D., Lavis, J. N., & Fretheim, A. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-s1-s8 · Cited by 56 · see citing works
Effectiveness and safety of splenectomy for gastriccarcinoma: A meta-analysis
Yang, K., Chen, X., Hu, J., Zhang, B., Chen, Z., & Chen, J. (2009) · World Journal of Gastroenterology · doi:10.3748/wjg.15.5352 · Cited by 51 · see citing works
A Systematic Evaluation of the Quality of Meta-analyses in Endodontics
Suebnukarn, S., Ngamboonsirisingh, S., & Rattanabanlang, A. (2010) · Journal of Endodontics · doi:10.1016/j.joen.2009.12.019 · Cited by 50 · see citing works
Evidence-based medicine—from best research evidence to a better surgical practice and health care
Antes, G., Sauerland, S., & Seiler, C. M. (2005) · Langenbeck s Archives of Surgery · doi:10.1007/s00423-005-0006-4 · Cited by 48 · see citing works
Bhar, S., Thombs, B., Pignotti, M., Bassel, M., Jewett, L., Coyne, J., & Beck, A. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000313689 · Cited by 49 · see citing works
Faiman, I., Smith, S. D. W., Hodsoll, J. P., Young, A. H., & Shotbolt, P. (2021) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2021.108047 · Cited by 45 · see citing works
Reporting and methodologic quality of Cochrane Neonatal review group systematic reviews
Faleh, K. A., & Al-Omran, M. A. (2009) · BMC Pediatrics · doi:10.1186/1471-2431-9-38 · Cited by 46 · see citing works
Reporting and methodological qualities of published surgical meta-analyses
Zhang, H., Han, J. S., Zhu, Y., Lau, W. Y., Schwartz, M., Xie, G.-Q., Dai, S.-Y., Shen, Y., Wu, M., Shen, F., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.06.009 · Cited by 43 · see citing works
Synthesizing medical evidence: systematic reviews and metaanalyses
Barker, F. G., & Carter, B. S. (2005) · Neurosurgical FOCUS · doi:10.3171/foc.2005.19.4.6 · Cited by 41 · see citing works
The Quality of Meta-Analyses of Genetic Association Studies: A Review With Recommendations
Minelli, C., Thompson, J. R., Abrams, K. R., Thakkinstian, A., & Attia, J. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwp350 · Cited by 39 · see citing works
Samargandi, O. A., Hasan, H., & Thoma, A. (2015) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000001898 · Cited by 36 · see citing works
Golder, S., Loke, Y. K., & Zorzela, L. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.09.013 · Cited by 34 · see citing works
The use of acupuncture for managing gynaecologic conditions: An overview of systematic reviews
Kang, H.-S., Jeong, D., Kim, D., & Lee, M. S. (2011) · Maturitas · doi:10.1016/j.maturitas.2011.02.001 · Cited by 31 · see citing works
Chen, C.-C., Chen, Y., Liu, X., Wen, Y., Ma, D., Huang, Y., Pu, L., Diao, Y., & Yang, K. (2016) · PLoS ONE · doi:10.1371/journal.pone.0155890 · Cited by 30 · see citing works
Xu, C., Furuya‐Kanamori, L., Kwong, J. S. W., Li, S., Liu, Y., & Doi, S. A. R. (2021) · Sleep Medicine Reviews · doi:10.1016/j.smrv.2021.101434 · Cited by 30 · see citing works
Need for Quality Improvement in Renal Systematic Reviews
Mrkobrada, M., Thiessen‐Philbrook, H., Haynes, R. B., Iansavichus, A. V., Rehman, F., & Garg, A. X. (2008) · Clinical Journal of the American Society of Nephrology · doi:10.2215/cjn.04401007 · Cited by 30 · see citing works
Yalley, A. A., Jarašiūnaitė–Fedosejeva, G., Akik, B. K., & Abreu, L. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1388858 · Cited by 29 · see citing works
Gerber, S., Tallon, D., Trelle, S., Schneider, M., Jüni, P., & Egger, M. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.10.022 · Cited by 27 · see citing works
Kamarási, V., & Mogyorósy, G. (2015) · Orvosi Hetilap · doi:10.1556/650.2015.30255 · Cited by 34 · see citing works
Meta-Analyses in Joint Arthroplasty: A Review of Quantity, Quality, and Impact
Sharma, R., Vannabouathong, C., Bains, S., Marshall, A., MacDonald, S. J., Parvizi, J., & Bhandari, M. (2011) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.j.01289 · Cited by 28 · see citing works
Acupuncture to treat common reproductive health complaints: An overview of the evidence
Smith, C. A., & Carmady, B. (2010) · Autonomic Neuroscience · doi:10.1016/j.autneu.2010.03.013 · Cited by 27 · see citing works
Torp-Pedersen, C. T., Goette, A., Nielsen, P. B., Potpara, T., Fauchier, L., Camm, A. J., Arbelo, E., Boriani, G., Skjoeth, F., Rumsfeld, J. S., et al. (2019) · EP Europace · doi:10.1093/europace/euz210 · Cited by 27 · see citing works
Glasziou, P., Chalmers, I., Altman, D. G., Bastian, H., Boutron, I., Brice, A., Jamtvedt, G., Farmer, A. A., Ghersi, D., Groves, T., et al. (2010) · Cited by 26 · see citing works
Can decision making in general surgery be based on evidence? An empirical study of Cochrane Reviews
Diener, M. K., Wolff, R. F., von Elm, E. B., Rahbari, N. N., Mavergames, C., Knaebel, H., Seiler, C. M., & Antes, G. (2009) · Surgery · doi:10.1016/j.surg.2009.02.016 · Cited by 21 · see citing works
Meta-Analyses in Plastic Surgery: Can We Trust Their Results?
McGuire, C., Samargandi, O. A., Corkum, J. P., Retrouvey, H., & Bezuhly, M. (2019) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000005880 · Cited by 21 · see citing works
Kim, H.-R., Choi, C.-H., & Jo, E. (2020) · Healthcare · doi:10.3390/healthcare8040446 · Cited by 21 · see citing works
Liu, P., Qiu, Y., Qian, Y., Chen, X., Wang, Y., Cui, J., & Zhai, X. (2016) · Journal of Gastroenterology and Hepatology · doi:10.1111/jgh.13591 · Cited by 20 · see citing works
Abushouk, A. I., Yunusa, I. U., Elmehrath, A. O., Elmatboly, A. M., Fayek, S. H., Abdelfattah, O., Saad, A. M., Isogai, T., Shekhar, S., Kalra, A., et al. (2021) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2021.671569 · Cited by 20 · see citing works
Systematische Übersichtsarbeiten und Metaanalysen in der Chirurgie
Diener, M. K., Seiler, C. M., & Antes, G. (2007) · Der Chirurg · doi:10.1007/s00104-007-1404-7 · Cited by 20 · see citing works
Boluyt, N., van der Lee, J. H., Moyer, V. A., Brand, P. L. P., & Offringa, M. (2007) · PEDIATRICS · doi:10.1542/peds.2006-3381 · Cited by 20 · see citing works
Jin, Y., Ma, E., Gao, W., Wei, H., & Dou, H. (2013) · International Journal of Nursing Practice · doi:10.1111/ijn.12123 · Cited by 19 · see citing works
Provenance Data Management in Health Information Systems: A Systematic Literature Review
Sembay, M. J., de Macedo, D. D. J., Pioli, L., Braga, R. M. M., & Cabezuelo, A. S. (2023) · Journal of Personalized Medicine · doi:10.3390/jpm13060991 · Cited by 21 · see citing works
Lei, J., Gao, G., & Jiang, J. (2012) · Journal of Neurotrauma · doi:10.1089/neu.2012.2548 · Cited by 18 · see citing works
Hasan, H., Muhammed, T., Yu, J., Taguchi, K., Samargandi, O. A., Howard, A. F., Lo, A., Olson, R. A., & Goddard, K. (2017) · Cancer Epidemiology · doi:10.1016/j.canep.2017.08.013 · Cited by 18 · see citing works
Reporting quality of Cochrane systematic reviews with Chinese herbal medicines
Zhang, X., Aixinjueluo, Q.-Y., Li, S.-Y., Song, L.-L., Lau, C. T., Tan, R., & Bian, Z. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1218-y · Cited by 18 · see citing works
Yang, K., Chen, H., Chen, X., Lu, Q., Pan, L., Liu, J., Dai, B., Zhang, B., Chen, Z., Chen, J., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0037698 · Cited by 17 · see citing works
Lane, P. W., Higgins, J. P. T., Anagnostelis, B., Anzures‐Cabrera, J., Baker, N. F., Cappelleri, J. C., Haughie, S., Hollis, S., Lewis, S. C., Moneuse, P., et al. (2013) · Research Synthesis Methods · doi:10.1002/jrsm.1072 · Cited by 16 · see citing works
Evaluation of meta‐analyses in the otolaryngological literature
Rudmik, L. R., Walen, S. G., Dixon, E., & Dort, J. C. (2008) · Otolaryngology · doi:10.1016/j.otohns.2008.03.020 · Cited by 16 · see citing works
Self-citationRandomised prospective study of abdominal wall closure in patients with gynaecological cancer
Berretta, R., Rolla, M., Patrelli, T. S., Piantelli, G., Merisio, C., Melpignano, M., Nardelli, G. B., & Modena, A. B. (2010) · Australian and New Zealand Journal of Obstetrics and Gynaecology · doi:10.1111/j.1479-828x.2010.01194.x · Cited by 15 · see citing works
Likhvantsev, V. V., Yadgarov, M. Y., Piazza, M. D., & Kadantseva, K. (2021) · General Reanimatology · doi:10.15360/1813-9779-2020-6-91-104 · Cited by 13 · see citing works
Effect of methodological quality measures in spinal surgery research: a metaepidemiological study
Jacobs, W. C. H., Kruyt, M. C., Verbout, A. J., & Öner, F. C. (2012) · The Spine Journal · doi:10.1016/j.spinee.2012.01.015 · Cited by 13 · see citing works
Primer on Systematic Review and Meta-Analysis
Tonelli, M. A., Hackam, D. G., & Garg, A. X. (2008) · Methods in molecular biology · doi:10.1007/978-1-59745-385-1_13 · Cited by 12 · see citing works
Effect size benchmarks: Time for a causal renaissance
Amari, P. M., Banks, G. C., Bourque, L., Holladay-Sandidge, H. D., & O’Boyle, E. H. (2024) · The Leadership Quarterly · doi:10.1016/j.leaqua.2024.101855 · Cited by 12 · see citing works
Systematic Reviews: Questions, Methods and UsagePreprint
Hansen, H., & Trifković, N. (2013) · RePEc: Research Papers in Economics · Cited by 11 · see citing works
Jiang, Q., Liu, Q., Chen, F., Zeng, X., Song, F., Lu, Z., & Cao, S. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.07.008 · Cited by 11 · see citing works
The art of surgery in the 21st century: based on natural sciences and new ethical dimensions
Beger, H. G., & Arbogast, R. (2006) · Langenbeck s Archives of Surgery · doi:10.1007/s00423-006-0039-3 · Cited by 11 · see citing works
Operative Standardisierung bei randomisiert kontrollierten Studien in der Chirurgie
Knaebel, H., Kirschner, M. H., Reidel, M. A., Büchler, M. W., & Seiler, C. M. (2006) · Der Chirurg · doi:10.1007/s00104-005-1149-0 · Cited by 11 · see citing works
Randomisierte kontrollierte und kontrollierte klinische Studien in der Zeitschrift „Der Chirurg“
Diener, M. K., Blümle, A., Szakallas, V., Antes, G., & Seiler, C. M. (2006) · Der Chirurg · doi:10.1007/s00104-006-1211-6 · Cited by 11 · see citing works
Zambon, M., Biondi‐Zoccai, G., Elena, B., Ruggeri, L., Zangrillo, A., & Landoni, G. (2012) · Journal of Anesthesia · doi:10.1007/s00540-012-1372-z · Cited by 10 · see citing works
Fischer, L., Bruckner, T., Diener, M. K., Kadmon, M., Wente, M. N., Sauerland, S., & Seiler, C. M. (2009) · Journal of surgical education · doi:10.1016/j.jsurg.2008.08.003 · Cited by 10 · see citing works
Bauer, H. (2005) · Der Chirurg · doi:10.1007/s00104-005-1064-4 · Cited by 10 · see citing works
Review of Meta-analysis Research on Exercise in South Korea
Song, Y., Gang, M., Kim, S.-A., & Shin, I. (2014) · Journal of Korean Academy of Nursing · doi:10.4040/jkan.2014.44.5.459 · Cited by 9 · see citing works
Metaanálisis: una forma básica de entender e interpretar su evidencia
Sos, V. J. E., Llueca, A., Villach, L. G., & Oliver, M. B. (2020) · Revista de Senología y Patología Mamaria · doi:10.1016/j.senol.2020.05.007 · Cited by 9 · see citing works
Limited evidence for effects of diet for type 2 diabetes from systematic reviews
de Laar, F. A. V., Akkermans, R., & van Binsbergen, J. J. (2007) · European Journal of Clinical Nutrition · doi:10.1038/sj.ejcn.1602611 · Cited by 9 · see citing works
Quality of reporting of systematic reviews and meta-analyses of surgical randomized clinical trials
Yu, J., Chen, W.-S., Wu, P., & Li, Y. (2020) · BJS Open · doi:10.1002/bjs5.50266 · Cited by 8 · see citing works
Song, Y., Oh, M., Park, S., Park, M., Kim, K., Lee, U., & Park, M. (2015) · Pain Management Nursing · doi:10.1016/j.pmn.2015.06.004 · Cited by 7 · see citing works
Pagkalidou, E., Doundoulakis, I., Apostolidou‐Kiouti, F., Bougioukas, K. I., Papadopoulos, K., Τσάπας, Α., Farmakis, I. T., Antonopoulos, A. S., Giannakoulas, G. A., & Haidich, A. (2023) · Hellenic Journal of Cardiology · doi:10.1016/j.hjc.2023.05.006 · Cited by 7 · see citing works
Audit and Feedback Features Impact Effectiveness on Care Quality
Hysong, S. J. (2009) · Cited by 7 · see citing works
Pouch vs. No Pouch Following Total Gastrectomy: Meta-Analysis and Systematic Review
Yang, K., Chen, X., & Hu, J. (2010) · The American Journal of Gastroenterology · doi:10.1038/ajg.2010.42 · Cited by 7 · see citing works
Delaney, J., Laws, P., Wille‐Jørgensen, P., & Engel, A. F. (2014) · Colorectal Disease · doi:10.1111/codi.12882 · Cited by 6 · see citing works
Methodological Quality of Meta-Analyses on the Elderly in Korea
송영신, 김선애, & 강문희 (2014) · 한국자치행정학보 · doi:10.18398/kjlgas.2014.28.4.349 · Cited by 5 · see citing works
Intelligence Assessment Instruments in Adult Prison Populations: A Systematic Review
van Esch, A. Y. M., Denzel, A. D., Scherder, E., & Masthoff, E. (2017) · International Journal of Offender Therapy and Comparative Criminology · doi:10.1177/0306624x17739186 · Cited by 5 · see citing works
Yang, K., Zang, Z., Niu, K., Sun, L., Zhang, W., Zhang, Y., Chen, X., Zhou, Z., & Hu, J.-K. (2021) · Frontiers in Oncology · doi:10.3389/fonc.2020.568872 · Cited by 5 · see citing works
Critical Analysis of Clinical Research Articles: A Guide for Evaluation
Roever, L., Resende, E. S., & Diniz, A. L. D. (2016) · Evidence based Medicine and Practice · doi:10.4172/2471-9919.1000e116 · Cited by 5 · see citing works
Passon, A. M., Drabik, A., & Sawicki, P. T. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.06.006 · Cited by 4 · see citing works
Salehi‐Pourmehr, H., Naseri, A., Mostafaei, A., Vahedi, L., Sajjadi, S., Tayebi, S., Mostafaei, H., & Hajebrahimi, S. (2021) · Urology Research and Practice · doi:10.5152/tud.2021.21038 · Cited by 4 · see citing works
Google Scholar as a Sole Literature Source for Meta-analyses in Otolaryngology Head and Neck Surgery
Ungar, O. J., Muhanna, N., & Chaushu, H. (2023) · Indian Journal of Otolaryngology and Head & Neck Surgery · doi:10.1007/s12070-023-03532-8 · Cited by 4 · see citing works
Schmucker, C. M., Blümle, A., Antes, G., & Lagrèze, W. A. (2007) · Der Ophthalmologe · doi:10.1007/s00347-007-1618-6 · Cited by 4 · see citing works
How Useful Are Meta-Analyses in Orthopedic Trauma?
Court-Brown, C. M., & McQueen, M. M. (2011) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0b013e318208f983 · Cited by 4 · see citing works
Squitieri, L. S., & Chung, K. C. (2013) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0b013e3182827b20 · Cited by 4 · see citing works
- Authors
- Dixon, E., Hameed, M., Sutherland, F., Cook, D. J., & Doig, C.
- Affiliations
- University of Calgary (CA)
- McMaster University (CA)
- Corresponding author
- Dixon, Elijah
- Hameed, Morad
- Sutherland, Francis
- Venue
- Annals of Surgery
- Published
- 2005-03
- Volume
- 241
- Issue
- 3
- Pages
- 450-459
- ISSN
- 0003-4932 (ISSN-L)
- PMC
- PMC1356983
- OpenAlex
- W2081069584
- Cited by
- 129
- References
- 89
- Citations by year
- 2024: 6 · 2023: 4 · 2022: 1 · 2021: 7 · 2020: 5 · 2019: 5 · 2017: 4 · 2016: 4 · 2015: 4 · 2014: 8 · 2013: 11 · 2012: 5
- FWCI
- 10.78
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Annals of Surgery (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- meta-analysis, methodological quality, general surgery, critical appraisal, reporting guidelines, surgical journals, interobserver agreement
- MeSH terms
- Publishing, Review Literature as Topic, General Surgery, Meta-Analysis as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
