Cited by 1,861Meta-analysis and systematic reviewsStatistical Methods in EpidemiologyClinical Reasoning and Diagnostic Skills

The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.

Empirical evidence of design-related bias in studies of diagnostic tests.

Lijmer, Jeroen G.·1999·JAMA

DOI 10.1001/jama.282.11.1061

Open this paper in CoChat — free account

Abstract

CONTEXT: The literature contains a large number of potential biases in the evaluation of diagnostic tests. Strict application of appropriate methodological criteria would invalidate the clinical application of most study results. OBJECTIVE: To empirically determine the quantitative effect of study design shortcomings on estimates of diagnostic accuracy. DESIGN AND SETTING: Observational study of the methodological features of 184 original studies evaluating 218 diagnostic tests. Meta-analyses on diagnostic tests were identified through a systematic search of the literature using MEDLINE, EMBASE, and DARE databases and the Cochrane Library (1996-1997). Associations between study characteristics and estimates of diagnostic accuracy were evaluated with a regression model. MAIN OUTCOME MEASURES: Relative diagnostic odds ratio (RDOR), which compared the diagnostic odds ratios of studies of a given test that lacked a particular methodological feature with those without the corresponding shortcomings in design. RESULTS: Fifteen (6.8%) of 218 evaluations met all 8 criteria; 64 (30%) met 6 or more. Studies evaluating tests in a diseased population and a separate control group overestimated the diagnostic performance compared with studies that used a clinical population (RDOR, 3.0; 95% confidence interval [CI], 2.0-4.5). Studies in which different reference tests were used for positive and negative results of the test under study overestimated the diagnostic performance compared with studies using a single reference test for all patients (RDOR, 2.2; 95% CI, 1.5-3.3). Diagnostic performance was also overestimated when the reference test was interpreted with knowledge of the test result (RDOR, 1.3; 95% CI, 1.0-1.9), when no criteria for the test were described (RDOR, 1.7; 95% CI, 1.1-2.5), and when no description of the population under study was provided (RDOR, 1.4; 95% CI, 1.1-1.7). CONCLUSION: These data provide empirical evidence that diagnostic studies with methodological shortcomings may overestimate the accuracy of a diagnostic test, particularly those including nonrepresentative patients or applying different reference standards.

Integrity signals

Registry

Crossref · 10.1001/jama.282.11.1061

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Untitled work
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Users' Guides to the Medical Literature
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.271.9.703 · Cited by 2,688
Problems of Spectrum and Bias in Evaluating the Efficacy of Diagnostic Tests
Ransohoff, D. F., & Feinstein, A. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197810262991705 · Cited by 1,739
Combining independent studies of a diagnostic test into a summary roc curve: Data‐analytic approaches and some additional considerations
Moses, L. E., Shapiro, D. E., & Littenberg, B. (1993) · Statistics in Medicine · doi:10.1002/sim.4780121403 · Cited by 1,405
Users' Guides to the Medical Literature
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.271.5.389 · Cited by 1,174
THE ESTIMATION AND SIGNIFICANCE OF THE LOGARITHM OF A RATIO OF FREQUENCIES
HALDANE, B. J. B. S. (1956) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1955.tb01285.x · Cited by 1,083
Selection and interpretation of diagnostic tests and procedures. Principles and applications.
Griner, P. F., Mayewski, R. J., Mushlin, A. I., & Greenland, P. (1981) · PubMed · Cited by 765
Use of Methodological Standards in Diagnostic Test Research
Reid, M. C. (1995) · JAMA · doi:10.1001/jama.274.8.645 · Cited by 710
Assessment of diagnostic tests when disease verification is subject to selection bias
Begg, C. B., & Greenes, R. A. (1983) · Biometrics · doi:10.2307/2530820 · Cited by 708
Meta-analysis of Pap Test Accuracy
Fahey, M. T., Irwig, L., & Macaskill, P. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117485 · Cited by 690

Show all 38 references

Sorted by citations

Items 601–700 of 1,002

Sensitivity and specificity of fluorescence microscopy for diagnosing pulmonary tuberculosis in a high HIV prevalence setting.
Cattamanchi, A., Davis, J. L., Worodria, W. O., den Boon, S., Yoo, S., Matovu, J., Kiidha, J., Nankya, F., Kyeyune, R. B., Byanyima, P., et al. (2009) · PubMed · Cited by 62
The blind leading the blind: Use and misuse of blinding in randomized controlled trials
Miller, L. E., & Stewart, M. E. (2010) · Contemporary Clinical Trials · doi:10.1016/j.cct.2010.11.004 · Cited by 66
The Effect of Study Design Biases on the Diagnostic Accuracy of Magnetic Resonance Imaging for Detecting Silicone Breast Implant Ruptures: A Meta-Analysis
Song, J. W., Kim, H. M., Bellfi, L. T., & Chung, K. C. (2011) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0b013e3182043630 · Cited by 62
Visual evoked potentials in migraine: Is the “neurophysiological hallmark” concept still valid?
Omland, P. M., Uglem, M., Hagen, K., Linde, M., Tronvik, E., & Sand, T. (2015) · Clinical Neurophysiology · doi:10.1016/j.clinph.2014.12.035 · Cited by 62
Accuracy of magnetic resonance imaging in ovarian tumor: a systematic quantitative review
Medeiros, L. R., Freitas, L. B., Rosa, D. D., Silva, F. R., Silva, L. S., Birtencourt, L. T., Edelweiss, M. I. A., & da Rosa, M. I. (2010) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2010.08.031 · Cited by 61
Diagnostic accuracy of cytokeratin-19 fragment (CYFRA 21–1) for bladder cancer: a systematic review and meta-analysis
Huang, Y., Chen, J., Yan, W., Zang, D., Qin, Q., & Deng, A. (2015) · Tumor Biology · doi:10.1007/s13277-015-3352-z · Cited by 61
A Meta‐Analysis of Prognostic Indicators to Predict Seizures, Arrhythmias or Death After Tricyclic Antidepressant Overdose
Bailey, B., Buckley, N. A., & Amre, D. K. (2004) · Journal of Toxicology Clinical Toxicology · doi:10.1081/clt-200035286 · Cited by 60
How to Perform a Systematic Review and Meta-analysis of Diagnostic Imaging Studies
Cronin, P., Kelly, A. M., Altaee, D. K., Foerster, B. R., Petrou, M., & Dwamena, B. A. (2018) · Academic Radiology · doi:10.1016/j.acra.2017.12.007 · Cited by 62
Validation of IMPROD biparametric MRI in men with clinically suspected prostate cancer: A prospective multi-institutional trial
Jambor, I., Verho, J., Ettala, O. O., Knaapila, J., Taimen, P., Syvänen, K. T., Kiviniemi, A., Kähkönen, E., Perez, I. M., Seppänen, M., et al. (2019) · PLoS Medicine · doi:10.1371/journal.pmed.1002813 · Cited by 61
Interdisciplinary Consensus on Diagnosis and Treatment of Testicular Germ Cell Tumors: Result of an Update Conference on Evidence–Based Medicine (EBM)
Krege, S., Souchon, R., & Schmoll, H. (2001) · European Urology · doi:10.1159/000049804 · Cited by 61
Clinimetrics corner: the many faces of selection bias
Hegedus, E. J., & Moody, J. P. (2010) · Journal of Manual & Manipulative Therapy · doi:10.1179/106698110x12640740712699 · Cited by 69
Observer variation in chest radiography of acute lower respiratory infections in children: a systematic review
Swingler, G. H. (2001) · BMC Medical Imaging · doi:10.1186/1471-2342-1-1 · Cited by 60
Evidence-Based Medicine, Systematic Reviews, and Guidelines in Interventional Pain Management: Part 5. Diagnostic Accuracy Studies
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/517 · Cited by 65
Towards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD Initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C., Glasziou, P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · American Journal of Roentgenology · doi:10.2214/ajr.181.1.1810051 · Cited by 60
Self-citation
Diagnostic and Prognostic Value of Stress Cardiovascular Magnetic Resonance Imaging in Patients With Known or Suspected Coronary Artery Disease
Ricci, F., Khanji, M. Y., Bisaccia, G., Cipriani, A., Cesare, A. D., Ceriello, L., Mantini, C., Zimarino, M., Fedorowski, A., Gallina, S., et al. (2023) · JAMA Cardiology · doi:10.1001/jamacardio.2023.1290 · Cited by 63
Meta‐analysis: yield of diagnostic tests for coeliac disease in dyspepsia
Ford, A. C., Ching, E. K., & Moayyedi, P. (2009) · Alimentary Pharmacology & Therapeutics · doi:10.1111/j.1365-2036.2009.04008.x · Cited by 59
Diagnostic performance of the platelet function analyzer (PFA-100®) for the detection of disorders of primary haemostasis in patients with a bleeding history–a systematic review and meta-analysis
Karger, R., Donner-Banzhoff, N., Müller, H., Kretschmer, V., & Hunink, M. G. M. (2007) · Platelets · doi:10.1080/09537100601100366 · Cited by 60
Utility of chromogranin A, pancreatic polypeptide, glucagon and gastrin in the diagnosis and follow‐up of pancreatic neuroendocrine tumours in multiple endocrine neoplasia type 1 patients
Qiu, W., Christakis, I. A., Silva, A. M., Bassett, R. L., Cao, L., Meng, Q. H., Grubbs, E. G., Zhao, H., Yao, J. C., Lee, J. E., et al. (2016) · Clinical Endocrinology · doi:10.1111/cen.13119 · Cited by 59
Updated systematic review and meta‐analysis of the predictive value of serum biomarkers in the assessment and management of fever during neutropenia in children with cancer
Arif, T., & Phillips, R. S. (2019) · Pediatric Blood & Cancer · doi:10.1002/pbc.27887 · Cited by 59
Diagnostic research on routine care data
Oostenbrink, R., Moons, K. G. M., Bleeker, S. E., Moll, H. A., & Grobbee, D. E. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00080-5 · Cited by 59
Comparative Assessment and External Validation of Hepatic Steatosis Formulae in a Community-Based Setting
Jung, T. Y., Kim, M. S., Hong, H. P., Kang, K. A., & Jun, D. W. (2020) · Journal of Clinical Medicine · doi:10.3390/jcm9092851 · Cited by 58
Transcriptomic signatures for diagnosing tuberculosis in clinical practice: a prospective, multicentre cohort study
Hoang, L. T., Jain, P., Pillay, T. D., Tolosa-Wright, M., Niazi, U. H. K., Takwoingi, Y., Halliday, A., Berrocal-Almanza, L. C., Deeks, J. J., Beverley, P. C. L., et al. (2021) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(20)30928-2 · Cited by 57
A comparison between an ultrasound based prediction model (LR2) and the Risk of Ovarian Malignancy Algorithm (ROMA) to assess the risk of malignancy in women with an adnexal mass
Kaijser, J., Gorp, T. V., Hoorde, K. V., Holsbeke, C. V., Sayasneh, A., Vergote, I. B., Bourne, T., Timmerman, D., & CALSTER, B. V. (2013) · Gynecologic Oncology · doi:10.1016/j.ygyno.2013.01.018 · Cited by 58
Accuracy of imaging parameters in the prediction of lethal pulmonary hypoplasia secondary to mid‐trimester prelabor rupture of fetal membranes: a systematic review and meta‐analysis
van Teeffelen, A. S. P., Hooft, J. V. ’., Oei, S. G., PORATH, M. M., Willekes, C., Opmeer, B. C., & Mol, B. W. (2011) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.10047 · Cited by 58
Systematic review and meta-analysis of the discriminatory performance of risk prediction rules in febrile neutropaenic episodes in children and young people
Phillips, B., Wade, R., Stewart, L. A., & Sutton, A. J. (2010) · European Journal of Cancer · doi:10.1016/j.ejca.2010.05.024 · Cited by 58
Imaging modalities in the diagnosis and monitoring of Achilles tendon ruptures: A systematic review
Dams, O. C., Reininga, I. H. F., Gielen, J., van den Akker‐Scheek, I., & Zwerver, J. (2017) · Injury · doi:10.1016/j.injury.2017.09.013 · Cited by 58
MDCT in Emergency Radiology:Is a Standardized Chest or Abdominal Protocol Sufficient for Evaluation of Thoracic and Lumbar Spine Trauma?
Roos, J. E., Hilfiker, P. R., Platz, A., Desbiolles, L. M., Boehm, T., Marinček, B., & Weishaupt, D. (2004) · American Journal of Roentgenology · doi:10.2214/ajr.183.4.1830959 · Cited by 58
Overview of Evidence-based Medicine: Challenges for Evidence-based Laboratory Medicine
McQueen, M. (2001) · Clinical Chemistry · doi:10.1093/clinchem/47.8.1536 · Cited by 58
Management of allergic and nonallergic rhinitis.
Long, A., McFadden, C., Devine, D. V., Chew, P. W., Kupelnick, B., & Lau, J. (2002) · PubMed Central · Cited by 58
Pros and cons of screening for occult Cushing syndrome
Tabarin, A., & Perez, P. (2011) · Nature Reviews Endocrinology · doi:10.1038/nrendo.2011.51 · Cited by 57
Accuracy of Pupil Assessment for the Detection of Glaucoma
Chang, D. S.-T., Xu, L., Boland, M. V., & Friedman, D. S. (2013) · Ophthalmology · doi:10.1016/j.ophtha.2013.04.012 · Cited by 57
Helical CT-enteroclysis in the detection of small-bowel tumours: a meta-analysis
Soyer, P. A., Aout, M., Hoeffel, C. C., Vicaut, É., Placé, V., & Boudiaf, M. (2012) · European Radiology · doi:10.1007/s00330-012-2595-y · Cited by 57
Cholecystectomy for Biliary Dyskinesia: How Did We Get There?
Bielefeldt, K., Saligram, S., Zickmund, S. L., Dudekula, A. B., Olyaee, M. S., & Yadav, D. K. (2014) · Digestive Diseases and Sciences · doi:10.1007/s10620-014-3342-9 · Cited by 57
USERʼS GUIDE TO THE SURGICAL LITERATURE
Bhandari, M., Montori, V. M., Swiontkowski, M. F., & Guyatt, G. H. (2003) · Journal of Bone and Joint Surgery · doi:10.2106/00004623-200306000-00027 · Cited by 57
ACCURACY OF CARBOHYDRATE-DEFICIENT TRANSFERRIN IN THE DETECTION OF EXCESSIVE ALCOHOL CONSUMPTION: A SYSTEMATIC REVIEW
Koch, H. (2004) · Alcohol and Alcoholism · doi:10.1093/alcalc/agh031 · Cited by 57
Ensuring continued progress in biomarkers for amyotrophic lateral sclerosis
Turner, M. R., & Benatar, M. G. (2014) · Muscle & Nerve · doi:10.1002/mus.24470 · Cited by 58
Cuff‐leak test for predicting postextubation airway complications: a systematic review
Zhou, T., Zhang, H., Chen, W., Xiong, Z., Fan, T., Fu, J., Wang, L., & Wang, G. (2011) · Journal of Evidence-Based Medicine · doi:10.1111/j.1756-5391.2011.01160.x · Cited by 56
Fall risk factors in community-dwelling elderly people
Bergland, A. (2012) · Norsk Epidemiologi · doi:10.5324/nje.v22i2.1561 · Cited by 56
Fluorine-18 deoxyglucose Positron Emission Tomography, Magnetic Resonance Imaging and Bone Scintigraphy for the Diagnosis of Bone Metastases in Patients with Lung Cancer: Which One is the Best? – a Meta-analysis
Liu, T., Xu, J., Xu, W., Bai, Y., Yan, W., & Yang, H. (2010) · Clinical Oncology · doi:10.1016/j.clon.2010.10.002 · Cited by 57
Methods of Prospective Investigation of Pulmonary Embolism Diagnosis III (PIOPED III)
Stein, P. D., GOTTSCHALK, A. R., Sostman, H. D., Chenevert, T. L., Fowler, S. E., Goodman, L. R., Hales, C. A., Hull, R. D., Kanal, E., Leeper, K. V., et al. (2008) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2008.06.003 · Cited by 56
Faecal dimeric M2 pyruvate kinase in colorectal cancer and polyps correlates with tumour staging and surgical intervention
Koss, K., Maxton, D. G., & Jankowski, J. A. (2007) · Colorectal Disease · doi:10.1111/j.1463-1318.2007.01334.x · Cited by 56
The accuracy of clinical parameters in the prediction of perinatal pulmonary hypoplasia secondary to midtrimester prelabour rupture of fetal membranes: A meta-analysis
van Teeffelen, A. S. P., van der Ham, D. P., Oei, S. G., PORATH, M. M., Willekes, C., & Mol, B. W. (2009) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2009.10.001 · Cited by 56
Accuracy of Positron Emission Tomography/Computed Tomography in the Diagnosis and Restaging for Recurrent Ovarian Cancer
Limei, Z., Yong, C., Yan, X., Tang, S., Xie, J., & Zhi-qing, L. (2013) · International Journal of Gynecological Cancer · doi:10.1097/igc.0b013e31828a183c · Cited by 56
Chromogranin A in the Follow-up of Gastroenteropancreatic Neuroendocrine Neoplasms
Rossi, R. E., Ciafardini, C., Sciola, V., Conte, D., & Massironi, S. (2018) · Pancreas · doi:10.1097/mpa.0000000000001184 · Cited by 57
Balance Impairment Not Predictive of Falls in Geriatric Rehabilitation Wards
Haines, T. P., Kuys, S. S., Morrison, G., Clarke, J., & Bew, P. G. (2008) · The Journals of Gerontology Series A · doi:10.1093/gerona/63.5.523 · Cited by 56
Computed tomography for the diagnosis of lumbar spinal pathology in adult patients with low back pain or sciatica: a diagnostic systematic review
van Rijn, R. M., Wassenaar, M., Verhagen, A. P., Ostelo, R., Ginai, A. Z., de Boer, M. R., van Tulder, M. W., & Koes, B. W. (2011) · European Spine Journal · doi:10.1007/s00586-011-2012-2 · Cited by 55
Decision analysis to complete diagnostic research by closing the gap between test characteristics and cost-effectiveness
Schaafsma, J. D., van der Graaf, Y., Rinkel, G. J. E., & Buskens, E. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.008 · Cited by 55
Diagnostic Accuracy of the Modified Evan’s Blue Dye Test in Detecting Aspiration in Patients with Tracheostomy: A Systematic Review of the Evidence
Béchet, S., Hill, F., Gilheaney, Ó., & Walshe, M. (2016) · Dysphagia · doi:10.1007/s00455-016-9737-3 · Cited by 59
Diagnostic Performance of Radiolabeled Prostate-Specific Membrane Antigen Positron Emission Tomography/Computed Tomography for Primary Lymph Node Staging in Newly Diagnosed Intermediate to High-Risk Prostate Cancer Patients: A Systematic Review and Meta-Analysis
Kim, S., Lee, S., & Ha, H. K. (2018) · Urologia Internationalis · doi:10.1159/000493169 · Cited by 55
Systematic review and meta-analysis of the test accuracy of ductus venosus Doppler to predict compromise of fetal/neonatal wellbeing in high risk pregnancies with placental insufficiency
Morris, R. K., Selman, T. J., Verma, M., Robson, S. C., Kleijnen, J., & Khan, K. S. (2010) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2010.04.017 · Cited by 55
From evidence to best practice in laboratory medicine.
Horvath, A. R. (2013) · Europe PMC (PubMed Central) · Cited by 54
Hydrosonography of the Gastrointestinal Tract
Maconi, G., Radice, E., Bareggi, E., & Porro, G. B. (2009) · American Journal of Roentgenology · doi:10.2214/ajr.08.1979 · Cited by 54
Evidence-Based Radiology and the ACR Appropriateness Criteria®
Blackmore, C. C., & Medina, L. S. (2006) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2006.03.003 · Cited by 54
Diagnostic accuracy of premanipulative vertebrobasilar insufficiency tests: A systematic review
Hutting, N., Verhagen, A. P., Vijverman, V., Keesenberg, M. D. M., Dixon, G., & Scholten-Peeters, G. G. M. (2012) · Manual Therapy · doi:10.1016/j.math.2012.09.009 · Cited by 54
Accuracy of B-Type Natriuretic Peptide Levels in the Diagnosis of Left Ventricular Dysfunction and Heart Failure: A Systematic Review
Latour-Pérez, J., Coves-Orts, F. J., Abad‐Terrado, C., Abraira, V., & Zamora, J. (2005) · European Journal of Heart Failure · doi:10.1016/j.ejheart.2005.10.004 · Cited by 54
Evidence-based laboratory medicine - a guide for critical evaluation of in vitro laboratory testing
Christenson, R. H. (2007) · Annals of Clinical Biochemistry International Journal of Laboratory Medicine · doi:10.1258/000456307780118127 · Cited by 54
Foundations for evidence-based intraoperative neurophysiological monitoring
Howick, J., COHEN, B. A., McCulloch, P. G., Thompson, M., & Skinner, S. A. (2015) · Clinical Neurophysiology · doi:10.1016/j.clinph.2015.05.033 · Cited by 53
Infrared Thermal Imaging in the Diagnosis of Musculoskeletal Injuries: A Systematic Review and Meta-Analysis
Sanchís‐Sánchez, E., Vergara-Hernández, C., de Anda, R. M. C. O., Palmer, R. S., Sanchís, E., & Codoñer‐Franch, P. (2014) · American Journal of Roentgenology · doi:10.2214/ajr.13.11716 · Cited by 55
RETINA MEASUREMENTS FOR DIAGNOSIS OF PARKINSON DISEASE
García‐Martín, E., Satué, M., Otín, S., Fuertes, I., Alarcia, R., Larrosa, J. M., Polo, V., & Pablo, L. E. (2013) · Retina · doi:10.1097/iae.0000000000000028 · Cited by 55
Prediction of Driving Capacity After Traumatic Brain Injury
Bucher, C. O., Brugger, C., der Linden, M. V., & Walder, B. (2011) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0b013e3182236299 · Cited by 54
Accuracy of radiographers red dot or triage of accident and emergency radiographs in clinical practice: a systematic review
Brealey, S., Scally, A., Hahn, S., Thomas, N., Godfrey, C., & Crane, S. (2006) · Clinical Radiology · doi:10.1016/j.crad.2006.01.015 · Cited by 53
Developmental Dysplasia of the Hip: Quality of Reporting of Diagnostic Accuracy for US
Roposch, A., Moreau, N. M., Uleryk, E. M., & Doria, A. S. (2006) · Radiology · doi:10.1148/radiol.2413051358 · Cited by 53
Diagnostic value of near‐infrared or fluorescent indocyanine green guided sentinel lymph node mapping in gastric cancer: A systematic review and meta‐analysis
He, M., Jiang, Z., Wang, C., Hao, Z., An, J., & Shen, J. (2018) · Journal of Surgical Oncology · doi:10.1002/jso.25285 · Cited by 55
STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration
Cohen, J. F., Korevaar, D. A., Altman, D. G., Bruns, D. E., Gatsonis, C., Hooft, L., Irwig, L., Levine, D., Reitsma, J. B., de Vet, H. C. W., et al. (2022) · Вопросы современной педиатрии · doi:10.15690/vsp.v21i3.2427 · Cited by 52
Tips for learners of evidence-based medicine: 5. The effect of spectrum of disease on the performance of diagnostic tests
Montori, V. M. (2005) · Canadian Medical Association Journal · doi:10.1503/cmaj.1031666 · Cited by 53
Technology Assessment in Radiology: Putting the Evidence in Evidence-based Radiology
Hollingworth, W., & Jarvik, J. G. (2007) · Radiology · doi:10.1148/radiol.2441051790 · Cited by 53
Guidelines for Reporting Information in Studies of Diagnostic Test Accuracy: The STARD Initiative
Meyer, G. J. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8103_01 · Cited by 52
VEGF and prostatic cancer: a systematic review
Botelho, F. B., Pina, F., & Lunet, N. (2010) · European Journal of Cancer Prevention · doi:10.1097/cej.0b013e32833b48e1 · Cited by 52
Diagnostic value of soluble CD163 serum levels in patients suspected of meningitis: Comparison with CRP and procalcitonin
Knudsen, T. B., Larsen, K. R., Kristiansen, T. B., Møller, H. J., Tvede, M., Eugen‐Olsen, J., & Kronborg, G. (2007) · Scandinavian Journal of Infectious Diseases · doi:10.1080/00365540601113685 · Cited by 52
Accuracy of Ultrasonography With Color Doppler in Ovarian Tumor
Medeiros, L. R., Rosa, D. D., da Rosa, M. I., & Bozzetti, M. C. (2009) · International Journal of Gynecological Cancer · doi:10.1111/igc.0b013e31819c1369 · Cited by 52
Performance of Emergency Department Screening Criteria for an Early ECG to Identify ST‐Segment Elevation Myocardial Infarction
Yiadom, M. Y. A. B., Baugh, C. W., McWade, C. M., Liu, X., Song, K. J., Patterson, B. W., Jenkins, C. A., Tanski, M., Mills, A. M., Salazar, G., et al. (2017) · Journal of the American Heart Association · doi:10.1161/jaha.116.003528 · Cited by 52
Usefulness of bone scintigraphy for the diagnosis of Complex Regional Pain Syndrome 1: A systematic review and Bayesian meta-analysis
Wertli, M. M., Brunner, F., Steurer, J., & Held, U. (2017) · PLoS ONE · doi:10.1371/journal.pone.0173688 · Cited by 52
Diagnostic Performance of F-18 Fluorocholine PET/CT for Parathyroid Localization in Hyperparathyroidism: a Systematic Review and Meta-Analysis
Kim, S., Lee, S., Jeong, S. Y., Pak, K., & Keun-young Kim, A. (2018) · Hormones and Cancer · doi:10.1007/s12672-018-0347-4 · Cited by 53
Does microalbuminuria predict illness severity in critically ill patients on the intensive care unit? A systematic review*
Gopal, S., Carr, B., & Nelson, P. (2006) · Critical Care Medicine · doi:10.1097/01.ccm.0000217922.75068.ea · Cited by 52
The accuracy of various tests for bacterial vaginosis in predicting preterm birth: a systematic review
Honest, H., Bachmann, L. M., Knox, E. M., Gupta, J. K., Kleijnen, J., & Khan, K. S. (2004) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2004.00124.x · Cited by 52
Local infusion of infliximab for the treatment of acute joint inflammation
Bokarewa, M. I., & Tarkowski, A. (2003) · Annals of the Rheumatic Diseases · doi:10.1136/ard.62.8.783 · Cited by 52
A Systematic Review and Lessons Learned from Early Lung Cancer Detection Trials Using Low-Dose Computed Tomography of the Chest
Bepler, G., Carney, D. G., Djulbegović, B., Clark, R. A., & Tockman, M. S. (2003) · Cancer Control · doi:10.1177/107327480301000405 · Cited by 51
The accuracy of lamellar body count and lecithin/sphingomyelin ratio in the prediction of neonatal respiratory distress syndrome: a meta-analysis
Wijnberger, L. D. E., Huisjes, A. J. M., Voorbij, H. A. M., Franx, A., Bruinse, H. W., & Mol, B. W. (2001) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2001.00142.x · Cited by 51
A Quantitative Analysis of Research Publications in Physical Therapy Journals
Miller, P. A., McKibbon, K. A., & Haynes, R. B. (2003) · Physical Therapy · doi:10.1093/ptj/83.2.123 · Cited by 51
Accuracy of Screening for Inhalational Anthrax after a Bioterrorist Attack
Hupert, N., Bearman, G. M., Mushlin, A. I., & Callahan, M. A. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-139-5_part_1-200309020-00009 · Cited by 51
Barium Enema and Endoscopy for the Detection of Colorectal Neoplasia: Sensitivity, Specificity, Complications and its Determinants
de Zwart, I. M., Griffioen, G. G., Shaw, M. P. C., Lamers, C. B. H. W., & Roos, A. (2001) · Clinical Radiology · doi:10.1053/crad.2000.0672 · Cited by 51
Chromogranin A levels in chronic liver disease and hepatocellular carcinoma
Massironi, S., Fraquelli, M., Paggi, S., Sangiovanni, A., Conte, D., Sciola, V., Ciafardini, C., Colombo, M., & PERACCHI, M. (2008) · Digestive and Liver Disease · doi:10.1016/j.dld.2008.05.002 · Cited by 50
Diagnostic Performance of MRI for Esophageal Carcinoma: A Systematic Review and Meta-Analysis
Lee, S. L., Yadav, P., Starekova, J., Christensen, L., Chandereng, T., Chappell, R. J., Reeder, S. B., & Bassetti, M. F. (2021) · Radiology · doi:10.1148/radiol.2021202857 · Cited by 52
A rapid, low‐dose, 13C‐urea tablet for the detection of Helicobacter pylori infection before and after treatment
Gatta, L., Vakil, N. B., Ricci, C., Osborn, J. F., Tampieri, A., Perna, F., Miglioli, M., & Vaira, D. (2003) · Alimentary Pharmacology & Therapeutics · doi:10.1046/j.1365-2036.2003.01490.x · Cited by 50
Recent developments in diagnosis and intervention for aspiration and dysphagia in stroke and other neuromuscular disorders
Doggett, D. L., Turkelson, C. M., & Coates, V. H. (2002) · Current Atherosclerosis Reports · doi:10.1007/s11883-002-0010-x · Cited by 50
How good is a negative cranial computed tomographic scan result in excluding subarachnoid hemorrhage?
Edlow, J. A., & Wyer, P. C. (2000) · Annals of Emergency Medicine · doi:10.1016/s0196-0644(00)56804-8 · Cited by 50
Accuracy of Ultrasonography in Predicting Celiac Disease
Fraquelli, M., Colli, A., Colucci, A., Bardella, M. T., Trovato, C. M. C., Pometta, R., Pagliarulo, M., & Conte, D. (2004) · Archives of Internal Medicine · doi:10.1001/archinte.164.2.169 · Cited by 50
Improving Reports of Studies of Diagnostic Tests
Rennie, D. (2003) · JAMA · doi:10.1001/jama.289.1.89 · Cited by 49
Assessing the performance of methodological search filters to improve the efficiency of evidence information retrieval: five literature reviews and a qualitative study
Lefebvre, C., Glanville, J., Beale, S., Boachie, C., Duffy, S., Fraser, C., Harbour, J., McCool, R., & Smith, L. (2017) · Health Technology Assessment · doi:10.3310/hta21690 · Cited by 49
Proteomic Approaches and Identification of Novel Therapeutic Targets for Alcoholism
Gorini, G., Harris, R. A., & Mayfield, R. D. (2013) · Neuropsychopharmacology · doi:10.1038/npp.2013.182 · Cited by 50
Characterization and factors associated with diarrhoeal diseases caused by enteric bacterial pathogens among children aged five years and below attending Igembe District Hospital, Kenya
Karambu, S., Matiru, V., Kiptoo, M. K., & Oundo, J. O. (2013) · Pan African Medical Journal · doi:10.11604/pamj.2013.16.37.2947 · Cited by 49
The clomiphene citrate challenge test for the prediction of poor ovarian response and nonpregnancy in patients undergoing in vitro fertilization: a systematic review
Hendriks, D. J., Mol, B. W., Bancsi, L. F. J. M. M., Velde, E. R. T., & Broekmans, F. J. (2006) · Fertility and Sterility · doi:10.1016/j.fertnstert.2006.03.033 · Cited by 49
Immunogenicity of mycobacterial vesicles in humans: Identification of a new tuberculosis antibody biomarker
Ziegenbalg, A., Prados‐Rosales, R., Jenny-Avital, E. R., Kim, R. S., Casadevall, A., & Achkar, J. M. (2013) · Tuberculosis · doi:10.1016/j.tube.2013.03.001 · Cited by 50
Clinical Assessment of Physical Examination Maneuvers for Rotator Cuff Lesions
Somerville, L. E., Willits, K. R., Johnson, A. M., Litchfield, R. B., LeBel, M., Moro, J. K., & Bryant, D. (2014) · The American Journal of Sports Medicine · doi:10.1177/0363546514538390 · Cited by 49
Eponyms and the Diagnosis of Aortic Regurgitation: What Says the Evidence?
Babu, A. N., Kymes, S. M., & Fryer, S. M. C. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-9-200305060-00010 · Cited by 49
Review: The Diagnostic Accuracy of Dementia-Screening Instruments With an Administration Time of 10 to 45 Minutes for Use in Secondary Care: A Systematic Review
Appels, B. A., & Scherder, E. (2010) · American Journal of Alzheimer s Disease & Other Dementias® · doi:10.1177/1533317510367485 · Cited by 48
Increased Diagnostic Information and Understanding Disease: Uncertainty in the Diagnosis of Developmental Hip Dysplasia
Roposch, A., & Wright, J. G. (2007) · Radiology · doi:10.1148/radiol.2422051937 · Cited by 49
Head-to-head comparison of multislice computed tomography and exercise electrocardiography for diagnosis of coronary artery disease
Dewey, M., Dübel, H. P., Schink, T., Baumann, G., & Hamm, B. (2006) · European Heart Journal · doi:10.1093/eurheartj/ehl148 · Cited by 49
Lecithin/sphingomyelin ratio and lamellar body count for fetal lung maturity: a meta-analysis
Besnard, A. E., Wirjosoekarto, S. A. M., Broeze, K. A., Opmeer, B. C., & Mol, B. W. (2013) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2013.02.013 · Cited by 48
Impact of Adjustment for Quality on Results of Metaanalyses of Diagnostic Accuracy
Leeflang, M., Reitsma, J. B., Scholten, R. J. P. M., Rutjes, A. W., Nisio, M. D., Deeks, J. J., & Bossuyt, P. M. (2006) · Clinical Chemistry · doi:10.1373/clinchem.2006.076398 · Cited by 48

Authors: Lijmer, J. G.
Affiliations: Amsterdam UMC Location University of Amsterdam (NL)
Corresponding author: Lijmer, Jeroen G.
ORCID: Lijmer, Jeroen G.
Venue: JAMA
Publisher: American Medical Association (AMA)
Published: 1999-09-15
Volume: 282
Issue: 11
Pages: 1061
ISSN: 0002-9955 (ISSN-L)
0098-7484
DOI: 10.1001/jama.282.11.1061
OpenAlex: W1971348077
Cited by: 1,861
References: 38
Citations by year: 2026: 56 · 2025: 38 · 2024: 38 · 2023: 45 · 2022: 45 · 2021: 48 · 2020: 74 · 2019: 50 · 2018: 73 · 2017: 66 · 2016: 79 · 2015: 82 · 2014: 73 · 2013: 78 · 2012: 79
FWCI: 92.03
Type: journal article
Language: en
Open access: closed
Locations: JAMA (publishedVersion)
PubMed (publishedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Pure Amsterdam UMC (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
Keywords: diagnostic accuracy, study design bias, methodological quality, diagnostic odds ratio, reference materials
MeSH terms: Diagnostic Tests, Routine, Evaluation Studies as Topic, Quality Control, Reference Standards, Regression Analysis, Research Design, Sensitivity and Specificity, Bias, Odds Ratio

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Empirical evidence of design-related bias in studies of diagnostic tests.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks