Cited by 1,861Meta-analysis and systematic reviewsStatistical Methods in EpidemiologyClinical Reasoning and Diagnostic Skills

The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.

Empirical evidence of design-related bias in studies of diagnostic tests.

Lijmer, Jeroen G.·1999·JAMA

DOI 10.1001/jama.282.11.1061

Open this paper in CoChat — free account

Abstract

CONTEXT: The literature contains a large number of potential biases in the evaluation of diagnostic tests. Strict application of appropriate methodological criteria would invalidate the clinical application of most study results. OBJECTIVE: To empirically determine the quantitative effect of study design shortcomings on estimates of diagnostic accuracy. DESIGN AND SETTING: Observational study of the methodological features of 184 original studies evaluating 218 diagnostic tests. Meta-analyses on diagnostic tests were identified through a systematic search of the literature using MEDLINE, EMBASE, and DARE databases and the Cochrane Library (1996-1997). Associations between study characteristics and estimates of diagnostic accuracy were evaluated with a regression model. MAIN OUTCOME MEASURES: Relative diagnostic odds ratio (RDOR), which compared the diagnostic odds ratios of studies of a given test that lacked a particular methodological feature with those without the corresponding shortcomings in design. RESULTS: Fifteen (6.8%) of 218 evaluations met all 8 criteria; 64 (30%) met 6 or more. Studies evaluating tests in a diseased population and a separate control group overestimated the diagnostic performance compared with studies that used a clinical population (RDOR, 3.0; 95% confidence interval [CI], 2.0-4.5). Studies in which different reference tests were used for positive and negative results of the test under study overestimated the diagnostic performance compared with studies using a single reference test for all patients (RDOR, 2.2; 95% CI, 1.5-3.3). Diagnostic performance was also overestimated when the reference test was interpreted with knowledge of the test result (RDOR, 1.3; 95% CI, 1.0-1.9), when no criteria for the test were described (RDOR, 1.7; 95% CI, 1.1-2.5), and when no description of the population under study was provided (RDOR, 1.4; 95% CI, 1.1-1.7). CONCLUSION: These data provide empirical evidence that diagnostic studies with methodological shortcomings may overestimate the accuracy of a diagnostic test, particularly those including nonrepresentative patients or applying different reference standards.

Integrity signals

Registry

Crossref · 10.1001/jama.282.11.1061

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Untitled work
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Users' Guides to the Medical Literature
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.271.9.703 · Cited by 2,688
Problems of Spectrum and Bias in Evaluating the Efficacy of Diagnostic Tests
Ransohoff, D. F., & Feinstein, A. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197810262991705 · Cited by 1,739
Combining independent studies of a diagnostic test into a summary roc curve: Data‐analytic approaches and some additional considerations
Moses, L. E., Shapiro, D. E., & Littenberg, B. (1993) · Statistics in Medicine · doi:10.1002/sim.4780121403 · Cited by 1,405
Users' Guides to the Medical Literature
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.271.5.389 · Cited by 1,174
THE ESTIMATION AND SIGNIFICANCE OF THE LOGARITHM OF A RATIO OF FREQUENCIES
HALDANE, B. J. B. S. (1956) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1955.tb01285.x · Cited by 1,083
Selection and interpretation of diagnostic tests and procedures. Principles and applications.
Griner, P. F., Mayewski, R. J., Mushlin, A. I., & Greenland, P. (1981) · PubMed · Cited by 765
Use of Methodological Standards in Diagnostic Test Research
Reid, M. C. (1995) · JAMA · doi:10.1001/jama.274.8.645 · Cited by 710
Assessment of diagnostic tests when disease verification is subject to selection bias
Begg, C. B., & Greenes, R. A. (1983) · Biometrics · doi:10.2307/2530820 · Cited by 708
Meta-analysis of Pap Test Accuracy
Fahey, M. T., Irwig, L., & Macaskill, P. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117485 · Cited by 690

Show all 38 references

Sorted by citations

Items 101–200 of 1,002

Transcranial Doppler Versus Angiography in Patients With Vasospasm due to a Ruptured Cerebral Aneurysm
Lysakowski, C., Walder, B., Costanza, M. C., & Tramèr, M. R. (2001) · Stroke · doi:10.1161/hs1001.097108 · Cited by 413
Screening for Cognitive Impairment in Older Adults: A Systematic Review for the U.S. Preventive Services Task Force
Lin, J. S., O’Connor, E., Rossom, R. C., Perdue, L. A., & Eckstrom, E. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-159-9-201311050-00730 · Cited by 433
Diagnostic and prognostic accuracy of clinical and laboratory parameters in community-acquired pneumonia
Müller-Stich, B. P., Harbarth, S., Stolz, D., Bingisser, R. M., Mueller, C. E., Leuppi, J. D., Nusbaumer, C., Tamm, M., & Christ‐Crain, M. (2007) · BMC Infectious Diseases · doi:10.1186/1471-2334-7-10 · Cited by 414
The criterion validity of the Geriatric Depression Scale: a systematic review
Wancata, J., Alexandrowicz, R. W., Marquart, B., Weiss, M., & Friedrich, F. (2006) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2006.00888.x · Cited by 433
A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard
Reitsma, J. B., Rutjes, A. W. S., Khan, K. S., Coomarasamy, A., & Bossuyt, P. M. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.02.005 · Cited by 405
An update of comprehensive evidence-based guidelines for interventional techniques in chronic spinal pain. Part II: guidance and recommendations.
Manchikanti, L., Abdi, S., Atluri, S. L., Benyamin, R. M., Boswell, M. V., Buenaventura, R. M., Bryce, D. A., Burks, P. A., Caraway, D. L., Calodney, A. K., et al. (2013) · PubMed · Cited by 398
Assessing the quality of research.
Glasziou, P., Vandenbroucke, J., & Chalmers, I. (2004) · BMJ · doi:10.1136/bmj.328.7430.39 · Cited by 391
A systematic review of the content of critical appraisal tools
Katrak, P., Bialocerkowski, A. E., Massy‐Westropp, N., Kumar, S., & Grimmer, K. A. (2004) · BMC Medical Research Methodology · doi:10.1186/1471-2288-4-22 · Cited by 389
Computed tomography and magnetic resonance imaging in staging of uterine cervical carcinoma: a systematic review
Bipat, S., Glas, A. S., van der Velden, J., Zwinderman, A. H., Bossuyt, P. M., & Stoker, J. (2003) · Gynecologic Oncology · doi:10.1016/s0090-8258(03)00409-8 · Cited by 385
Sensitivity and Specificity of Posterior Corneal Elevation Measured by Pentacam in Discriminating Keratoconus/Subclinical Keratoconus
de Sanctis, U., Loiacono, C., Richiardi, L., Turco, D., Mutani, B., & Grignolo, F. M. (2008) · Ophthalmology · doi:10.1016/j.ophtha.2008.02.020 · Cited by 389
Diagnostic accuracy of nucleic acid amplification tests for tuberculous meningitis: a systematic review and meta-analysis
Pai, M., Flores, L. L., Pai, N., Hubbard, A., Riley, L. W., & Colford, J. M. (2003) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(03)00772-2 · Cited by 384
Research Gaps on Use of Opioids for Chronic Noncancer Pain: Findings From a Review of the Evidence for an American Pain Society and American Academy of Pain Medicine Clinical Practice Guideline
Chou, R., Ballantyne, J. C., Fanciullo, G. J., Fine, P. G., & Miaskowski, C. A. (2009) · Journal of Pain · doi:10.1016/j.jpain.2008.10.007 · Cited by 392
Diagnostic Performance of Computed Tomography Angiography in Peripheral Arterial Disease
Met, R., Bipat, S., Legemate, D. A., Reekers, J. A., & Koelemay, M. J. W. (2009) · JAMA · doi:10.1001/jama.301.4.415 · Cited by 377
Detection of lymph node metastases in head and neck cancer: A meta-analysis comparing US, USgFNAC, CT and MR imaging
de Bondt, R. B. J., Nelemans, P. J., Hofman, P. A. M., Casselman, J. W., Kremer, B., van Engelshoven, J. M. A., & Beets‐Tan, R. G. H. (2007) · European Journal of Radiology · doi:10.1016/j.ejrad.2007.02.037 · Cited by 376
Diagnosis of bone metastases: a meta-analysis comparing 18FDG PET, CT, MRI and bone scintigraphy
Yang, H., Liu, T., Wang, X., Xu, Y. X., & Deng, S. (2011) · European Radiology · doi:10.1007/s00330-011-2221-4 · Cited by 376
Antral follicle count in the prediction of poor ovarian response and pregnancy after in vitro fertilization: A meta-analysis and comparison with basal follicle-stimulating hormone level
Hendriks, D. J., Mol, B. W., Bancsi, L. F. J. M. M., Velde, E. R. T., & Broekmans, F. J. (2005) · Fertility and Sterility · doi:10.1016/j.fertnstert.2004.10.011 · Cited by 376
Systematic review and meta-analysis of the diagnostic accuracy of ultrasonography for deep vein thrombosis
Goodacre, S. W., Sampson, F. C., Thomas, S., van Beek, E. J. R., & Sutton, A. J. (2005) · BMC Medical Imaging · doi:10.1186/1471-2342-5-6 · Cited by 372
Development and validation of methods for assessing the quality of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W., Dinnes, J., Reitsma, J. B., Bossuyt, P. M., & Kleijnen, J. (2004) · Health Technology Assessment · doi:10.3310/hta8250 · Cited by 373
Non-invasive imaging compared with intra-arterial angiography in the diagnosis of symptomatic carotid stenosis: a meta-analysis
Wardlaw, J. M., Chappell, F. M., Best, J. J. K., Wartolowska, K. A., & Berry, E. (2006) · The Lancet · doi:10.1016/s0140-6736(06)68650-9 · Cited by 372
Validation of the Edinburgh Postnatal Depression Scale (EPDS) in a sample of mothers from the 2004 Pelotas Birth Cohort Study
Santos, I. S., Matijasevich, A., Tavares, B. F., Barros, A. J. D., Botelho, I. P., Lapolli, C., Magalhães, P. V. D. S., Barbosa, A. P. P. N., & Barros, F. C. (2007) · Cadernos de Saúde Pública · doi:10.1590/s0102-311x2007001100005 · Cited by 371
The validity of individual Rorschach variables: Systematic reviews and meta-analyses of the comprehensive system.
Mihura, J. L., Meyer, G. J., Dumitrascu, N., & Bombel, G. (2012) · Psychological Bulletin · doi:10.1037/a0029406 · Cited by 399
Opioids for Chronic Noncancer Pain: Prediction and Identification of Aberrant Drug-Related Behaviors: A Review of the Evidence for an American Pain Society and American Academy of Pain Medicine Clinical Practice Guideline
Chou, R., Fanciullo, G. J., Fine, P. G., Miaskowski, C. A., Passik, S. D., & Portenoy, R. K. (2009) · Journal of Pain · doi:10.1016/j.jpain.2008.10.009 · Cited by 365
Accuracy of the 15‐item geriatric depression scale (GDS‐15) in a community sample of the oldest old
de Craen, A. J. M., Heeren, T. J., & Gussekloo, J. (2003) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.773 · Cited by 364
Evidence base of clinical diagnosis: Evaluation of diagnostic procedures
Knottnerus, J. A. (2002) · BMJ · doi:10.1136/bmj.324.7335.477 · Cited by 358
Eccentric Loading, Shock-Wave Treatment, or a Wait- and-See Policy for Tendinopathy of the Main Body of Tendo Achillis
Rompe, J. D., Nafe, B., Furia, J. P., & Maffulli, N. (2007) · The American Journal of Sports Medicine · doi:10.1177/0363546506295940 · Cited by 356
Use of PCR for diagnosis of invasive aspergillosis: systematic review and meta-analysis
Mengoli, C., Cruciani, M., Barnes, R. A., Loeffler, J., & Donnelly, J. P. (2009) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(09)70019-2 · Cited by 354
The Role of 11C-Choline and 18F-Fluorocholine Positron Emission Tomography (PET) and PET/CT in Prostate Cancer: A Systematic Review and Meta-analysis
Umbehr, M., Müntener, M., Hany, T. F., Sulser, T., & Bachmann, L. M. (2013) · European Urology · doi:10.1016/j.eururo.2013.04.019 · Cited by 353
The STARD-AI reporting guideline for diagnostic accuracy studies using artificial intelligence
Sounderajah, V., Guni, A., Liu, X., Collins, G. S., Karthikesalingam, A., Markar, S. R., Golub, R. M., Denniston, A. K., Shetty, S., Moher, D., et al. (2025) · Nature Medicine · doi:10.1038/s41591-025-03953-8 · Cited by 352
Small Intestinal Bacterial Overgrowth in Irritable Bowel Syndrome: Systematic Review and Meta-analysis
Ford, A. C., Spiegel, B. M. R., Talley, N. J., & Moayyedi, P. (2009) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2009.06.031 · Cited by 351
Acute Appendicitis: Meta-Analysis of Diagnostic Performance of CT and Graded Compression US Related to Prevalence of Disease
van Randen, A., Bipat, S., Zwinderman, A. H., Ubbink, D. T., Stoker, J., & Boermeester, M. A. (2008) · Radiology · doi:10.1148/radiol.2483071652 · Cited by 351
Incidence of and Risk Factors for Pulmonary Complications after Nonthoracic Surgery
McAlister, F. A., Bertsch, K., Man, J., Bradley, J., & Jacka, M. J. (2004) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200408-1069oc · Cited by 346
Systematic Review on the Management of Chronic Constipation in North America
Brandt, L. J., Prather, C. M., Quigley, E. M. M., Schiller, L. R., Schoenfeld, P., & Talley, N. J. (2005) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2005.50613_2.x · Cited by 344
CT and Conventional and Diffusion-weighted MR Imaging in Acute Stroke: Study in 691 Patients at Presentation to the Emergency Department
Mullins, M. E., Schaefer, P. W., Sorensen, A. G., Halpern, E. F., Ay, H., He, J., Koroshetz, W. J., & González, R. (2002) · Radiology · doi:10.1148/radiol.2242010873 · Cited by 343
GenoType MTBDR assays for the diagnosis of multidrug-resistant tuberculosis: a meta-analysis
Ling, D. I., Zwerling, A. A., & Pai, M. (2008) · European Respiratory Journal · doi:10.1183/09031936.00061808 · Cited by 342
Inﬂammatory bowel disease
Teitelbaum, D. H., & Coran, A. G. (2006) · CRC Press eBooks · doi:10.1201/b13237-67 · Cited by 341
Bias in Research Studies
Sica, G. T. (2006) · Radiology · doi:10.1148/radiol.2383041109 · Cited by 333
ACCF Proposed Method for Evaluating the Appropriateness of Cardiovascular Imaging
Patel, M. R., Spertus, J. A., Brindis, R. G., Hendel, R. C., Douglas, P. S., Peterson, E. D., Wolk, M. J., Allen, J. M., & Raskin, I. E. (2005) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2005.08.030 · Cited by 332
Physical examination for lumbar radiculopathy due to disc herniation in patients with low-back pain
van der Windt, D., Simons, E., Riphagen, I. I., Ammendolia, C., Verhagen, A. P., Laslett, M., Devillé, W. L. J. M., Deyo, R. A., Bouter, L. M., de Vet, H. C. W., et al. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007431.pub2 · Cited by 335
Diagnostic Accuracy of Serum 1,3-β- d -Glucan for Pneumocystis jiroveci Pneumonia, Invasive Candidiasis, and Invasive Aspergillosis: Systematic Review and Meta-Analysis
Ōnishi, A., Sugiyama, D., Kogata, Y., Saegusa, J., Sugimoto, T., Kawano, S., Morinobu, A., Nishimura, K., & Kumagai, S. (2011) · Journal of Clinical Microbiology · doi:10.1128/jcm.05267-11 · Cited by 331
Accuracy of electrocardiography in diagnosis of left ventricular hypertrophy in arterial hypertension: systematic review
Pewsner, D., Jüni, P., Egger, M., Battaglia, M., Sundström, J., & Bachmann, L. M. (2007) · BMJ · doi:10.1136/bmj.39276.636354.ae · Cited by 329
World Health Organization Systematic Review of Screening Tests for Preeclampsia
Conde‐Agudelo, A., Villar, J., & Lindheimer, M. D. (2004) · Obstetrics and Gynecology · doi:10.1097/01.aog.0000147599.47713.5d · Cited by 320
Systematic review and validation of prediction rules for identifying children with serious infections in emergency departments and urgent-access primary care.
Thompson, M., den Bruel, A. V., Verbakel, J. Y. J., Lakhanpaul, M., Haj-Hassan, T. A., Stevens, R., Moll, H. A., Buntinx, F., Berger, M. Y., Aertgeerts, B., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16150 · Cited by 324
Methods of prediction and prevention of pre-eclampsia: systematic reviews of accuracy and effectiveness literature with economic modelling
Meads, C., Cnossen, J. S., Meher, S., Juarez-Garcia, A., ter Riet, G., Duley, L., Roberts, T. E., Mol, B. W., van der Post, J., Leeflang, M., et al. (2008) · Health Technology Assessment · doi:10.3310/hta12060 · Cited by 322
Systematic reviews and meta-analyses of diagnostic test accuracy
Leeflang, M. (2013) · Clinical Microbiology and Infection · doi:10.1111/1469-0691.12474 · Cited by 326
Effect of study design and quality on unsatisfactory rates, cytology classifications, and accuracy in liquid-based versus conventional cervical cytology: a systematic review
DAVEY, E. A., Barratt, A. L., Irwig, L., Chan, S. F., Macaskill, P., Mannes, P., & Saville, A. M. (2006) · The Lancet · doi:10.1016/s0140-6736(06)67961-0 · Cited by 318
Evidence-based Diagnostics: Adult Septic Arthritis
Carpenter, C. R., Schuur, J. D., Everett, W. W., & Pines, J. M. (2011) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2011.01121.x · Cited by 325
The Malawi Developmental Assessment Tool (MDAT): The Creation, Validation, and Reliability of a Tool to Assess Child Development in Rural African Settings
Gladstone, M., Lancaster, G., Umar, E., Nyirenda-Nyang’wa, M., Kayira, E., van den Broek, N. R., & Smyth, R. L. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000273 · Cited by 314
Accuracy of cervicovaginal fetal fibronectin test in predicting risk of spontaneous preterm birth: systematic review
Honest, H., Bachmann, L. M., Gupta, J. K., Kleijnen, J., & Khan, K. S. (2002) · BMJ · doi:10.1136/bmj.325.7359.301 · Cited by 314
Systematic Review of Computed Tomographic Angiography for Assessment of Carotid Artery Disease
Koelemay, M. J. W., Nederkoorn, P. J., Reitsma, J. B., & Majoie, C. B. L. M. (2004) · Stroke · doi:10.1161/01.str.0000141426.63959.cc · Cited by 314
Assessment of the accuracy of diagnostic tests: the cross-sectional study
Knottnerus, J. A., & Muris, J. W. M. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00206-3 · Cited by 315
Clinical Validity of a Negative Computed Tomography Scan in Patients With Suspected Pulmonary Embolism
Quiroz, R., Kucher, N., Zou, K. H., Kipfmueller, F., Costello, P., Goldhaber, S. Z., & Schoepf, U. J. (2005) · JAMA · doi:10.1001/jama.293.16.2012 · Cited by 309
Risk of Thyroid Cancer Based on Thyroid Ultrasound Imaging Characteristics
Smith‐Bindman, R., Lebda, P. L., Feldstein, V. A., Sellami, D., Goldstein, R. B., Brasic, N., Jin, C., & Kornak, J. (2013) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2013.9245 · Cited by 308
Biomarkers of sepsis
Marshall, J. C., & Reinhart, K. (2009) · Critical Care Medicine · doi:10.1097/ccm.0b013e3181a02afc · Cited by 316
Role of US in Detection of Crohn Disease: Meta-Analysis
Fraquelli, M., Colli, A., Casazza, G., Paggi, S., Colucci, A., Massironi, S., Duca, P., & Conte, D. (2005) · Radiology · doi:10.1148/radiol.2361040799 · Cited by 304
Second-Trimester Ultrasound to Detect Fetuses With Down Syndrome
Smith‐Bindman, R., Hosmer, W., Feldstein, V. A., Deeks, J. J., & Goldberg, J. D. (2001) · JAMA · doi:10.1001/jama.285.8.1044 · Cited by 303
A systematic review of diagnostic studies in myasthenia gravis
Benatar, M. G. (2006) · Neuromuscular Disorders · doi:10.1016/j.nmd.2006.05.006 · Cited by 302
Sensitivity and specificity of color duplex ultrasound measurement in the estimation of internal carotid artery stenosis: A systematic review and meta-analysis
Jahromi, A. S., Cinà, C. S., Liu, Y., & Clase, C. M. (2005) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2005.02.044 · Cited by 302
Diagnosis of the condition of the dental pulp: a systematic review
Mejàre, I. A., Axelsson, S., Davidson, T., Frisk, F., Hakeberg, M., Kvist, T., Norlund, A., Petersson, A., Portenier, I., Sandberg, H., et al. (2012) · International Endodontic Journal · doi:10.1111/j.1365-2591.2012.02016.x · Cited by 296
What kind of evidence is it that Evidence-Based Medicine advocates want health care providers and consumers to pay attention to?
Haynes, R. B. (2002) · BMC Health Services Research · doi:10.1186/1472-6963-2-3 · Cited by 297
The value of FDG-PET in the detection, grading and response to therapy of soft tissue and bone sarcomas; a systematic review and meta-analysis
Bastiaannet, E., Groen, H., Jager, P. L., Cobben, D., van der Graaf, W. T. A., Vaalburg, W., & Hoekstra, H. J. (2003) · Cancer Treatment Reviews · doi:10.1016/j.ctrv.2003.07.004 · Cited by 293
Prognostic value of coronary electron-beam computed tomography for coronary heart disease events in asymptomatic populations11The views contained herein represent the private views of the authors and should not be construed in any way to represent those of the Department of Defense or the Department of the Army.
O’Malley, P. G., Taylor, A. J., Jackson, J. L., Doherty, T. M., & Detrano, R. (2000) · The American Journal of Cardiology · doi:10.1016/s0002-9149(99)00906-6 · Cited by 293
Accuracy of outpatient endometrial biopsy in the diagnosis of endometrial cancer: a systematic quantitative review
Clark, T. J., Mann, C. H., Shah, N., Khan, K. S., Song, F., & Gupta, J. K. (2002) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2002.01088.x · Cited by 291
Meta-Analysis of BACTEC MGIT 960 and BACTEC 460 TB, with or without Solid Media, for Detection of Mycobacteria
Cruciani, M., Scarparo, C., Malena, M., Bosco, O., Serpelloni, G., & Mengoli, C. (2004) · Journal of Clinical Microbiology · doi:10.1128/jcm.42.5.2321-2325.2004 · Cited by 291
Bedside screening tests vs. videofluoroscopy or fibreoptic endoscopic evaluation of swallowing to detect dysphagia in patients with neurological disorders: systematic review
Bours, G. J. J. W., Speyer, R., Lemmens, J., Limburg, M., & de Wit, R. (2009) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2008.04915.x · Cited by 286
Association of Journal Quality Indicators With Methodological Quality of Clinical Research Articles
Lee, K. P. (2002) · JAMA · doi:10.1001/jama.287.21.2805 · Cited by 284
A systematic review classifies sources of bias and variation in diagnostic test accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., & Mallett, S. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.05.014 · Cited by 283
Ultrasonographic endometrial thickness for diagnosing endometrial pathology in women with postmenopausal bleeding: a meta‐analysis
Gupta, J. K., CHIEN, P. F. W., Voit, D., Clark, T. J., & Khan, K. S. (2002) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1034/j.1600-0412.2001.810902.x · Cited by 288
A meta-analysis comparing the prognostic accuracy of six diagnostic tests for predicting perioperative cardiac risk in patients undergoing major vascular surgery
Kertai, M. D., Boersma, E., Bax, J. J., Heijenbrok‐Kal, M. H., Hunink, M. G. M., L’talien, G. J., Roelandt, J. R. T. C., van Urk, H., & Poldermans, D. (2003) · Heart · doi:10.1136/heart.89.11.1327 · Cited by 280
Abacavir-Lamivudine-Zidovudine vs Indinavir-Lamivudine-Zidovudine in Antiretroviral-Naive HIV-Infected Adults<SUBTITLE>A Randomized Equivalence Trial</SUBTITLE>
Staszewski, S. (2001) · JAMA · doi:10.1001/jama.285.9.1155 · Cited by 277
The Diagnosis of Acute Mesenteric Ischemia: A Systematic Review and Meta-analysis
Cudnik, M. T., Darbha, S., Jones, J., Macedo, J., Stockton, S. W., & Hiestand, B. C. (2013) · Academic Emergency Medicine · doi:10.1111/acem.12254 · Cited by 275
Urinary Biomarkers for Diagnosis of Bladder Cancer
Chou, R., Gore, J. L., Buckley, D., Fu, R. F., Gustafson, K., Griffin, J. C., Grusing, S., & Selph, S. (2015) · Annals of Internal Medicine · doi:10.7326/m15-0997 · Cited by 279
Ultrasonography, Computed Tomography and Magnetic Resonance Imaging for Diagnosis and Determining Resectability of Pancreatic Adenocarcinoma
Bipat, S., Phoa, S. S. K. S., van Delden, O. M., Bossuyt, P. M., Gouma, D. J., ris, J. S. L., & Stoker, J. (2005) · Journal of Computer Assisted Tomography · doi:10.1097/01.rct.0000164513.23407.b3 · Cited by 269
The diagnostic value of symptoms for colorectal cancer in primary care: a systematic review
Astin, M., Griffin, T., Neal, R. D., Rose, P. W., & Hamilton, W. T. (2011) · British Journal of General Practice · doi:10.3399/bjgp11x572427 · Cited by 270
Optical coherence tomography (OCT) for detection of macular oedema in patients with diabetic retinopathy
Virgili, G., Menchini, F., Casazza, G., Hogg, R. E., Das, R., Wang, X., & Michelessi, M. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008081.pub3 · Cited by 284
Technology-Enhanced Simulation to Assess Health Professionals
Cook, D. A., Brydges, R., Zendejas, B., Hamstra, S. J., & Hatala, R. A. (2013) · Academic Medicine · doi:10.1097/acm.0b013e31828ffdcf · Cited by 282
Regional Comparisons of Optical Coherence Tomography Angiography Vessel Density in Primary Open-Angle Glaucoma
Rao, H. L., Pradhan, Z. S., Weinreb, R. N., Reddy, H. B., Riyazuddin, M., Dasari, S., Palakurthy, M., Puttaiah, N. K., Rao, D. A. S., & Webers, C. A. B. (2016) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2016.08.030 · Cited by 269
Tumor Markers in the Diagnosis of Primary Bladder Cancer. A Systematic Review
Glas, A. S., Roos, D., Deutekom, M. D. L. F., Zwinderman, A. H., Bossuyt, P. M., & Kurth, K. (2003) · The Journal of Urology · doi:10.1097/01.ju.0000067461.30468.6d · Cited by 268
Clinical Utility of Diagnostic Tests for Constipation in Adults: A Systematic Review
Rao, S. S. C., Öztürk, R., & Laine, L. (2005) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2005.41845.x · Cited by 261
Commercial Serological Tests for the Diagnosis of Active Pulmonary and Extrapulmonary Tuberculosis: An Updated Systematic Review and Meta-Analysis
Steingart, K. R., Flores, L., Dendukuri, N., Schiller, I., Laal, S., Ramsay, A., Hopewell, P. C., & Pai, M. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1001062 · Cited by 266
Accuracy of Lung Ultrasonography versus Chest Radiography for the Diagnosis of Adult Community-Acquired Pneumonia: Review of the Literature and Meta-Analysis
Ye, X., Xiao, H. F., Chen, B., & Zhang, S.-Y. (2015) · PLoS ONE · doi:10.1371/journal.pone.0130066 · Cited by 271
Transvaginal sonographic cervical length for the prediction of spontaneous preterm birth in twin pregnancies: a systematic review and metaanalysis
Conde‐Agudelo, A., Romero, R. J., Hassan, S. S., & Yeo, L. (2010) · American Journal of Obstetrics and Gynecology · doi:10.1016/j.ajog.2010.02.064 · Cited by 257
Analysing the relationship between treatment effect and underlying risk in meta-analysis: comparison and development of approaches
Sharp, S. J., & Thompson, S. G. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001215)19:23 · Cited by 99
Diagnostic accuracy of tests for lymph node status in primary cervical cancer: a systematic review and meta-analysis
Selman, T. J., Mann, C. H., Zamora, J., Appleyard, T.-L., & Khan, K. S. (2008) · Canadian Medical Association Journal · doi:10.1503/cmaj.071124 · Cited by 253
Systematic Review: Comparative Effectiveness of Core-Needle and Open Surgical Biopsy to Diagnose Breast Lesions
Bruening, W., Fontanarosa, J., Tipton, K., Treadwell, J. R., Launders, J., & Schoelles, K. (2010) · Annals of Internal Medicine · doi:10.7326/0003-4819-152-1-201001050-00190 · Cited by 251
World Health Organization Systematic Review of Screening Tests for Preeclampsia
Cnossen, J. S., Mol, B. W., van der Post, J., Bossuyt, P. M., & ter Riet, G. (2005) · Obstetrics and Gynecology · doi:10.1097/01.aog.0000162539.68541.c2 · Cited by 249
Limited Value of Alarm Features in the Diagnosis of Upper Gastrointestinal Malignancy: Systematic Review and Meta-analysis
Vakil, N. B., Moayyedi, P., Fennerty, M. B., & Talley, N. J. (2006) · Gastroenterology · doi:10.1053/j.gastro.2006.04.029 · Cited by 246
Predicting the diagnosis of autism in adults using the Autism-Spectrum Quotient (AQ) questionnaire
Ashwood, K. L., Gillan, N., Horder, J., Hayward, H., Woodhouse, E., McEwen, F. S., Findon, J. L., Eklund, H., Spain, D., Wilson, C. E., et al. (2016) · Psychological Medicine · doi:10.1017/s0033291716001082 · Cited by 252
The validity of a sore throat score in family practice.
McIsaac, W. J., Goel, V., To, T. M., & Low, D. E. (2000) · Europe PMC (PubMed Central) · Cited by 243
Diagnostic value of sonography in patients with suspected carpal tunnel syndrome: A prospective study
Ziswiler, H., Reichenbach, S., Vögelin, E., Bachmann, L. M., Villiger, P. M., & Jüni, P. (2005) · Arthritis & Rheumatism · doi:10.1002/art.20723 · Cited by 242
Diagnostic value of C reactive protein in infections of the lower respiratory tract: systematic review
van der Meer, V., Neven, A. K., van den Broek, P. J., & Assendelft, W. J. (2005) · BMJ · doi:10.1136/bmj.38483.478183.eb · Cited by 245
Understanding the Direction of Bias in Studies of Diagnostic Test Accuracy
Kohn, M. A., Carpenter, C. R., & Newman, T. B. (2013) · Academic Emergency Medicine · doi:10.1111/acem.12255 · Cited by 247
Nucleic acid amplification tests in the diagnosis of tuberculous pleuritis: a systematic review and meta-analysis
Pai, M., Flores, L., Hubbard, A., Riley, L. W., & Colford, J. M. (2004) · BMC Infectious Diseases · doi:10.1186/1471-2334-4-6 · Cited by 244
A Critical Review of the American Pain Society Clinical Practice Guidelines For Interventional Techniques: Part 2. Therapeutic Interventions
Manchikanti, L. (2010) · Pain Physician · doi:10.36076/ppj.2010/13/e215 · Cited by 233
Yield of Diagnostic Tests for Celiac Disease in Individuals With Symptoms Suggestive of Irritable Bowel Syndrome
Ford, A. C., Chey, W. D., Talley, N. J., Malhotra, A., Spiegel, B. M. R., & Moayyedi, P. (2009) · Archives of Internal Medicine · doi:10.1001/archinternmed.2009.22 · Cited by 241
Accuracy of mean arterial pressure and blood pressure measurements in predicting pre-eclampsia: systematic review and meta-analysis
Cnossen, J. S., Vollebregt, K. C., de Vrieze, N., ter Riet, G., Mol, B. W., Franx, A., Khan, K. S., & van der Post, J. (2008) · BMJ · doi:10.1136/bmj.39540.522049.be · Cited by 241
The partial area under the summary ROC curve
Walter, S. D. (2005) · Statistics in Medicine · doi:10.1002/sim.2103 · Cited by 250
The utility of diagnostic tests in irritable bowel syndrome patients: a systematic review
Cash, B. D., Schoenfeld, P., & Chey, W. D. (2002) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2002.07027.x · Cited by 242
Assessing the Quality of Randomised Controlled Trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · Wiley eBooks · doi:10.1002/9780470693926.ch5 · Cited by 237
Magnetic resonance imaging in the preoperative assessment of patients with primary breast cancer: systematic review of diagnostic accuracy and meta-analysis
Plana, N., Carreira, C., Muriel, A., Chiva, M., Abraira, V., Emparanza, J. I., Bonfill, X., & Zamora, J. (2011) · European Radiology · doi:10.1007/s00330-011-2238-8 · Cited by 238
Commercial Serological Antibody Detection Tests for the Diagnosis of Pulmonary Tuberculosis: A Systematic Review
Steingart, K. R., Henry, M., Laal, S., Hopewell, P. C., Ramsay, A., Menzies, D., Cunningham, J. A., Weldingh, K. N., & Pai, M. (2007) · PLoS Medicine · doi:10.1371/journal.pmed.0040202 · Cited by 238

Authors: Lijmer, J. G.
Affiliations: Amsterdam UMC Location University of Amsterdam (NL)
Corresponding author: Lijmer, Jeroen G.
ORCID: Lijmer, Jeroen G.
Venue: JAMA
Publisher: American Medical Association (AMA)
Published: 1999-09-15
Volume: 282
Issue: 11
Pages: 1061
ISSN: 0002-9955 (ISSN-L)
0098-7484
DOI: 10.1001/jama.282.11.1061
OpenAlex: W1971348077
Cited by: 1,861
References: 38
Citations by year: 2026: 56 · 2025: 38 · 2024: 38 · 2023: 45 · 2022: 45 · 2021: 48 · 2020: 74 · 2019: 50 · 2018: 73 · 2017: 66 · 2016: 79 · 2015: 82 · 2014: 73 · 2013: 78 · 2012: 79
FWCI: 92.03
Type: journal article
Language: en
Open access: closed
Locations: JAMA (publishedVersion)
PubMed (publishedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Pure Amsterdam UMC (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
Keywords: diagnostic accuracy, study design bias, methodological quality, diagnostic odds ratio, reference materials
MeSH terms: Diagnostic Tests, Routine, Evaluation Studies as Topic, Quality Control, Reference Standards, Regression Analysis, Research Design, Sensitivity and Specificity, Bias, Odds Ratio

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Empirical evidence of design-related bias in studies of diagnostic tests.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks