Cited by 1,861Meta-analysis and systematic reviewsStatistical Methods in EpidemiologyClinical Reasoning and Diagnostic Skills

The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.

Empirical evidence of design-related bias in studies of diagnostic tests.

Lijmer, Jeroen G.·1999·JAMA

DOI 10.1001/jama.282.11.1061

Open this paper in CoChat — free account

Abstract

CONTEXT: The literature contains a large number of potential biases in the evaluation of diagnostic tests. Strict application of appropriate methodological criteria would invalidate the clinical application of most study results. OBJECTIVE: To empirically determine the quantitative effect of study design shortcomings on estimates of diagnostic accuracy. DESIGN AND SETTING: Observational study of the methodological features of 184 original studies evaluating 218 diagnostic tests. Meta-analyses on diagnostic tests were identified through a systematic search of the literature using MEDLINE, EMBASE, and DARE databases and the Cochrane Library (1996-1997). Associations between study characteristics and estimates of diagnostic accuracy were evaluated with a regression model. MAIN OUTCOME MEASURES: Relative diagnostic odds ratio (RDOR), which compared the diagnostic odds ratios of studies of a given test that lacked a particular methodological feature with those without the corresponding shortcomings in design. RESULTS: Fifteen (6.8%) of 218 evaluations met all 8 criteria; 64 (30%) met 6 or more. Studies evaluating tests in a diseased population and a separate control group overestimated the diagnostic performance compared with studies that used a clinical population (RDOR, 3.0; 95% confidence interval [CI], 2.0-4.5). Studies in which different reference tests were used for positive and negative results of the test under study overestimated the diagnostic performance compared with studies using a single reference test for all patients (RDOR, 2.2; 95% CI, 1.5-3.3). Diagnostic performance was also overestimated when the reference test was interpreted with knowledge of the test result (RDOR, 1.3; 95% CI, 1.0-1.9), when no criteria for the test were described (RDOR, 1.7; 95% CI, 1.1-2.5), and when no description of the population under study was provided (RDOR, 1.4; 95% CI, 1.1-1.7). CONCLUSION: These data provide empirical evidence that diagnostic studies with methodological shortcomings may overestimate the accuracy of a diagnostic test, particularly those including nonrepresentative patients or applying different reference standards.

Integrity signals

Registry

Crossref · 10.1001/jama.282.11.1061

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Untitled work
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Users' Guides to the Medical Literature
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.271.9.703 · Cited by 2,688
Problems of Spectrum and Bias in Evaluating the Efficacy of Diagnostic Tests
Ransohoff, D. F., & Feinstein, A. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197810262991705 · Cited by 1,739
Combining independent studies of a diagnostic test into a summary roc curve: Data‐analytic approaches and some additional considerations
Moses, L. E., Shapiro, D. E., & Littenberg, B. (1993) · Statistics in Medicine · doi:10.1002/sim.4780121403 · Cited by 1,405
Users' Guides to the Medical Literature
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.271.5.389 · Cited by 1,174
THE ESTIMATION AND SIGNIFICANCE OF THE LOGARITHM OF A RATIO OF FREQUENCIES
HALDANE, B. J. B. S. (1956) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1955.tb01285.x · Cited by 1,083
Selection and interpretation of diagnostic tests and procedures. Principles and applications.
Griner, P. F., Mayewski, R. J., Mushlin, A. I., & Greenland, P. (1981) · PubMed · Cited by 765
Use of Methodological Standards in Diagnostic Test Research
Reid, M. C. (1995) · JAMA · doi:10.1001/jama.274.8.645 · Cited by 710
Assessment of diagnostic tests when disease verification is subject to selection bias
Begg, C. B., & Greenes, R. A. (1983) · Biometrics · doi:10.2307/2530820 · Cited by 708
Meta-analysis of Pap Test Accuracy
Fahey, M. T., Irwig, L., & Macaskill, P. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117485 · Cited by 690

Show all 38 references

Sorted by citations

Items 501–600 of 1,002

Advances in the serological diagnosis of invasive Aspergillus infections in patients with haematological disorders
Maertens, J. A., Theunissen, K., Lodewyck, T., Lagrou, K., & Eldere, J. V. (2007) · Mycoses · doi:10.1111/j.1439-0507.2007.01375.x · Cited by 78
Turbidimetric D-Dimer Test in the Diagnosis of Pulmonary Embolism: A Metaanalysis
Brown, M. D., Lau, J., Nelson, R. D., & Kline, J. A. (2003) · Clinical Chemistry · doi:10.1373/clinchem.2003.022277 · Cited by 81
Updated Systematic Review and Meta-Analysis of the Performance of Risk Prediction Rules in Children and Young People with Febrile Neutropenia
Phillips, R. S., Lehrnbecher, T., Alexander, S. W., & Sung, L. (2012) · PLoS ONE · doi:10.1371/journal.pone.0038300 · Cited by 80
Fetal and early neonatal interleukin-6 response
Chiesa, C., Pacifico, L., Natale, F., Hofer, N., Osborn, J. F., & Resch, B. (2015) · Cytokine · doi:10.1016/j.cyto.2015.03.015 · Cited by 86
Ultrasound factors to predict the outcome of external cephalic version: a meta‐analysis
Kok, M., Cnossen, J. S., Gravendeel, L., van der Post, J., & Mol, B. W. (2008) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.6277 · Cited by 80
High-Resolution Ultrasound in the Detection of Silicone Gel Breast Implant Shell Failure: Background, In Vitro Studies, and Early Clinical Results
Bengtson, B. P., & Eaves, F. F. (2012) · Aesthetic Surgery Journal · doi:10.1177/1090820x11434507 · Cited by 80
Ultrasonography, computed tomography and magnetic resonance imaging for diagnosis of ovarian carcinoma
Liu, J., Xu, Y., & Wang, J. (2007) · European Journal of Radiology · doi:10.1016/j.ejrad.2007.02.040 · Cited by 80
Systematic reviews of diagnostic tests in cancer: review of methods and reporting
Mallett, S. (2006) · BMJ · doi:10.1136/bmj.38895.467130.55 · Cited by 79
Diagnostic performance of complete lower limb venous ultrasound in patients with clinically suspected acute pulmonary embolism
Colombier, D., Victor, G., Elias, M., Arnaud, C., Juchet, H., Ducassé, J.-L., Didier, A. P., Colin, C., Rousseau, H., Nguyen, F., et al. (2003) · Thrombosis and Haemostasis · doi:10.1160/th03-05-0278 · Cited by 80
Computed tomography angiography or magnetic resonance angiography for detection of intracranial vascular malformations in patients with intracerebral haemorrhage
Josephson, C. B., White, P., Krishan, A., & Salman, R. A. (2014) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009372.pub2 · Cited by 80
Accuracy of musculoskeletal imaging for the diagnosis of polymyalgia rheumatica: systematic review
Mackie, S. L., Koduri, G., Hill, C. L., Wakefield, R. J., Hutchings, A., Loy, C. T., Dasgupta, B., & Wyatt, J. C. (2015) · RMD Open · doi:10.1136/rmdopen-2015-000100 · Cited by 82
Meta-Analysis: Identification of Low Birthweight by Other Anthropometric Measurements at Birth in Developing Countries
Goto, E. (2011) · Journal of Epidemiology · doi:10.2188/jea.je20100182 · Cited by 79
Achieving Quality in Cardiovascular Imaging II
Douglas, P. S., Chen, J., Gillam, L. D., Hendel, R. C., Hundley, W. G., Masoudi, F. A., Patel, M. R., & Peterson, E. D. (2009) · JACC. Cardiovascular imaging · doi:10.1016/j.jcmg.2008.11.012 · Cited by 79
A systematic review finds that diagnostic reviews fail to incorporate quality despite available tools
Whiting, P. F., Rutjes, A. W., Dinnes, J., Reitsma, J. B., Bossuyt, P. M., & Kleijnen, J. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.04.008 · Cited by 78
First Notification of Positive Blood Cultures and the High Accuracy of the Gram Stain Report
Søgaard, M., Nørgaard, M., & Schønheyder, H. C. (2007) · Journal of Clinical Microbiology · doi:10.1128/jcm.02523-06 · Cited by 79
The autopsy as an outcome and performance measure.
Shojania, K. G., Burton, E. C., McDonald, K. M., & Goldman, L. (2002) · PubMed Central · Cited by 78
Systematic Review of Cervical Discography as a Diagnostic Test for Chronic Spinal Pain
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/305 · Cited by 79
Evaluation of a clinical test. II: Assessment of validity
Chien, P. F. W., & Khan, K. S. (2001) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2001.00128.x · Cited by 78
Guidelines for Reporting Medical Research: A Critical Appraisal
Johansen, M., & Thomsen, S. F. (2016) · International Scholarly Research Notices · doi:10.1155/2016/1346026 · Cited by 78
Test characteristics of alpha-fetoprotein for detecting hepatocellular carcinoma in patients with hepatitis C
Gupta, S. N., Bent, S., & Kohlwes, J. (2003) · Annals of Internal Medicine · Cited by 78
Randomized, controlled clinical trials in sepsis: Has methodological quality improved over time?
Graf, J., Doig, G., Cook, D., Vincent, J., & Sibbald, W. (2002) · Critical Care Medicine · doi:10.1097/00003246-200202000-00032 · Cited by 73
Polymerase chain reaction blood tests for the diagnosis of invasive aspergillosis in immunocompromised people
Cruciani, M., Mengoli, C., Barnes, R. A., Donnelly, J. P., Loeffler, J., Jones, B. L., Klingspor, L., Maertens, J. A., Morton, C. O., & White, L. P. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009551.pub4 · Cited by 80
A systematic review identifies five “red flags” to screen for vertebral fracture in patients with low back pain
Henschke, N., Maher, C. G., & Refshauge, K. M. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.04.013 · Cited by 77
The Lachman test is the most sensitive and the pivot shift the most specific test for the diagnosis of ACL rupture
Prins, M. H. (2006) · Australian Journal of Physiotherapy · doi:10.1016/s0004-9514(06)70069-1 · Cited by 77
A systematic review of the diagnostic test accuracy of brief cognitive tests to detect amnestic mild cognitive impairment
Ozer, S., Young, J. B., Champ, C., & Burke, M. R. (2016) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4444 · Cited by 83
History, Physical Examination, Laboratory Testing, and Emergency Department Ultrasonography for the Diagnosis of Acute Cholecystitis
Jain, A., Mehta, N., Secko, M. A., Schechter, J., Papanagnou, D., Pandya, S., & Sinert, R. H. (2016) · Academic Emergency Medicine · doi:10.1111/acem.13132 · Cited by 80
STARD for Abstracts: essential items for reporting diagnostic accuracy studies in journal or conference abstracts
Cohen, J. F., Korevaar, D. A., Gatsonis, C., Glasziou, P., Hooft, L., Moher, D., Reitsma, J. B., de Vet, H. C. W., & Bossuyt, P. M. (2017) · BMJ · doi:10.1136/bmj.j3751 · Cited by 78
Should we use carbohydrate-deficient transferrin instead of gamma-glutamyltransferase for detecting problem drinkers? A systematic review and metaanalysis.
Scouller, K., Conigrave, K. M., Macaskill, P., Irwig, L., & Whitfield, J. B. (2000) · PubMed · Cited by 77
Radiologic Differentiation Between Bacterial and Viral Lower Respiratory Infection in Children: A Systematic Literature Review
Swingler, G. H. (2000) · Clinical Pediatrics · doi:10.1177/000992280003901101 · Cited by 77
Optical coherence tomography (OCT) for detection of macular oedema in patients with diabetic retinopathy
Virgili, G., Menchini, F., Murro, V., Peluso, E., Rosa, F., & Casazza, G. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008081.pub2 · Cited by 77
Catheter-directed thrombolysis (intrathrombus injection) in treatment of deep venous thrombosis: a systematic review
Alesh, I., Kayali, F., & Stein, P. D. (2007) · Catheterization and Cardiovascular Interventions · doi:10.1002/ccd.21079 · Cited by 76
Diagnostic accuracy of 18F-FDG PET or PET/CT for the characterization of adrenal masses: a systematic review and meta-analysis
Kim, S.-J., Lee, S.-W., Pak, K., Kim, I.-J., & Kim, K. (2018) · The British Journal of Radiology · doi:10.1259/bjr.20170520 · Cited by 76
Quality and Reporting of Diagnostic Accuracy Studies in TB, HIV and Malaria: Evaluation Using QUADAS and STARD Standards
Fontela, P. S., Pai, N. P., Schiller, I., Dendukuri, N., Ramsay, A., & Pai, M. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007753 · Cited by 76
Toward Complete and Accurate Reporting of Studies of Diagnostic Accuracy
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C., Glasziou, P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Academic Radiology · doi:10.1016/s1076-6332(03)80086-7 · Cited by 76
Self-citation
Evidence- and Consensus-Based Practice Guidelines for the Diagnosis of Irritable Bowel Syndrome
Fass, R., Longstreth, G. F., Pimentel, M., Fullerton, S. C., Russak, S. M., Chiou, C., Reyes, E., Crane, P. K., Eisen, G. M., McCarberg, B. H., et al. (2001) · Archives of Internal Medicine · doi:10.1001/archinte.161.17.2081 · Cited by 77
Screening for critical illness polyneuromyopathy with single nerve conduction studies
Moss, M., Yang, M. L., Macht, M., Sottile, P. D., Gray, L. S., McNulty, M. C., & Quan, D. (2014) · Intensive Care Medicine · doi:10.1007/s00134-014-3251-6 · Cited by 77
Diagnostic studies as multivariable, prediction research
Moons, K. G. M., & Grobbee, D. E. (2002) · Journal of Epidemiology & Community Health · doi:10.1136/jech.56.5.337 · Cited by 75
Diagnostic Performance of Random Urine Samples Using Albumin Concentration vs Ratio of Albumin to Creatinine for Microalbuminuria Screening in Patients With Diabetes Mellitus
Wu, H., Peng, Y., Chiang, C., Huang, J., Hung, K., Wu, K., Tu, Y., & Chien, K. (2014) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2014.1363 · Cited by 80
Study Design for Concurrent Development, Assessment, and Implementation of New Diagnostic Imaging Technology
Hunink, M. G. M., & Krestin, G. P. (2002) · Radiology · doi:10.1148/radiol.2223010335 · Cited by 75
Noninvasive Tests for Inflammatory Bowel Disease: A Meta-analysis
Holtman, G. A., van Leeuwen, Y., Reitsma, J. B., & Berger, M. Y. (2015) · PEDIATRICS · doi:10.1542/peds.2015-2126 · Cited by 75
Performance of the Aldosterone to Renin Ratio as a Screening Test for Primary Aldosteronism
Hung, A., Ahmed, S., Gupta, A., Davis, A., Kline, G. A., Leung, A. A. C., Ruzicka, M., Hiremath, S. S., & Hundemer, G. L. (2021) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/clinem/dgab348 · Cited by 76
Factors that Influence the Reported Sensitivity of Rapid Antigen Testing for SARS-CoV-2
Parvu, V., Gary, D. S., Mann, J., Lin, Y., Mills, D., Cooper, L. A., Andrews, J. C., Manabe, Y. C., Pekosz, A. S., & Cooper, C. K. (2021) · Frontiers in Microbiology · doi:10.3389/fmicb.2021.714242 · Cited by 72
Association between compliance with methodological standards of diagnostic research and reported test accuracy: meta-analysis of focused assessment of US for trauma.
Stengel, D., Bauwens, K., Rademacher, G., Mutze, S., & Ekkernkamp, A. (2005) · Radiology · doi:10.1148/radiol.2361040791 · Cited by 80
The Di PEP study: an observational study of the diagnostic accuracy of clinical assessment, D‐dimer and chest x‐ray for suspected pulmonary embolism in pregnancy and postpartum
Goodacre, S. W., Horspool, K., Nelson‐Piercy, C., Knight, M., Shephard, N., Lecky, F. E., Thomas, S., Hunt, B. J., & Fuller, G. W. (2018) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.15286 · Cited by 74
Intrapartum tests for group B streptococcus: accuracy and acceptability of screening
DANIELS, J. P., Gray, J. W., Pattison, H. M., Gray, R. G., Hills, R. K., Khan, K. S., & on behalf of the GBS Collaborative Group (2010) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2010.02725.x · Cited by 73
The management of work-related asthma guidelines: a broader perspective
Baur, X., Aasen, T., Burge, P. S., Heederik, D. J. J., Henneberger, P. K., Maestrelli, P., Schlünssen, V., Vandenplas, O., & Wilken, D. (2012) · European Respiratory Review · doi:10.1183/09059180.00004711 · Cited by 75
Adjunctive Tests for Diagnosis of Tuberculosis: Serology, ELISPOT for Site-Specific Lymphocytes, Urinary Lipoarabinomannan, String Test, and Fine Needle Aspiration
Achkar, J. M., Lawn, S. D., Moosa, M. Y. S., Wright, C. A., & Kasprowicz, V. O. (2011) · The Journal of Infectious Diseases · doi:10.1093/infdis/jir450 · Cited by 73
Accuracy of serum uric acid determination in predicting pre‐eclampsia: A systematic review
Cnossen, J. S., de Ruyter‐Hanhijärvi, H., van der Post, J., Mol, B. W., Khan, K. S., & ter Riet, G. (2006) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1080/00016340500342037 · Cited by 75
Value of history-taking in syncope patients: in whom to suspect long QT syndrome?
Colman, N., Bakker, A., Linzer, M., Reitsma, J. B., Wieling, W., & Wilde, A. A. M. (2009) · EP Europace · doi:10.1093/europace/eup101 · Cited by 73
Diagnostic Accuracy of F-18 FDG PET/CT for Preoperative Lymph Node Staging in Newly Diagnosed Bladder Cancer Patients: A Systematic Review and Meta-Analysis
Ha, H. K., Koo, P. J., & Kim, S. (2018) · Oncology · doi:10.1159/000488200 · Cited by 72
Measuring Depression in Persons With Spinal Cord Injury: A Systematic Review
Kalpakjian, C. Z., Bombardier, C. H., Schomer, K. G., Brown, P. A., & Johnson, K. L. (2009) · Journal of Spinal Cord Medicine · doi:10.1080/10790268.2009.11760748 · Cited by 72
Detecting insomnia in patients with low back pain: accuracy of four self-report sleep measures
Alsaadi, S. M., McAuley, J. H., Hush, J. M., Bartlett, D. J., Henschke, N., Grunstein, R. R., & Maher, C. G. (2013) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-14-196 · Cited by 73
The Accuracy of Transcranial Doppler in the Diagnosis of Middle Cerebral Artery Stenosis
Navarro, J. C., Lao, A. Y., Sharma, V. K., Tsivgoulis, G. K., & Alexandrov, A. V. (2007) · Cerebrovascular Diseases · doi:10.1159/000099130 · Cited by 72
A ccuracy of screening instruments for detection of neuropsychiatric syndromes in P arkinson's disease
Martínez‐Martín, P., Leentjens, A. F. G., de Pedro-Cuesta, J., Chaudhuri, К. R., Schrag, A. E., & Weintraub, D. A. (2015) · Movement Disorders · doi:10.1002/mds.26522 · Cited by 72
GenoType MTBDRplus Assay for Rapid Detection of Multidrug Resistance in Mycobacterium tuberculosis: A Meta-Analysis
Bai, Y., Wang, Y., Shao, C., Hao, Y., & Jin, Y. (2016) · PLoS ONE · doi:10.1371/journal.pone.0150321 · Cited by 72
Detection of vertebral metastases: a meta-analysis comparing MRI, CT, PET, BS and BS with SPECT
Liu, T., Wang, S., Liu, H., Meng, B., Zhou, F., He, F., Shi, X., & Yang, H. (2016) · Journal of Cancer Research and Clinical Oncology · doi:10.1007/s00432-016-2288-z · Cited by 70
Diagnostic accuracy of the appearance of Nigrosome-1 on magnetic resonance imaging in Parkinson's disease: A systematic review and meta-analysis
Chau, M. T., Todd, G., Wilcox, R., Agzarian, M., & Bezak, E. (2020) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2020.07.002 · Cited by 74
Diagnostic accuracy and added value of blood-based protein biomarkers for pancreatic cancer: a meta-analysis of aggregate and individual participant data
Boyd, L. N. C., Ali, M., Leeflang, M., Treglia, G., de Vries, R., Large, T. Y. S. L., Besselink, M. G., Giovannetti, E., van Laarhoven, H. W. M., & Geert Kazemier, M. (2022) · EClinicalMedicine · doi:10.1016/j.eclinm.2022.101747 · Cited by 70
Diagnostic accuracy of temporomandibular disorder pain tests: a multicenter study.
Visscher, C. M., Naeije, M., Laat, A. D., Michelotti, A., Nilner, M., Craane, B., Ekberg, E., Farella, M., & Lobbezoo, F. (2009) · PubMed · Cited by 71
The Effects of Study Design and Spectrum Bias on the Evaluation of Diagnostic Accuracy of Confocal Scanning Laser Ophthalmoscopy in Glaucoma
Medeiros, F. A., Ng, D., Zangwill, L. M., Sample, P. A., Bowd, C., & Weinreb, R. N. (2006) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.06-0618 · Cited by 71
A Four-Step Approach for Developing Diagnostic Tests in Psychiatry: EEG in ADHD as a Test Case
Boutros, N. N., Fraenkel, L., & Feingold, A. (2005) · Journal of Neuropsychiatry · doi:10.1176/jnp.17.4.455 · Cited by 71
Low back pain investigations and prognosis: a review
Refshauge, K. M., & Maher, C. G. (2006) · British Journal of Sports Medicine · doi:10.1136/bjsm.2004.016659 · Cited by 78
Diagnostic Test Accuracy in Childhood Pulmonary Tuberculosis: A Bayesian Latent Class Analysis
Schumacher, S. G., van Smeden, M., Dendukuri, N., Joseph, L., Nicol, M. P., Pai, M., & Zar, H. J. (2016) · American Journal of Epidemiology · doi:10.1093/aje/kww094 · Cited by 71
Systematic review and meta-analysis of middle cerebral artery Doppler to predict perinatal wellbeing
Morris, R. K., Say, R., Robson, S. C., Kleijnen, J., & Khan, K. S. (2012) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2012.07.027 · Cited by 70
Diagnostic Performance of Magnetic Resonance Imaging and Computed Tomography for Advanced Retinoblastoma
de Jong, M. C., de Graaf, P., Noij, D. P., Göricke, S. L., Maeder, P. P., Galluzzi, P., Brisse, H. J., Moll, A. C., & Castelijns, J. A. (2014) · Ophthalmology · doi:10.1016/j.ophtha.2013.11.021 · Cited by 70
Creation and Critique of Studies of Diagnostic Accuracy: Use of the STARD and QUADAS Methodological Quality Assessment Tools
Cook, C. E., Cleland, J. A., & Huijbregts, P. A. (2007) · Journal of Manual & Manipulative Therapy · doi:10.1179/106698107790819945 · Cited by 69
Heart-type fatty acid-binding protein in the early diagnosis of acute myocardial infarction: a systematic review and meta-analysis
Slot, M. H. E. B., Reitsma, J. B., Rutten, F. H., Hoes, A. W., & van der Heijden, G. J. M. G. (2010) · Heart · doi:10.1136/hrt.2010.208272 · Cited by 70
Ovarian reserve tests for predicting fertility outcomes for assisted reproductive technology: the International Systematic Collaboration of Ovarian Reserve Evaluation protocol for a systematic review of ovarian reserve test accuracy
Johnson, N., Bagrie, E., Coomarasamy, A., Bhattacharya, S., Shelling, A. N., Jessop, S., Farquhar, C. M., & Khan, K. S. (2006) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2006.01068.x · Cited by 70
Should We Use Carbohydrate-deficient Transferrin instead of γ-Glutamyltransferase for Detecting Problem Drinkers? A Systematic Review and Metaanalysis
Scouller, K., Conigrave, K. M., Macaskill, P., Irwig, L., & Whitfield, J. B. (2000) · Clinical Chemistry · doi:10.1093/clinchem/46.12.1894 · Cited by 70
Current clinical selection strategies for identification of hereditary non‐polyposis colorectal cancer families are inadequate: a meta‐analysis
Kievit, W., de Bruin, J. H. F. M., Adang, E., Ligtenberg, M., Nagengast, F. M., Krieken, J. V., & Hoogerbrugge, N. (2004) · Clinical Genetics · doi:10.1111/j.1399-0004.2004.00220.x · Cited by 70
How accurate are maternal symptoms in predicting impending complications in women with preeclampsia? A systematic review and meta-analysis
Thangaratinam, S., Gallos, I. D., MEAH, N., USMAN, S., ISMAIL, K. M. K., Khan, K. S., & FOR TIPPS (TESTS IN PREDICTION OF PRE-ECLAMPSIA'S SEVERITY) REVIEW GROUP (2011) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1111/j.1600-0412.2011.01111.x · Cited by 69
Faecal Calprotectin in Suspected Paediatric Inflammatory Bowel Disease
Degraeuwe, P. L. J., Beld, M. P. A., Ashorn, M. H., Canani, R. B., Day, A. S., Diamanti, A., Fagerberg, U. L., Henderson, P., Kolho, K., de Vijver, E. V., et al. (2014) · Journal of Pediatric Gastroenterology and Nutrition · doi:10.1097/mpg.0000000000000615 · Cited by 69
Effect of Spectrum Bias on the Diagnostic Accuracy of Spectral-Domain Optical Coherence Tomography in Glaucoma
Rao, H. L., Kumbar, T., Addepalli, U. K., Bharti, N., Senthil, S., Choudhari, N. S., & Garudadri, C. S. (2012) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.11-8463 · Cited by 69
Diagnostic accuracy of methods for the detection of BRCA1 and BRCA2 mutations: a systematic review
Gerhardus, A., Schleberger, H., Schlegelberger, B., & Gadzicki, D. (2007) · European Journal of Human Genetics · doi:10.1038/sj.ejhg.5201806 · Cited by 68
Accuracy of B-Type Natriuretic Peptide Tests to Exclude Congestive Heart Failure
Battaglia, M., Pewsner, D., Jüni, P., Egger, M., Bucher, H. C., & Bachmann, L. M. (2006) · Archives of Internal Medicine · doi:10.1001/archinte.166.10.1073 · Cited by 68
Derivation of a Clinical Decision Guide in the Diagnosis of Cervical Facet Joint Pain
Schneider, G. M., Jull, G. A., Thomas, K. C., Smith, A. D., Emery, C. A., Faris, P., Cook, C. E., Frizzell, B., & SALO, P. T. (2014) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2014.02.026 · Cited by 68
Effect of Disease Severity and Optic Disc Size on Diagnostic Accuracy of RTVue Spectral Domain Optical Coherence Tomograph in Glaucoma
Rao, H. L., Leite, M. T., Weinreb, R. N., Zangwill, L. M., de Alencar, L. M., Sample, P. A., & Medeiros, F. A. (2010) · Investigative Ophthalmology & Visual Science · doi:10.1167/iovs.10-5546 · Cited by 68
The value of clinical features in the diagnosis of acute pulmonary embolism: systematic review and meta-analysis
West, J., Goodacre, S. W., & Sampson, F. C. (2007) · QJM · doi:10.1093/qjmed/hcm113 · Cited by 68
News from the International Committee of Medical Journal Editors
Davidoff, F. F. (2000) · Annals of Internal Medicine · doi:10.7326/0003-4819-133-3-200008010-00017 · Cited by 68
An evaluation of the osmole gap as a screening test for toxic alcohol poisoning
Lynd, L. D., Richardson, K., Purssell, R. A., Abu‐Laban, R. B., Brubacher, J. R., Lepik, K. J., & Sivilotti, M. L. A. (2008) · BMC Emergency Medicine · doi:10.1186/1471-227x-8-5 · Cited by 67
An Update of the Systematic Appraisal of the Accuracy and Utility of Lumbar Discography in Chronic Low Back Pain
Manchikanti, L. (2013) · Pain Physician · doi:10.36076/ppj.2013/16/se55 · Cited by 66
Diagnostic accuracy of interleukin 27 for tuberculous pleural effusion: two prospective studies and one meta-analysis
Wang, W., Zhou, Q., Zhai, K., Wang, Y., Liu, J.-Y., Wang, X., Wang, Z., Zhang, J., Tong, Z.-H., & Shi, H. (2017) · Thorax · doi:10.1136/thoraxjnl-2016-209718 · Cited by 66
Reproducibility of the STARD checklist: an instrument to assess the quality of reporting of diagnostic accuracy studies
Smidt, N., Rutjes, A. W., van der Windt, D., Ostelo, R., Bossuyt, P. M., Reitsma, J. B., Bouter, L. M., & de Vet, H. C. W. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-12 · Cited by 66
Overinterpretation of Clinical Applicability in Molecular Diagnostic Research
Lumbreras, B., Parker, L. A., Porta, M., Pollán, M., Ioannidis, J. P. A., & Hernández-Aguado, I. (2009) · Clinical Chemistry · doi:10.1373/clinchem.2008.121517 · Cited by 65
Markers for the non-invasive diagnosis of mesothelioma: a systematic review
van der Bij, S., Schaake, E. E., Koffijberg, H., Burgers, J. A., de Mol, B. A. J. M., & Moons, K. G. M. (2011) · British Journal of Cancer · doi:10.1038/bjc.2011.104 · Cited by 64
Clinical Performance of Two Fluorescence-Based Methods in Detecting Occlusal Caries Lesions in Primary Teeth
Matos, R., Novaes, T. F., Braga, M. M., Siqueira, W. L., Duarte, D. A., & Mendes, F. M. (2011) · Caries Research · doi:10.1159/000328673 · Cited by 65
Screening injured children for physical abuse or neglect in emergency departments: a systematic review
Woodman, J., Lecky, F. E., Hodes, D., Pitt, M., Taylor, B., & Gilbert, R. E. (2009) · Child Care Health and Development · doi:10.1111/j.1365-2214.2009.01025.x · Cited by 65
Systematic reviews in laboratory medicine: principles, processes and practical considerations
Horvath, A. R., & Pewsner, D. (2004) · Clinica Chimica Acta · doi:10.1016/j.cccn.2003.12.015 · Cited by 69
Quality of Reporting of Diagnostic Accuracy Studies: No Change Since STARD Statement Publication—Before-and-after Study
Wilczynski, N. L. (2008) · Radiology · doi:10.1148/radiol.2483072067 · Cited by 65
Diagnostic value of fine needle aspiration BRAFV600E mutation analysis in papillary thyroid cancer: a systematic review and meta-analysis
Fnais, N., Soobiah, C., Al-Qahtani, K. H., Hamid, J. S., Perrier, L., Straus, S. E., & Tricco, A. C. (2015) · Human Pathology · doi:10.1016/j.humpath.2015.06.001 · Cited by 64
Diagnostic performance of myocardial perfusion imaging with conventional and CZT single-photon emission computed tomography in detecting coronary artery disease: A meta-analysis
Cantoni, V., Green, R., Acampa, W., Zampella, E., Assante, R., Nappi, C., Gaudieri, V., Mannarino, T., Cuocolo, R., Vaia, E. D., et al. (2019) · Journal of Nuclear Cardiology · doi:10.1007/s12350-019-01747-3 · Cited by 70
Early-Onset Neonatal Sepsis
Chiesa, C., Pacifico, L., Osborn, J. F., Bonci, E., Hofer, N., & Resch, B. (2015) · Medicine · doi:10.1097/md.0000000000001230 · Cited by 64
On the Science of Rorschach Research
Meyer, G. J. (2000) · Journal of Personality Assessment · doi:10.1207/s15327752jpa7501_6 · Cited by 64
Biomarkers for diagnosis of childhood tuberculosis: A systematic review
Togun, T. O., MacLean, E. L.-H., Kampmann, B., & Pai, M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0204029 · Cited by 66
Development and Validation of the Balance Outcome Measure for Elder Rehabilitation
Haines, T. P., Kuys, S. S., Morrison, G., Clarke, J., Bew, P. G., & McPhail, S. (2007) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2007.09.012 · Cited by 63
Clinical Assessment of Ankle Joint Dorsiflexion
Gatt, A., & Chockalingam, N. (2011) · Journal of the American Podiatric Medical Association · doi:10.7547/1010059 · Cited by 63
Accuracy and reliability of physical signs in the diagnosis of pleural effusion
Kalantri, S., Joshi, R. P., Lokhande, T., Singh, A., Morgan, M. E., Colford, J. M., & Pai, M. (2006) · Respiratory Medicine · doi:10.1016/j.rmed.2006.07.014 · Cited by 63
Diagnostic accuracy of F-18 FDG PET or PET/CT for detection of lymph node metastasis in clinically node negative head and neck cancer patients; A systematic review and meta-analysis
Kim, S., Pak, K., & Kim, K. (2018) · American Journal of Otolaryngology · doi:10.1016/j.amjoto.2018.10.013 · Cited by 64
Usefulness of peripapillary nerve fiber layer thickness assessed by optical coherence tomography as a biomarker for Alzheimer’s disease
Sánchez, D., Castilla-Marti, M., Rodríguez‐Gómez, O., Valero, S., Piferrer, A., Martínez, G., Martínez, J., Serra, J., Moreno–Grau, S., Hernández‐Olasagarre, B., et al. (2018) · Scientific Reports · doi:10.1038/s41598-018-34577-3 · Cited by 64
Systematic Review on the Management of Chronic Constipation in North America
Brandt, L. J., Prather, C. M., Quigley, E. M. M., Schiller, L. R., Schoenfeld, P., & Talley, N. J. (2005) · The American Journal of Gastroenterology · doi:10.14309/00000434-200507001-00002 · Cited by 63

Authors: Lijmer, J. G.
Affiliations: Amsterdam UMC Location University of Amsterdam (NL)
Corresponding author: Lijmer, Jeroen G.
ORCID: Lijmer, Jeroen G.
Venue: JAMA
Publisher: American Medical Association (AMA)
Published: 1999-09-15
Volume: 282
Issue: 11
Pages: 1061
ISSN: 0002-9955 (ISSN-L)
0098-7484
DOI: 10.1001/jama.282.11.1061
OpenAlex: W1971348077
Cited by: 1,861
References: 38
Citations by year: 2026: 56 · 2025: 38 · 2024: 38 · 2023: 45 · 2022: 45 · 2021: 48 · 2020: 74 · 2019: 50 · 2018: 73 · 2017: 66 · 2016: 79 · 2015: 82 · 2014: 73 · 2013: 78 · 2012: 79
FWCI: 92.03
Type: journal article
Language: en
Open access: closed
Locations: JAMA (publishedVersion)
PubMed (publishedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Pure Amsterdam UMC (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
Keywords: diagnostic accuracy, study design bias, methodological quality, diagnostic odds ratio, reference materials
MeSH terms: Diagnostic Tests, Routine, Evaluation Studies as Topic, Quality Control, Reference Standards, Regression Analysis, Research Design, Sensitivity and Specificity, Bias, Odds Ratio

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Empirical evidence of design-related bias in studies of diagnostic tests.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks