Cited by 1,861Meta-analysis and systematic reviewsStatistical Methods in EpidemiologyClinical Reasoning and Diagnostic Skills

The DOI matches its Crossref record; 38 of the 38 references it cites were found in a registry or an index.

Empirical evidence of design-related bias in studies of diagnostic tests.

Lijmer, Jeroen G.·1999·JAMA

DOI 10.1001/jama.282.11.1061

Open this paper in CoChat — free account

Abstract

CONTEXT: The literature contains a large number of potential biases in the evaluation of diagnostic tests. Strict application of appropriate methodological criteria would invalidate the clinical application of most study results. OBJECTIVE: To empirically determine the quantitative effect of study design shortcomings on estimates of diagnostic accuracy. DESIGN AND SETTING: Observational study of the methodological features of 184 original studies evaluating 218 diagnostic tests. Meta-analyses on diagnostic tests were identified through a systematic search of the literature using MEDLINE, EMBASE, and DARE databases and the Cochrane Library (1996-1997). Associations between study characteristics and estimates of diagnostic accuracy were evaluated with a regression model. MAIN OUTCOME MEASURES: Relative diagnostic odds ratio (RDOR), which compared the diagnostic odds ratios of studies of a given test that lacked a particular methodological feature with those without the corresponding shortcomings in design. RESULTS: Fifteen (6.8%) of 218 evaluations met all 8 criteria; 64 (30%) met 6 or more. Studies evaluating tests in a diseased population and a separate control group overestimated the diagnostic performance compared with studies that used a clinical population (RDOR, 3.0; 95% confidence interval [CI], 2.0-4.5). Studies in which different reference tests were used for positive and negative results of the test under study overestimated the diagnostic performance compared with studies using a single reference test for all patients (RDOR, 2.2; 95% CI, 1.5-3.3). Diagnostic performance was also overestimated when the reference test was interpreted with knowledge of the test result (RDOR, 1.3; 95% CI, 1.0-1.9), when no criteria for the test were described (RDOR, 1.7; 95% CI, 1.1-2.5), and when no description of the population under study was provided (RDOR, 1.4; 95% CI, 1.1-1.7). CONCLUSION: These data provide empirical evidence that diagnostic studies with methodological shortcomings may overestimate the accuracy of a diagnostic test, particularly those including nonrepresentative patients or applying different reference standards.

Integrity signals

Registry

Crossref · 10.1001/jama.282.11.1061

Cites

38 of 38 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Untitled work
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Users' Guides to the Medical Literature
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.271.9.703 · Cited by 2,688
Problems of Spectrum and Bias in Evaluating the Efficacy of Diagnostic Tests
Ransohoff, D. F., & Feinstein, A. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197810262991705 · Cited by 1,739
Combining independent studies of a diagnostic test into a summary roc curve: Data‐analytic approaches and some additional considerations
Moses, L. E., Shapiro, D. E., & Littenberg, B. (1993) · Statistics in Medicine · doi:10.1002/sim.4780121403 · Cited by 1,405
Users' Guides to the Medical Literature
Jaeschke, R. (1994) · JAMA · doi:10.1001/jama.271.5.389 · Cited by 1,174
THE ESTIMATION AND SIGNIFICANCE OF THE LOGARITHM OF A RATIO OF FREQUENCIES
HALDANE, B. J. B. S. (1956) · Annals of Human Genetics · doi:10.1111/j.1469-1809.1955.tb01285.x · Cited by 1,083
Selection and interpretation of diagnostic tests and procedures. Principles and applications.
Griner, P. F., Mayewski, R. J., Mushlin, A. I., & Greenland, P. (1981) · PubMed · Cited by 765
Use of Methodological Standards in Diagnostic Test Research
Reid, M. C. (1995) · JAMA · doi:10.1001/jama.274.8.645 · Cited by 710
Assessment of diagnostic tests when disease verification is subject to selection bias
Begg, C. B., & Greenes, R. A. (1983) · Biometrics · doi:10.2307/2530820 · Cited by 708
Meta-analysis of Pap Test Accuracy
Fahey, M. T., Irwig, L., & Macaskill, P. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117485 · Cited by 690

Show all 38 references

Sorted by citations

Items 701–800 of 1,002

Lesion type and reader experience affect the diagnostic accuracy of breast MRI: A multiple reader ROC study
Baltzer, P., Kaiser, W. A., & Dietzel, M. (2014) · European Journal of Radiology · doi:10.1016/j.ejrad.2014.10.023 · Cited by 48
Shortcomings in the Current Amyotrophic Lateral Sclerosis Trials and Potential Solutions for Improvement
Katyal, N., & Govindarajan, R. (2017) · Frontiers in Neurology · doi:10.3389/fneur.2017.00521 · Cited by 49
Sensitivity and complications of thoracentesis and thoracoscopy: a meta-analysis
Martinez-Zayas, G., Molina, S., & Ost, D. E. (2022) · European Respiratory Review · doi:10.1183/16000617.0053-2022 · Cited by 53
Diagnostic Accuracy of Molecular Amplification Tests for Human African Trypanosomiasis—Systematic Review
Mugasa, C. M., Adams, E. R., Boer, K. R., Dyserinck, H., Büscher, P., Schallig, H. D. F. H., & Leeflang, M. (2012) · PLoS neglected tropical diseases · doi:10.1371/journal.pntd.0001438 · Cited by 47
Risk score to stratify children with suspected serious bacterial infection: observational cohort study
Brent, A., Lakhanpaul, M., Thompson, M. J., Collier, J., Ray, S., Ninis, N., Levin, M., & MacFaul, R. (2011) · Archives of Disease in Childhood · doi:10.1136/adc.2010.183111 · Cited by 49
The Clinical Value of 3‐Dimensional Saline Infusion Sonography in Addition to 2‐Dimensional Saline Infusion Sonography in Women With Abnormal Uterine Bleeding
de Kroon, C. D., Louwe, L. A., Trimbos, J. B. M. Z., & Jansen, F. W. (2004) · Journal of Ultrasound in Medicine · doi:10.7863/jum.2004.23.11.1433 · Cited by 47
Resting-state EEG for the diagnosis of idiopathic epilepsy and psychogenic nonepileptic seizures: A systematic review
Faiman, I., Smith, S. D. W., Hodsoll, J. P., Young, A. H., & Shotbolt, P. (2021) · Epilepsy & Behavior · doi:10.1016/j.yebeh.2021.108047 · Cited by 48
An Update of the Appraisal of the Accuracy and Utility of Cervical Discography in Chronic Neck Pain
Onyewu, O. (2012) · Pain Physician · doi:10.36076/ppj.2012/15/e777 · Cited by 45
A review of medical records and discharge summary data found moderate to high predictive values of discharge diagnoses of venous thromboembolism during pregnancy and postpartum
Larsen, T. B., Johnsen, S. P., Møller, C. I., Larsen, H., & Sørensen, H. T. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.07.004 · Cited by 47
The accuracy of maternal anthropometry measurements as predictor for spontaneous preterm birth—a systematic review
Honest, H., Bachmann, L. M., Ngai, C. S. W., Gupta, J. K., Kleijnen, J., & Khan, K. S. (2004) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2004.07.041 · Cited by 47
History and Physical Examination Plus Laboratory Testing for the Diagnosis of Adult Female Urinary Tract Infection
Meister, L., Morley, E. J., Scheer, D., & Sinert, R. H. (2013) · Academic Emergency Medicine · doi:10.1111/acem.12171 · Cited by 51
Accuracy of liver function tests for predicting adverse maternal and fetal outcomes in women with preeclampsia: a systematic review
Thangaratinam, S., Koopmans, C. M., Iyengar, S., Zamora, J., ISMAIL, K. M. K., Mol, B. W., Khan, K. S., & FOR TIPPS (TESTS IN PREDICTION OF PREECLAMPSIA'S SEVERITY) REVIEW GROUP (2011) · Acta Obstetricia Et Gynecologica Scandinavica · doi:10.1111/j.1600-0412.2011.01112.x · Cited by 47
Assessing risk of bias and applicability
Reitsma, J. B., Rutjes, A. W., Whiting, P. F., Yang, B., Leeflang, M., Bossuyt, P. M., & Deeks, J. J. (2023) · Wiley eBooks · doi:10.1002/9781119756194.ch8 · Cited by 50
The pain provocation-based straight leg raise test for diagnosis of lumbar disc herniation, lumbar radiculopathy, and/or sciatica: A systematic review of clinical utility
Scaia, V., Baxter, D. G., & Cook, C. E. (2012) · Journal of Back and Musculoskeletal Rehabilitation · doi:10.3233/bmr-2012-0339 · Cited by 46
Performance of the Osteoporosis Self-Assessment Tool in ruling out low bone mineral density in postmenopausal women: a systematic review
Rud, B., Hilden, J., Hyldstrup, L., & Hróbjartsson, A. (2007) · Osteoporosis International · doi:10.1007/s00198-006-0319-3 · Cited by 46
Diagnostic utility of patient history and physical examination data to detect spondylolysis and spondylolisthesis in athletes with low back pain: A systematic review
Grødahl, L. H. J., Fawcett, L., Nazareth, M., Smith, R. A., Spencer, S., Heneghan, N. R., & Rushton, A. (2016) · Manual Therapy · doi:10.1016/j.math.2016.03.011 · Cited by 46
The Di PEP (Diagnosis of PE in Pregnancy) biomarker study: An observational cohort study augmented with additional cases to determine the diagnostic utility of biomarkers for suspected venous thromboembolism during pregnancy and puerperium
Hunt, B. J., Parmar, K., Horspool, K., Shephard, N., Nelson‐Piercy, C., & Goodacre, S. W. (2018) · British Journal of Haematology · doi:10.1111/bjh.15102 · Cited by 46
Extracellular MicroRNAs as Intercellular Mediators and Noninvasive Biomarkers of Cancer
Ortíz-Quintero, B. (2020) · Cancers · doi:10.3390/cancers12113455 · Cited by 48
Systems to Rate the Strength of Scientific Evidence: Summary
West, S. L., King, V., Carey, T., Lohr, K. N., Mckoy, N. A., Sutton, S. F., & Lux, L. J. (2002) · Cited by 46
Physicians??? ability to diagnose sepsis in newborns and critically ill children
Fischer, J. E. (2005) · Pediatric Critical Care Medicine · doi:10.1097/01.pcc.0000161583.34305.a0 · Cited by 46
Is High Resolution Melting Analysis (HRMA) Accurate for Detection of Human Disease-Associated Mutations? A Meta Analysis
Li, B.-S., Wang, X., Ma, F., Jiang, B., Song, X., & Xu, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028078 · Cited by 45
Criteria for evaluation of measurement properties of clinical balance measures for use in fall prevention studies
Moe‐Nilssen, R., Nordin, E., & Lundin‐Olsson, L. (2007) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2007.00839.x · Cited by 46
Polymerase chain reaction blood tests for the diagnosis of invasive aspergillosis in immunocompromised people
Cruciani, M., Mengoli, C., Loeffler, J., Donnelly, P., Barnes, R. A., Jones, B., Klingspor, L., Morton, C. O., & Maertens, J. A. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009551.pub2 · Cited by 46
Empirical evidence of the impact of study characteristics on the performance of prediction models: a meta-epidemiological study
Damen, J. A., Debray, T. P. A., Pajouheshnia, R., Reitsma, J. B., Scholten, R. J. P. M., Moons, K. G. M., & Hooft, L. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026160 · Cited by 46
Meta‐analysis of diagnostic test data: A bivariate Bayesian modeling approach
Verde, P. E. (2010) · Statistics in Medicine · doi:10.1002/sim.4055 · Cited by 45
The value of medical history taking as risk indicator for tuboperitoneal pathology: a systematic review
Luttjeboer, F., Verhoeve, H. R., van Dessel, H. J. H. M., van der Veen, F., Mol, B. W., & Coppus, S. F. P. J. (2009) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2008.02070.x · Cited by 45
Diagnosis of Subclinical Keratoconus Using Posterior Elevation Measured With 2 Different Methods
de Sanctis, U., Aragno, V., Dalmasso, P., Brusasco, L., & Grignolo, F. M. (2013) · Cornea · doi:10.1097/ico.0b013e3182854774 · Cited by 45
The validity and accuracy of clinical tests used to detect labral pathology of the shoulder – A systematic review
Munro, W., & Healy, R. (2008) · Manual Therapy · doi:10.1016/j.math.2008.08.008 · Cited by 45
Musculoskeletal Causes of Chronic Pelvic Pain: A Systematic Review of Diagnosis: Part I*
Tu, F. F., As‐Sanie, S., & Steege, J. F. (2005) · Obstetrical & Gynecological Survey · doi:10.1097/01.ogx.0000167831.83619.9f · Cited by 46
Accuracy of clinical tests in the diagnosis of anterior cruciate ligament injury: a systematic review
Swain, M. S., Henschke, N., Kamper, S. J., Downie, A., Koes, B. W., & Maher, C. G. (2014) · Chiropractic & Manual Therapies · doi:10.1186/s12998-014-0025-8 · Cited by 48
Decision making about healthcare-related tests and diagnostic test strategies. Paper 2: a review of methodological and practical challenges
Mustafa, R. A., Wiercioch, W., Cheung, A., Prediger, B., Brożek, J., Bossuyt, P. M., Garg, A. X., Lelgemann, M., Bühler, D., & Schünemann, H. J. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.09.003 · Cited by 49
The diagnostic accuracy of bleeding assessment tools for the identification of patients with mild bleeding disorders: A systematic review
Heubel-Moenen, F. C. J. I., Nelemans, P. J., Schols, S. E. M., Schouten, H. C., Henskens, Y., & Beckers, E. A. M. (2018) · Haemophilia · doi:10.1111/hae.13486 · Cited by 45
Cautionary tales in the clinical interpretation of studies of diagnostic tests
Scott, I. A., Greenberg, P. B., & Poole, P. J. (2007) · Internal Medicine Journal · doi:10.1111/j.1445-5994.2007.01436.x · Cited by 45
Tubal evaluation in the investigation of subfertility: A structured comparison of tests
Papaioannou, S., Bourdrez, P., Varma, R., Afnan, M., Mol, B. W., & Coomarasamy, A. (2004) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2004.00403.x · Cited by 45
Diagnostic accuracy of the Cepheid Xpert Xpress and the Abbott ID NOW assay for rapid detection of SARS‐CoV‐2: A systematic review and meta‐analysis
Lee, J. H., & Song, J. (2021) · Journal of Medical Virology · doi:10.1002/jmv.26994 · Cited by 44
Development and Replication of Objective Measurements of Social Visual Engagement to Aid in Early Diagnosis and Assessment of Autism
JONES, W. R., Klaiman, C., Richardson, S. S., Lambha, M., Reid, M., Hamner, T., Beacham, C., Lewis, P., Paredes, J., Edwards, L. A., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.30145 · Cited by 49
New Prognostic Markers for Outcome of Acute Pancreatitis
Sigounas, D., Tatsioni, A., Christodoulou, D. K., Tsianos, E. V., & Ioannidis, J. P. A. (2011) · Pancreas · doi:10.1097/mpa.0b013e31820bf8ac · Cited by 44
Evaluation of macular thickness and volume tested by optical coherence tomography as biomarkers for Alzheimer’s disease in a memory clinic
Sánchez, D., Castilla-Marti, M., Marquié, M., Valero, S., Moreno–Grau, S., Rodríguez‐Gómez, O., Piferrer, A., Martínez, G., Martínez, J., de Rojas, I., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-58399-4 · Cited by 45
Kinetic gait analysis in healthy dogs and dogs with osteoarthritis: An evaluation of precision and overlap performance of a pressure-sensitive walkway and the use of symmetry indices
Nielsen, M. B. M., Pedersen, T. R., Mouritzen, A., Vitger, A. D., Nielsen, L. N., Poulsen, H. H., & Miles, J. E. (2020) · PLoS ONE · doi:10.1371/journal.pone.0243819 · Cited by 44
The Evidence Based Medicine approach to diagnostic testing: practicalities and limitations.
Hawkins, R. C. (2005) · Europe PMC (PubMed Central) · Cited by 44
Role of interferon-gamma release assays in the diagnosis of pulmonary tuberculosis in patients with advanced HIV infection
Cattamanchi, A., Ssewenyana, I., Davis, J. L., Huang, L., Worodria, W. O., den Boon, S., Yoo, S., Andama, A. O., Hopewell, P. C., & Cao, H. (2010) · BMC Infectious Diseases · doi:10.1186/1471-2334-10-75 · Cited by 43
Daily spinal mechanical loading as a risk factor for acute non-specific low back pain: a case–control study using the 24-Hour Schedule
Bakker, E. W. P., Verhagen, A. P., Lucas, C., Koning, H. J. C. M. F., de Haan, R. J., & Koes, B. W. (2006) · European Spine Journal · doi:10.1007/s00586-006-0111-2 · Cited by 43
Evaluating Diagnostic Accuracy in the Face of Multiple Reference Standards
Naaktgeboren, C. A., de Groot, J. A. H., van Smeden, M., Moons, K. G. M., & Reitsma, J. B. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-159-3-201308060-00009 · Cited by 42
Clinical Relevance of Studies on the Accuracy of Visual Inspection for Detecting Caries Lesions: A Systematic Review
Gimenez, T., Piovesan, C., Braga, M. M., Raggio, D. P., Deery, C., Ricketts, D. N. J., Ekstrand, K., & Mendes, F. M. (2015) · Caries Research · doi:10.1159/000365948 · Cited by 43
Prediction of low birthweight and small for gestational age from symphysis-fundal height mainly in developing countries: a meta-analysis
Goto, E. (2013) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2012-202141 · Cited by 43
Circulating Lipids Are Associated with Alcoholic Liver Cirrhosis and Represent Potential Biomarkers for Risk Assessment
Meikle, P. J., Mundra, P. A., Wong, G., Rahman, K., Huynh, K., Barlow, C. K., Duly, A. M. P., Haber, P., Whitfield, J. B., & Seth, D. (2015) · PLoS ONE · doi:10.1371/journal.pone.0130346 · Cited by 43
18F PET with florbetaben for the early diagnosis of Alzheimer's disease dementia and other dementias in people with mild cognitive impairment (MCI)
Martínez, G., Vernooij, R. W. M., Padilla, P. F., Zamora, J., Flicker, L. A., & Bonfill, X. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012883 · Cited by 44
Shear wave elastography for liver fibrosis in chronic hepatitis B: Adapting the cut-offs to alanine aminotransferase levels improves accuracy
Zeng, J., Zheng, J., Jin, J., Mao, Y., Guo, H.-Y., Lu, M., Zheng, H., & Zheng, R. (2018) · European Radiology · doi:10.1007/s00330-018-5621-x · Cited by 43
Evaluating Noninvasive Markers to Identify Advanced Fibrosis by Liver Biopsy in HBV/HIV Co‐infected Adults
Sterling, R. K., King, W. C., Wahed, A. S., Kleiner, D. E., Khalili, M., Sulkowski, M., Chung, R. T., Jain, M. K., Lisker‐Melman, M., Wong, D., et al. (2019) · Hepatology · doi:10.1002/hep.30825 · Cited by 43
Exfoliative cytology as a diagnostic test for basal cell carcinoma: a meta-analysis
Bakis, S., Irwig, L., Wood, G., & Wong, D. (2004) · British Journal of Dermatology · doi:10.1111/j.1365-2133.2004.05716.x · Cited by 43
Test–retest and inter-rater reliability for the Comprehensive Developmental Inventory for Infants and Toddlers diagnostic and screening tests
Liao, H., & Pan, Y.-L. (2005) · Early Human Development · doi:10.1016/j.earlhumdev.2005.07.008 · Cited by 43
Accuracy of magnetic resonance imaging of inguinofemoral lymph nodes in vulval cancer
Singh, K., Orakwue, C. F., Honest, H., Balogun, M., López, C., & Luesley, D. M. (2006) · International Journal of Gynecological Cancer · doi:10.1111/j.1525-1438.2006.00456.x · Cited by 43
Testing a test
Powers, W. J. (2000) · Neurology · doi:10.1212/wnl.54.8.1549 · Cited by 43
General Introduction: Evaluation of Diagnostic Procedures
Knottnerus, J. A., Buntinx, F., & van Weel, C. (2008) · doi:10.1002/9781444300574.ch1 · Cited by 43
Testing adults by questionnaire for social and communication disorders, including autism spectrum disorders, in an adult mental health service population
Brugha, T., Tyrer, F., Leaver, A., Lewis, S., Seaton, S., Morgan, Z., Tromans, S., & van Rensburg, K. (2020) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1814 · Cited by 42
Validity of the Thessaly Test in Evaluating Meniscal Tears Compared With Arthroscopy: A Diagnostic Accuracy Study
Goossens, P., Keijsers, E., van Geenen, R. C. I., Zijta, A., van den Broek, M., Verhagen, A. P., & Scholten-Peeters, G. G. M. (2014) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2015.5215 · Cited by 42
Newborn screening for Tyrosinemia type 1 using succinylacetone – a systematic review of test accuracy
Stinton, C., Geppert, J., Freeman, K., Clarke, A., Johnson, S. A., Fraser, H., Sutcliffe, P. A., & Taylor‐Phillips, S. (2017) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-017-0599-z · Cited by 46
Tuberculosis diagnostics trials: do they lack methodological rigor?
Pai, M., & O’Brien, R. (2006) · Expert Review of Molecular Diagnostics · doi:10.1586/14737159.6.4.509 · Cited by 42
Accuracy of UK Rapid Test Consortium (UK-RTC) “AbC-19 Rapid Test” for detection of previous SARS-CoV-2 infection in key workers: test accuracy study
Mulchandani, R., Jones, H. E., Taylor‐Phillips, S., Shute, J., Perry, K. R., Jamarani, S., Brooks, T. J. G., Charlett, A., Hickman, M., Oliver, I., et al. (2020) · BMJ · doi:10.1136/bmj.m4262 · Cited by 38
Evaluation of interferon-gamma release assays for the diagnosis of tuberculosis: an updated meta-analysis
Dai, Y., Feng, Y. Y., Xu, R., Xu, W., Lü, W., & Wang, J. (2012) · European Journal of Clinical Microbiology & Infectious Diseases · doi:10.1007/s10096-012-1674-y · Cited by 41
How Useful Is the IQCODE for Discriminating between Alzheimer’s Disease, Mild Cognitive Impairment and Subjective Memory Complaints?
Sikkes, S. A. M., van den Berg, M. T., Knol, D. L., Klerk, E. S. M. D. L., Scheltens, P., Uitdehaag, B. M. J., Klein, M., & Pijnenburg, Y. A. L. (2010) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000321697 · Cited by 42
Antibiotic use for presumed neonatally acquired infections far exceeds that for central line-associated blood stream infections: an exploratory critique
Wirtschafter, D. D., Padilla, G., Suh, O., Wan, K., Trupp, D., & Fayard, E. E. (2011) · Journal of Perinatology · doi:10.1038/jp.2011.39 · Cited by 41
Diagnostic accuracy of sTREM-1 to identify infection in critically ill patients with systemic inflammatory response syndrome
Latour-Pérez, J., Alcalá-López, A., García-García, M. Á., Sánchez-Hernández, J. F., Abad‐Terrado, C., Viedma-Contreras, J. A., Masiá, M., Tejera, M. G., Arizo-León, D., Porcar, M. J. B., et al. (2010) · Clinical Biochemistry · doi:10.1016/j.clinbiochem.2010.03.001 · Cited by 41
Signs and symptoms in adult patients with acute dyspnea: a systematic review and meta-analysis
Renier, W., Winckelmann, K. H.-V., Verbakel, J. Y. J., Aertgeerts, B., & Buntinx, F. (2017) · European Journal of Emergency Medicine · doi:10.1097/mej.0000000000000429 · Cited by 41
Comparing the Diagnostic Accuracies of F-18 Fluorodeoxyglucose Positron Emission Tomography and Magnetic Resonance Imaging for the Detection of Spondylodiscitis
Kim, S., Pak, K., Kim, K., & Lee, J. S. (2018) · Spine · doi:10.1097/brs.0000000000002861 · Cited by 44
Diagnostic value of lung ultrasound for neonatal respiratory distress syndrome: a meta-analysis and systematic review
Ma, H., Yan, W., & Liu, J. (2020) · Medical Ultrasonography · doi:10.11152/mu-2485 · Cited by 43
Confirmatory Testing for Primary Aldosteronism
Leung, A. A. C., Padwal, R. S., Hundemer, G. L., Venos, E., Campbell, D. J. T., Holmes, D. T., Orton, D. J., So, B., Przybojewski, S. J., Caughlin, C. E., et al. (2025) · Annals of Internal Medicine · doi:10.7326/annals-24-03153 · Cited by 40
Accuracy of Magnetic Resonance Imaging in Grading Knee Chondral Defects
Zhang, M., Min, Z., Rana, N., & Liu, H. (2012) · Arthroscopy The Journal of Arthroscopic and Related Surgery · doi:10.1016/j.arthro.2012.04.138 · Cited by 40
A simple plaster for screening for diabetic neuropathy: A diagnostic test accuracy systematic review and meta-analysis
Τσάπας, Α., Liakos, A., Paschos, P., Karagiannis, T., Bekiari, E., Tentolouris, N., & Boura, P. (2013) · Metabolism · doi:10.1016/j.metabol.2013.11.019 · Cited by 40
The clinical value of a cluster of patient history and observational findings as a diagnostic support tool for lumbar spine stenosis
Cook, C. E., Brown, C. R., Michael, K., Isaacs, R. E., Howes, C. R., Richardson, W. J., Roman, M., & Hegedus, E. J. (2010) · Physiotherapy Research International · doi:10.1002/pri.500 · Cited by 40
The Dangers of False-Positive and False-Negative Test Results: False-Positive Results as a Function of Pretest Probability
Jackson, B. R. (2008) · Clinics in Laboratory Medicine · doi:10.1016/j.cll.2007.12.009 · Cited by 42
Second trimester prenatal ultrasound for the detection of pregnancies at increased risk of Trisomy 18 based on serum screening
Cho, R. C., Chu, P., & Smith‐Bindman, R. (2009) · Prenatal Diagnosis · doi:10.1002/pd.2166 · Cited by 40
Diagnostic utility of clinical tests for spinal dysfunction
Cook, C. E., & Hegedus, E. J. (2010) · Manual Therapy · doi:10.1016/j.math.2010.07.004 · Cited by 42
Semen and urine culture in the diagnosis of chronic bacterial prostatitis
Montes, L. Z., Mejia, A. A. S., Munarriz, C. A. L., & Gutierrez, E. C. (2008) · International braz j urol · doi:10.1590/s1677-55382008000100006 · Cited by 40
Inositol Phosphoglycan P-Type in Preeclampsia
Williams, P. J., Gumaa, K. A., Scioscia, M., Redman, C. W. G., & Rademacher, T. W. (2006) · Hypertension · doi:10.1161/01.hyp.0000251301.12357.ba · Cited by 40
Estimation of the diagnostic threshold accounting for decision costs and sampling uncertainty
Skaltsa, K., Jover, L., & Carrasco, J. L. (2010) · Biometrical Journal · doi:10.1002/bimj.200900294 · Cited by 40
Meta‐analysis of the diagnostic accuracy of transesophageal echocardiography for assessment of atherosclerosis in the ascending aorta in patients undergoing cardiac surgery
van Zaane, B., Zuithoff, N. P. A., Reitsma, J. B., Bax, L., Nierich, A. P., & Moons, K. G. M. (2008) · Acta Anaesthesiologica Scandinavica · doi:10.1111/j.1399-6576.2008.01694.x · Cited by 40
Usefulness of 4-, 8-, and 16-Slice Computed Tomography for Detection of Graft Occlusion or Patency After Coronary Artery Bypass Grafting
Stein, P. D., Beemath, A., Skaf, E., Kayali, F., Janjua, M. S. T., Alesh, I. G., & Olson, R. E. (2005) · The American Journal of Cardiology · doi:10.1016/j.amjcard.2005.07.089 · Cited by 40
Methods For Evidence Synthesis in Interventional Pain Management
Manchikanti, L. (2003) · Pain Physician · doi:10.36076/ppj.2003/6/89 · Cited by 40
Systematic Review of the Diagnostic Accuracy of Haptoglobin, Serum Amyloid A, and Fibrinogen versus Clinical Reference Standards for the Diagnosis of Bovine Respiratory Disease
Abdallah, A., Hewson, J., Francoz, D., Selim, H., & Buczinski, S. (2016) · Journal of Veterinary Internal Medicine · doi:10.1111/jvim.13975 · Cited by 39
Performance of rapid diagnostic tests, microscopy, loop-mediated isothermal amplification (LAMP) and PCR for malaria diagnosis in Ethiopia: a systematic review and meta-analysis
Feleke, D. G., Alemu, Y., & Yemanebirhane, N. (2021) · Malaria Journal · doi:10.1186/s12936-021-03923-8 · Cited by 44
Immune-based diagnostics for TB in children: what is the evidence?
Ling, D. I., Zwerling, A. A., Steingart, K. R., & Pai, M. (2010) · Paediatric Respiratory Reviews · doi:10.1016/j.prrv.2010.09.009 · Cited by 39
IDENTIFYING NON-ALCOHOLIC FATTY LIVER DISEASE AMONG ASYMPTOMATIC OVERWEIGHT AND OBESE INDIVIDUALS BY CLINICAL AND BIOCHEMICAL CHARACTERISTICS
Haentjens, P., Massaad, D., Reynaert, H., Peeters, E., MEERHAEGHE, A. V., Vinken, S., Poppe, K. G., & Velkeniers, B. (2009) · Acta Clinica Belgica · doi:10.1179/acb.2009.084 · Cited by 39
The Use of the Osmole Gap as a Screening Test for the Presence of Exogenous Substances
Purssell, R. A., Lynd, L. D., & Koga, Y. (2004) · Toxicological Reviews · doi:10.2165/00139709-200423030-00005 · Cited by 39
Clinical Tests for Screening and Diagnosis of Cervical Spine Myelopathy: A Systematic Review
Cook, C. E., Wilhelm, M. P., Cook, A. E., Petrosino, C., & Isaacs, R. E. (2011) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/j.jmpt.2011.08.008 · Cited by 39
Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative:The STARD initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C., Glasziou, P., Irwig, L., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2007) · Pure Amsterdam UMC · doi:10.1111/j.1939-165x.2007.tb00175.x · Cited by 37
Self-citation
The Systematic Guideline Review: Method, rationale, and test on chronic heart failure
Muth, C., Gensichen, J. S., Beyer, M., Hutchinson, A., & Gerlach, F. M. (2009) · BMC Health Services Research · doi:10.1186/1472-6963-9-74 · Cited by 40
Point-of-Care Testing: Impact on Medical Outcomes
Price, C. P. (2001) · Clinics in Laboratory Medicine · doi:10.1016/s0272-2712(18)30035-0 · Cited by 39
Prolonged, but not complicated, grief is a mental disorder
Maciejewski, P. K., & Prigerson, H. G. (2017) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.116.196238 · Cited by 40
Empirical assessment of bias in machine learning diagnostic test accuracy studies
Crowley, R. J., Tan, Y. J., & Ioannidis, J. P. A. (2020) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa075 · Cited by 39
Histopathologically Validated Diagnostic Accuracy of PSMA-PET/CT in the Primary and Secondary Staging of Prostate Cancer and the Impact of PSMA-PET/CT on Clinical Management: A Systematic Review and Meta-analysis
Jeet, V., Parkinson, B., Song, R., Sharma, R., & Hoyle, M. (2023) · Seminars in Nuclear Medicine · doi:10.1053/j.semnuclmed.2023.02.006 · Cited by 41
Diagnostic Value of Stool Dna Testing for Multiple Markers Of Colorectal Cancer and Advanced Adenoma: A Meta-Analysis
Yang, H., Xia, B., Jiang, B., Wang, G., Yang, Y., Chen, H. H., Li, B., Xu, A., Huang, Y.-B., & Wang, X. (2013) · Canadian Journal of Gastroenterology · doi:10.1155/2013/258030 · Cited by 38
Magnetic resonance imaging findings in respect to carpal tunnel syndrome
Pasternack, I., Malmivaara, A. V., Tervahartiala, P. O., Forsberg, H., & Vehmas, T. (2003) · Scandinavian Journal of Work Environment & Health · doi:10.5271/sjweh.721 · Cited by 38
A protocol for a systematic review of the diagnostic accuracy of blood markers, synovial fluid, and tissue testing in periprosthetic joint infections (PJI)
Beaulé, P. E., Shea, B., Abedlbary, H., Ahmadzai, N., Skidmore, B., Mallick, R., Hutton, B., Bunting, A. C., Moran, J., Ward, R., et al. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0124-1 · Cited by 38
Acceptability, Accuracy, and Safety of Disposable Transnasal Capsule Endoscopy for Barrett's Esophagus Screening
Sami, S. S., Iyer, P. G., Pophali, P. A., Halland, M., di Pietro, M., Ortiz‐Fernández‐Sordo, J., White, J. R., Johnson, M. L., Guha, I. N., Fitzgerald, R. C., et al. (2018) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2018.07.019 · Cited by 38
A systematic review of the diagnostic accuracy of physical examination for the detection of cirrhosis
de Bruyn, G., & Graviss, E. A. (2001) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-1-6 · Cited by 38
Comparison of transvaginal sonography in recumbent and standing maternal positions to predict spontaneous preterm birth in singleton and twin pregnancies
Arabin, B., Roos, C., Kollen, B. J., & van Eyck, J. (2006) · Ultrasound in Obstetrics and Gynecology · doi:10.1002/uog.2694 · Cited by 38
Delayed post gadolinium MRI descriptors for Meniere’s disease: a systematic review and meta-analysis
Connor, S. E. J., Grzeda, M. T., Jamshidi, B., Sebastien Ourselin, A., Hajnal, J. V., & Pai, I. (2023) · European Radiology · doi:10.1007/s00330-023-09651-8 · Cited by 39
Detection of Epstein-Barr Virus DNA in Serum or Plasma for Nasopharyngeal Cancer: A Meta-Analysis
Liu, Y., Fang, Z., Liu, L., Yang, S., & Zhang, L. (2011) · Genetic Testing and Molecular Biomarkers · doi:10.1089/gtmb.2011.0012 · Cited by 37
Quality of reporting of test accuracy studies in reproductive medicine: impact of the Standards for Reporting of Diagnostic Accuracy (STARD) initiative
Coppus, S. F. P. J., van der Veen, F., Bossuyt, P. M., & Mol, B. W. (2006) · Fertility and Sterility · doi:10.1016/j.fertnstert.2006.03.050 · Cited by 38

Authors: Lijmer, J. G.
Affiliations: Amsterdam UMC Location University of Amsterdam (NL)
Corresponding author: Lijmer, Jeroen G.
ORCID: Lijmer, Jeroen G.
Venue: JAMA
Publisher: American Medical Association (AMA)
Published: 1999-09-15
Volume: 282
Issue: 11
Pages: 1061
ISSN: 0002-9955 (ISSN-L)
0098-7484
DOI: 10.1001/jama.282.11.1061
OpenAlex: W1971348077
Cited by: 1,861
References: 38
Citations by year: 2026: 56 · 2025: 38 · 2024: 38 · 2023: 45 · 2022: 45 · 2021: 48 · 2020: 74 · 2019: 50 · 2018: 73 · 2017: 66 · 2016: 79 · 2015: 82 · 2014: 73 · 2013: 78 · 2012: 79
FWCI: 92.03
Type: journal article
Language: en
Open access: closed
Locations: JAMA (publishedVersion)
PubMed (publishedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Pure Amsterdam UMC (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
Health Sciences › Medicine › Family Practice › Clinical Reasoning and Diagnostic Skills
Keywords: diagnostic accuracy, study design bias, methodological quality, diagnostic odds ratio, reference materials
MeSH terms: Diagnostic Tests, Routine, Evaluation Studies as Topic, Quality Control, Reference Standards, Regression Analysis, Research Design, Sensitivity and Specificity, Bias, Odds Ratio

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Empirical evidence of design-related bias in studies of diagnostic tests.

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks