The DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Receiver-operating characteristic curve analysis in diagnostic, prognostic and predictive biomarker research
Abstract
#### Take-home messages From a clinical perspective, biomarkers may have a variety of functions, which correspond to different stages (table 1) in disease development, such as in the progression in cancer or cardiovascular disease.1 2 Biomarkers can assist in the care of patients who are asymptomatic (screening biomarkers), those who are suspected to have the disease (diagnostic biomarkers) and those with overt disease (prognostic biomarkers) for whom therapy may or may not have been initiated. Biomarkers can also be used for treatment response (predictive biomarkers) or surveillance after therapy (monitoring biomarkers). Fundamental for the use of biomarkers in all situations is biomarker accuracy—the ability to correctly classify one condition and/or outcome from another (eg, healthy versus diseased). View this table: Table 1 Clinical use of biomarkers: rationale and objectives for use of cancer biomarkers For the clinician, diagnostic testing plays a fundamental role in clinical practice. For instance, daily surgical decision making is based on the correct classification by pathology, radiology and/or clinical chemistry reports involving tissue and/or image evaluation and interpretation of disease conditions—in many decisions the interpretation is based on results in the “grey-area” although requiring “black-and-white” answers for choice of treatment (fig 1). Further, predictive modelling to estimate expected outcomes such as mortality or adverse events based on patient risk characteristics is common in any type of clinical research. Receiver-operating characteristic (ROC) …
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine
Zweig, M. H., & Campbell, G. (1993) · Clinical Chemistry · doi:10.1093/clinchem/39.4.561 · Cited by 6,569
Phases of Biomarker Development for Early Detection of Cancer
Pepe, M. S., Etzioni, R., Feng, Z., Potter, J. D., Thompson, M. L., Thornquist, M., Winget, M., & Yasui, Y. (2001) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/93.14.1054 · Cited by 1,686 · cited 2×
“Further, five phases of biomarker development for early detection of cancer have been proposed (table 2).(31)”
Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models
Zou, K. H., O’Malley, A. J., & Mauri, L. (2007) · Circulation · doi:10.1161/circulationaha.105.594929 · Cited by 1,473
Receiver operating characteristic (ROC) methodology: the state of the art.
Hanley, J. A. (1989) · PubMed · Cited by 807
Reporting Recommendations for Tumor Marker Prognostic Studies
McShane, L. M., Altman, D. G., Sauerbrei, W., Taube, S. E., Gion, M., & Clark, G. M. (2005) · Journal of Clinical Oncology · doi:10.1200/jco.2004.01.0454 · Cited by 779
Statistical Evaluation of Prognostic versus Diagnostic Models: Beyond the ROC Curve
Cook, N. R. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096529 · Cited by 691
Rules of evidence for cancer molecular-marker discovery and validation
Ransohoff, D. F. (2004) · Nature Reviews Cancer · doi:10.1038/nrc1322 · Cited by 498
Bias as a threat to the validity of cancer molecular-marker research
Ransohoff, D. F. (2005) · Nature Reviews Cancer · doi:10.1038/nrc1550 · Cited by 487
The Limitations of Risk Factors as Prognostic Tools
Ware, J. H. (2006) · New England Journal of Medicine · doi:10.1056/nejmp068249 · Cited by 466
The search for new cardiovascular biomarkers
Gerszten, R. E., & Wang, T. J. (2008) · Nature · doi:10.1038/nature06802 · Cited by 358
ROC Curves in Clinical Chemistry: Uses, Misuses, and Possible Solutions
Obuchowski, N. A., Lieber, M. L., & Wians, F. H. (2004) · Clinical Chemistry · doi:10.1373/clinchem.2004.031823 · Cited by 358
Partial AUC Estimation and Regression
Dodd, L. E., & Pepe, M. S. (2003) · Biometrics · doi:10.1111/1541-0420.00071 · Cited by 346
Obuchowski (2005) · doi:10.2214/ajr.184.2.01840364 · Cited by 321
Pepe, M. S., Cai, T., & Longton, G. (2006) · Biometrics · doi:10.1111/j.1541-0420.2005.00420.x · Cited by 272
Decision-Making Studies in Patient Management
Lusted, L. B. (1971) · New England Journal of Medicine · doi:10.1056/nejm197102252840805 · Cited by 238
Zlobec, I., Steele, R., Terracciano, L., Jass, J. R., & Lugli, A. (2007) · Journal of Clinical Pathology · doi:10.1136/jcp.2006.044537 · Cited by 225
Janes, H., & Pepe, M. S. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn099 · Cited by 212
Fundamentals of clinical research for radiologists
Joseph, L., & Reinhold, C. (2005) · American Journal of Roentgenology · Cited by 193
Insights into latent class analysis of diagnostic test performance
Pepe, M. S., & Janes, H. (2007) · Biostatistics · doi:10.1093/biostatistics/kxl038 · Cited by 181
Li, J., & Fine, J. P. (2008) · Biostatistics · doi:10.1093/biostatistics/kxm050 · Cited by 167
Baker, S. G. (2003) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/95.7.511 · Cited by 166
Comparison of Eight Computer Programs for Receiver-Operating Characteristic Analysis
Stephan, C., Wesseling, S., Schink, T., & Jung, K. (2003) · Clinical Chemistry · doi:10.1373/49.3.433 · Cited by 140
Parodi, S., Izzotti, A., & Muselli, M. (2005) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/dji034 · Cited by 136
Clark, R. D., & Webster-Clark, D. J. (2008) · Journal of Computer-Aided Molecular Design · doi:10.1007/s10822-008-9181-z · Cited by 112
Søreide, K., Nedrebø, B. S., Knapp, J.-C., Glomsaker, T. B., Søreide, J. A., & Kørner, H. (2008) · Surgical Oncology · doi:10.1016/j.suronc.2008.06.006 · Cited by 95
Self-citationApplication of the Time‐Dependent ROC Curves for Prognostic Accuracy with Multiple Biomarkers
Zheng, Y., Cai, T., & Feng, Z. (2005) · Biometrics · doi:10.1111/j.1541-0420.2005.00441.x · Cited by 93
Pepe, M. S., & Janes, H. (2008) · JNCI Journal of the National Cancer Institute · doi:10.1093/jnci/djn215 · Cited by 73
Evaluating the ROC performance of markers for future events
PEPE, M. S., Zheng, Y., Jin, Y., Huang, Y., Parikh, C. R., & Levy, W. C. (2007) · Lifetime Data Analysis · doi:10.1007/s10985-007-9073-x · Cited by 61
Kørner, H., Søreide, K., Stokkeland, P. J., & Søreide, J. A. (2006) · Annals of Surgical Oncology · doi:10.1245/s10434-006-9060-6 · Cited by 58
Self-citationEvaluating technologies for classification and prediction in medicine
Pepe, M. S. (2005) · Statistics in Medicine · doi:10.1002/sim.2431 · Cited by 53
A non‐inferiority test for diagnostic accuracy based on the paired partial areas under ROC curves
Li, C., Liao, C., & Liu, J. (2007) · Statistics in Medicine · doi:10.1002/sim.3121 · Cited by 52
Søreide, J. A. (1999) · The European Journal of Surgery · doi:10.1080/11024159950189744 · Cited by 41
Walter, S. D., & Sinuff, T. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.09.002 · Cited by 32
Søreide, K., Gudlaugsson, E. G., Skaland, I., Janssen, E. A. M., van Diermen, B., Kørner, H., & Baak, J. P. A. (2008) · International Journal of Colorectal Disease · doi:10.1007/s00384-007-0424-6 · Cited by 28
Self-citationROC curves are a suitable and flexible tool for the analysis of gene expression profiles
Parodi, S., Muselli, M., Fontana, V., & Bonassi, S. (2003) · Cytogenetic and Genome Research · doi:10.1159/000074404 · Cited by 26
Evaluating laboratory diagnostic tests
Walley, T. (2008) · BMJ · doi:10.1136/bmj.39513.576701.80 · Cited by 25
The optimal ratio of cases to controls for estimating the classification accuracy of a biomarker
Janes, H., & Pepe, M. (2005) · Biostatistics · doi:10.1093/biostatistics/kxj018 · Cited by 25
Musiał, J., Swadźba, J., Motyl, A., & Iwaniec, T. (2003) · PubMed · Cited by 25
Cheung, R. M., Altschuler, M. D., D'Amico, A. V., Malkowicz, S. B., Wein, A. J., & Whittington, R. (2001) · Urology · doi:10.1016/s0090-4295(01)01209-2 · Cited by 21
On the analysis of glycomics mass spectrometry data via the regularized area under the ROC curve
Ye, J., Liu, H., Kirmiz, C., Lebrilla, C. B., & Rocke, D. M. (2007) · BMC Bioinformatics · doi:10.1186/1471-2105-8-477 · Cited by 11
When is “abnormal” abnormal? Dealing with the slightly out of range laboratory result: Figure 1
Smellie, W. S. A. (2006) · Journal of Clinical Pathology · doi:10.1136/jcp.2005.035048 · Cited by 10
Ison, J., & Blades, M. (2005) · Applied Bioinformatics · doi:10.2165/00822942-200504020-00006 · Cited by 4
Insights into Latent Class Analysis
PEPE, M. S., & Janes, H. (2005) · Collection of Biostatistics Research Archive · Cited by 4
Cited by
Saito, T., & Rehmsmeier, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118432 · Cited by 5,309
Translational biomarker discovery in clinical metabolomics: an introductory tutorial
Xia, J., Broadhurst, D. I., Wilson, M., & Wishart, D. S. (2013) · Metabolomics · doi:10.1007/s11306-012-0482-9 · Cited by 953
Zuk, A., & Bonventre, J. V. (2016) · Annual Review of Medicine · doi:10.1146/annurev-med-050214-013407 · Cited by 739
Immunohistochemistry for Pathologists: Protocols, Pitfalls, and Tips
Kim, S.-W., Roh, J., & Park, C.-S. (2016) · Journal of Pathology and Translational Medicine · doi:10.4132/jptm.2016.08.08 · Cited by 499
Impact of Platelet Reactivity on Clinical Outcomes After Percutaneous Coronary Intervention
Brar, S. S., ten Berg, J., Marcucci, R., Price, M. J., Valgimigli, M., Kim, H.-S., Patti, G., Breet, N. J., DiSciascio, G., Cuisset, T., et al. (2011) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2011.06.059 · Cited by 422
Metadata
- Authors
- Søreide, K.
- Venue
- Journal of Clinical Pathology
- Publisher
- BMJ
- Published
- 2008-09-25
- Volume
- 62
- Issue
- 1
- Pages
- 1-5
- ISSN
- 0021-9746 (ISSN-L)
- 1472-4146
- OpenAlex
- W2068138485
- Cited by
- 300
- References
- 43
- FWCI
- 16.14
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.