The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Interobserver Reproducibility of the PI-RADS Version 2 Lexicon: A Multicenter Study of Six Experienced Prostate Radiologists
Open accessAbstract
Purpose To determine the interobserver reproducibility of the Prostate Imaging Reporting and Data System (PI-RADS) version 2 lexicon. Materials and Methods This retrospective HIPAA-compliant study was institutional review board-approved. Six radiologists from six separate institutions, all experienced in prostate magnetic resonance (MR) imaging, assessed prostate MR imaging examinations performed at a single center by using the PI-RADS lexicon. Readers were provided screen captures that denoted the location of one specific lesion per case. Analysis entailed two sessions (40 and 80 examinations per session) and an intersession training period for individualized feedback and group discussion. Percent agreement (fraction of pairwise reader combinations with concordant readings) was compared between sessions. κ coefficients were computed. Results No substantial difference in interobserver agreement was observed between sessions, and the sessions were subsequently pooled. Agreement for PI-RADS score of 4 or greater was 0.593 in peripheral zone (PZ) and 0.509 in transition zone (TZ). In PZ, reproducibility was moderate to substantial for features related to diffusion-weighted imaging (κ = 0.535-0.619); fair to moderate for features related to dynamic contrast material-enhanced (DCE) imaging (κ = 0.266-0.439); and fair for definite extraprostatic extension on T2-weighted images (κ = 0.289). In TZ, reproducibility for features related to lesion texture and margins on T2-weighted images ranged from 0.136 (moderately hypointense) to 0.529 (encapsulation). Among 63 lesions that underwent targeted biopsy, classification as PI-RADS score of 4 or greater by a majority of readers yielded tumor with a Gleason score of 3+4 or greater in 45.9% (17 of 37), without missing any tumor with a Gleason score of 3+4 or greater. Conclusion Experienced radiologists achieved moderate reproducibility for PI-RADS version 2, and neither required nor benefitted from a training session. Agreement tended to be better in PZ than TZ, although was weak for DCE in PZ. The findings may help guide future PI-RADS lexicon updates. (©) RSNA, 2016 Online supplemental material is available for this article.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
High agreement but low Kappa: I. the problems of two paradoxes
Feinstein, A. R., & Cicchetti, D. V. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90158-l · Cited by 3,034
ESUR prostate MR guidelines 2012
Barentsz, J. O., Richenberg, J., Clements, R., Choyke, P., Verma, S., Villeirs, G., Rouviere, O., Logager, V., & Fütterer, J. J. (2012) · European Radiology · doi:10.1007/s00330-011-2377-y · Cited by 2,438
Barentsz, J. O., Weinreb, J. C., Verma, S., Thoeny, H. C., Tempany, C. M., Shtern, F., Padhani, A. R., Margolis, D., Macura, K. J., Haider, M. A., et al. (2016) · European Urology · doi:10.1016/j.eururo.2015.08.038 · Cited by 547
Self-citationBI-RADS Lexicon for US and Mammography: Interobserver Variability and Positive Predictive Value
Lazarus, E., Mainiero, M. B., Schepps, B., Koelliker, S. L., & Livingston, L. S. (2006) · Radiology · doi:10.1148/radiol.2392042127 · Cited by 511
Muller, B. G., Shih, J. H., Sankineni, S., Marko, J., Rais-Bahrami, S., George, A. K., de la Rosette, J. J. M. C. H., Merino, M. J., Wood, B. J., Pinto, P., et al. (2015) · Radiology · doi:10.1148/radiol.2015142818 · Cited by 331
Self-citationBehavior and interpretation of the κ statistic: Resolution of the two paradoxes
Lantz, C. A., & Nebenzahl, E. (1996) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(95)00571-4 · Cited by 311
Rosenkrantz, A. B., Kim, S., Lim, R. P., Hindman, N., Deng, F.-M., Babb, J. S., & Taneja, S. S. (2013) · Radiology · doi:10.1148/radiol.13122233 · Cited by 267
Self-citationBerg, W. A., D’Orsi, C. J., Jackson, V. P., Bassett, L. W., Beam, C. A., Lewis, R. S., & Crewson, P. E. (2002) · Radiology · doi:10.1148/radiol.2243011626 · Cited by 208
Abdullah, N., Mesurolle, B., El-Khoury, M., & Kao, E. (2009) · Radiology · doi:10.1148/radiol.2523080670 · Cited by 205
Meng, X., Rosenkrantz, A. B., Mendhiratta, N., Fenstermaker, M., Huang, R., Wysock, J. S., Bjurlin, M. A., Marshall, S., Deng, F.-M., Zhou, M., et al. (2016) · European Urology · doi:10.1016/j.eururo.2015.06.005 · Cited by 184
Self-citationRenard-Penna, R., Mozer, P., Cornud, F., Delongchamps, N. B., Bruguière, É., Portalez, D., & Malavaud, B. A. (2015) · Radiology · doi:10.1148/radiol.14140184 · Cited by 107
Rosenkrantz, A. B., Geppert, C., Grimm, R., Block, K. T., Glielmi, C., Feng, L., Otazo, R., Ream, J., Moccaldi, M., Taneja, S. S., et al. (2014) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.24661 · Cited by 105
Self-citationAkın, O., Riedl, C. C., Ishill, N. M., Moskowitz, C. S., Zhang, J., & Hricak, H. (2009) · European Radiology · doi:10.1007/s00330-009-1625-x · Cited by 95
Observer agreement paradoxes in 2x2 tables: comparison of agreement measures
Shankar, V., & Bangdiwala, S. I. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-100 · Cited by 88
Cheng, S., Lee, J.-J., Lin, J., Chuang, S., Chien, M.-N., & Liu, C. (2012) · Head & Neck · doi:10.1002/hed.22985 · Cited by 84
Heidenreich, A. (2011) · European Urology · doi:10.1016/j.eururo.2011.01.013 · Cited by 54
Open-source image registration for MRI–TRUS fusion-guided prostate interventions
Fedorov, A., Khallaghi, S., Sánchez, C. A., Lassó, A., Fels, S., Tuncali, K., Sugar, E. N., Kapur, T., Zhang, C., Wells, W. M., et al. (2015) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-015-1180-7 · Cited by 53
Cited by
MRI-Targeted or Standard Biopsy for Prostate-Cancer Diagnosis
Kasivisvanathan, V., Rannikko, A. S., Borghi, M., Panebianco, V., Mynderse, L. A., Vaarala, M. H., Briganti, A., Budäus, L., Hellawell, G., Hindley, R. G., et al. (2018) · New England Journal of Medicine · doi:10.1056/nejmoa1801993 · Cited by 3,091
Self-citationTurkbey, B., Rosenkrantz, A. B., Haider, M. A., Padhani, A. R., Villeirs, G., Macura, K. J., Tempany, C. M., Choyke, P. L., Cornud, F., Margolis, D. J., et al. (2019) · European Urology · doi:10.1016/j.eururo.2019.02.033 · Cited by 2,544
Self-citationWestphalen, A. C., McCulloch, C. E., Anaokar, J. M., Arora, S., Barashi, N. S., Barentsz, J. O., Bathala, T. K., Bittencourt, L. K., Booker, M. T., Braxton, V. G., et al. (2020) · Radiology · doi:10.1148/radiol.2020190646 · Cited by 422
Self-citationMultiparametric MRI for prostate cancer diagnosis: current status and future directions
Stabile, A., Giganti, F., Rosenkrantz, A. B., Taneja, S. S., Villeirs, G., Gill, I. S., Allen, C., Emberton, M., Moore, C. M., & Kasivisvanathan, V. (2020) · Nature Reviews Urology · doi:10.1038/s41585-019-0212-4 · Cited by 398
Self-citationMoldovan, P. C., Van den Broeck, T., Sylvester, R., Marconi, L., Bellmunt, J., van den Bergh, R. C. N., Bolla, M., Briers, E., Cumberbatch, M. G., Fossati, N., et al. (2017) · European Urology · doi:10.1016/j.eururo.2017.02.026 · Cited by 391
Metadata
- Authors
- Rosenkrantz, A. B., Ginocchio, L. A., Cornfeld, D., Froemming, A. T., Gupta, R. T., Turkbey, B., Westphalen, A. C., Babb, J. S., & Margolis, D. J.
- Venue
- Radiology
- Published
- 2016-09
- Volume
- 280
- Issue
- 3
- Pages
- 793-804
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2334235689
- Cited by
- 501
- References
- 17
- FWCI
- 50.58
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.