Interobserver Variability in the CT Assessment of Honeycombing in the Lungs
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
PURPOSE: To quantify observer agreement and analyze causes of disagreement in identifying honeycombing at chest computed tomography (CT). MATERIALS AND METHODS: The institutional review board approved this multiinstitutional HIPAA-compliant retrospective study, and informed patient consent was not required. Five core study members scored 80 CT images with a five-point scale (5 = definitely yes to 1 = definitely no) to establish a reference standard for the identification of honeycombing. Forty-three observers from various subspecialties and geographic regions scored the CT images by using the same scoring system. Weighted κ values of honeycombing scores compared with the reference standard were analyzed to investigate intergroup differences. Images were divided into four groups to allow analysis of imaging features of cases in which there was disagreement: agreement on the presence of honeycombing, agreement on the absence of honeycombing, disagreement on the presence of honeycombing, and other (none of the preceding three groups applied). RESULTS: Agreement of scores of honeycombing presence by 43 observers with the reference standard was moderate (Cohen weighted κ values: 0.40-0.58). There were no significant differences in κ values among groups defined by either subspecialty or geographic region (Tukey-Kramer test, P = .38 to >.99). In 29% of cases, there was disagreement on identification of honeycombing. These cases included honeycombing mixed with traction bronchiectasis, large cysts, and superimposed pulmonary emphysema. CONCLUSION: Identification of honeycombing at CT is subjective, and disagreement is largely caused by conditions that mimic honeycombing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Raghu, G., Collard, H. R., Egan, J. J., Martinez, F. J., Behr, J., Brown, K. K., Colby, T. V., Cordier, J.-F., Flaherty, K. R., Lasky, J. A., et al. (2011) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.2009-040gl · Cited by 7,186
Self-citationFleischner Society: Glossary of Terms for Thoracic Imaging
Hansell, D. M., Bankier, A. A., MacMahon, H., McLoud, T. C., Müller, N. L., & Remy, J. (2008) · Radiology · doi:10.1148/radiol.2462070712 · Cited by 4,198
Self-citationIdiopathic Pulmonary Fibrosis: Diagnosis and Treatment: International Consensus Statement
(2000) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/ajrccm.161.2.ats3-00 · Cited by 2,628
Measurement of Observer Agreement
Kundel, H. L., & Polansky, M. (2003) · Radiology · doi:10.1148/radiol.2282011860 · Cited by 1,492
Combined pulmonary fibrosis and emphysema: a distinct underrecognised entity
Cottin, V., Nunes, H., Brillet, P.-Y., Delaval, P., Devouassoux, G., Tillie-Leblond, I., Israel-Biet, D., Court-Fortune, I., Valeyre, D., & Cordier, J.-F. (2005) · European Respiratory Journal · doi:10.1183/09031936.05.00021005 · Cited by 1,004
Idiopathic Interstitial Pneumonia: What Is the Effect of a Multidisciplinary Approach to Diagnosis?
Flaherty, K. R., King, T. E., Raghu, G., Lynch, J. P., Colby, T. V., Travis, W. D., Gross, B. H., Kazerooni, E. A., Toews, G. B., Long, Q., et al. (2004) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200402-147oc · Cited by 673
Idiopathic Nonspecific Interstitial Pneumonia: Report of an American Thoracic Society Project
Travis, W. D., Hunninghake, G., King, T. E., Lynch, D. A., Colby, T. V., Galvin, J. R., Brown, K. K., Chung, M. P., Cordier, J.-F., du Bois, R. M., et al. (2008) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200611-1685oc · Cited by 599
Self-citationHigh-Resolution Computed Tomography in Idiopathic Pulmonary Fibrosis: Diagnosis and Prognosis
Lynch, D. A., Godwin, J. D., Safrin, S., Starko, K. M., Hormel, P., Brown, K. K., Raghu, G., King, T. E., Bradford, W. Z., Schwartz, D. A., et al. (2005) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.200412-1756oc · Cited by 547
Self-citationClinical significance of histological classification of idiopathic interstitial pneumonia
Flaherty, K. R., Toews, G. B., Travis, W. D., Colby, T. V., Kazerooni, E. A., Gross, B. H., Jain, A., Strawderman, R. L., Paine, R., Flint, A., et al. (2002) · European Respiratory Journal · doi:10.1183/09031936.02.00182002 · Cited by 372
Idiopathic Interstitial Pneumonias: Diagnostic Accuracy of Thin-Section CT in 129 Patients
Johkoh, T., Müller, N. L., Cartier, Y., Kavanagh, P. V., Hartman, T. E., Akira, M., Ichikado, K., Ando, M., & Nakamura, H. (1999) · Radiology · doi:10.1148/radiology.211.2.r99ma01555 · Cited by 356
Self-citation
Cited by
Diagnosis of Idiopathic Pulmonary Fibrosis. An Official ATS/ERS/JRS/ALAT Clinical Practice Guideline
Raghu, G., Remy-Jardin, M., Myers, J. L., Richeldi, L., Ryerson, C. J., Lederer, D. J., Behr, J., Cottin, V., Danoff, S. K., Morell, F., et al. (2018) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201807-1255st · Cited by 4,103
Self-citationRaghu, G., Remy-Jardin, M., Richeldi, L., Thomson, C. C., Inoue, Y., Johkoh, T., Kreuter, M., Lynch, D. A., Maher, T. M., Martinez, F. J., et al. (2022) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.202202-0399st · Cited by 2,957
Self-citationDiagnostic criteria for idiopathic pulmonary fibrosis: a Fleischner Society White Paper
Lynch, D. A., Sverzellati, N., Travis, W. D., Brown, K. K., Colby, T. V., Galvin, J. R., Goldin, J. G., Hansell, D. M., Inoue, Y., Johkoh, T., et al. (2018) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(17)30433-2 · Cited by 1,030
“In a large study 55 in which observers were presented with single CT images, disagreement about the presence or absence of Other systemic disease (sarcoid, immune-system abnormalities) • Is there evidence of other organ involvement?”
Self-citationIdiopathic pulmonary fibrosis: pathogenesis and management
Sgalla, G., Iovene, B., Calvello, M., Ori, M., Varone, F., & Richeldi, L. (2018) · Respiratory Research · doi:10.1186/s12931-018-0730-2 · Cited by 573
Fleischner Society: Glossary of Terms for Thoracic Imaging
Bankier, A. A., MacMahon, H., Colby, T., Gevenois, P. A., Goo, J. M., Leung, A. N. C., Lynch, D. A., Schaefer-Prokop, C. M., Tomiyama, N., Travis, W. D., et al. (2024) · Radiology · doi:10.1148/radiol.232558 · Cited by 422
Self-citationWalsh, S. L. F., Calandriello, L., Silva, M., & Sverzellati, N. (2018) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(18)30286-8 · Cited by 390
Interobserver agreement for the ATS/ERS/JRS/ALAT criteria for a UIP pattern on CT
Walsh, S. L. F., Calandriello, L., Sverzellati, N., Wells, A. U., & Hansell, D. M. (2016) · Thorax · doi:10.1136/thoraxjnl-2015-207252 · Cited by 334
Self-citationIdiopathic pulmonary fibrosis: Current and future treatment
Glass, D. S., Grossfeld, D., Renna, H. A., Agarwala, P., Spiegler, P., DeLeon, J., & Reiss, A. B. (2022) · The Clinical Respiratory Journal · doi:10.1111/crj.13466 · Cited by 314
Jacob, J., Bartholmai, B. J., Rajagopalan, S., Kokosi, M., Nair, A., Karwoski, R., Walsh, S. L. F., Wells, A. U., & Hansell, D. M. (2017) · European Respiratory Journal · doi:10.1183/13993003.01011-2016 · Cited by 309
Self-citationDiagnosis of idiopathic pulmonary fibrosis
Choi, H. S. (2021) · Journal of the Korean Medical Association · doi:10.5124/jkma.2021.64.4.248 · Cited by 259
Effect of nintedanib in subgroups of idiopathic pulmonary fibrosis by diagnostic criteria
Raghu, G., Wells, A. U., Nicholson, A. G., Richeldi, L., Flaherty, K. R., Le Maulf, F., Stowasser, S., Schlenker-Herceg, R., & Hansell, D. M. (2017) · American Journal of Respiratory and Critical Care Medicine · doi:10.1164/rccm.201602-0402oc · Cited by 180
Self-citationEvaluating disease severity in idiopathic pulmonary fibrosis
Robbie, H., Daccord, C., Chua, F., & Devaraj, A. (2017) · European Respiratory Review · doi:10.1183/16000617.0051-2017 · Cited by 93
Experimental and quantitative imaging techniques in interstitial lung disease
Weatherley, N. D., Eaden, J. A., Stewart, N. J., Bartholmai, B. J., Swift, A. J., Bianchi, S. M., & Wild, J. M. (2019) · Thorax · doi:10.1136/thoraxjnl-2018-211779 · Cited by 87
Idiopathic Pulmonary Fibrosis: Where do We Stand and How Far to Go?
Singh, V., Ulasov, I., Gupta, S., Singh, A., Roy, V. K., & Kharwar, R. K. (2024) · Discovery Medicine · doi:10.24976/discov.med.202436180.3 · Cited by 17
Deep learning and the evaluation of pulmonary fibrosis
Levin, D. L. (2018) · The Lancet Respiratory Medicine · doi:10.1016/s2213-2600(18)30371-0 · Cited by 16
Metadata
- Authors
- Watadani, T., Sakai, F., Johkoh, T., Noma, S., Akira, M., Fujimoto, K., Bankier, A. A., Lee, K. S., Müller, N. L., Song, J.-W., Park, J.-S., Lynch, D. A., Hansell, D. M., Remy-Jardin, M., Franquet, T., & Sugiyama, Y.
- Venue
- Radiology
- Published
- 2013-03
- Volume
- 266
- Issue
- 3
- Pages
- 936-944
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W2135761719
- Cited by
- 411
- References
- 27
- FWCI
- 14.47
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.