Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Cited by 189

The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.

PENet—a scalable deep-learning model for automated diagnosis of pulmonary embolism using volumetric CT imaging

Open access
Huang, Shih-Cheng, Kothari, Tanay, Banerjee, Imon, Chute, Chris, Ball, Robyn L., Borus, Norah, Huang, Andrew, Patel, Bhavik N., Rajpurkar, Pranav, Irvin, Jeremy, Dunnmon, Jared, Bledsoe, Joseph, Shpanskaya, Katie, Dhaliwal, Abhay, Zamanian, Roham, Ng, Andrew Y., Lungren, Matthew P. · 2020 · npj Digital Medicine

Abstract

Pulmonary embolism (PE) is a life-threatening clinical problem and computed tomography pulmonary angiography (CTPA) is the gold standard for diagnosis. Prompt diagnosis and immediate treatment are critical to avoid high morbidity and mortality rates, yet PE remains among the diagnoses most frequently missed or delayed. In this study, we developed a deep learning model—PENet, to automatically detect PE on volumetric CTPA scans as an end-to-end solution for this purpose. The PENet is a 77-layer 3D convolutional neural network (CNN) pretrained on the Kinetics-600 dataset and fine-tuned on a retrospective CTPA dataset collected from a single academic institution. The PENet model performance was evaluated in detecting PE on data from two different institutions: one as a hold-out dataset from the same institution as the training data and a second collected from an external institution to evaluate model generalizability to an unrelated population dataset. PENet achieved an AUROC of 0.84 [0.82–0.87] on detecting PE on the hold out internal test set and 0.85 [0.81–0.88] on external dataset. PENet also outperformed current state-of-the-art 3D CNN models. The results represent successful application of an end-to-end 3D CNN model for the complex task of PE diagnosis without requiring computationally intensive and time consuming preprocessing and demonstrates sustained performance on data from an external institution. Our model could be applied as a triage tool to automatically identify clinically important PEs allowing for prioritization for diagnostic radiology interpretation and improved care pathways via more efficient diagnosis.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1038/s41746-020-0266-y

Cites

9 of 9 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 9 references

Research works printed but not linked: 41

  1. Horlander, K. T., Mannino, D. M. & Leeper, K. V. Pulmonary embolism mortality in the United States, 1979–1998: an analysis using multiple-cause mortality data. Arch. Intern. Med. 163, 1711–1717 (2003). · DOI · Paper page
  2. Le Gal, G. & Bounameaux, H. Diagnosing pulmonary embolism: running after the decreasing prevalence of cases among suspected patients. J. Thrombosis Haemost. 2, 1244–1246 (2004). · DOI
  3. Leung, A. N. et al. An Official American Thoracic Society/Society of Thoracic Radiology clinical practice guideline: evaluation of suspected pulmonary embolism in pregnancy. Am. J. Respir. Crit. Care Med. 184, 1200–1208 (2011). · DOI · Paper page
  4. Leung, A. N. et al. American Thoracic Society documents: an official American Thoracic Society/Society of Thoracic Radiology clinical practice guideline—evaluation of suspected pulmonary embolism in pregnancy. Radiology 262, 635–646 (2012). · DOI
  5. Yavas, U. S., Calisir, C. & Ozkan, I. R. The Interobserver Agreement between Residents and Experienced Radiologists for Detecting Pulmonary Embolism and DVT with Using CT Pulmonary Angiography and Indirect CT Venography. Korean J. Radiol. 9, 498–502 (2008). · doi:10.3348/kjr.2008.9.6.498
  6. Rufener, S. L., Patel, S., Kazerooni, E. A., Schipper, M. & Kelly, A. M. Comparison of on-call radiology resident and faculty interpretation of 4- and 16-row multidetector CT pulmonary angiography with indirect CT venography. Acad. Radiol. 15, 71–76 (2008). · doi:10.1016/j.acra.2007.06.030
  7. Joshi, R., Wu, K., Kaicker, J. & Choudur, H. Reliability of on-call radiology residents’ interpretation of 64-slice CT pulmonary angiography for the detection of pulmonary embolism. Acta Radiol. 55, 682–690 (2013). · doi:10.1177/0284185113506135
  8. Kline, T. J. & Kline, T. S. Radiologists, communication, and Resolution 5: a medicolegal issue. Radiology 184, 131–134 (1992). · doi:10.1148/radiology.184.1.1609068
  9. FitzGerald, R. Radiological error: analysis, standard setting, targeted instruction and teamworking. Eur. Radiol. 15, 1760–1767 (2005). · DOI
  10. Chandra, S., Sarkar, P. K., Chandra, D., Ginsberg, N. E. & Cohen, R. I. Finding an alternative diagnosis does not justify increased use of CT-pulmonary angiography. BMC Pulm. Med. 13, 9 (2013). · DOI
  11. Prologo, J. D., Gilkeson, R. C., Diaz, M. & Asaad, J. CT pulmonary angiography: a comparative analysis of the utilization patterns in emergency department and hospitalized patients between 1998 and 2003. Am. J. Roentgenol. 183, 1093–1096 (2004). · DOI
  12. Rajpurkar P. et al. Mura dataset: towards radiologist-level abnormality detection in musculoskeletal radiographs. arXiv preprint arXiv:171206957 (2017).
  13. Park, Allison et al. Deep Learning–Assisted Diagnosis of Cerebral Aneurysms Using the HeadXNet Model. JAMA Netw. Open 2, e195600–e195600 (2019). · DOI · Paper page
  14. Moore, A. J. E. et al. Imaging of acute pulmonary embolism: an update. Cardiovasc. Diagn. Ther. 8, 225–ÿ243 (2018). · doi:10.21037/cdt.2017.12.01
  15. Patil, S. et al. Neural network in the clinical diagnosis of acute pulmonary embolism. Chest 104, 1685–1689 (1993). · DOI
  16. Tourassi, G. D. et al. Artificial neural network for diagnosis of acute pulmonary embolism: effect of case and observer selection. Radiology 194, 889–893 (1995). · DOI
  17. Scott, J. A. & Palmer, E. L. Neural network analysis of ventilation-perfusion lung scans. Radiology 186, 661–664 (1993). · DOI
  18. Serpen, G., Tekkedil, D. K. & Orra, M. A knowledge-based artificial neural network classifier for pulmonary embolism diagnosis. Comput. Biol. Med. 38, 204–220 (2008). · DOI
  19. Liang, J., Bi, J. Computer aided detection of pulmonary embolism with tobogganing and mutiple instance classification in CT pulmonary angiography. in IPMI (eds Karssemeijer, N., Lelieveldt, B.). LNCS, vol. 4584, pp. 630–641. (Springer, Heidelberg, 2007). · DOI
  20. Ozkan, H., Osman, O., Şahin, S. & Boz, A. F. A novel method for pulmonary embolism detection in cta images. Comput. Methods Prog. Biomed. 113, 757–766 (2014). · doi:10.1016/j.cmpb.2013.12.014
  21. Park, S. C., Chapman, B. E. & Zheng, B. A multistage approach to improve performance of computer-aided detection of pulmonary embolisms depicted on CT images: preliminary investigation. IEEE Trans. Biomed. Eng. 58, 1519–1527 (2011). · doi:10.1109/tbme.2010.2063702
  22. Wang, et al. Improving performance of computer-aided detection of pulmonary embolisms by incorporating a new pulmonary vascular-tree segmentation algorithm. in SPIE Medical Imaging, pp. 83152U–83152U. (International Society for Optics and Photonics, 2012). · doi:10.1117/12.911301
  23. Das, M. et al. Computer-aided detection of pulmonary embolism: influence on radiologists detection performance with respect to vessel segments. Eur. Radiol. 18, 1350–1355 (2008). · doi:10.1007/s00330-008-0889-x
  24. Tajbakhsh, N., Michael B. G. & Liang J. Computer-aided pulmonary embolism detection using a novel vessel-aligned multi-planar image representation and convolutional neural networks. International Conference on Medical Image Computing and Computer-Assisted Intervention. (Springer, Cham, 2015). https://doi.org/10.1007/978-3-319-24571-3_8. · DOI
  25. Yang, X., et al. A two-stage convolutional neural network for pulmonary embolism detection from CTPA images. IEEE Access (2019). · DOI
  26. Donato, A. A., Khoche, S., Santora, J. & Wagner, B. Clinical outcomes in patients with isolated subsegmental pulmonary emboli diagnosed by multi-detector CT pulmonary angiography. Thromb. Res. 126, e266–e270 (2010). · doi:10.1016/j.thromres.2010.07.001
  27. Eyer, B. A., Goodman, L. R. & Washington, L. Clinicians “response to radiologists” reports of isolated subsegmental pulmonary embolism or inconclusive interpretation of pulmonary embolism using MDCT. AJR 184, 623–628 (2005). · doi:10.2214/ajr.184.2.01840623
  28. Bastawrous, S. & Carney, B. Improving patient safety: avoiding unread imaging exams in the national va enterprise electronic health record. J. Digit. Imaging 30, 309–313 (2017). · DOI
  29. Fitzgerald, R. Error in radiology. Clin. Radiol. 56, 938–946 (2001). · DOI · Paper page
  30. Goodman, L. R. Small pulmonary emboli: what do we know? Radiology 234, 654–658 (2005). · DOI
  31. Blondon, M., Righini, M., Aujesky, D., Le Gal, G. & Perrier, A. Usefulness of preemptive anticoagulation in patients with suspected pulmonary embolism: a decision analysis. Chest 142, 697–703 (2012). · DOI
  32. Remy-Jardin, M., Remy, J., Artaud, D., Deschildre, F. & Duhamel, A. Peripheral pulmonary arteries: optimization of the acquisition protocol. Radiology 204, 157–163 (1997). · DOI · Paper page
  33. Albrecht, M. H. et al. State-of-the-art pulmonary CT angiography for acute pulmonary embolism. Am. J. Roentgenol. 208, 495–504 (2017). · DOI
  34. Andrew L. et al. Rectifier Nonlinearities Improve Neural Network Acoustic Models. in Proc 30th International Conference on Machine Learning. vol. 28. (Atlanta, Georgia, USA, 2013).
  35. Kay W., et al. The Kinetics Human Action Video Dataset. http://arxiv.org/abs/1705.06950 (2017). · arXiv
  36. Wu Y., He K. Group Normalization. http://arxiv.org/abs/1803.08494 (2018). · arXiv
  37. Xie, S., et al. Aggregated Residual Transformations for Deep Neural Networks. https://arxiv.org/abs/1611.05431 (2016). · DOI · Paper page
  38. Huang, G., et al. Densely Connected Convolutional Networks. https://arxiv.org/abs/1608.06993 (2016). · arXiv
  39. Hara, K., Kataoka, H. & Satoh, Y. Can spatiotemporal 3d cnns retrace the history of 2d cnns and imagenet?. https://arxiv.org/abs/1711.09577 (2017). · DOI · Paper page
  40. Smith, L. N. Cyclical learning rates for training neural networks. in Proc 2017 IEEE Winter Conference on Applications of Computer Vision (WACV). (IEEE, 2017). · DOI · Paper page
  41. Zhou, B., et al. Learning Deep Features for Discriminative Localization. https://arxiv.org/abs/1512.04150 (2015). · arXiv

Cited by

See all 189

Metadata

Authors
Huang, S.-C., Kothari, T., Banerjee, I., Chute, C., Ball, R. L., Borus, N., Huang, A., Patel, B. N., Rajpurkar, P., Irvin, J., Dunnmon, J., Bledsoe, J., Shpanskaya, K., Dhaliwal, A., Zamanian, R., Ng, A. Y., & Lungren, M. P.
Venue
npj Digital Medicine
Published
2020-04-24
Volume
3
Issue
1
Pages
61-61
ISSN
2398-6352 (ISSN-L)
OpenAlex
W3018185338
Cited by
189
References
9
FWCI
8.40
Type
journal article
Language
en
Open access
gold
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: PENet—a scalable deep-learning model for automated diagnosis of pulmonary embolism using volumetric CT imaging. https://app.cochat.ai/papers/10.1038/s41746-020-0266-y
The paper
Huang, S.-C., Kothari, T., Banerjee, I., Chute, C., Ball, R. L., Borus, N., Huang, A., Patel, B. N., Rajpurkar, P., Irvin, J., Dunnmon, J., Bledsoe, J., Shpanskaya, K., Dhaliwal, A., Zamanian, R., Ng, A. Y., & Lungren, M. P. (2020). PENet—a scalable deep-learning model for automated diagnosis of pulmonary embolism using volumetric CT imaging. npj Digital Medicine. https://doi.org/10.1038/s41746-020-0266-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.