The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
PENet—a scalable deep-learning model for automated diagnosis of pulmonary embolism using volumetric CT imaging
Open accessAbstract
Pulmonary embolism (PE) is a life-threatening clinical problem and computed tomography pulmonary angiography (CTPA) is the gold standard for diagnosis. Prompt diagnosis and immediate treatment are critical to avoid high morbidity and mortality rates, yet PE remains among the diagnoses most frequently missed or delayed. In this study, we developed a deep learning model—PENet, to automatically detect PE on volumetric CTPA scans as an end-to-end solution for this purpose. The PENet is a 77-layer 3D convolutional neural network (CNN) pretrained on the Kinetics-600 dataset and fine-tuned on a retrospective CTPA dataset collected from a single academic institution. The PENet model performance was evaluated in detecting PE on data from two different institutions: one as a hold-out dataset from the same institution as the training data and a second collected from an external institution to evaluate model generalizability to an unrelated population dataset. PENet achieved an AUROC of 0.84 [0.82–0.87] on detecting PE on the hold out internal test set and 0.85 [0.81–0.88] on external dataset. PENet also outperformed current state-of-the-art 3D CNN models. The results represent successful application of an end-to-end 3D CNN model for the complex task of PE diagnosis without requiring computationally intensive and time consuming preprocessing and demonstrates sustained performance on data from an external institution. Our model could be applied as a triage tool to automatically identify clinically important PEs allowing for prioritization for diagnostic radiology interpretation and improved care pathways via more efficient diagnosis.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Squeeze-and-Excitation Networks
Hu, J., Shen, L., Albanie, S., Sun, G., & Wu, E. (2020) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2019.2913372 · Cited by 12,157
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1512.03385 · Cited by 4,196
Zech, J. R., Badgeley, M. A., Liu, M., Costa, A. B., Titano, J. J., & Oermann, E. K. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002683 · Cited by 1,719
Rajpurkar, P., Irvin, J., Ball, R. L., Zhu, K., Yang, B., Mehta, H., Duan, T., Ding, D., Bagul, A., Langlotz, C. P., et al. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002686 · Cited by 1,449
Self-citationDeep learning algorithms for detection of critical findings in head CT scans: a retrospective study
Chilamkurthy, S., Ghosh, R., Tanamala, S., Biviji, M., Campeau, N. G., Venugopal, V. K., Mahajan, V., Rao, P., & Warier, P. (2018) · The Lancet · doi:10.1016/s0140-6736(18)31645-3 · Cited by 1,020
Bien, N., Rajpurkar, P., Ball, R. L., Irvin, J., Park, A., Jones, E., Bereket, M., Patel, B. N., Yeom, K. W., Shpanskaya, K., et al. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002699 · Cited by 734
Self-citationAutomated deep-neural-network surveillance of cranial images for acute neurologic events
Titano, J. J., Badgeley, M., Schefflein, J., Pain, M., Su, A., Cai, M., Swinburne, N., Zech, J., Kim, J., Bederson, J., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0147-y · Cited by 458
Larson, D. B., Chen, M. C., Lungren, M. P., Halabi, S. S., Stence, N. V., & Langlotz, C. P. (2018) · Radiology · doi:10.1148/radiol.2017170236 · Cited by 456
Self-citationAssessment of Convolutional Neural Networks for Automated Classification of Chest Radiographs
Dunnmon, J. A., Yi, D., Langlotz, C. P., Ré, C., Rubin, D. L., & Lungren, M. P. (2019) · Radiology · doi:10.1148/radiol.2018181422 · Cited by 206
Self-citation
Research works printed but not linked: 41
- Horlander, K. T., Mannino, D. M. & Leeper, K. V. Pulmonary embolism mortality in the United States, 1979–1998: an analysis using multiple-cause mortality data. Arch. Intern. Med. 163, 1711–1717 (2003). · DOI · Paper page
- Le Gal, G. & Bounameaux, H. Diagnosing pulmonary embolism: running after the decreasing prevalence of cases among suspected patients. J. Thrombosis Haemost. 2, 1244–1246 (2004). · DOI
- Leung, A. N. et al. An Official American Thoracic Society/Society of Thoracic Radiology clinical practice guideline: evaluation of suspected pulmonary embolism in pregnancy. Am. J. Respir. Crit. Care Med. 184, 1200–1208 (2011). · DOI · Paper page
- Leung, A. N. et al. American Thoracic Society documents: an official American Thoracic Society/Society of Thoracic Radiology clinical practice guideline—evaluation of suspected pulmonary embolism in pregnancy. Radiology 262, 635–646 (2012). · DOI
- Yavas, U. S., Calisir, C. & Ozkan, I. R. The Interobserver Agreement between Residents and Experienced Radiologists for Detecting Pulmonary Embolism and DVT with Using CT Pulmonary Angiography and Indirect CT Venography. Korean J. Radiol. 9, 498–502 (2008). · doi:10.3348/kjr.2008.9.6.498
- Rufener, S. L., Patel, S., Kazerooni, E. A., Schipper, M. & Kelly, A. M. Comparison of on-call radiology resident and faculty interpretation of 4- and 16-row multidetector CT pulmonary angiography with indirect CT venography. Acad. Radiol. 15, 71–76 (2008). · doi:10.1016/j.acra.2007.06.030
- Joshi, R., Wu, K., Kaicker, J. & Choudur, H. Reliability of on-call radiology residents’ interpretation of 64-slice CT pulmonary angiography for the detection of pulmonary embolism. Acta Radiol. 55, 682–690 (2013). · doi:10.1177/0284185113506135
- Kline, T. J. & Kline, T. S. Radiologists, communication, and Resolution 5: a medicolegal issue. Radiology 184, 131–134 (1992). · doi:10.1148/radiology.184.1.1609068
- FitzGerald, R. Radiological error: analysis, standard setting, targeted instruction and teamworking. Eur. Radiol. 15, 1760–1767 (2005). · DOI
- Chandra, S., Sarkar, P. K., Chandra, D., Ginsberg, N. E. & Cohen, R. I. Finding an alternative diagnosis does not justify increased use of CT-pulmonary angiography. BMC Pulm. Med. 13, 9 (2013). · DOI
- Prologo, J. D., Gilkeson, R. C., Diaz, M. & Asaad, J. CT pulmonary angiography: a comparative analysis of the utilization patterns in emergency department and hospitalized patients between 1998 and 2003. Am. J. Roentgenol. 183, 1093–1096 (2004). · DOI
- Rajpurkar P. et al. Mura dataset: towards radiologist-level abnormality detection in musculoskeletal radiographs. arXiv preprint arXiv:171206957 (2017).
- Park, Allison et al. Deep Learning–Assisted Diagnosis of Cerebral Aneurysms Using the HeadXNet Model. JAMA Netw. Open 2, e195600–e195600 (2019). · DOI · Paper page
- Moore, A. J. E. et al. Imaging of acute pulmonary embolism: an update. Cardiovasc. Diagn. Ther. 8, 225–ÿ243 (2018). · doi:10.21037/cdt.2017.12.01
- Patil, S. et al. Neural network in the clinical diagnosis of acute pulmonary embolism. Chest 104, 1685–1689 (1993). · DOI
- Tourassi, G. D. et al. Artificial neural network for diagnosis of acute pulmonary embolism: effect of case and observer selection. Radiology 194, 889–893 (1995). · DOI
- Scott, J. A. & Palmer, E. L. Neural network analysis of ventilation-perfusion lung scans. Radiology 186, 661–664 (1993). · DOI
- Serpen, G., Tekkedil, D. K. & Orra, M. A knowledge-based artificial neural network classifier for pulmonary embolism diagnosis. Comput. Biol. Med. 38, 204–220 (2008). · DOI
- Liang, J., Bi, J. Computer aided detection of pulmonary embolism with tobogganing and mutiple instance classification in CT pulmonary angiography. in IPMI (eds Karssemeijer, N., Lelieveldt, B.). LNCS, vol. 4584, pp. 630–641. (Springer, Heidelberg, 2007). · DOI
- Ozkan, H., Osman, O., Şahin, S. & Boz, A. F. A novel method for pulmonary embolism detection in cta images. Comput. Methods Prog. Biomed. 113, 757–766 (2014). · doi:10.1016/j.cmpb.2013.12.014
- Park, S. C., Chapman, B. E. & Zheng, B. A multistage approach to improve performance of computer-aided detection of pulmonary embolisms depicted on CT images: preliminary investigation. IEEE Trans. Biomed. Eng. 58, 1519–1527 (2011). · doi:10.1109/tbme.2010.2063702
- Wang, et al. Improving performance of computer-aided detection of pulmonary embolisms by incorporating a new pulmonary vascular-tree segmentation algorithm. in SPIE Medical Imaging, pp. 83152U–83152U. (International Society for Optics and Photonics, 2012). · doi:10.1117/12.911301
- Das, M. et al. Computer-aided detection of pulmonary embolism: influence on radiologists detection performance with respect to vessel segments. Eur. Radiol. 18, 1350–1355 (2008). · doi:10.1007/s00330-008-0889-x
- Tajbakhsh, N., Michael B. G. & Liang J. Computer-aided pulmonary embolism detection using a novel vessel-aligned multi-planar image representation and convolutional neural networks. International Conference on Medical Image Computing and Computer-Assisted Intervention. (Springer, Cham, 2015). https://doi.org/10.1007/978-3-319-24571-3_8. · DOI
- Yang, X., et al. A two-stage convolutional neural network for pulmonary embolism detection from CTPA images. IEEE Access (2019). · DOI
- Donato, A. A., Khoche, S., Santora, J. & Wagner, B. Clinical outcomes in patients with isolated subsegmental pulmonary emboli diagnosed by multi-detector CT pulmonary angiography. Thromb. Res. 126, e266–e270 (2010). · doi:10.1016/j.thromres.2010.07.001
- Eyer, B. A., Goodman, L. R. & Washington, L. Clinicians “response to radiologists” reports of isolated subsegmental pulmonary embolism or inconclusive interpretation of pulmonary embolism using MDCT. AJR 184, 623–628 (2005). · doi:10.2214/ajr.184.2.01840623
- Bastawrous, S. & Carney, B. Improving patient safety: avoiding unread imaging exams in the national va enterprise electronic health record. J. Digit. Imaging 30, 309–313 (2017). · DOI
- Fitzgerald, R. Error in radiology. Clin. Radiol. 56, 938–946 (2001). · DOI · Paper page
- Goodman, L. R. Small pulmonary emboli: what do we know? Radiology 234, 654–658 (2005). · DOI
- Blondon, M., Righini, M., Aujesky, D., Le Gal, G. & Perrier, A. Usefulness of preemptive anticoagulation in patients with suspected pulmonary embolism: a decision analysis. Chest 142, 697–703 (2012). · DOI
- Remy-Jardin, M., Remy, J., Artaud, D., Deschildre, F. & Duhamel, A. Peripheral pulmonary arteries: optimization of the acquisition protocol. Radiology 204, 157–163 (1997). · DOI · Paper page
- Albrecht, M. H. et al. State-of-the-art pulmonary CT angiography for acute pulmonary embolism. Am. J. Roentgenol. 208, 495–504 (2017). · DOI
- Andrew L. et al. Rectifier Nonlinearities Improve Neural Network Acoustic Models. in Proc 30th International Conference on Machine Learning. vol. 28. (Atlanta, Georgia, USA, 2013).
- Kay W., et al. The Kinetics Human Action Video Dataset. http://arxiv.org/abs/1705.06950 (2017). · arXiv
- Wu Y., He K. Group Normalization. http://arxiv.org/abs/1803.08494 (2018). · arXiv
- Xie, S., et al. Aggregated Residual Transformations for Deep Neural Networks. https://arxiv.org/abs/1611.05431 (2016). · DOI · Paper page
- Huang, G., et al. Densely Connected Convolutional Networks. https://arxiv.org/abs/1608.06993 (2016). · arXiv
- Hara, K., Kataoka, H. & Satoh, Y. Can spatiotemporal 3d cnns retrace the history of 2d cnns and imagenet?. https://arxiv.org/abs/1711.09577 (2017). · DOI · Paper page
- Smith, L. N. Cyclical learning rates for training neural networks. in Proc 2017 IEEE Winter Conference on Applications of Computer Vision (WACV). (IEEE, 2017). · DOI · Paper page
- Zhou, B., et al. Learning Deep Features for Discriminative Localization. https://arxiv.org/abs/1512.04150 (2015). · arXiv
Cited by
External Validation of Deep Learning Algorithms for Radiologic Diagnosis: A Systematic Review
Yu, A. C., Mohajer, B., & Eng, J. (2022) · Radiology: Artificial Intelligence · doi:10.1148/ryai.210064 · Cited by 408
Benchmarking saliency methods for chest X-ray interpretation
Saporta, A., Gui, X., Agrawal, A., Pareek, A., Truong, S. Q. H., Nguyen, C. D. T., Ngo, V.-D., Seekins, J., Blankenberg, F. G., Ng, A. Y., et al. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00536-x · Cited by 270
Self-citationArtificial intelligence-based methods for fusion of electronic health records and imaging data
Mohsen, F., Ali, H., El Hajj, N., & Shah, Z. (2022) · Scientific Reports · doi:10.1038/s41598-022-22514-4 · Cited by 250
Huang, S.-C., Pareek, A., Zamanian, R., Banerjee, I., & Lungren, M. P. (2020) · Scientific Reports · doi:10.1038/s41598-020-78888-w · Cited by 246
Self-citationPierre, K., Haneberg, A. G., Kwak, S., Peters, K. R., Hochhegger, B., Sananmuang, T., Tunlayadechanont, P., Tighe, P. J., Mancuso, A., & Forghani, R. (2023) · Seminars in Roentgenology · doi:10.1053/j.ro.2023.02.003 · Cited by 79
Metadata
- Authors
- Huang, S.-C., Kothari, T., Banerjee, I., Chute, C., Ball, R. L., Borus, N., Huang, A., Patel, B. N., Rajpurkar, P., Irvin, J., Dunnmon, J., Bledsoe, J., Shpanskaya, K., Dhaliwal, A., Zamanian, R., Ng, A. Y., & Lungren, M. P.
- Venue
- npj Digital Medicine
- Published
- 2020-04-24
- Volume
- 3
- Issue
- 1
- Pages
- 61-61
- ISSN
- 2398-6352 (ISSN-L)
- OpenAlex
- W3018185338
- Cited by
- 189
- References
- 9
- FWCI
- 8.40
- Type
- journal article
- Language
- en
- Update notices
- correction (2020-07-28)
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- creativecommons.org/licenses/by/4.0 (vor)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: PENet—a scalable deep-learning model for automated diagnosis of pulmonary embolism using volumetric CT imaging. https://app.cochat.ai/papers/10.1038/s41746-020-0266-y
- The paper
- Huang, S.-C., Kothari, T., Banerjee, I., Chute, C., Ball, R. L., Borus, N., Huang, A., Patel, B. N., Rajpurkar, P., Irvin, J., Dunnmon, J., Bledsoe, J., Shpanskaya, K., Dhaliwal, A., Zamanian, R., Ng, A. Y., & Lungren, M. P. (2020). PENet—a scalable deep-learning model for automated diagnosis of pulmonary embolism using volumetric CT imaging. npj Digital Medicine. https://doi.org/10.1038/s41746-020-0266-y
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.