The DOI matches its Crossref record; 45 of the 46 references it cites were found in a registry or an index.
An on-chip photonic deep neural network for image classification
Open accessAbstract
Deep neural networks with applications from computer vision to medical diagnosis 1-5 are commonly implemented using clock-based processors 6-14 , in which computation speed is mainly limited by the clock frequency and the memory access time. In the optical domain, despite advances in photonic computation 15-17 , the lack of scalable on-chip optical non-linearity and the loss of photonic devices limit the scalability of optical deep networks. Here we report an integrated end-to-end photonic deep neural network (PDNN) that performs sub-nanosecond image classification through direct processing of the optical waves impinging on the on-chip pixel array as they propagate through layers of neurons. In each neuron, linear computation is performed optically and the non-linear activation function is realized opto-electronically, allowing a classification time of under 570 ps, which is comparable with a single clock cycle of state-of-the-art digital platforms. A uniformly distributed supply light provides the same per-neuron optical output range, allowing scalability to large-scale PDNNs. Two-class and four-class classification of handwritten letters with accuracies higher than 93.8% and 89.8%, respectively, is demonstrated. Direct, clock-less processing of optical data eliminates analogue-to-digital conversion and the requirement for a large memory module, allowing faster and more energy efficient neural networks for the next generations of deep learning systems.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“What further stands out in Fig. 8 is that photonic tensor cores, which accelerate matrix-by-vector multiplication (MVM), report modest energy efficiency despite their admirable throughput [36, 164, 237].”
From Brain-inspired computing systems: a systematic literature review (2024) · cites this paper as [36]
In the citing paper
“Furthermore, not every article reports the full chip power consumption, which includes the power consumption of peripheral components, such as ADCs and DACs [36].”
From Brain-inspired computing systems: a systematic literature review (2024) · cites this paper as [36]
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2017) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2016.2577031 · Cited by 73,472
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
Ren, S., He, K., Girshick, R., & Sun, J. (2015) · arXiv · doi:10.48550/arxiv.1506.01497 · Cited by 70,812
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Cross validatory choice and assessment of statistical predictions
Stone, M. (1974) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1974.tb00994.x · Cited by 10,881
Shin, H.-C., Roth, H. R., Gao, M., Lu, L., Xu, Z., Nogues, I., Yao, J., Mollura, D., & Summers, R. M. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2528162 · Cited by 5,759
Deep learning with coherent nanophotonic circuits
Shen, Y., Harris, N. C., Skirlo, S., Prabhu, M., Baehr-Jones, T., Hochberg, M., Sun, X., Zhao, S., Larochelle, H., Englund, D., et al. (2017) · Nature Photonics · doi:10.1038/nphoton.2017.93 · Cited by 3,340
Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?
Tajbakhsh, N., Shin, J. Y., Gurudu, S. R., Hurst, R. T., Kendall, C. B., Gotway, M. B., & Liang, J. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2535302 · Cited by 3,277
Global contrast based salient region detection
Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., & Hu, S.-M. (2011) · CVPR 2011 · doi:10.1109/cvpr.2011.5995344 · Cited by 2,976
All-optical machine learning using diffractive deep neural networks
Lin, X., Rivenson, Y., Yardimci, N. T., Veli, M., Luo, Y., Jarrahi, M., & Ozcan, A. (2018) · Science · doi:10.1126/science.aat8084 · Cited by 2,568
Research works printed but not linked: 4
- LeCun, Y. & Bengio, Y. in The Handbook of Brain Theory and Neural Networks (ed. Arbib, M. A.) 255–258 (MIT Press, 1998).
- Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25, 1097–1105 (2012).
- Nair, V. & Hinton, G. E. Rectified linear units improve restricted Boltzmann machines. In Proc. 27th International Conference on Machine Learning (eds Fürnkranz, J. & Joachims, T.) 807–814 (Omnipress, 2010).
- Kist, A. M. Deep learning on edge TPUs. Preprint at https://arxiv.org/abs/2108.13732 (2021). · arXiv
Cited by
Technology Roadmap for Flexible Sensors
Luo, Y., Abidian, M. R., Ahn, J.-H., Akinwande, D., Andrews, A. M., Antonietti, M., Bao, Z., Berggren, M., Berkey, C. A., Bettinger, C. J., et al. (2023) · ACS Nano · doi:10.1021/acsnano.2c12606 · Cited by 1,383
Roadmapping the next generation of silicon photonics
Shekhar, S., Bogaerts, W., Chrostowski, L., Bowers, J. E., Hochberg, M., Soref, R., & Shastri, B. J. (2024) · Nature Communications · doi:10.1038/s41467-024-44750-0 · Cited by 878
The physics of optical computing
McMahon, P. L. (2023) · Nature Reviews Physics · doi:10.1038/s42254-023-00645-5 · Cited by 418
Microcomb-based integrated photonic processing unit
Bai, B., Yang, Q., Shu, H., Chang, L., Yang, F., Shen, B., Tao, Z., Wang, J., Xu, S., Xie, W., et al. (2023) · Nature Communications · doi:10.1038/s41467-022-35506-9 · Cited by 345
Large-scale photonic chiplet Taichi empowers 160-TOPS/W artificial general intelligence
Xu, Z., Zhou, T., Ma, M., Deng, C., Dai, Q., & Fang, L. (2024) · Science · doi:10.1126/science.adl1203 · Cited by 308
Metadata
- Authors
- Ashtiani, F., Geers, A. J., & Aflatouni, F.
- Affiliations
- University of Pennsylvania (US)
- Corresponding author
- Aflatouni, Firooz
- Venue
- Nature
- Published
- 2022-06-01
- Volume
- 606
- Issue
- 7914
- Pages
- 501-506
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W4281845262
- Cited by
- 699
- References
- 46
- Citations by year
- 2026: 114 · 2025: 235 · 2024: 191 · 2023: 121 · 2022: 38
- FWCI
- 48.13
- Type
- journal article
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- www.springer.com/tdm (tdm)
- www.springer.com/tdm (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Figshare (submittedVersion, public-domain)
- arXiv (Cornell University) (cc-by)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Neural Networks and Reservoir Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Advanced Memory and Neural Computing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Photonic and Optical Devices
- Keywords
- silicon photonics, image classification, handwritten letter recognition, energy-efficient neural networks
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An on-chip photonic deep neural network for image classification. https://app.cochat.ai/papers/10.1038/s41586-022-04714-0
- The paper
- Ashtiani, F., Geers, A. J., & Aflatouni, F. (2022). An on-chip photonic deep neural network for image classification. Nature. https://doi.org/10.1038/s41586-022-04714-0
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.