The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Image sensing with multilayer nonlinear optical neural networks
Open accessAbstract
A nonlinear optical neural network image sensor based on an image intensifier enables efficient all-optical image encoding for a variety of machine-vision tasks. Optical imaging is commonly used for both scientific and technological applications across industry and academia. In image sensing, a measurement, such as of an object’s position or contour, is performed by computational analysis of a digitized image. An emerging image-sensing paradigm relies on optical systems that—instead of performing imaging—act as encoders that optically compress images into low-dimensional spaces by extracting salient features; however, the performance of these encoders is typically limited by their linearity. Here we report a nonlinear, multilayer optical neural network (ONN) encoder for image sensing based on a commercial image intensifier as an optical-to-optical nonlinear activation function. This nonlinear ONN outperforms similarly sized linear optical encoders across several representative tasks, including machine-vision benchmarks, flow-cytometry image classification and identification of objects in a three-dimensionally printed real scene. For machine-vision tasks, especially those featuring incoherent broadband illumination, our concept allows for a considerable reduction in the requirement of camera resolution and electronic post-processing complexity. In general, image pre-processing with ONNs should enable image-sensing applications that operate accurately with fewer pixels, fewer photons, higher throughput and lower latency.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Deep Residual Learning for Image Recognition
He, K., Zhang, X., Ren, S., & Sun, J. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.90 · Cited by 235,474
Reducing the dimensionality of data with neural networks
Hinton, G. E., & Salakhutdinov, R. R. (2006) · Science · doi:10.1126/science.1127647 · Cited by 20,928
Larian Studios Dev Team (2024) · doi:10.1145/3292500.3330701 · Cited by 8,618 · cited 4×
“By taking advantage of the large number of optical modes available in space, time, or frequency [4, 53], ONNs allow completely parallel, optical-domain computation of wide and densely connected layers in DNNs [4, 10, 11, 16], with the potential be orders of magnitude faster than electronic DNNs [13, 15, 19].”
BackgroundMethodInfluentialSantos, A. G., da Rocha, G. O., & de Andrade, J. B. (2019) · Scientific Reports · doi:10.1038/s41598-018-37186-2 · Cited by 8,495
Single-pixel imaging via compressive sampling
Duarte, M. F., Davenport, M. A., Takhar, D., Laska, J. N., Sun, T., Kelly, K. F., & Baraniuk, R. G. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2007.914730 · Cited by 3,575
5th International Conference on Learning Representations (ICLR 17)
Havrylov, S., & Titov, I. (2017) · Cited by 3,503
Photonics for artificial intelligence and neuromorphic computing
Shastri, B. J., Tait, A. N., Ferreira de Lima, T., Pernice, W. H. P., Bhaskaran, H., Wright, C. D., & Prucnal, P. R. (2021) · Nature Photonics · doi:10.1038/s41566-020-00754-y · Cited by 1,756
All-optical spiking neurosynaptic networks with self-learning capabilities
Feldmann, J., Youngblood, N., Wright, C. D., Bhaskaran, H., & Pernice, W. H. P. (2019) · Nature · doi:10.1038/s41586-019-1157-8 · Cited by 1,529
11 TOPS photonic convolutional accelerator for optical neural networks
Xu, X., Tan, M., Corcoran, B., Wu, J., Boes, A., Nguyen, T. G., Chu, S. T., Little, B. E., Hicks, D. G., Morandotti, R., et al. (2021) · Nature · doi:10.1038/s41586-020-03063-0 · Cited by 1,518
Ultrafast machine vision with 2D material neural network image sensors
Mennel, L., Symonowicz, J., Wachter, S., Polyushkin, D. K., Molina-Mendoza, A. J., & Mueller, T. (2020) · Nature · doi:10.1038/s41586-020-2038-x · Cited by 1,167
Cited by
The physics of optical computing
McMahon, P. L. (2023) · Nature Reviews Physics · doi:10.1038/s42254-023-00645-5 · Cited by 418
Self-citationDifferential perovskite hemispherical photodetector for intelligent imaging and location tracking
Feng, X., Li, C., Song, J., He, Y., Qu, W., Li, W., Guo, K., Liu, L., Yang, B., & Wei, H. (2024) · Nature Communications · doi:10.1038/s41467-024-44857-4 · Cited by 73
Polaritonic machine learning for graph-based data analysis
Wang, Y., Scali, S., & Kyriienko, O. (2026) · Physical Review E · doi:10.1103/fgy1-n4vp
Metadata
- Authors
- Wang, T., Sohoni, M. M., Wright, L. G., Stein, M. M., Ma, S.-Y., Onodera, T., Anderson, M. G., & McMahon, P. L.
- Venue
- Nature Photonics
- Published
- 2023-03-23
- Volume
- 17
- Issue
- 5
- Pages
- 408-415
- ISSN
- 1749-4885 (ISSN-L)
- 1749-4893
- OpenAlex
- W4360612389
- Cited by
- 273
- References
- 48
- FWCI
- 23.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Image sensing with multilayer nonlinear optical neural networks. https://app.cochat.ai/papers/10.1038/s41566-023-01170-8
- The paper
- Wang, T., Sohoni, M. M., Wright, L. G., Stein, M. M., Ma, S.-Y., Onodera, T., Anderson, M. G., & McMahon, P. L. (2023). Image sensing with multilayer nonlinear optical neural networks. Nature Photonics. https://doi.org/10.1038/s41566-023-01170-8
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.