The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Reprogrammable Electro-Optic Nonlinear Activation Functions for Optical Neural Networks
Open accessAbstract
We introduce an electro-optic hardware platform for nonlinear activation functions in optical neural networks. The optical-to-optical nonlinearity operates by converting a small portion of the input optical signal into an analog electric signal, which is used to intensity -modulate the original optical signal with no reduction in processing speed. Our scheme allows for complete nonlinear on-off contrast in transmission at relatively low optical power thresholds and eliminates the requirement of having additional optical sources between each of the layers of the network Moreover, the activation function is reconfigurable via electrical bias, allowing it to be programmed or trained to synthesize a variety of nonlinear responses. Using numerical simulations, we demonstrate that this activation function significantly improves the expressiveness of optical neural networks, allowing them to perform well on two benchmark machine learning tasks: learning a multi-input exclusive-OR (XOR) logic function and classification of images of handwritten numbers from the MNIST dataset. The addition of the nonlinear activation function improves test accuracy on the MNIST task from 85% to 94%.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Introduction to Fourier optics
Goodman, J. W. (1968) · Cited by 10,608
Introduction to Fourier Optics
Sutton, P. (1996) · Quantum and Semiclassical Optics: Journal of the European Optical Society Part B · doi:10.1088/1355-5111/8/5/014 · Cited by 4,934
Deep learning with coherent nanophotonic circuits
Shen, Y., Harris, N. C., Skirlo, S., Prabhu, M., Baehr-Jones, T., Hochberg, M., Sun, X., Zhao, S., Larochelle, H., Englund, D., et al. (2017) · Nature Photonics · doi:10.1038/nphoton.2017.93 · Cited by 3,340
Microwave photonics combines two worlds
Capmany, J., & Novak, D. (2007) · Nature Photonics · doi:10.1038/nphoton.2007.89 · Cited by 2,983
A fully photonics-based coherent radar system
Ghelfi, P., Laghezza, F., Scotti, F., Serafino, G., Capria, A., Pinna, S., Onori, D., Porzi, C., Scaffardi, M., Malacarne, A., et al. (2014) · Nature · doi:10.1038/nature13078 · Cited by 1,111
Larger, L., Soriano, M. C., Brunner, D., Appeltant, L., Gutierrez, J. M., Pesquera, L., Mirasso, C. R., & Fischer, I. (2012) · Optics Express · doi:10.1364/oe.20.003241 · Cited by 864
Neuromorphic photonic networks using silicon photonic weight banks
Tait, A. N., de Lima, T. F., Zhou, E., Wu, A. X., Nahmias, M. A., Shastri, B. J., & Prucnal, P. R. (2017) · Scientific Reports · doi:10.1038/s41598-017-07754-z · Cited by 849
Integrated microwave photonics
Marpaung, D., Roeloffzen, C., Heideman, R., Leinse, A., Sales, S., & Capmany, J. (2013) · Laser & Photonics Reviews · doi:10.1002/lpor.201200032 · Cited by 787
Chang, J., Sitzmann, V., Dun, X., Heidrich, W., & Wetzstein, G. (2018) · Scientific Reports · doi:10.1038/s41598-018-30619-y · Cited by 564
Training of photonic neural networks through in situ backpropagation and gradient measurement
Hughes, T. W., Minkov, M., Shi, Y., & Fan, S. (2018) · Optica · doi:10.1364/optica.5.000864 · Cited by 504
Self-citationSelf-configuring universal linear optical component [Invited]
Miller, D. A. B. (2013) · Photonics Research · doi:10.1364/prj.1.000001 · Cited by 474
Monolayer graphene as a saturable absorber in a mode-locked laser
Bao, Q., Zhang, H., Ni, Z., Wang, Y., Polavarapu, L., Shen, Z., Xu, Q.-H., Tang, D., & Loh, K. P. (2011) · Nano Research · doi:10.1007/s12274-010-0082-9 · Cited by 473
Nonlinear silicon-on-insulator waveguides for all-optical signal processing
Koos, C., Jacome, L., Poulton, C., Leuthold, J., & Freude, W. (2007) · Optics Express · doi:10.1364/oe.15.005976 · Cited by 406
Silicon Photonic Modulator Neuron
Tait, A. N., Ferreira de Lima, T., Nahmias, M. A., Miller, H. B., Peng, H.-T., Shastri, B. J., & Prucnal, P. R. (2019) · Physical Review Applied · doi:10.1103/physrevapplied.11.064043 · Cited by 331
Holography in artificial neural networks
Psaltis, D., Brady, D., Gu, X.-G., & Lin, S. (1990) · Nature · doi:10.1038/343325a0 · Cited by 279
Abu-Mostafa, Y. S., & Psaltis, D. (1987) · Scientific American · doi:10.1038/scientificamerican0387-88 · Cited by 252
Neuromorphic Photonic Integrated Circuits
Peng, H.-T., Nahmias, M. A., de Lima, T. F., Tait, A. N., & Shastri, B. J. (2018) · IEEE Journal of Selected Topics in Quantum Electronics · doi:10.1109/jstqe.2018.2840448 · Cited by 232
Fully analogue photonic reservoir computer
Duport, F., Smerieri, A., Akrout, A., Haelterman, M., & Massar, S. (2016) · Scientific Reports · doi:10.1038/srep22381 · Cited by 206
Superconducting Optoelectronic Circuits for Neuromorphic Computing
Shainline, J. M., Buckley, S. M., Mirin, R. P., & Nam, S. W. (2017) · Physical Review Applied · doi:10.1103/physrevapplied.7.034013 · Cited by 205
Matrix Optimization on Universal Unitary Photonic Devices
Pai, S., Bartlett, B., Solgaard, O., & Miller, D. A. B. (2019) · Physical Review Applied · doi:10.1103/physrevapplied.11.064044 · Cited by 197
Self-citationWide-bandwidth continuously tunable optical delay line using silicon microring resonators
Cardenas, J., Foster, M. A., Sherwood-Droz, N., Poitras, C. B., Lira, H. L. R., Zhang, B., Gaeta, A. L., Khurgin, J. B., Morton, P., & Lipson, M. (2010) · Optics Express · doi:10.1364/oe.18.026525 · Cited by 174
Nozaki, K., Matsuo, S., Fujii, T., Takeda, K., Shinya, A., Kuramochi, E., & Notomi, M. (2019) · Nature Photonics · doi:10.1038/s41566-019-0397-3 · Cited by 152
Optical frontend for a convolutional neural network
Colburn, S., Chu, Y., Shilzerman, E., & Majumdar, A. (2019) · Applied Optics · doi:10.1364/ao.58.003179 · Cited by 141
Evolution of the SEED technology: bistable logic gates to optoelectronic smart pixels
Lentine, A. L., & Miller, D. A. B. (1993) · IEEE Journal of Quantum Electronics · doi:10.1109/3.199320 · Cited by 128
All-Optical Reservoir Computing on a Photonic Chip Using Silicon-Based Ring Resonators
Coarer, F. D.-L., Sciamanna, M., Katumba, A., Freiberger, M., Dambre, J., Bienstman, P., & Rontani, D. (2018) · IEEE Journal of Selected Topics in Quantum Electronics · doi:10.1109/jstqe.2018.2836985 · Cited by 119
Networks with trainable amplitude of activation functions
Trentin, E. (2001) · Neural Networks · doi:10.1016/s0893-6080(01)00028-4 · Cited by 106
Highly uniform and low-loss passive silicon photonics devices using a 300mm CMOS platform
Selvaraja, S. K., Heyn, P. D., Winroth, G., Ong, P., Lepage, G., Cailler, C., Rigny, A., Bourdelle, K. K., Bogaerts, W., Thourhout, D. V., et al. (2014) · Optical Fiber Communication Conference · doi:10.1364/ofc.2014.th2a.33 · Cited by 82
Neuromorphic Photonics, Principles of
Shastri, B. J., Tait, A. N., de Lima, T. F., Nahmias, M. A., Peng, H.-T., & Prucnal, P. R. (2018) · Springer eBooks · doi:10.1007/978-3-642-27737-5_702-1 · Cited by 52
A comparative study of GPU programming models and architectures using neural networks
Pallipuram, V. K., Bhuiyan, M. M., & Smith, M. C. (2011) · The Journal of Supercomputing · doi:10.1007/s11227-011-0631-3 · Cited by 42
First Principles Optimization of Opto-Electronic Communication Links
Settaluri, K. T., Keraly, C. L., Yablonovitch, E., & Stojanovic, V. M. (2017) · IEEE Transactions on Circuits and Systems I Regular Papers · doi:10.1109/tcsi.2016.2633942 · Cited by 15
Thermally Tunable Hybrid Photonic Architecture for Nonlinear Optical Circuits
Radulaski, M., Bose, R., Tran, T. D., Vaerenbergh, T. V., Kielpinski, D., & Beausoleil, R. G. (2018) · ACS Photonics · doi:10.1021/acsphotonics.8b00376 · Cited by 7
Cited by
Photonics for artificial intelligence and neuromorphic computing
Shastri, B. J., Tait, A. N., Ferreira de Lima, T., Pernice, W. H. P., Bhaskaran, H., Wright, C. D., & Prucnal, P. R. (2021) · Nature Photonics · doi:10.1038/s41566-020-00754-y · Cited by 1,756
Deep learning for the design of photonic structures
Ma, W., Liu, Z., Kudyshev, Z. A., Boltasseva, A., Cai, W., & Liu, Y. (2021) · Nature Photonics · doi:10.1038/s41566-020-0685-y · Cited by 1,136
Inference in artificial intelligence with deep optics and photonics
Wetzstein, G., Ozcan, A., Gigan, S., Fan, S., Englund, D., Soljačić, M., Denz, C., Miller, D. A. B., & Psaltis, D. (2020) · Nature · doi:10.1038/s41586-020-2973-6 · Cited by 1,031
Self-citationAn optical neural chip for implementing complex-valued neural network
Zhang, H., Gu, M., Jiang, X. D., Thompson, J., Cai, H., Paesani, S., Santagati, R., Laing, A., Zhang, Y., Yung, M. H., et al. (2021) · Nature Communications · doi:10.1038/s41467-020-20719-7 · Cited by 666
Photonic matrix multiplication lights up photonic accelerator and beyond
Zhou, H., Dong, J., Cheng, J., Dong, W., Huang, C., Shen, Y., Zhang, Q., Gu, M., Qian, C., Chen, H., et al. (2022) · Light: Science & Applications · doi:10.1038/s41377-022-00717-8 · Cited by 563
Metadata
- Authors
- Williamson, I. A. D., Hughes, T. W., Minkov, M., Bartlett, B., Pai, S., & Fan, S.
- Venue
- IEEE Journal of Selected Topics in Quantum Electronics
- Published
- 2020-01
- Volume
- 26
- Issue
- 1
- Pages
- 1-12
- ISSN
- 1077-260X (ISSN-L)
- 1558-4542
- OpenAlex
- W2964082513
- Cited by
- 346
- References
- 32
- FWCI
- 14.97
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.