Learned Integrated Sensing Pipeline: Reconfigurable Metasurface Transceivers as Trainable Physical Layer in an Artificial Neural Network
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
The rapid proliferation of intelligent systems (e.g., fully autonomous vehicles) in today's society relies on sensors with low latency and computational effort. Yet current sensing systems ignore most available a priori knowledge, notably in the design of the hardware level, such that they fail to extract as much task‐relevant information per measurement as possible. Here, a “learned integrated sensing pipeline” (LISP), including in an end‐to‐end fashion both physical and processing layers, is shown to enable joint learning of optimal measurement strategies and a matching processing algorithm, making use of a priori knowledge on task, scene, and measurement constraints. Numerical results demonstrate accuracy improvements around 15% for object recognition tasks with limited numbers of measurements, using dynamic metasurface apertures capable of transceiving programmable microwave patterns. Moreover, it is concluded that the optimal learned microwave patterns are nonintuitive, underlining the importance of the LISP paradigm in current sensorization trends.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Adam: A Method for Stochastic Optimization
Kingma, D. P., & Ba, J. (2014) · arXiv · doi:10.48550/arxiv.1412.6980 · Cited by 98,946
Learning representations by back-propagating errors
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986) · Nature · doi:10.1038/323533a0 · Cited by 31,892
Efficient Processing of Deep Neural Networks: A Tutorial and Survey
Sze, V., Chen, Y.-H., Yang, T.-J., & Emer, J. S. (2017) · Proceedings of the IEEE · doi:10.1109/jproc.2017.2761740 · Cited by 4,215 · cited 1×
“In future implementations, it may be worthwhile to include additional measurement and processing constraints in the LISP, such as phaseless measurements and few-bit processing [76], to lower the hardware requirements further.”
MethodCoding Metamaterials, Digital Metamaterials and Programmable Metamaterials
Cui, T. J., Qi, M. Q., Wan, X., Zhao, J., & Cheng, Q. (2014) · Light: Science & Applications · doi:10.1038/lsa.2014.99 · Cited by 3,801 · cited 1×
“Our LISP could of course also be implemented with other wavefront shaping setups such as arrays of reconfigurable antennas [23], reflect-arrays illuminated by a separate feed (e.g. a horn antenna) [50–52] or leaky-wave antennas with individually controllable radiating elements [53, 54].”
MethodDeep learning with coherent nanophotonic circuits
Shen, Y., Harris, N. C., Skirlo, S., Prabhu, M., Baehr-Jones, T., Hochberg, M., Sun, X., Zhao, S., Larochelle, H., Englund, D., et al. (2017) · Nature Photonics · doi:10.1038/nphoton.2017.93 · Cited by 3,340
End-to-End Incremental Learning
Castro, F. M., Marín-Jiménez, M. J., Guil, N., Schmid, C., & Alahari, K. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01258-8_15 · Cited by 1,184
Performing Mathematical Operations with Metamaterials
Silva, A., Monticone, F., Castaldi, G., Galdi, V., Alù, A., & Engheta, N. (2014) · Science · doi:10.1126/science.1242818 · Cited by 1,136 · cited 1×
“Interestingly, our LISP can also be interpreted in light of recent efforts to meet the exploding computational demands of ANNs with wave-based analog computing, which seeks to perform desired operations with waves as they interact with carefully tailored systems [36–43].”
A survey on ambient-assisted living tools for older adults
Rashidi, P., & Mihailidis, A. (2013) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2012.2234129 · Cited by 1,128
Inverse design and demonstration of a compact and broadband on-chip wavelength demultiplexer
Piggott, A. Y., Lu, J., Lagoudakis, K. G., Petykiewicz, J., Babinec, T. M., & Vučković, J. (2015) · Nature Photonics · doi:10.1038/nphoton.2015.69 · Cited by 1,113
Cited by
Optical meta-waveguides for integrated photonics and beyond
Meng, Y., Chen, Y., Lu, L., Ding, Y., Cusano, A., Fan, J. A., Hu, Q., Wang, K., Xie, Z., Liu, Z., et al. (2021) · Light: Science & Applications · doi:10.1038/s41377-021-00655-x · Cited by 464
Zhang, Z., Wen, F., Sun, Z., Guo, X., He, T., & Lee, C. (2022) · Advanced Intelligent Systems · doi:10.1002/aisy.202100228 · Cited by 464
Analogue computing with metamaterials
Zangeneh-Nejad, F., Sounas, D. L., Alù, A., & Fleury, R. (2020) · Nature Reviews Materials · doi:10.1038/s41578-020-00243-2 · Cited by 437
Dielectric metalens for miniaturized imaging systems: progress and challenges
Pan, M., Fu, Y., Zheng, M., Chen, H., Zang, Y., Duan, H., Li, Q., Qiu, M., & Hu, Y. (2022) · Light: Science & Applications · doi:10.1038/s41377-022-00885-7 · Cited by 383
Intelligent metasurfaces: control, communication and computing
Li, L., Zhao, H., Liu, C., Li, L., & Cui, T. J. (2022) · eLight · doi:10.1186/s43593-022-00013-3 · Cited by 347
Metasurface-enabled on-chip multiplexed diffractive neural networks in the visible
Luo, X., Hu, Y., Ou, X., Li, X., Lai, J., Liu, N., Cheng, X., Pan, A., & Duan, H. (2022) · Light: Science & Applications · doi:10.1038/s41377-022-00844-2 · Cited by 335
Machine learning powered ellipsometry
Liu, J., Zhang, D., Yu, D., Ren, M., & Xu, J. (2021) · Light: Science & Applications · doi:10.1038/s41377-021-00482-0 · Cited by 102
High-Efficiency Transmissive Tunable Metasurfaces for Binary Cascaded Diffractive Layers
Jia, Y., Lu, H., Fan, Z., Wu, B., Qu, F., Zhao, M.-J., Qian, C., & Chen, H. (2024) · IEEE Transactions on Antennas and Propagation · doi:10.1109/tap.2024.3385112 · Cited by 32
Metadata
- Authors
- del Hougne, P., Imani, M. F., Diebold, A. V., Horstmeyer, R., & Smith, D. R.
- Venue
- Advanced Science
- Publisher
- Wiley
- Published
- 2019-12-06
- Volume
- 7
- Issue
- 3
- Pages
- 1901913-1901913
- ISSN
- 2198-3844 (ISSN-L)
- OpenAlex
- W2992450609
- Cited by
- 143
- References
- 13
- FWCI
- 14.82
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.