The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Universal quantum control through deep reinforcement learning
Open accessAbstract
Emerging reinforcement learning techniques using deep neural networks have shown great promise in control optimization. They harness non-local regularities of noisy control trajectories and facilitate transfer learning between tasks. To leverage these powerful capabilities for quantum control optimization, we propose a new control framework to simultaneously optimize the speed and fidelity of quantum computation against both leakage and stochastic control errors. For a broad family of two-qubit unitary gates that are important for quantum simulation of many-electron systems, we improve the control robustness by adding control noise into training environments for reinforcement learning agents trained with trusted-region-policy-optimization. The agent control solutions demonstrate a two-order-of-magnitude reduction in average-gate-error over baseline stochastic-gradient-descent solutions and up to a one-order-of-magnitude reduction in gate time from optimal gate synthesis counterparts. These significant improvements in both fidelity and runtime are achieved by combining new physical understandings and state-of-the-art machine learning techniques. Our results open a venue for wider applications in quantum simulation, quantum chemistry and quantum supremacy tests using near-term quantum devices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mastering the game of Go with deep neural networks and tree search
Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al. (2016) · Nature · doi:10.1038/nature16961 · Cited by 15,612
Simulating physics with computers
Feynman, R. P. (1982) · International Journal of Theoretical Physics · doi:10.1007/bf02650179 · Cited by 7,691
Asynchronous Methods for Deep Reinforcement Learning
Mnih, V., Badia, A. P., Mirza, M., Graves, A., Lillicrap, T. P., Harley, T., Silver, D., & Kavukcuoglu, K. (2016) · arXiv · doi:10.48550/arxiv.1602.01783 · Cited by 7,132
Quantum Mechanics Helps in Searching for a Needle in a Haystack
Grover, L. K. (1997) · Physical Review Letters · doi:10.1103/physrevlett.79.325 · Cited by 4,306
Khaneja, N., Reiss, T., Kehlet, C., Schulte-Herbrüggen, T., & Glaser, S. J. (2005) · Journal of Magnetic Resonance · doi:10.1016/j.jmr.2004.11.004 · Cited by 1,854
Superconducting quantum circuits at the surface code threshold for fault tolerance
Barends, R., Kelly, J., Megrant, A., Veitia, A., Sank, D., Jeffrey, E., White, T. C., Mutus, J., Fowler, A. G., Campbell, B., et al. (2014) · Nature · doi:10.1038/nature13171 · Cited by 1,733
IEEE Transactions on Neural Networks and Learning Systems
(2013) · IEEE Computational Intelligence Magazine · doi:10.1109/mci.2013.2264575 · Cited by 1,573
Characterizing quantum supremacy in near-term devices
Boixo, S., Isakov, S. V., Smelyanskiy, V. N., Babbush, R., Ding, N., Jiang, Z., Bremner, M. J., Martinis, J. M., & Neven, H. (2018) · Nature Physics · doi:10.1038/s41567-018-0124-x · Cited by 1,175
Self-citationIdentifying and attacking the saddle point problem in high-dimensional non-convex optimization
Dauphin, Y., Pascanu, R., Gulcehre, C., Cho, K., Ganguli, S., & Bengio, Y. (2014) · arXiv · doi:10.48550/arxiv.1406.2572 · Cited by 827
Simple Pulses for Elimination of Leakage in Weakly Nonlinear Qubits
Motzoi, F., Gambetta, J. M., Rebentrost, P., & Wilhelm, F. K. (2009) · Physical Review Letters · doi:10.1103/physrevlett.103.110501 · Cited by 814
A simple formula for the average gate fidelity of a quantum dynamical operation
Nielsen, M. A. (2002) · Physics Letters A · doi:10.1016/s0375-9601(02)01272-0 · Cited by 725
Scalable and Robust Randomized Benchmarking of Quantum Processes
Magesan, E., Gambetta, J. M., & Emerson, J. (2011) · Physical Review Letters · doi:10.1103/physrevlett.106.180504 · Cited by 724
Progress towards practical quantum variational algorithms
Wecker, D., Hastings, M. B., & Troyer, M. (2015) · Physical Review A · doi:10.1103/physreva.92.042303 · Cited by 716
Quantum control theory and applications: a survey
Dong, D., & Petersen, I. R. (2010) · IET Control Theory & Applications · doi:10.1049/iet-cta.2009.0508 · Cited by 601
Qubit Architecture with High Coherence and Fast Tunable Coupling
Chen, Y., Neill, C., Roushan, P., Leung, N., Fang, M., Barends, R., Kelly, J., Campbell, B., Chen, Z., Chiaro, B., et al. (2014) · Physical Review Letters · doi:10.1103/physrevlett.113.220502 · Cited by 584
A blueprint for demonstrating quantum supremacy with superconducting qubits
Neill, C., Roushan, P., Kechedzhi, K., Boixo, S., Isakov, S. V., Smelyanskiy, V., Megrant, A., Chiaro, B., Dunsworth, A., Arya, K., et al. (2018) · Science · doi:10.1126/science.aao4309 · Cited by 458
Self-citationOptimal quantum circuits for general two-qubit gates
Vatan, F., & Williams, C. (2004) · Physical Review A · doi:10.1103/physreva.69.032315 · Cited by 443
Quantum Simulation of Electronic Structure with Linear Depth and Connectivity
Kivlichan, I. D., McClean, J., Wiebe, N., Gidney, C., Aspuru-Guzik, A., Chan, G. K.-L., & Babbush, R. (2018) · Physical Review Letters · doi:10.1103/physrevlett.120.110501 · Cited by 431
Optimally robust shortcuts to population inversion in two-level quantum systems
Ruschhaupt, A., Chen, X., Alonso, D., & Muga, J. G. (2012) · New Journal of Physics · doi:10.1088/1367-2630/14/9/093040 · Cited by 360
Fluctuations of Energy-Relaxation Times in Superconducting Qubits
Klimov, P. V., Kelly, J., Chen, Z., Neeley, M., Megrant, A., Burkett, B., Barends, R., Arya, K., Chiaro, B., Chen, Y., et al. (2018) · Physical Review Letters · doi:10.1103/physrevlett.121.090502 · Cited by 328
Self-citationAnalytic control methods for high-fidelity unitary operations in a weakly nonlinear oscillator
Gambetta, J. M., Motzoi, F., Merkel, S. T., & Wilhelm, F. K. (2011) · Physical Review A · doi:10.1103/physreva.83.012308 · Cited by 268
Zueco, D., Reuther, G. M., Kohler, S., & Hänggi, P. (2009) · Physical Review A · doi:10.1103/physreva.80.033846 · Cited by 201
Fast adiabatic qubit gates using onlyσzcontrol
Martinis, J. M., & Geller, M. R. (2014) · Physical Review A · doi:10.1103/physreva.90.022307 · Cited by 195
Bounding quantum gate error rate based on reported average fidelity
Sanders, Y. R., Wallman, J. J., & Sanders, B. C. (2015) · New Journal of Physics · doi:10.1088/1367-2630/18/1/012002 · Cited by 180
Quantification and characterization of leakage errors
Wood, C. J., & Gambetta, J. M. (2018) · Physical Review A · doi:10.1103/physreva.97.032306 · Cited by 177
Quantum Algorithms to Simulate Many-Body Physics of Correlated Fermions
Jiang, Z., Sung, K. J., Kechedzhi, K., Smelyanskiy, V. N., & Boixo, S. (2018) · Physical Review Applied · doi:10.1103/physrevapplied.9.044036 · Cited by 175
Self-citationChakrabarti, R., & Rabitz, H. (2007) · International Reviews in Physical Chemistry · doi:10.1080/01442350701633300 · Cited by 165
Fidelity-Based Probabilistic Q-Learning for Control of Quantum Systems
Chen, C., Dong, D., Li, H., Chu, J., & Tarn, T. (2013) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2013.2283574 · Cited by 154
High-Fidelity Single-Shot Toffoli Gate via Quantum Control
Zahedinejad, E., Ghosh, J., & Sanders, B. C. (2015) · Physical Review Letters · doi:10.1103/physrevlett.114.200502 · Cited by 151
Optimal control of coupled Josephson qubits
Spörl, A. K., Schulte‐Herbrüggen, T., Glaser, S. J., Bergholm, V., Storcz, M. J., Ferber, J., & Wilhelm, F. K. (2007) · Physical Review A · doi:10.1103/physreva.75.012302 · Cited by 120
Robust Optimal Quantum Gates for Josephson Charge Qubits
Montangero, S., Calarco, T., & Fazio, R. (2007) · Physical Review Letters · doi:10.1103/physrevlett.99.170501 · Cited by 119
Learning in quantum control: High-dimensional global optimization for noisy quantum dynamics
Palittapongarnpim, P., Wittek, P., Zahedinejad, E., Vedaie, S. S., & Sanders, B. C. (2017) · Neurocomputing · doi:10.1016/j.neucom.2016.12.087 · Cited by 108
Designing High-Fidelity Single-Shot Three-Qubit Gates: A Machine-Learning Approach
Zahedinejad, E., Ghosh, J., & Sanders, B. C. (2016) · Physical Review Applied · doi:10.1103/physrevapplied.6.054005 · Cited by 102
Robust characterization of leakage errors
Wallman, J. J., Barnhill, M., & Emerson, J. (2016) · New Journal of Physics · doi:10.1088/1367-2630/18/4/043021 · Cited by 97
Glassy Phase of Optimal Quantum Control
Day, A. G. R., Bukov, M., Weinberg, P., Mehta, P., & Sels, D. (2019) · Physical Review Letters · doi:10.1103/physrevlett.122.020601 · Cited by 69
Learning robust pulses for generating universal quantum gates
Dong, D., Wu, C., Chen, C., Qi, B., Petersen, I. R., & Nori, F. (2016) · Scientific Reports · doi:10.1038/srep36090 · Cited by 63
Robust Learning Control Design for Quantum Unitary Transformations
Wu, C., Qi, B., Chen, C., & Dong, D. (2016) · IEEE Transactions on Cybernetics · doi:10.1109/tcyb.2016.2610979 · Cited by 59
Gate-error analysis in simulations of quantum computers with transmon qubits
Willsch, D., Nocon, M., Jin, F., Raedt, H. A. D., & Michielsen, K. F. L. (2017) · Physical Review A · doi:10.1103/physreva.96.062302 · Cited by 57
Goldin, Y., & Avishai, Y. (2000) · Physical review. B, Condensed matter · doi:10.1103/physrevb.61.16750 · Cited by 52
On the relationship between quantum control landscape structure and optimization complexity
Moore, K. W., Hsieh, M., & RABITZ, H. A. (2008) · The Journal of Chemical Physics · doi:10.1063/1.2907740 · Cited by 46
Characterization of control noise effects in optimal quantum unitary dynamics
Hocker, D. L., Brif, C., Grace, M., Donovan, A., Ho, T.-S., Tibbetts, K. M., Wu, R.-B., & RABITZ, H. A. (2014) · Physical Review A · doi:10.1103/physreva.90.062309 · Cited by 43
Leakage-resilient approach to fault-tolerant quantum computing with superconducting elements
Ghosh, J., & Fowler, A. G. (2015) · Physical Review A · doi:10.1103/physreva.91.020302 · Cited by 43
Robust quantum gates for stochastic time-varying noise
Huang, C.-H., & Goan, H. (2017) · Physical Review A · doi:10.1103/physreva.95.062325 · Cited by 33
Controlling Qubit Networks in Polynomial Time
Arenz, C., & RABITZ, H. A. (2018) · Physical Review Letters · doi:10.1103/physrevlett.120.220503 · Cited by 17
Cited by
Photonic quantum information processing: a concise review
Slussarenko, S., & Pryde, G. J. (2019) · Applied Physics Reviews · doi:10.1063/1.5115814 · Cited by 644
Koch, C. P., Boscain, U., Calarco, T., Dirr, G., Filipp, S., Glaser, S. J., Kosloff, R., Montangero, S., Schulte-Herbrüggen, T., Sugny, D., et al. (2022) · EPJ Quantum Technology · doi:10.1140/epjqt/s40507-022-00138-x · Cited by 405
Artificial intelligence and machine learning for quantum technologies
Krenn, M., Landgraf, J., Foesel, T., & Marquardt, F. (2023) · Physical Review A · doi:10.1103/physreva.107.010101 · Cited by 162
Model-Free Quantum Control with Reinforcement Learning
Sivak, V. V., Eickbusch, A., Liu, H., Royer, B., Tsioutsios, I., & Devoret, M. H. (2022) · Physical Review X · doi:10.1103/physrevx.12.011059 · Cited by 130
(2019) · doi:10.1145/3297858.3304018 · Cited by 118
“The conflict between amount of calibration and circuit latency can potentially be resolved by incorporating realistic error modeling into our optimal control tool [55].”
Background
Metadata
- Authors
- Niu, M. Y., Boixo, S., Smelyanskiy, V. N., & Neven, H.
- Venue
- npj Quantum Information
- Published
- 2019-04-23
- Volume
- 5
- Issue
- 1
- ISSN
- 2056-6387 (ISSN-L)
- OpenAlex
- W2792427217
- Cited by
- 381
- References
- 45
- FWCI
- 20.95
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.