PreprintCited by 69Quantum Computing Algorithms and ArchitectureReinforcement Learning in RoboticsQuantum many-body systems

The DOI matches its DataCite record.

Quantum enhancements for deep reinforcement learning in large spaces

Open access
Jerbi, Sofiene, Trenkwalder, Lea M., Nautrup, Hendrik Poulsen, Briegel, Hans J., Dunjko, Vedran·2019·arXiv

Abstract

In the past decade, the field of quantum machine learning has drawn significant attention due to the prospect of bringing genuine computational advantages to now widespread algorithmic methods. However, not all domains of machine learning have benefited equally from quantum enhancements. Notably, deep learning and reinforcement learning, despite their tremendous success in the classical domain, both individually and combined, remain relatively unaddressed by the quantum community. Arguably, one reason behind this is the systematic use in these domains of models and methods without prominent computational bottlenecks, leaving little room for quantum improvements. In this work, we study the state-of-the-art neural-network approaches for reinforcement learning with quantum enhancements in mind. We demonstrate the substantial learning advantage that models with a sampling bottleneck can provide over conventional neural network architectures in complex learning environments. These so-called energy-based models, like deep energy-based reinforcement learning, and deep projective simulation that we also introduce in this work, effectively allow to trade off learning performance for efficiency of computation. To alleviate the additional computational costs, we propose to leverage future and near-term quantum algorithms, resulting in overall more advantageous learning algorithms. This is achieved using cutting-edge and new quantum computing machinery to speed-up classical sampling methods and by employing generalized models to gain an additional quantum advantage.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.1910.12760

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Quantum RL has been studied for algorithms such as SARSA or Q Learning.

    “Quantum RL has been studied for algorithms such as SARSA or Q Learning (Jerbi et al. , 2019), which are some of the elementary RL algorithms (Sutton and Barto, 2018).”

    From Noisy intermediate-scale quantum algorithms (2022) · cites this paper as Jerbi et al. , 2019

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 110

  1. Physics , vol. 56, no. 2, pp. 172-185, 2015.
  2. [5]J. Adcock, E. Allen, M. Day, S. Frick, J. Hinchliff, M. Johnson, S. Morley-Short, S. Pallister, A. Price, and S. Stanisic, 'Advances in quantum machine learning,' arXiv preprint arXiv:1512.02900 , 2015. · arXiv
  3. [6]M. Schuld, Supervised learning with quantum computers . Springer, 2018.
  4. [7]H. Neven, V. S. Denchev, G. Rose, and W. G. Macready, 'Training a binary classifier with the quantum adiabatic algorithm,' arXiv preprint arXiv:0811.0416 , 2008. · arXiv
  5. [8]S. Lloyd, S. Garnerone, and P. Zanardi, 'Quantum algorithms for topological and geometric analysis of data,' Nature communications , vol. 7, no. 1, pp. 1-7, 2016.
  6. [9]P. Rebentrost, M. Mohseni, and S. Lloyd, 'Quantum support vector machine for big data classification,' Physical review letters , vol. 113, no. 13, p. 130503, 2014.
  7. [10]S. Lloyd, M. Mohseni, and P. Rebentrost, 'Quantum principal component analysis,' Nature Physics , vol. 10, no. 9, pp. 631-633, 2014.
  8. [11]N. Wiebe, D. Braun, and S. Lloyd, 'Quantum algorithm for data fitting,' Physical review letters , vol. 109, no. 5, p. 050505, 2012.
  9. [12]J. Preskill, 'Quantum computing in the nisq era and beyond,' Quantum , vol. 2, p. 79, 2018.
  10. [13]M. H. Amin, E. Andriyash, J. Rolfe, B. Kulchytskyy, and R. Melko, 'Quantum boltzmann machine,' Physical Review X , vol. 8, no. 2, p. 021050, 2018.
  11. [14]M. Schuld, A. Bocharov, K. M. Svore, and N. Wiebe, 'Circuit-centric quantum classifiers,' Physical Review A , vol. 101, no. 3, p. 032308, 2020.
  12. [15]J. Allcock, C.-Y. Hsieh, I. Kerenidis, and S. Zhang, 'Quantum algorithms for feedforward neural networks,' arXiv preprint arXiv:1812.03089 , 2018. · arXiv
  13. [16]I. Kerenidis, J. Landman, and A. Prakash, 'Quantum algorithms for deep convolutional neural networks,' arXiv preprint arXiv:1911.01117 , 2019. · arXiv
  14. [17]D. Silver, J. Schrittwieser, K. Simonyan, I. Antonoglou, A. Huang, A. Guez, T. Hubert, L. Baker, M. Lai, A. Bolton, et al. , 'Mastering the game of go without human knowledge,' Nature , vol. 550, no. 7676, p. 354, 2017.
  15. [18]D. Silver, T. Hubert, J. Schrittwieser, I. Antonoglou, M. Lai, A. Guez, M. Lanctot, L. Sifre, D. Kumaran, T. Graepel, et al. , 'A general reinforcement learning algorithm that masters chess, shogi, and go through selfplay,' Science , vol. 362, no. 6419, pp. 1140-1144, 2018.
  16. [19]G. D. Paparo, V. Dunjko, A. Makmal, M. A. MartinDelgado, and H. J. Briegel, 'Quantum speedup for active learning agents,' Physical Review X , vol. 4, no. 3, p. 031002, 2014.
  17. [20]A. Levit, D. Crawford, N. Ghadermarzy, J. S. Oberoi, E. Zahedinejad, and P. Ronagh, 'Free energy-based reinforcement learning using a quantum processor,' arXiv preprint arXiv:1706.00074 , 2017. · arXiv
  18. [21]F. Neukart, D. Von Dollen, C. Seidel, and G. Compostella, 'Quantum-enhanced reinforcement learning for finite-episode games with discrete state spaces,' Frontiers in Physics , vol. 5, p. 71, 2018.
  19. [22]V. Dunjko, Y.-K. Liu, X. Wu, and J. M. Taylor, 'Exponential improvements for quantum-accessible reinforcement learning,' arXiv preprint arXiv:1710.11160 , 2017. · arXiv
  20. [23]V. Dunjko, J. M. Taylor, and H. J. Briegel, 'Quantumenhanced machine learning,' Physical review letters , vol. 117, no. 13, p. 130501, 2016.
  21. [24]V. Dunjko, J. M. Taylor, and H. J. Briegel, 'Framework for learning agents in quantum environments,' arXiv preprint arXiv:1507.08482 , 2015. · arXiv
  22. [26]P. Ronagh, 'Quantum algorithms for solving dynamic programming problems,' arXiv preprint arXiv:1906.02229 , 2019. · arXiv
  23. [27]V. Dunjko, J. M. Taylor, and H. J. Briegel, 'Advances in quantum reinforcement learning,' in 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC) , pp. 282-287, IEEE, 2017.
  24. [28]V. Giovannetti, S. Lloyd, and L. Maccone, 'Quantum random access memory,' Physical review letters , vol. 100, no. 16, p. 160501, 2008.
  25. [29]Y. Lecun, S. Chopra, R. Hadsell, M. A. Ranzato, and F. J. Huang, 'A tutorial on energy-based learning,' in Predicting structured data , MIT Press, 2006.
  26. [30]H. J. Kappen, 'Learning quantum models from quantum or classical data,' Journal of Physics A: Mathematical and Theoretical , vol. 53, no. 21, p. 214001, 2020.
  27. [31]V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski, et al. , 'Human-level control through deep reinforcement learning,' Nature , vol. 518, no. 7540, p. 529, 2015.
  28. [32]B. Sallans and G. E. Hinton, 'Reinforcement learning with factored states and actions,' Journal of Machine Learning Research , vol. 5, no. Aug, pp. 1063-1088, 2004.
  29. [34]H. J. Briegel and G. De las Cuevas, 'Projective simulation for artificial intelligence,' Scientific reports , vol. 2, p. 400, 2012.
  30. [35]M. August and J. M. Hern´ andez-Lobato, 'Taking gradients through experiments: Lstms and memory proximal policy optimization for black-box quantum control,' in International Conference on High Performance Computing , pp. 591-613, Springer, 2018.
  31. [36]T. F¨ osel, P. Tighineanu, T. Weiss, and F. Marquardt, 'Reinforcement learning with neural networks for quantum feedback,' Physical Review X , vol. 8, no. 3, p. 031084, 2018.
  32. [37]M. Bukov, A. G. Day, D. Sels, P. Weinberg, A. Polkovnikov, and P. Mehta, 'Reinforcement learning in different phases of quantum control,' Physical Review X , vol. 8, no. 3, p. 031086, 2018.
  33. [38]M. Bukov, 'Reinforcement learning for autonomous preparation of floquet-engineered states: Inverting the quantum kapitza oscillator,' Physical Review B , vol. 98, no. 22, p. 224305, 2018.
  34. [39]A. A. Melnikov, H. P. Nautrup, M. Krenn, V. Dunjko, M. Tiersch, A. Zeilinger, and H. J. Briegel, 'Active learning machine learns to create new quantum experiments,' Proceedings of the National Academy of Sciences , vol. 115, no. 6, pp. 1221-1226, 2018.
  35. [40]H. P. Nautrup, N. Delfosse, V. Dunjko, H. J. Briegel, and N. Friis, 'Optimizing quantum error correction codes with reinforcement learning,' Quantum , vol. 3, p. 215, 2019.
  36. [41]R. Sweke, M. S. Kesselring, E. P. van Nieuwenburg, and J. Eisert, 'Reinforcement learning decoders for fault-tolerant quantum computation,' arXiv preprint arXiv:1810.07207 , 2018. · arXiv
  37. [42]P. Palittapongarnpim, P. Wittek, and B. C. Sanders, 'Controlling adaptive quantum phase estimation with scalable reinforcement learning,' in 24th European Symposium on Artificial Neural Networks, Bruges, April 2729, 2016 , pp. 327-332, 2016.
  38. [43]S. S. Vedaie, P. Palittapongarnpim, and B. C. Sanders, 'Reinforcement learning for quantum metrology via quantum control,' in 2018 IEEE Photonics Society Summer Topical Meeting Series (SUM) , pp. 163-164, IEEE, 2018.
  39. [44]R. Porotti, D. Tamascelli, M. Restelli, and E. Prati, 'Coherent transport of quantum states by deep rein- forcement learning,' Communications Physics , vol. 2, no. 1, p. 61, 2019.
  40. [45]J. Walln¨ ofer, A. A. Melnikov, W. D¨ ur, and H. J. Briegel, 'Machine learning for long-distance quantum communication,' arXiv preprint arXiv:1904.10797 , 2019. · arXiv
  41. [46]H. Xu, J. Li, L. Liu, Y. Wang, H. Yuan, and X. Wang, 'Transferable control for quantum parameter estimation through reinforcement learning,' arXiv preprint arXiv:1904.11298 , 2019. · arXiv
  42. [47]M. Dalgaard, F. Motzoi, J. J. Sorensen, and J. Sherson, 'Global optimization of quantum dynamics with alphazero deep exploration,' npj Quantum Information , vol. 6, no. 1, 2020.
  43. [48]M. Hessel, J. Modayil, H. Van Hasselt, T. Schaul, G. Ostrovski, W. Dabney, D. Horgan, B. Piot, M. Azar, and D. Silver, 'Rainbow: Combining improvements in deep reinforcement learning,' in Thirty-Second AAAI Conference on Artificial Intelligence , 2018.
  44. [49]T. Haarnoja, H. Tang, P. Abbeel, and S. Levine, 'Reinforcement learning with deep energy-based policies,' in Proceedings of the 34th International Conference on Machine Learning-Volume 70 , pp. 1352-1361, JMLR. org, 2017.
  45. [50]G. Dulac-Arnold, R. Evans, H. van Hasselt, P. Sunehag, T. Lillicrap, J. Hunt, T. Mann, T. Weber, T. Degris, and B. Coppin, 'Deep reinforcement learning in large discrete action spaces,' arXiv preprint arXiv:1512.07679 , 2015. · arXiv
  46. [51]G. E. Hinton and T. J. Sejnowski, 'Optimal perceptual inference,' in Proceedings of the IEEE conference on Computer Vision and Pattern Recognition , pp. 448453, Citeseer, 1983.
  47. [52]E. Ising, 'Contribution to the theory of ferromagnetism,' Z. Phys. , vol. 31, pp. 253-258, 1925.
  48. [53]N. Heess, D. Silver, and Y. W. Teh, 'Actor-critic reinforcement learning with energy-based policies,' in Proceedings of the Tenth European Workshop on Reinforcement Learning , vol. 24, pp. 45-58, PMLR, 2013.
  49. [55]S. Elfwing, E. Uchibe, and K. Doya, 'From free energy to expected energy: Improving energy-based value function approximation in reinforcement learning,' Neural Networks , vol. 84, pp. 17-27, 2016.
  50. [56]D. Crawford, A. Levit, N. Ghadermarzy, J. S. Oberoi, and P. Ronagh, 'Reinforcement learning using quantum boltzmann machines,' Quantum Information & Computation , vol. 18, no. 1-2, pp. 51-74, 2018.
  51. [57]J. Martens, A. Chattopadhya, T. Pitassi, and R. Zemel, 'On the representational efficiency of restricted boltzmann machines,' in Advances in Neural Information Processing Systems , pp. 2877-2885, 2013.
  52. [58]J. Ngiam, Z. Chen, P. W. Koh, and A. Y. Ng, 'Learning deep energy models,' in Proceedings of the 28th international conference on machine learning (ICML-11) , pp. 1105-1112, 2011.
  53. [59]Y. Du and I. Mordatch, 'Implicit generation and generalization in energy-based models,' arXiv preprint arXiv:1903.08689 , 2019. · arXiv
  54. [60]P. M. Long and R. Servedio, 'Restricted boltzmann machines are hard to approximately evaluate or simulate,' in Proceedings of the 27th International Conference on Machine Learning (ICML-10) , pp. 703-710, 2010.
  55. [61]G. E. Hinton, 'A practical guide to training restricted boltzmann machines,' in Neural networks: Tricks of the trade , pp. 599-619, Springer, 2012.
  56. [62]M. Welling and G. E. Hinton, 'A new learning algorithm for mean field boltzmann machines,' in International Conference on Artificial Neural Networks , pp. 351-357, Springer, 2002.
  57. [63]M. A. Carreira-Perpinan and G. E. Hinton, 'On contrastive divergence learning.,' in Aistats , vol. 10, pp. 3340, Citeseer, 2005.
  58. [64]A. Fischer and C. Igel, 'Bounding the bias of contrastive divergence learning,' Neural computation , vol. 23, no. 3, pp. 664-673, 2011.
  59. [65]N. Le Roux and Y. Bengio, 'Representational power of restricted boltzmann machines and deep belief networks,' Neural computation , vol. 20, no. 6, pp. 16311649, 2008.
  60. [66]G. Mont´ ufar, N. Ay, and K. Ghazi-Zahedi, 'Geometry and expressive power of conditional restricted boltzmann machines,' The Journal of Machine Learning Research , vol. 16, no. 1, pp. 2405-2436, 2015.
  61. [67]G. F. Mont´ ufar, J. Rauh, and N. Ay, 'Expressive power and approximation errors of restricted boltzmann machines,' in Advances in neural information processing systems , pp. 415-423, 2011.
  62. [68]V. Vapnik and A. Y. Chervonenkis, 'On the uniform convergence of relative frequencies of events to their probabilities,' Measures of Complexity , vol. 16, no. 2, p. 11, 1971.
  63. [69]N. Harvey, C. Liaw, and A. Mehrabian, 'Nearly-tight vc-dimension bounds for piecewise linear neural networks,' in Conference on Learning Theory , pp. 10641068, 2017.
  64. [70]S. Liang and R. Srikant, 'Why deep neural networks for function approximation?,' arXiv preprint arXiv:1610.04161 , 2016. · arXiv
  65. [71]R. Salakhutdinov and G. Hinton, 'Deep boltzmann machines,' in Artificial in telligence and statistics , pp. 448455, 2009.
  66. [72]G. E. Hinton, S. Osindero, and Y.-W. Teh, 'A fast learning algorithm for deep belief nets,' Neural computation , vol. 18, no. 7, pp. 1527-1554, 2006.
  67. [74]J. N. Tsitsiklis and B. Van Roy, 'Analysis of temporaldiffference learning with function approximation,' in Advances in neural information processing systems , pp. 1075-1081, 1997.
  68. [75]J. Fu, A. Kumar, M. Soh, and S. Levine, 'Diagnosing bottlenecks in deep q-learning algorithms,' arXiv preprint arXiv:1902.10250 , 2019. · arXiv
  69. [76]A. A. Melnikov, A. Makmal, and H. J. Briegel, 'Benchmarking projective simulation in navigation problems,' IEEE Access , vol. 6, pp. 64639-64648, 2018.
  70. [77]G. Brockman, V. Cheung, L. Pettersson, J. Schneider, J. Schulman, J. Tang, and W. Zaremba, 'Openai gym,' CoRR , vol. abs/1606.01540, 2016. · arXiv
  71. [78]A. W. Harrow and A. Y. Wei, 'Adaptive quantum simulated annealing for bayesian inference and estimating partition functions,' in Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms , pp. 193-212, SIAM, 2020.
  72. [79]M.-H. Yung and A. Aspuru-Guzik, 'A quantumquantum metropolis algorithm,' Proceedings of the National Academy of Sciences , vol. 109, no. 3, pp. 754-759, 2012.
  73. [80]J. Van Apeldoorn, A. Gily´ en, S. Gribling, and R. de Wolf, 'Quantum sdp-solvers: Better upper and lower bounds,' Quantum , vol. 4, p. 230, 2020.
  74. [81]A. N. Chowdhury, G. H. Low, and N. Wiebe, 'A variational quantum algorithm for preparing quantum gibbs states,' arXiv preprint arXiv:2002.00055 , 2020. · arXiv
  75. [82]J. Wu and T. H. Hsieh, 'Variational thermal quantum simulation via thermofield double states,' Physical Review Letters , vol. 123, no. 22, p. 220502, 2019.
  76. [83]Y. Wang, G. Li, and X. Wang, 'Variational quantum gibbs state preparation with a truncated taylor series,' arXiv preprint arXiv:2005.08797 , 2020. · arXiv
  77. [84]J. Mautner, A. Makmal, D. Manzano, M. Tiersch, and H. J. Briegel, 'Projective simulation for classical learning agents: a comprehensive investigation,' New Generation Computing , vol. 33, no. 1, pp. 69-114, 2015.
  78. [85]D. J. Aldous, 'Some inequalities for reversible markov chains,' Journal of the London Mathematical Society , vol. 2, no. 3, pp. 564-576, 1982.
  79. [86]N. Srivastava and R. R. Salakhutdinov, 'Multimodal learning with deep boltzmann machines,' in Advances in neural information processing systems , pp. 2222-2230, 2012.
  80. [87]X. Gao and L.-M. Duan, 'Efficient representation of quantum many-body states with deep neural networks,' Nature communications , vol. 8, no. 1, pp. 1-6, 2017.
  81. [88]N. Wiebe and L. Wossnig, 'Generative training of quantum boltzmann machines with hidden units,' arXiv preprint arXiv:1905.09902 , 2019. · arXiv
  82. [89]D. W. Berry and A. M. Childs, 'Black-box hamiltonian simulation and unitary implementation,' arXiv preprint arXiv:0910.4157 , 2009. · arXiv
  83. [90]P. Wocjan, C.-F. Chiang, A. Abeyesinghe, and D. Nagaj, 'Quantum speed-up for approximating partition functions,' arXiv preprint arXiv:0811.0596 , 2008. · arXiv
  84. [91]C. Durr and P. Hoyer, 'A quantum algorithm for finding the minimum,' arXiv preprint quant-ph/9607014 , 1996. · arXiv
  85. [92]G. H. Low and I. L. Chuang, 'Hamiltonian simulation by qubitization,' Quantum , vol. 3, p. 163, 2019.
  86. [93]T. J. Yoder, G. H. Low, and I. L. Chuang, 'Fixed-point quantum search with an optimal number of queries,' Physical review letters , vol. 113, no. 21, p. 210501, 2014.
  87. [94]M. Szegedy, 'Quantum speed-up of markov chain based algorithms,' in Foundations of Computer Science, 2004. Proceedings. 45th Annual IEEE Symposium on , pp. 3241, IEEE, 2004.
  88. [95]F. Magniez, A. Nayak, J. Roland, and M. Santha, 'Search via quantum walk,' SIAM Journal on Computing , vol. 40, no. 1, pp. 142-164, 2011.
  89. [96]G. Brassard, M. Mosca, and A. Tapp, 'Quantum amplitude amplification and estimation,' Contemporary Mathematics , vol. 305, pp. 53-74, 2002.
  90. [97]P. Wocjan and A. Abeyesinghe, 'Speedup via quantum sampling,' Physical Review A , vol. 78, no. 4, p. 042336, 2008.
  91. [98]D. Orsucci, H. J. Briegel, and V. Dunjko, 'Faster quantum mixing for slowly evolving sequences of markov chains,' Quantum , vol. 2, p. 105, 2018.
  92. [99]K. Temme, T. J. Osborne, K. G. Vollbrecht, D. Poulin, and F. Verstraete, 'Quantum metropolis sampling,' Na- ture , vol. 471, no. 7336, pp. 87-90, 2011.
  93. [100]R. D. Somma, S. Boixo, H. Barnum, and E. Knill, 'Quantum simulations of classical annealing processes,' Physical review letters , vol. 101, no. 13, p. 130504, 2008.
  94. [101]Y. Suba¸ sı, L. Cincio, and P. J. Coles, 'Entanglement spectroscopy with a depth-two quantum circuit,' Journal of Physics A: Mathematical and Theoretical , vol. 52, no. 4, p. 044001, 2019.
  95. [102]J. Nocedal and S. Wright, Numerical optimization . Springer Science & Business Media, 2006.
  96. [103]M. R. Jerrum, L. G. Valiant, and V. V. Vazirani, 'Random generation of combinatorial structures from a uniform distribution,' Theoretical computer science , vol. 43, pp. 169-188, 1986.
  97. [104]E. Farhi and H. Neven, 'Classification with quantum neural networks on near term processors,' arXiv preprint arXiv:1802.06002 , 2018. · arXiv
  98. [105]S. Y.-C. Chen, C.-H. H. Yang, J. Qi, P.-Y. Chen, X. Ma, and H.-S. Goan, 'Variational quantum circuits for deep reinforcement learning,' arXiv preprint arXiv:1907.00397 , 2019. · arXiv
  99. [106]M. Schuld, R. Sweke, and J. J. Meyer, 'The effect of data encoding on the expressive power of variational quantum machine learning models,' arXiv preprint arXiv:2008.08605 , 2020. · arXiv
  100. [107]X. Gao, Z.-Y. Zhang, and L.-M. Duan, 'A quantum machine learning algorithm based on generative models,' Science advances , vol. 4, no. 12, p. eaat9004, 2018.
  101. [108]V. Havl´ ıˇ cek, A. D. C´ orcoles, K. Temme, A. W. Harrow, A. Kandala, J. M. Chow, and J. M. Gambetta, 'Supervised learning with quantum-enhanced feature spaces,' Nature , vol. 567, no. 7747, pp. 209-212, 2019.
  102. [109]M. Schuld and N. Killoran, 'Quantum machine learning in feature hilbert spaces,' Physical review letters , vol. 122, no. 4, p. 040504, 2019.
  103. [110]S. Lloyd, M. Schuld, A. Ijaz, J. Izaac, and N. Killoran, 'Quantum embeddings for machine learning,' arXiv preprint arXiv:2001.03622 , 2020. · arXiv
  104. [111]R. Bellman, R. Corporation, and K. M. R. Collection, Dynamic Programming . Rand Corporation research study, Princeton University Press, 1957.
  105. [113]S. Geman and D. Geman, 'Stochastic relaxation, gibbs distributions, and the bayesian restoration of images,' IEEE Transactions on pattern analysis and machine intelligence , no. 6, pp. 721-741, 1984.
  106. [114]D. H. Ackley, G. E. Hinton, and T. J. Sejnowski, 'A learning algorithm for boltzmann machines,' Cognitive science , vol. 9, no. 1, pp. 147-169, 1985.
  107. [115]A. Fischer and C. Igel, 'An introduction to restricted boltzmann machines,' in Iberoamerican Congress on Pattern Recognition , pp. 14-36, Springer, 2012.
  108. [116]M. A. Nielsen and I. L. Chuang, Quantum Computation and Quantum Information . Cambridge University Press, 2010.
  109. [117]V. Dunjko, N. Friis, and H. J. Briegel, 'Quantumenhanced deliberation of learning agents using trapped ions,' New Journal of Physics , vol. 17, no. 2, p. 023006, 2015.
  110. [118]L. Grover and T. Rudolph, 'Creating superpositions that correspond to efficiently integrable probability distributions,' arXiv preprint quant-ph/0208112 , 2002. · arXiv

Cited by

Sorted by citations

Metadata

Authors
Jerbi, S., Trenkwalder, L. M., Nautrup, H. P., Briegel, H. J., & Dunjko, V.
Affiliations
  • Universität Innsbruck (AT)
  • University of Konstanz (DE)
  • Leiden University (NL)
Venue
arXiv
Publisher
arXiv
Published
2019
Volume
2
Issue
1
ISSN
2691-3399 (ISSN-L)
OpenAlex
W3087891829
Cited by
69
References
0
Citations by year
2026: 5 · 2025: 8 · 2024: 16 · 2023: 18 · 2022: 11 · 2021: 11
FWCI
4.95
Type
journal article
Language
en
Open access
Locations
  • PRX Quantum (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • Digital Library of the University of Innsbruck (University of Innsbruck) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • arXiv (Cornell University)
Funders
  • Österreichischen Akademie der Wissenschaften
  • Austrian Science Fund (DK-ALM:W1259-N27, W 1259, F7102, W1259N27, SFB Beyond C F7102)
  • Nederlandse Organisatie voor Wetenschappelijk Onderzoek (024.003.037, 024.003)
  • Ministerium für Wissenschaft, Forschung und Kunst Baden-Württemberg (AZ:33- 7533.-30-10/41/1)
  • Universität Innsbruck (W1259)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Quantum Computing Algorithms and Architecture
  • Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
  • Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Quantum many-body systems
Keywords
quantum algorithms, energy-based models, large state spaces, hybrid quantum-classical algorithms, physics-guided machine learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review