CoChat
Sign Up
PreprintCited by 99Quantum Computing Algorithms and ArchitectureQuantum many-body systemsQuantum Information and Cryptography

The DOI matches its DataCite record.

Variational Quantum Boltzmann Machines

Open access
Zoufal, Christa, Lucchi, Aurélien, Woerner, Stefan·2020·arXiv
DOI 10.48550/arxiv.2006.06004arXiv 2006.06004
Open this paper in CoChat — free accountOpen PDF

Abstract

This work presents a novel realization approach to Quantum Boltzmann Machines (QBMs). The preparation of the required Gibbs states, as well as the evaluation of the loss function's analytic gradient is based on Variational Quantum Imaginary Time Evolution, a technique that is typically used for ground state computation. In contrast to existing methods, this implementation facilitates near-term compatible QBM training with gradients of the actual loss function for arbitrary parameterized Hamiltonians which do not necessarily have to be fully-visible but may also include hidden units. The variational Gibbs state approximation is demonstrated with numerical simulations and experiments run on real quantum hardware provided by IBM Quantum. Furthermore, we illustrate the application of this variational QBM approach to generative and discriminative learning tasks using numerical simulation.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2006.06004

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Extensions of the QBM, such as the Variational Quantum Boltzmann Machine (VQBM), have improved upon trainability.

    “Extensions of the QBM, such as the Variational Quantum Boltzmann Machine (VQBM) (Zoufal et al. , 2020), have improved upon trainability.”

    From Noisy intermediate-scale quantum algorithms (2022) · cites this paper as Zoufal et al. , 2020

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 60

  1. Ackley DH, Hinton GE, Sejnowski TJ (1985) A learning algorithm for Boltzmann machines. Cogn Sci 9(1):147-169
  2. Altman E (2019) Synthesizing credit card transactions. arXiv:1910. 03033
  3. Anschütz ER, Cao Y (2019) Realizing Quantum Boltzmann Machines Through Eigenstate Thermalization. arXiv:1903.01359 · arXiv
  4. Anshu A, Arunachalam S, Kuwahara T, Soleimanifar M (2020) Sample-efficient learning of quantum many-body systems. arXiv:2004.07266 · arXiv
  5. Assis CAS, Pereira ACM, Carrano EG, Ramos R, Dias W (2018) Restricted Boltzmann machines for the prediction of trends in financial time series. In: International Joint Conference on Neural Networks
  6. Auer J, Krotscheck E, Chin SA (2001) A fourth-order real-space algorithm for solving local Schrödinger equations. The Journal of Chemical Physics 115(15):6841-6846
  7. Besag J (1975) Statistical analysis of non-lattice data. Journal of the Royal Statistical Society. Series D (The Statistician) 24(3):179- 195
  8. Boltzmann L (1877) Über die Natur der Gasmoleküle. In: Wis- senschaftliche Abhandlungen, Vol. I, II, and III Brandão FGSL, Kastoryano MJ (2019) Finite correlation length implies efficient preparation of quantum thermal states. Commun Math Phys 365(1):1-16
  9. Chowdhury A, Low GH, Wiebe N (2020) A Variational Quantum Algorithm for Preparing Quantum Gibbs States. arXiv:2002. 00055
  10. Dembo RS, Steihaug T (1983) Truncated-Newton algorithms for large- scale unconstrained optimization. Math Program 26(2):190-212
  11. Du K-L, Swamy MNS (2019) Boltzmann machines. In: Neural networks and statistical learning. Springer London, London
  12. Farhi E, Goldstone J, Gutmann S (2014) A quantum approximate optimization algorithm applied to a bounded occurrence constraint problem. arXiv:1411.4028 · arXiv
  13. Farhi E, Neven H (2018) Classification with quantum neural networks on near term processors. arXiv:1802.06002 · arXiv
  14. Fischer A (2015) Training restricted Boltzmann machines. KI - Künstliche Intelligenz 29(4):25-39
  15. Fischer A, Igel C (2012) An Introduction to Restricted Boltzmann Machines. In: Alvarez L, Mejail M, Gomez L, Jacobo J (eds) Progress in pattern recognition, image analysis, computer vision, and applications. Springer Berlin Heidelberg
  16. Fischer A, Igel C (2012) An introduction to restricted Boltzmann machines. In: Alvarez L, Mejail M, Gomez L, Jacobo J (eds) Progress in pattern recognition, image analysis, computer vision, and applications. Springer Berlin Heidelberg, Berlin, Heidelberg
  17. Gentile AA, Flynn B, Knauer S, Wiebe N, Paesani S, Granade C, Rarity J, Santagati R, Laing A (2020) Learning models of quantum systems from experiments. arXiv:2002.06169 · arXiv
  18. Gibbs JW (1902) Elementary principles in statistical mechanics. Cambridge University Press, Cambridge
  19. Gibbs JW (2010) Elementary principles in statistical mechanics: Developed with especial reference to the rational foundation of thermodynamics. Cambridge Library Collection -Mathematics. Cambridge University Press, Cambridge
  20. Greenberger DM, Horne MA, Zeilinger A (1989) Going beyond bell's theorem. Springer Netherlands, Dordrecht
  21. Gupta N, Roy AK, Deb BM (2002) One-dimensional multiple- well oscillators: A time-dependent quantum mechanical approach. Pramana 59(4):575-583
  22. Hangleiter D, Roth I, Nagaj D, Eisert J (2020) Easing the Monte Carlo sign problem. Science Advances 6(33):eabb8341. arXiv:1906.02309 · arXiv
  23. Hansen PC (2000) The L-Curve and its use in the numerical treatment of inverse problems. WIT Press, Southampton
  24. Hinton GE (2012) A practical guide to training restricted Boltzmann machines. In: Montavon G, Orr GB, Müller K-R (eds) Neural networks: Tricks of the trade: Second edition. Springer Berlin Heidelberg, Berlin, Heidelberg
  25. Hrasko R, Pacheco AGC, Krohling RA (2015) Time series prediction using restricted Boltzmann machines and backpropagation. 3rd International Conference on Information Technology and Quantitative Management 55:990-999
  26. Ising E (1925) Beitrag zur Theorie des Ferromagnetismus. Zeitschrift für Physik 31(1):253-258
  27. Kappen H (2020) Learning quantum models from quantum or classical data. Journal of Physics A: Mathematical and Theoretical 53(21). arXiv:1803.11278 · arXiv
  28. Kardestuncer H (1975) Finite differences. In: Discrete Mechanics A Unified Approach. Springer Vienna
  29. Kastoryano MJ, Brandão FGSL (2016) Quantum Gibbs samplers: The commuting case. Commun Math Phys 344(3):915-957
  30. Kingma DP, Ba J (2015) Adam: A method for stochastic optimization. In: Bengio Y, LeCun Y (eds) 3rd International Conference on Learning Representations
  31. Koczor B, Benjamin S (2019) Quantum natural gradient generalised to non-unitary circuits. arXiv:1912.08660 · arXiv
  32. Li Z-X, Jiang Y-F, Yao H (2015) Solving the fermion sign problem in quantum Monte Carlo simulations by Majorana representation. Phys. Rev. B 91:241117. https://doi.org/10.1103/PhysRevB.91. 241117 · DOI
  33. Liu B, Webb GI (2010) Generative and discriminative learning. In: Sammut C, Webb GI (eds) Encyclopedia of machine learning. Springer US, Boston, MA
  34. Liu F, Liu B, Sun C, Liu M, Wang X (2013) Deep learning approaches for link prediction in social network services. Springer Berlin Heidelberg, Berlin
  35. Magnus W (1954) On the exponential solution of differential equations for a linear operator. Commun Pur Appl Math 7(4):649-673
  36. Marrero CO, Kieferová M, Wiebe N (2020) Entanglement Induced Barren Plateaus. arXiv:2010.15968 · arXiv
  37. McArdle S, Jones T, Endo S, Li Y, Benjamin SC, Yuan X (2019) Variational ansatz-based quantum simulation of imaginary time evolution. npj Quantum Information 5(1):1-6
  38. McLachlan AD (1964) A variational solution of the time-dependent Schrödinger equation. Mol Phys 8(1):39-44
  39. Melko RG, Carleo G, Carrasquilla J, Cirac JI (2019) Restricted Boltzmann machines in quantum physics. Nat Phys 15(9):887- 892
  40. Mohamed A-R, Hinton G (2010) Phone recognition using Restricted Boltzmann machines. IEEE International Conference on Acous- tics, Speech and Signal Processing -Proceedings
  41. Montúfar G (2018) Restricted Boltzmann Machines: Introduction and Review. In: Ay N, Gibilisco P, Matúš F (eds) Information geometry and its applications. Springer International Publishing
  42. Motta M, et al. (2020) Determining eigenstates and thermal states on a quantum computer using quantum imaginary time evolution. Nat Phys 16(2):205-210
  43. Murphy KP (2012) Machine learning: a probabilistic perspective. MIT Press, Cambridge
  44. Nielsen MA, Chuang IL (2010) Quantum computation and quantum information. Cambridge University Press, Cambridge
  45. Noh H, You T, Mun J, Han B (2017) Regularizing deep neural networks by noise: Its interpretation and optimization. In: NIPS
  46. Pauli W (1927) Über Gasentartung und Paramagnetismus. Zeitschrift für Physik 41(2):81-102
  47. Peierls R (1936) On Ising's model of ferromagnetism. Math Proc Camb Philos Soc 32(3):477-481
  48. Reddi SJ, Kale S, Kumar S (2018) On the convergence of adam and beyond. In: International conference on learning representations
  49. Spieksma FCR (1995) Boltzmann machines. In: Braspenning PJ, Thuijsman F, Weijters AJMM (eds) Artificial neural networks: an introduction to ANN theory and practice. Springer Berlin Heidelberg
  50. Stamatopoulos N, Egger DJ, Sun Y, Zoufal C, Iten R, Shen N, Woerner S (2020) Option pricing using quantum computers. Quantom 4(291). arXiv:1905. 02666
  51. Sutskever I, Tieleman T (2010) On the convergence properties of contrastive divergence. Proceedings of the thirteenth interna- tional conference on artificial intelligence and statistics 9:789- 795
  52. Thompson CJ (1965) Inequality with applications in statistical mechanics. J Math Phys 6(11):1812-1813
  53. Tibshirani R (2011) Regression shrinkage and selection via the lasso: a retrospective. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 73(3):273-282
  54. Tieleman T (2008) Training restricted Boltzmann machines using approximations to the likelihood gradient. Proceedings of the 25th International Conference on Machine Learning
  55. Tikhonov AN, Goncharsky AV, Stepanov VV, Yagola AG (1995) Numerical methods for the solution of ill-posed problems. Mathematics and Its Applications. Springer, Berlin
  56. Torlai G, Mazzola G, Carrasquilla J, Troyer M, Melko R, Carleo G (2018) Neural-network quantum state tomography. Nat Phys 14(5):447-450
  57. Wiebe N, Wossnig L (2019) Generative training of quantum Boltzmann machines with hidden units. arXiv:1905.09902 · arXiv
  58. Younes L (1996) Synchronous Boltzmann machines can be universal approximators. Appl Math Lett 9(3):109-113
  59. Yung M-H, Aspuru-Guzik A (2012) A quantum-quantum Metropolis algorithm. Proceedings of the National Academy of Sciences 109(3):754-759
  60. Zoufal C, Lucchi A, Woerner S (2019) Quantum generative adversarial networks for learning and loading random distributions. npj Quantum Information 5(1):1-9

Cited by

Sorted by citations

Metadata

Authors
Zoufal, C., Lucchi, A., & Woerner, S.
Affiliations
  • ETH Zurich (CH)
  • IBM Research - Zurich (CH)
Corresponding author
Woerner, Stefan
ORCID
Venue
arXiv
Publisher
arXiv
Published
2020
Volume
3
Issue
1
ISSN
2524-4906 (ISSN-L)
DOI
10.48550/arxiv.2006.06004
arXiv
2006.06004
OpenAlex
W3034772724
Cited by
99
References
0
Citations by year
2026: 7 · 2025: 15 · 2024: 24 · 2023: 22 · 2022: 14 · 2021: 16 · 2020: 1
FWCI
6.72
Type
journal article
Language
en
Open access
Licence
Locations
  • Quantum Machine Intelligence (publishedVersion, cc-by)
  • arXiv (Cornell University) (submittedVersion)
  • Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by)
  • arXiv (Cornell University)
  • ETH Zürich Research Collection (cc-by)
  • Bulletin of the American Physical Society
Funders
  • International Business Machines Corporation
  • Eidgenössische Technische Hochschule Zürich
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Quantum Computing Algorithms and Architecture
  • Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Quantum many-body systems
  • Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Quantum Information and Cryptography
Keywords
quantum Boltzmann machines, variational quantum circuits, gradient-based learning, hidden units, generative models, discriminative models, quantum machine learning

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review