CoChat
Sign Up
Cited by 215Quantum Computing Algorithms and ArchitectureQuantum many-body systemsQuantum Information and Cryptography

Estimation of effective temperatures in quantum annealers for sampling applications: A case study with possible applications in deep learning

Open access
Benedetti, Marcello, Realpe-Gómez, John, Biswas, Rupak, Perdomo-Ortiz, Alejandro·2016·Physical Review A
DOI 10.1103/physreva.94.022308
Open this paper in CoChat — free accountOpen PDF

Abstract

An increase in the efficiency of sampling from Boltzmann distributions would have a significant impact on deep learning and other machine-learning applications. Recently, quantum annealers have been proposed as a potential candidate to speed up this task, but several limitations still bar these state-of-the-art technologies from being used effectively. One of the main limitations is that, while the device may indeed sample from a Boltzmann-like distribution, quantum dynamical arguments suggest it will do so with an instance-dependent effective temperature, different from its physical temperature. Unless this unknown temperature can be unveiled, it might not be possible to effectively use a quantum annealer for Boltzmann sampling. In this work, we propose a strategy to overcome this challenge with a simple effective-temperature estimation algorithm. We provide a systematic study assessing the impact of the effective temperatures in the learning of a special class of a restricted Boltzmann machine embedded on quantum hardware, which can serve as a building block for deep-learning architectures. We also provide a comparison to $k$-step contrastive divergence (CD-$k$) with $k$ up to 100. Although assuming a suitable fixed effective temperature also allows us to outperform one-step contrastive divergence (CD-1), only when using an instance-dependent effective temperature do we find a performance close to that of CD-100 for the case studied here.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1103/physreva.94.022308

Cites

52 of 52 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Quantum algorithms have been proposed using a D-Wave machine or a circuit algorithm that sample from the Boltzmann distribution quadratically faster than is possible classically.

    “Quantum algorithms have been proposed, using a D-Wave machine [101-103] or a circuit algorithm [104]; that sample from the Boltzmann distribution quadratically faster than it is possible classically [23].”

    From The prospects of quantum computing in computational molecular biology (2021) · cites this paper as [103]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

5 of the 57 references couldn’t be matched to a known paper.

Research works printed but not linked: 27

  1. [1]H. Neven, V. S. Denchev, G. Rose, and W. G. Macready, arXiv:0811.0416 (2008). · arXiv
  2. [2]H. Neven, V. S. Denchev, M. Drew-Brook, J. Zhang, W. G. Macready, and G. Rose, in Demonstrations at NIPS-09, 24th Annual Conference on Neural Information Processing Systems (2009), pp. 1-17.
  3. [3]H. Neven, V. S. Denchev, G. Rose, and W. G. Macready, arXiv:0912.0779 (2009). · arXiv
  4. [6]V. S. Denchev, N. Ding, S. Vishwanathan, and H. Neven, arXiv:1205.1148 (2012). · arXiv
  5. [7]S. Lloyd, M. Mohseni, and P. Rebentrost, arXiv:1307.0411 (2013). · arXiv
  6. [9]V. Dumoulin, I. J. Goodfellow, A. C. Courville, and Y. Bengio, in Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, July 27 -31, 2014, Qu´ ebec City, Qu´ ebec, Canada. (2014), pp. 1199-1205.
  7. [12]K. M. S. Nathan Wiebe, Ashish Kapoor, arXiv:1412.3489 (2015). · arXiv
  8. [16]Mohammad H. Amin and Evgeny Andriyash and Jason Rolfe and Bohdan Kulchytskyy and Roger Melko, arXiv:1601.02036 (2016). · arXiv
  9. [17]A. Finnila, M. Gomez, C. Sebenik, C. Stenson, and J. Doll, Chemical Physics Letters 219 , 343 (1994).
  10. [23]B. O'Gorman, R. Babbush, A. Perdomo-Ortiz, A. Aspuru-Guzik, and V. Smelyanskiy, The European Physical Journal Special Topics 224 , 163 (2015),
  11. [30]J. E. Dorband, in ITNG, Washington DC (2015), pp. 703-707.
  12. [31]A. Sinclair and M. Jerrum, Inf. Comput. 82 , 93 (1989), ISSN 0890-5401, URL http://dx.doi.org/10.1016/ 0890-5401(89)90067-9 .
  13. [33]P. M. Long and R. Servedio, in Proceedings of the 27th International Conference on Machine Learning (ICML10) , edited by J. Frnkranz and T. Joachims (Omnipress, 2010), pp. 703-710.
  14. [35]P. Smolensky, in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Vol. 1 , edited by D. E. Rumelhart, J. L. McClelland, and C. PDP Research Group (MIT Press, Cambridge, MA, USA, 1986), chap. Information Processing in Dynamical Systems: Foundations of Harmony Theory, pp. 194-281, ISBN 0-262-68053-X.
  15. [45]A. Fischer and C. Igel, in Proceedings of the 20th International Conference on Artificial Neural Networks: Part III (Springer-Verlag, Berlin, Heidelberg, 2010), ICANN'10, pp. 208-217, ISBN 3-642-15824-2, 978-3-642-15824-7.
  16. [47]T. Albash, S. Boixo, D. A. Lidar, and P. Zanardi, New Journal of Physics 14 , 123016 (2012).
  17. [48]V. N. Smelyanskiy, D. Venturelli, A. Perdomo-Ortiz, S. Knysh, and M. I. Dykman, arXiv:1511.02581 (2015). · arXiv
  18. [51]I. J. Myung, V. Balasubramanian, and M. A. Pitt, Proceedings of the National Academy of Sciences 97 , 11170 (2000).
  19. [52]I. Mastromatteo, ArXiv e-prints (2013), 1311.0190.
  20. [59]M. Gabrie, E. W. Tramel, and F. Krzakala, in Advances in Neural Information Processing Systems 28 , edited by C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett (Curran Associates, Inc., 2015), pp. 640-648.
  21. [60]G. E. Hinton, in Neural Networks: Tricks of the Trade (2nd ed.) , edited by G. Montavon, G. B. Orr, and K.R. Mller (Springer, 2012), vol. 7700 of Lecture Notes in Computer Science , pp. 599-619.
  22. [61]M. Benedetti, Master's thesis, Universit´ e Lumi` ere Lyon 2, France (2015).
  23. [63]J. Raymond, S. Yarkoni, and E. Andriyash, arXiv:1606.00919 (2016). · arXiv
  24. [65]M. M´ ezard and T. Mora, Journal of Physiology-Paris 103 , 107 (2009), ISSN 0928-4257, Neuromathematics of Vision.
  25. [66]F. Ricci-Tersenghi, Journal of Statistical Mechanics: Theory and Experiment 2012 , P08015 (2012).
  26. [67]H. C. Nguyen and J. Berg, Journal of Statistical Mechanics: Theory and Experiment 2012 , P03004 (2012).
  27. [69]A. Decelle and F. Ricci-Tersenghi, arXiv:1501.03034 (2015). · arXiv

Cited by

Sorted by citations

Related

Authors
Benedetti, M., Realpe-Gómez, J., Biswas, R., & Perdomo-Ortiz, A.
Affiliations
Ames Research Center (US)
ORCID
Venue
Physical Review A
Publisher
American Physical Society (APS)
Published
2016-08-09
Volume
94
Issue
2
ISSN
  • 0556-2791 (ISSN-L)
  • 2469-9926
  • 2469-9934
DOI
10.1103/physreva.94.022308
OpenAlex
W2517233404
Cited by
215
References
57
Citations by year
2026: 15 · 2025: 17 · 2024: 14 · 2023: 27 · 2022: 27 · 2021: 18 · 2020: 23 · 2019: 27 · 2018: 29 · 2017: 13 · 2016: 5
FWCI
20.06
Type
journal article
Language
en
Open access
Licence
Locations
  • Physical Review A (publishedVersion)
  • arXiv (Cornell University) (submittedVersion)
  • arXiv (Cornell University)
Funders
Ames Research Center (NNA14AA60C, NAS2-03144)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Quantum Computing Algorithms and Architecture
  • Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Quantum many-body systems
  • Physical Sciences › Computer Science › Artificial Intelligence › Quantum Information and Cryptography
Keywords
quantum annealers, effective temperature estimation, Boltzmann sampling, restricted Boltzmann machine, quantum machine learning, contrastive divergence, deep learning, quantum computing hardware, sampling efficiency

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review