Evaluating Quantum Approximate Optimization Algorithm: A Case Study
Open accessAbstract
Quantum Approximate Optimization Algorithm (QAOA) is one of the most promising quantum algorithms for the Noisy Intermediate-Scale Quantum (NISQ) era. Quantifying the performance of QAOA in the near-term regime is of utmost importance. We perform a large-scale numerical study of the approximation ratios attainable by QAOA is the low-to medium-depth regime. To find good QAOA parameters we perform 990 million 10-qubit QAOA circuit evaluations. We find that the approximation ratio increases only marginally as the depth is increased, and the gains are offset by the increasing complexity of optimizing variational parameters. We observe a high variation in approximation ratios attained by QAOA, including high variations within the same class of problem instances. We observe that the difference in approximation ratios between problem instances increases as the similarity between instances decreases. We find that optimal QAOA parameters concentrate for instances in out benchmark, confirming the previous findings for a different class of problems.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Investigations on the impact of different classical optimizers for parameter optimization in general advocate for gradient-free global optimizers when dealing with real quantum hardware.
“Investigations on the impact of different classical optimizers for parameter optimization in general advocate for gradient-free global optimizers when dealing with real quantum hardware [37, 47, 100, 121].”
From Quantum Combinatorial Optimization in the NISQ Era: A Systematic Mapping Study (2024) · cites this paper as [121]
The Methods (p. 2) describe using derivative-free BOBYQA to optimize QAOA parameters, but call it a local optimizer; the study is numerical, not an evaluation on real quantum hardware. The Discussion (p. 5) notes limitations of local optimization while also describing gradient-based approaches as promising. It does not generally advocate gradient-free global optimizers for hardware. (LLM, conf=0.86)
Experimental — accuracy not yet measuredA large-scale evaluation on QAOA validated the theoretical properties and yielded further empirical performance bounds.
“Continuing with empirical studies on gate-based quantum CO approaches, a large-scale evaluation on QAOA [92, 121] validated the theoretical properties [4, 21, 43] and yielded further empirical performance bounds.”
From Quantum Combinatorial Optimization in the NISQ Era: A Systematic Mapping Study (2024) · cites this paper as [121]
The reachability issue of QAOA has been theoretically proven and empirically validated.
“It has been theoretically proven [4, 43, 44] and empirically validated [121].”
From Quantum Combinatorial Optimization in the NISQ Era: A Systematic Mapping Study (2024) · cites this paper as [121]
Optimal parameters for QAOA are similar for similar problem instances.
“Optimal parameters for QAOA are similar for similar problem instances.”
From Quantum Combinatorial Optimization in the NISQ Era: A Systematic Mapping Study (2024) · cites this paper as [121]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Reducibility among Combinatorial Problems
Karp, R. M. (1972) · Complexity of Computer Computations · doi:10.1007/978-1-4684-2001-2_9 · Cited by 11,511 · see citing works
Goemans, M. X., & Williamson, D. P. (1995) · Journal of the ACM · doi:10.1145/227683.227684 · Cited by 3,587 · see citing works
Quantum approximate optimization algorithm for MaxCut: A fermionic view
Wang, Z., Hadfield, S., Jiang, Z., & Rieffel, E. G. (2018) · Physical Review A · doi:10.1103/physreva.97.022304 · Cited by 353 · see citing works
Performance of the Quantum Approximate Optimization Algorithm on the Maximum Cut Problem
Crooks, G. E. (2018) · arXiv · doi:10.48550/arxiv.1811.08419 · Cited by 158 · see citing works
Performance of hybrid quantum-classical variational heuristics for combinatorial optimization
Nannicini, G. (2019) · Physical Review E · doi:10.1103/physreve.99.013304 · Cited by 138 · see citing works
Multistart Methods for Quantum Approximate optimization
Shaydulin, R., Safro, I., & Larson, J. (2019) · 2019 IEEE High Performance Extreme Computing Conference (HPEC) · doi:10.1109/hpec.2019.8916288 · Cited by 110 · see citing works
Self-citationNetwork Community Detection on Small Quantum Computers
Shaydulin, R., Ushijima‐Mwesigwa, H., Safro, I., Mniszewski, S. M., & Alexeev, Y. (2019) · Advanced Quantum Technologies · doi:10.1002/qute.201900029 · Cited by 57 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 11
- [1][1] E. Farhi, J. Goldstone, and S. Gutmann, 'A quantum approximate optimization algorithm,' arXiv:1411.4028 , 2014. - · arXiv
- [2][2] --, 'A quantum approximate optimization algorithm applied to a bounded occurrence constraint problem,' arXiv:1412.6062 , 2014. - · arXiv
- [4][4] --, 'Community detection across emerging quantum architectures,' Proceedings of the 3rd International Workshop on Post Moore's Era Supercomputing , 2018. -
- [5][5] P. K. Barkoutsos, G. Nannicini, A. Robert, I. Tavernelli, and S. Woerner, 'Improving variational quantum optimization using cvar,' arXiv preprint arXiv:1907.04769 , 2019. - · arXiv
- [7][7] L. Zhou, S.-T. Wang, S. Choi, H. Pichler, and M. D. Lukin, 'Quantum approximate optimization algorithm: Performance, mechanism, and implementation on near-term devices,' arXiv:1812.01041 , 2018. - · arXiv
- [10][10] G. B. Mbeng, R. Fazio, and G. Santoro, 'Quantum annealing: a journey through digitalitalization, control, and hybrid quantum variational schemes,' arXiv preprint arXiv:1906.08948 , 2019. - · arXiv
- [14][14] M. J. Powell, 'The BOBYQA algorithm for bound constrained optimization without derivatives,' Cambridge NA Report NA2009/06, University of Cambridge, Cambridge , pp. 26-46, 2009. -
- [17][17] P. Erd˝ os and A. R´ enyi, 'On the evolution of random graphs,' Publ. Math. Inst. Hung. Acad. Sci , vol. 5, no. 1, pp. 17-60, 1960. -
- [19][19] A. A. Hagberg, D. A. Schult, and P. J. Swart, 'Exploring network structure, dynamics, and function using NetworkX,' in Proceedings of the 7th Python in Science Conference (SciPy 2008) , G. Varoquaux, T. Vaught, and J. Millman, Eds., Pasadena, CA USA, 2008, pp. 11-15. -
- [21][21] F. G. Brandao, M. Broughton, E. Farhi, S. Gutmann, and H. Neven, 'For fixed control parameters the quantum approximate optimization algorithm's objective function value concentrates for typical instances,' arXiv:1812.04170 , 2018. - · arXiv
- [23][23] S. Khairy, R. Shaydulin, L. Cincio, Y. Alexeev, and P. Balaprakash, 'Reinforcement-learning-based variational quantum circuits optimization for combinatorial problems,' Accepted for Poster Presentation at the Machine Learning and the Physical Sciences workshop at Conference on Neural Information Processing Systems (NeurIPS 2019), 2019. -
Cited by
Sorted by citations
Warm-starting quantum optimization
Egger, D. J., Mareček, J., & Woerner, S. (2021) · Quantum · doi:10.22331/q-2021-06-17-479 · Cited by 269 · see citing works
Multiblock ADMM Heuristics for Mixed-Binary Optimization on Classical and Quantum Computers
Gambella, C., & Simonetto, A. (2020) · IEEE Transactions on Quantum Engineering · doi:10.1109/tqe.2020.3033139 · Cited by 60 · see citing works
Dalyac, C., Henriet, L., Jeandel, E., Lechner, W., Perdrix, S., Porcheron, M., & Veshchezerova, M. (2021) · EPJ Quantum Technology · doi:10.1140/epjqt/s40507-021-00100-3 · Cited by 46 · see citing works
Parameter Setting in Quantum Approximate Optimization of Weighted Problems
Sureshbabu, S. H., Herman, D., Shaydulin, R., Basso, J., Chakrabarti, S., Sun, Y., & Pistoia, M. (2024) · Quantum · doi:10.22331/q-2024-01-18-1231 · Cited by 41 · see citing works
Self-citationExploiting Symmetry Reduces the Cost of Training QAOA
Shaydulin, R., & Wild, S. M. (2021) · IEEE Transactions on Quantum Engineering · doi:10.1109/tqe.2021.3066275 · Cited by 39 · see citing works
Self-citationQAOAKit: A Toolkit for Reproducible Study, Application, and Verification of the QAOA
Shaydulin, R., Marwaha, K., Wurtz, J., & Lotshaw, P. C. (2021) · 2021 IEEE/ACM Second International Workshop on Quantum Computing Software (QCS) · doi:10.1109/qcs54837.2021.00011 · Cited by 31 · see citing works
“between similar graph instances; in other words, the optimal parameters from one instance can be transferred to another one [3], [6]–[8], [12], [14], [20].”
BackgroundSelf-citationQuantum Combinatorial Optimization in the NISQ Era: A Systematic Mapping Study
Gemeinhardt, F., Garmendia, A., Wimmer, M., Weder, B., & Leymann, F. (2024) · ACM Computing Surveys · doi:10.1145/3620668 · Cited by 22 · see citing works
“It has been theoretically proven [4, 43, 44] and empirically validated [121].”
BackgroundMethodInfluentialEnergy-Efficient Cluster Head Selection via Quantum Approximate Optimization
Choi, J., Oh, S., & Kim, J. (2020) · Electronics · doi:10.3390/electronics9101669 · Cited by 20 · see citing works
High-Round QAOA for MAX $k$-SAT on Trapped Ion NISQ Devices
Pelofske, E., Bärtschi, A., Golden, J., & Eidenbenz, S. (2023) · 2023 IEEE International Conference on Quantum Computing and Engineering (QCE) · doi:10.1109/qce57702.2023.00064 · Cited by 15 · see citing works
Quantum Computing in Civil Engineering: Potentials and Limitations
Ploennigs, J., Berger, M., Mevissen, M., & Smarsly, K. (2025) · Lecture Notes in Civil Engineering · doi:10.1007/978-3-031-87364-5_2 · Cited by 7 · see citing works
- Authors
- Shaydulin, R., & Alexeev, Y.
- Affiliations
- Clemson University (US)
- Argonne National Laboratory (US)
- Venue
- 2019 Tenth International Green and Sustainable Computing Conference (IGSC)
- Publisher
- IEEE
- Published
- 2019-10
- Pages
- 1-6
- OpenAlex
- W2979402214
- Cited by
- 55
- References
- 7
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 9 · 2023: 12 · 2022: 12 · 2021: 9 · 2020: 5 · 2019: 2
- FWCI
- 2.68
- Type
- conference paper
- Language
- en
- Open access
- green
- arxiv.org
- Licence
- Locations
- International Green and Sustainable Computing Conference (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- arXiv (Cornell University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Quantum Computing Algorithms and Architecture
- Physical Sciences › Physics and Astronomy › Atomic and Molecular Physics, and Optics › Quantum many-body systems
- Physical Sciences › Computer Science › Artificial Intelligence › Metaheuristic Optimization Algorithms Research
- Keywords
- quantum approximate optimization algorithm, approximation ratio, variational parameter optimization, circuit depth, NISQ devices, combinatorial optimization
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review