Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
Cited by 2

The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.

Greener deep reinforcement learning: analysis of energy and carbon efficiency across Atari benchmarks

Gardner, Jason, Dutta, Ayan, Roy, Swapnoneel, Patrick Kreidl, O., Bölöni, Ladislau·2026·Artificial Intelligence Review
DOI 10.1007/s10462-026-11520-x
Open this paper in CoChat — free account

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10462-026-11520-x

Cites

5 of 5 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 5 references

Research works printed but not linked: 37

  1. Asmat H, Ullah F, Khan AA, Ali F, Mohmand MI (2025) A novel caching framework for information-centric iot using deep reinforcement proximal policy optimization. Comput Commun 241:108261. https://doi.org/10.1016/j.comcom.2025.108261 · DOI
  2. Bellemare MG, Naddaf Y, Veness J, Bowling M (2013) The arcade learning environment: an evaluation platform for general agents. J Artifi Intell Res 47:253–279. https://doi.org/10.1613/jair.3912 · DOI · Paper page
  3. Blose M, Akinyemi LA, Ojo S, Faheem M, Imoize AL, Khan AA (2024) Scalable hybrid switching-driven software defined networking issue: from the perspective of reinforcement learning standpoint. IEEE Access 12:63334–63350. https://doi.org/10.1109/ACCESS.2024.3387273 · DOI
  4. Cobbe KW, Hilton J, Klimov O, Schulman J (2021) Phasic policy gradient. In: International conference on machine learning. PMLR, pp 2020–2027
  5. Dabney W, Rowland M, Bellemare M, Munos R (2018) Distributional reinforcement learning with quantile regression. Proc AAAI Conf Artif Intell. https://doi.org/10.48550/arXiv.1710.10044 · DOI
  6. Ecoffet A, Huizinga J, Lehman J, Stanley KO, Clune J (2019) Go-explore: a new approach for hard-exploration problems. https://arxiv.org/10.48550/arXiv.1901.10995. · DOI · Paper page
  7. Engstrom L, Ilyas A, Santurkar S, Tsipras D, Janoos F, Rudolph L, Madry A (2020) Implementation matters in deep policy gradients: a case study on PPO and TRPO. arXiv:2005.12729 · arXiv
  8. Espeholt L, Soyer H, Munos R, Simonyan K, Mnih V, Ward T, Doron Y, Firoiu V, Harley T, Dunning I et al (2018) Impala: Scalable distributed deep-rl with importance weighted actor-learner architectures. In: International conference on machine learning. PMLR, pp 1407–1416
  9. Freitag C, Berners-Lee M, Widdicks K, Knowles B, Blair GS, Friday A (2021) The real climate and transformative impact of ICT: a critique of estimates, trends, and regulations. Patterns 2(9):100340. https://doi.org/10.1016/j.patter.2021.100340 · DOI · Paper page
  10. Gürtler N, Blaes S, Kolev P, Widmaier F, Wüthrich M, Bauer S, Schölkopf B, Martius G (2023) Benchmarking offline reinforcement learning on real-robot hardware. https://doi.org/10.48550/arXiv.2307.15690 · DOI
  11. Henderson P, Islam R, Bachman P, Pineau J, Precup D, Meger D (2018) Deep reinforcement learning that matters. In: Proceedings of the AAAI conference on artificial intelligence, vol. 32 · DOI · Paper page
  12. Henderson P, Hu J, Romoff J, Brunskill E, Jurafsky D, Pineau J (2020) Towards the systematic reporting of the energy and carbon footprints of machine learning. J Mach Learn Res 21(248):1–43
  13. Jayaraman P, Desman J, Sabounchi M, Nadkarni GN, Sakhuja A (2024) A primer on reinforcement learning in medicine for clinicians. NPJ Digital Med 7(1):337. https://doi.org/10.1038/s41746-024-01316-0 · DOI
  14. Kakade SM (2003) On the sample complexity of reinforcement learning. PhD thesis, University College London. https://discovery.ucl.ac.uk/id/eprint/10100726/1/On%20the%20sample%20complexity%20of%20reinforcement%20learning.pdf
  15. Kearns M, Singh S (2002) Near-optimal reinforcement learning in polynomial time. Mach Learn 49(2–3):209–232. https://doi.org/10.1023/A:1017984413808 · DOI
  16. Khan AA, Zakarya M, Khan R (2019) H$$^2$$-a hybrid heterogeneity aware resource orchestrator for cloud platforms. IEEE Syst J 13(4):3873–3876. https://doi.org/10.1109/JSYST.2019.2899913 · DOI
  17. Khan AA, Zakarya M, Buyya R, Khan R, Khan M, Rana O (2021) An energy and performance aware consolidation technique for containerized datacenters. IEEE Trans Cloud Comput 9(4):1305–1322. https://doi.org/10.1109/TCC.2019.2920914 · DOI
  18. Kiran BR, Sobh I, Talpaert V, Mannion P, Al Sallab AA, Yogamani S, Pérez P (2021) Deep reinforcement learning for autonomous driving: a survey. IEEE Trans Intell Transp Syst 23(6):4909–4926 · DOI · Paper page
  19. Kulbaka I, Dutta A, Kreidl OP, Bölöni L, Roy S (2024) Gdm-net: Gas distribution mapping with a mobile robot using deep reinforcement learning and gaussian process regression. In: 2024 IEEE/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp 4511–4518 · DOI
  20. Kwiatkowski A, Towers M, Terry J, Balis JU, Cola GD, Deleu T, Goulão M, Kallinteris A, Krimmel M, KG, A, Perez-Vicente R, Pierré A, Schulhoff S, Tai JJ, Tan H, Younis OG (2024) Gymnasium: a standard interface for reinforcement learning environments. https://doi.org/10.48550/arXiv.2407.17032 · DOI
  21. Lin Y, Church A, Yang M, Li H, Lloyd J, Zhang D, Lepora NF (2023) Bi-touch: Bimanual tactile manipulation with sim-to-real deep reinforcement learning. IEEE Robot Autom Lett 8(9):5472–5479. https://doi.org/10.1109/LRA.2023.329599 · DOI
  22. Mania H, Guy A, Recht B (2018) Simple random search of static linear policies is competitive for reinforcement learning. Adv Neural Inf Process Syst 31
  23. Miao Y, Ding L, Zhang S, Bao R, Zhang L, Tao D (2025) Information-theoretic reward modeling for stable rlhf: detecting and mitigating reward hacking arXiv:2510.13694 [cs.LG] · arXiv
  24. Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, Graves A, Riedmiller M, Fidjeland AK, Ostrovski G et al (2015) Human-level control through deep reinforcement learning. Nature 518(7540):529–533. https://doi.org/10.1038/nature14236 · DOI · Paper page
  25. Mnih V, Badia AP, Mirza M, Graves A, Lillicrap T, Harley T, Silver D, Kavukcuoglu K (2016) Asynchronous methods for deep reinforcement learning. In: Balcan MF, Weinberger KQ (eds.) Proceedings of The 33rd international conference on machine learning. Proceedings of Machine Learning Research, vol. 48, pp. 1928–1937. PMLR, New York, New York, USA. https://proceedings.mlr.press/v48/mniha16.html
  26. Nickolls J, Buck I, Garland M, Skadron K (2008) Scalable parallel programming with cuda. In: ACM SIGGRAPH 2008 classes. SIGGRAPH ’08. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/1401132.1401152 · DOI
  27. Orr J, Dutta A (2023) Multi-agent deep reinforcement learning for multi-robot applications: a survey. Sensors 23(7):3625. https://doi.org/10.3390/s23073625 · DOI
  28. Raffin A, Hill A, Gleave A, Kanervisto A, Ernestus M, Dormann N (2021) Stable-Baselines3: reliable reinforcement learning implementations. J Mach Learn Res 22(268):1–8
  29. Schulman J, Levine S, Abbeel P, Jordan M, Moritz P (2015) Trust region policy optimization. In: Bach F, Blei D (eds.) Proceedings of the 32nd international conference on machine learning. Proceedings of Machine Learning Research, vol. 37, pp. 1889–1897. PMLR, Lille, France. https://proceedings.mlr.press/v37/schulman15.html
  30. Schwartz R, Dodge J, Smith NA, Etzioni O (2020) Green ai. Commun ACM 63(12):54–63 · DOI · Paper page
  31. Strubell E, Ganesh A, McCallum A (2020) Energy and policy considerations for modern deep learning research. Proc AAAI Conf Artif Intell 34:13693–13696
  32. Van Hasselt H, Guez A, Silver D (2016) Deep reinforcement learning with double q-learning. In: Proceedings of the AAAI conference on artificial intelligence, vol. 30 · DOI · Paper page
  33. Zakarya M (2018) Energy, performance and cost efficient datacenters: a survey. Renew Sustain Energy Rev 94:363–385. https://doi.org/10.1016/j.rser.2018.06.005 · DOI
  34. Zakarya M (2019) An extended energy-aware cost recovery approach for virtual machine migration. IEEE Syst J 13(2):1466–1477. https://doi.org/10.1109/JSYST.2018.2829890 · DOI
  35. Zakarya M, Gillam L (2019) Managing energy, performance and cost in large scale heterogeneous datacenters using migrations. Future Gener Comput Syst 93(C):529–547. https://doi.org/10.1016/j.future.2018.10.044 · DOI
  36. Zakarya M, Khan AA, Qazani MRC, Ali H, Al-Bahri M, Khan AUR, Ali A, Khan R (2024) Sustainable computing across datacenters: a review of enabling models and techniques. Comput Sci Rev 52:100620. https://doi.org/10.1016/j.cosrev.2024.100620 · DOI
  37. Zhou Z, Zhu X (2025) Deep reinforcement learning control unlocks enhanced heat transfer in turbulent convection. Proc Natl Acad Sci USA 122(37):2506351122. https://doi.org/10.1073/pnas.2506351122 · DOI

Cited by

Metadata

Authors
Gardner, J., Dutta, A., Roy, S., Patrick Kreidl, O., & Bölöni, L.
Venue
Artificial Intelligence Review
Publisher
Springer Science and Business Media LLC
Published
2026-03-27
Volume
59
Issue
6
ISSN
1573-7462
DOI
10.1007/s10462-026-11520-x
Cited by
2
References
5
Language
en
Licence
Funders
  • National Science Foundation, United States (1932300)
  • National Science Foundation (1931767)

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.