Agent-based homeostatic control for green energy in the smart grid
Open accessAbstract
With dwindling nonrenewable energy reserves and the adverse effects of climate change, the development of the smart electricity grid is seen as key to solving global energy security issues and to reducing carbon emissions. In this respect, there is a growing need to integrate renewable (or green) energy sources in the grid. However, the intermittency of these energy sources requires that demand must also be made more responsive to changes in supply, and a number of smart grid technologies are being developed, such as high-capacity batteries and smart meters for the home, to enable consumers to be more responsive to conditions on the grid in real time. Traditional solutions based on these technologies, however, tend to ignore the fact that individual consumers will behave in such a way that best satisfies their own preferences to use or store energy (as opposed to that of the supplier or the grid operator). Hence, in practice, it is unclear how these solutions will cope with large numbers of consumers using their devices in this way. Against this background, in this article, we develop novel control mechanisms based on the use of autonomous agents to better incorporate consumer preferences in managing demand. These agents, residing on consumers' smart meters, can both communicate with the grid and optimize their owner's energy consumption to satisfy their preferences. More specifically, we provide a novel control mechanism that models and controls a system comprising of a green energy supplier operating within the grid and a number of individual homes (each possibly owning a storage device). This control mechanism is based on the concept of homeostasis whereby control signals are sent to individual components of a system, based on their continuous feedback, in order to change their state so that the system may reach a stable equilibrium. Thus, we define a new carbon-based pricing mechanism for this green energy supplier that takes advantage of carbon-intensity signals available on the Internet in order to provide real-time pricing. The pricing scheme is designed in such a way that it can be readily implemented using existing communication technologies and is easily understandable by consumers. Building upon this, we develop new control signals that the supplier can use to incentivize agents to shift demand (using their storage device) to times when green energy is available. Moreover, we show how these signals can be adapted according to changes in supply and to various degrees of penetration of storage in the system. We empirically evaluate our system and show that, when all homes are equipped with storage devices, the supplier can significantly reduce its reliance on other carbon-emitting power sources to cater for its own shortfalls. By so doing, the supplier reduces the carbon emission of the system by up to 25% while the consumer reduces its costs by up to 14.5%. Finally, we demonstrate that our homeostatic control mechanism is not sensitive to small prediction errors and the supplier is incentivized to accurately predict its green production to minimize costs.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Techniques such as deep RL, agent-based models, online optimization, and dynamic programming can help maximize profits for decentralized storage, demand, and generation, given real-time prices.
“Techniques such as (deep) RL [291,292,810,881], agent-based models [173,662,663,863], online optimization [99], and dynamic programming [704] can then help maximize profits for decentralized storage, demand, and generation, given real-time prices.”
From Tackling climate change with machine learning (2023) · cites this paper as [663]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
An Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500 · see citing works
Gaussian Processes for Machine Learning
Rasmussen, C. E., & Williams, C. K. I. (2005) · doi:10.7551/mitpress/3206.001.0001 · Cited by 11,705 · see citing works
Introduction to Machine Learning
(2019) · Series in machine perception and artificial intelligence · doi:10.1142/9789811201967_0001 · Cited by 1,638 · see citing works
Fundamentals of Power System Economics
Kirschen, D. S., & Štrbac, G. (2004) · Wiley eBooks · doi:10.1002/0470020598 · Cited by 1,634 · see citing works
Operation and sizing of energy storage for wind power plants in a market system
Korpaas, M., Holen, A. T., & Hildrum, R. (2003) · International Journal of Electrical Power & Energy Systems · doi:10.1016/s0142-0615(03)00016-4 · Cited by 508 · see citing works
Short-Term Trading for a Wind Power Producer
Morales, J. M., Conejo, A. J., & Pérez‐Ruiz, J. (2010) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2009.2036810 · Cited by 479 · see citing works
Schweppe, F. C., Tabors, R. D., Kirtley, J. L., et al. (1980) · IEEE Transactions on Power Apparatus and Systems · doi:10.1109/tpas.1980.319745 · Cited by 383 · see citing works
Agent-based control for decentralised demand side management in the smart grid
Ramchurn, S. D., Vytelingum, P., Rogers, A., et al. (2011) · ePrints Soton (University of Southampton) · doi:10.5555/2030470.2030472 · Cited by 337 · see citing works
Self-citationAgent-based micro-storage management for the Smart Grid
Vytelingum, P., Voice, T., Ramchurn, S. D., et al. (2010) · ePrints Soton (University of Southampton) · doi:10.5555/1838206.1838212 · Cited by 316 · see citing works
Self-citationPacific Northwest GridWise? Testbed Demonstration Projects; Part I. Olympic Peninsula Project
Hammerstrom, D. J., Ambrosio, R., Carlon, T. A., et al. (2008) · doi:10.2172/926113 · Cited by 301 · see citing works
Quantifying Customer Response to Dynamic Pricing
Faruqui, A., & George, S. S. (2005) · The Electricity Journal · doi:10.1016/j.tej.2005.04.005 · Cited by 268 · see citing works
Multiagent Systems for Manufacturing Control
Bussmann, S., Jennings, N. R., & Wooldridge, M. (2004) · Springer series in agent technology/Springer series on agent technology · doi:10.1007/978-3-662-08872-2 · Cited by 211 · see citing works
Self-citationValue of combining energy storage and wind in short-term energy and balancing markets
Bathurst, G. N., & Štrbac, G. (2003) · Electric Power Systems Research · doi:10.1016/s0378-7796(03)00050-6 · Cited by 205 · see citing works
Electricity Markets: Pricing, Structures and Economics
Harris, C. (2006) · Wiley eBooks · doi:10.1002/9781118673409 · Cited by 145 · see citing works
Online mechanism design for electric vehicle charging
Gerding, E., Robu, V., Stein, S., et al. (2011) · ePrints Soton (University of Southampton) · doi:10.5555/2031678.2031733 · Cited by 130 · see citing works
Demand response in the UK's domestic sector
Hamidi, V., Li, F., & Robinson, F. V. P. (2009) · Electric Power Systems Research · doi:10.1016/j.epsr.2009.07.013 · Cited by 126 · see citing works
Milligan, M. R., Porter, K., DeMeo, E. A., et al. (2009) · IEEE Power and Energy Magazine · doi:10.1109/mpe.2009.934268 · Cited by 122 · see citing works
Gomes, C. P. (2009) · The Bridge · Cited by 118 · see citing works
Using Archon to develop real-world DAI applications. 1
Jennings, N. R., Mamdani, E. H., Corera, J., et al. (1996) · IEEE Expert · doi:10.1109/64.546585 · Cited by 106 · see citing works
Self-citationSupervisory Control of a Wind Farm
Lubośny, Z., & Bialek, J. W. (2007) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2007.901101 · Cited by 105 · see citing works
Algorithms for a spot price responding residential load controller
Schweppe, F. C., Daryanian, B., & Tabors, R. D. (1989) · IEEE Transactions on Power Systems · doi:10.1109/59.193823 · Cited by 105 · see citing works
Development of open source software for power market research: the AMES test bed
Li, H., & Tesfatsion, L. (2009) · The Journal of Energy Markets · doi:10.21314/jem.2009.020 · Cited by 104 · see citing works
DC Optimal Power Flow Formulation and Solution Using QuadProgJPreprint
Sun, J., Tesfatsion, L., Sun, J., et al. (2006) · RePEc: Research Papers in Economics · doi:10.22004/ag.econ.18221 · Cited by 86 · see citing works
Long-Term Effects of Feed-In Tariffs and Carbon Taxes on Distribution Systems
Wong, S., Bhattacharya, K., & Fuller, J. D. (2010) · IEEE Transactions on Power Systems · doi:10.1109/tpwrs.2009.2038783 · Cited by 64 · see citing works
Potential for Domestic Dynamic Demand-Side Management in the UK
Infield, D. G., Short, J. A., Horne, C., et al. (2007) · IEEE Power Engineering Society General Meeting · doi:10.1109/pes.2007.385696 · Cited by 58 · see citing works
Introduction to Machine Learning
Jin, Y., Wang, H., & Sun, C. (2021) · Studies in computational intelligence · doi:10.1007/978-3-030-74640-7_4 · Cited by 53 · see citing works
Electric Power Planning for Regulated and Deregulated Markets
Mazer, A. (2006) · Wiley eBooks · doi:10.1002/9780470130575 · Cited by 52 · see citing works
Electric power planning for regulated and deregulated markets
(2007) · Choice Reviews Online · doi:10.5860/choice.45-0301 · Cited by 46 · see citing works
COORDINATION OF DISTRIBUTED ENERGY RESOURCE AGENTS
Li, J., Poulton, G., & James, G. C. (2010) · Applied Artificial Intelligence · doi:10.1080/08839514.2010.481483 · Cited by 41 · see citing works
Optimal size of energy storage to accommodate high penetration of renewable resources in WECC system
Makarov, Y. V., Du, P., Kintner-Meyer, M. C., et al. (2010) · doi:10.1109/isgt.2010.5434768 · Cited by 23 · see citing works
Hamidi, V., Li, F., & Robinson, F. V. P. (2008) · doi:10.1109/pes.2008.4596269 · Cited by 22 · see citing works
The HomeBots System and Field Test - A Multi-Commodity Market for Predictive Power Load Management,
Ygge, F., Akkermans, J. M., Andersson, A., et al. (1999) · Data Archiving and Networked Services (DANS) · Cited by 19 · see citing works
Reliability studies of a PV-WG hybrid system in presence of multi-micro storage systems
Burgio, A., Menniti, D., Pinnarelli, A., et al. (2009) · doi:10.1109/ptc.2009.5281931 · Cited by 15 · see citing works
Influence of emissions trading scheme on market clearing and prices
Kockar, I., Conejo, A. J., & McDonald, J. R. (2009) · IEEE Power & Energy Society General Meeting (PESGM) · doi:10.1109/pes.2009.5275425 · Cited by 13 · see citing works
Facilitating emission trade within power exchange: Development of conceptual platform
Gajbhiye, R. K., & Soman, S. A. (2010) · International Conference on the European Energy Market (EEM) · doi:10.1109/eem.2010.5558759 · Cited by 3 · see citing works
Is load-based carbon trading less costly than source-based trading?
Hobbs, B. F., Bushnell, J., & Wolak, F. A. (2010) · International Conference on the European Energy Market (EEM) · doi:10.1109/eem.2010.5558761 · Cited by 2 · see citing works
Algorithms for a Spot Price Responding Residential Load Controller
Schweppe, F. C., Daryanian, B., & Tabors, R. D. (1989) · IEEE Power Engineering Review · doi:10.1109/mper.1989.4310690 · Cited by 2 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- KOK, K. AND VENEKAMP, G. 2010. Market-based control in decentralized power systems. In Proceedings of the First International Workshop on Agent Technology for Energy Systems.
- MARIEB, E. AND HOEHN, K. 2007. Human anatomy & physiology. Pearson Education.
Cited by
Sorted by citations
Tackling climate change with machine learning
Rolnick, D., Donti, P. L., Kaack, L. H., Kochanski, K., Lacoste, A., Sankaran, K., Ross, A. S., Milojevic-Dupont, N., Jaques, N., Waldman-Brown, A., et al. (2023) · ACM Computing Surveys · doi:10.1145/3485128 · Cited by 336 · see citing works
- Authors
- Ramchurn, S. D., Vytelingum, P., Rogers, A., & Jennings, N. R.
- Affiliations
- University of Southampton (GB)
- Venue
- ACM Transactions on Intelligent Systems and Technology
- Published
- 2011-07
- Volume
- 2
- Issue
- 4
- Pages
- 1-28
- ISSN
- 2157-6904 (ISSN-L)
- 2157-6912
- OpenAlex
- W1977146286
- Cited by
- 126
- References
- 37
- Citations by year
- 2026: 1 · 2025: 15 · 2024: 7 · 2023: 5 · 2022: 5 · 2021: 3 · 2020: 3 · 2019: 4 · 2018: 4 · 2017: 9 · 2016: 13 · 2015: 8 · 2014: 19 · 2013: 20 · 2012: 7
- FWCI
- 10.98
- Type
- journal article
- Language
- en
- Open access
- green
- eprints.soton.ac.uk
- Locations
- ACM Transactions on Intelligent Systems and Technology (publishedVersion)
- ePrints Soton (University of Southampton) (submittedVersion)
- Spiral (Imperial College London) (submittedVersion)
- Topics
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Smart Grid Energy Management
- Physical Sciences › Engineering › Control and Systems Engineering › Microgrid Control and Optimization
- Physical Sciences › Engineering › Electrical and Electronic Engineering › IoT-based Smart Home Systems
- Keywords
- smart grid, clean energy, renewable energy integration, homeostatic regulation, autonomous agents, demand response, energy storage, smart meters, carbon pricing, real-time pricing, carbon intensity, carbon emission reduction, consumer preferences, load shifting, energy cost reduction, multi-agent systems, energy security, renewable energy intermittency
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review