A Multi-Agent Machine Learning Framework for Intelligent Energy Demand Management

A Multi-Agent Machine Learning Framework for Intelligent Energy Demand Management

Ying Guo (CSIRO ICT Centre, Australia) and Rongxin Li (CSIRO ICT Centre, Australia)
Copyright: © 2012 |Pages: 15
DOI: 10.4018/978-1-60960-818-7.ch214
OnDemand PDF Download:
$30.00
List Price: $37.50

Abstract

In order to cope with the unpredictability of the energy market and provide rapid response when supply is strained by demand, an emerging technology, called energy demand management, enables appliances to manage and defer their electricity consumption when price soars. Initial experiments with our multi-agent, power load management simulator, showed a marked reduction in energy consumption when price-based constraints were imposed on the system. However, these results also revealed an unforeseen, negative effect: that reducing consumption for a bounded time interval decreases system stability. The reason is that price-driven control synchronizes the energy consumption of individual agents. Hence price, alone, is an insufficient measure to define global goals in a power load management system. In this chapter the authors explore the effectiveness of a multi-objective, system-level goal which combines both price and system stability. The authors apply the commonly known reinforcement learning framework, enabling the energy distribution system to be both cost saving and stable. They test the robustness of their algorithm by applying it to two separate systems, one with indirect feedback and one with direct feedback from local load agents. Results show that their method is not only adaptive to multiple systems, but is also able to find the optimal balance between both system stability and energy cost.
Chapter Preview
Top

Introduction

As technology advances, consumers become increasingly more power hungry. This causes many countries, including Australia, to suffer from an increasing gap between electricity supply and demand (Hou, 2007; US, 2002). The traditional way of tackling such a problem is to increase supply by investing heavily in infrastructure and building more generators. Alternatively, power load management can reduce levels of power consumption on the demand side, and hence reduce the level of energy required to run appliances, saving money and reducing the risk of inadequate supply (Sutton, et. al. 1998; Wilson, et. al. 2003).

Electricity distribution is a complex system, consisting of loads, generators, and transmission and distribution networks (Guo, et. al. 2005). To control this physical system, generators and retailers bid into a market that balances supply and demand while ensuring safe network operation. Demand and price fluctuate quickly and loads that are responsive in real time can have high value to retailers and networks. This scenario is ideal for the adoption of multi-agent technology (Dimeas, et. al. 2004; McArthur, et. al. 2005). A network of autonomous agents can be overlaid on the physical distribution network, controlling customer loads and, where available, local generators (Borenstein et. al. 2002; Hagg, et. al. 1995; Li, et. al. 2008; Platt, 2009; Ygge, 1998).

Australia’s Commonwealth Scientific and Industrial Research Organisation (CSIRO) is developing an energy management and control system that consists of an agent network to be installed at multiple levels of the electricity distribution network (James, et. al. 2006; Li, et. al. 2007; Li, et. al. 2007; Zeman, et. al. 2008). This system has a three-level architecture consisting of the following types of agents: 1) the top-level broker agent; 2) the middle-level group agent and 2) the bottom-level appliance agent.

Appliance agents are responsible for the low-level management of consumption for each end-use device. At the bottom level, appliances can be intelligently switched on or off based on customer preferences (Guo, et. al. 2005). A cluster of such agents is then managed by a group agent on the middle level (Li, et. al. 2007; Ogston, et. al. 2007). The group agents also receive an energy quota from an upper-level broker agent representing the needs of electricity market participants and network operators. This energy quota is a limit on the total energy consumption for a group of appliances.

Complete Chapter List

Search this Book:
Reset