You are on page 1of 6

2005 IEEE/PES Transmission and Distribution

Conference & Exhibition: Asia and Pacific


Dalian, China

Optimal Coordination For Multi-Agent Based


Secondary Voltage Control In Power System
Sheng Gehao, Jiang Xiuceng, and Zeng Yi

Abstract: The secondary voltage control scheme based on contingencies resulting from a large disturbance of load or a
multi-agent theory is presented in the paper. In this scheme, the sudden fault, it is necessary for reactive power reserves near
individual primary voltage controllers and the secondary controller the bus where voltage violation occurs to provide fast and
are represented as a set of execution agents and a coordination agent,
effective reactive power support. Neither SVC nor CSVC can
respectively, who work either independently or coordinately to
control the system-wide voltage level. According to the principles of
obtain a satisfactory result in such emergency situation.
the multi-agent system (MAS), the optimal coordination methods For the sake of overcoming shortcomings of
among voltage controllers in normal operating condition and in conventional SVC system, the paper attempts to apply the
system contingencies are investigated respectively. Under normal multi-agent technology to SVC of power system. As an
conditions, the multi-agent based control system works as a active branch of application in distributed artificial
conventional secondary voltage control system, realizing global intelligence (DAI), the multi-agent technique has been
optimal var/voltage control. When system runs into contingencies, widely applied to large and complex system, capable of
contract net protocol, which is widely used in MAS, are introduced finding a concerted and parallel solution for a distributed
to realize coordination and cooperation among voltage control system [7]. With the development of the multi-agent system
agents for eliminating voltage violation. The simulation results of
the New England 39-bus system show that the proposed control
(MAS) theory, many researchers attempt to apply it to
scheme and coordination method are very effective in managing control systems in recent years. From the point of view of
global voltage profile of power system as well as settling local system control, a multi-agent based control system is
voltage violation problems in system contingencies. different from traditional decentralized control. Treating each
controller as an autonomous control agent, the fundamental
Index Terms : secondary voltage control; multi-agent system; cooperation mechanism of MAS lies in the task sharing and
contract net protocol communication among agents. Although many experiences
have demonstrated the tremendous potential in studies on
I. INTRODUCTION agent-based coordinated control system, few of paper in

N owadays, the hierarchical voltage control strategy point is presented in practical power system control [8-9].
with three levels has been developed by some electric This paper is organized in the following way. Firstly,
utilities to prevent voltage deterioration and keep a concept and framework of SVC system based on MAS
better use of existing reactive power resources[1]-[6]. theory is presented. In the proposed control system, the
In the hierarchical voltage control system, secondary individual primary voltage controllers and the secondary
control is the most important part for improving power controller are represented as a set of execution agents and a
system voltage dynamic performance. The first type of coordination agent, respectively, who work either
secondary voltage control (SVC) was initiated by EDF in independently or coordinately to control the system-wide
1980s[1]. Recently, a faster and more precise type of second voltage level. Based on the principles of the MAS, the
control system - Coordinated Secondary Voltage Control optimal coordination method for proposed control system in
(CSVC) has been in use in France and is expected to take normal operating condition and in contingency are
over from existing SVC system in the near future[4]. investigated respectively, for enhancing the ability of fast and
However, the limitations still exist. In CSVC, a dedicated coordinated voltage and reactive power control. Especially,
computer directly adjusts the set-points of all the controlling contract net protocol, which is widely used in coordination of
units and is responsible for supervising the whole control MAS, are introduced to realize coordination and cooperation
process. Therefore, a high precision of voltage characteristics among voltage control agents in system contingencies.
of the loads, network data and very high reliability of remote Finally, the simulation results of the New England 39-bus
data acquisition, communication equipment must be system are presented to illustrate the validity of the proposed
warranted for determining a target state. However, it is control scheme.
difficult for a centralized control system to meet these
requirements. Additionally, when system runs into II. FRAMEWORK OF MULTI-AGENT BASED
SECONDARY VOLTAGE CONTROL
This project was supported by China Postdoctoral Science The multi-agent approach focuses on the interaction
Foundation (No.20040350475). and cooperation of autonomous agent groups. By means of
Sheng Gehao is with Department of Electrical Engineering, Shanghai encapsulating local control and message-based agent
Jiao Tong University, Shanghai, China. (e-mail: sgh168@263.net). communication, the multi-agent system (MAS) provides a
Jiang Xiuceng is with Department of Electrical Engineering, loosely coupled and open environment. The agent acquires
Shanghai Jiao Tong University, Shanghai, China. (e-mail: up-dated information through regular interaction with its
xcjiang@sjtu.edu.cn)

1
0-7803-9114-4/05/$20.00 ©2005 IEEE.
environment and other agents, and adjusts its actions for the dynamically adjust its behaviors according to information
benefit of its highly self-adaptive function. As a result, the provided by the sensor. The rule base contains sets of
MAS can dynamically improve its capabilities and is easily declarative heuristics that determine decision-making manner.
adapted to an uncertain dynamic system. The control algorithm module provides the control
As for the application of multi-agent technology in a algorithms for executing the control task.
decentralized control system, each individual controller can The decision-making head is the core of each control
be treated as a control agent, and all control agents constitute agent. For meeting voltage control requirement in different
a multi-agent system working together for a common system state,the corresponding agent should take different
objective of attaining a specific control target [9]. control strategy and control algorithm under normal
The basic structure of the multi-agent based secondary condition and system contingency. The important part of the
voltage control system is shown in Fig.1. The regional decision-making head is to evaluate the current operating
secondary controller is treated as a coordination agent (CA) state according to information of the surroundings, and
and individual primary voltage controllers (including determine the work mode (control strategy) of the agent. Two
generators, static var compensator, synchronous condenser, work modes are involved in the proposed control system: the
static condenser, etc.) are governed by the corresponding normal mode and the emergency mode. The decision-making
execution agents (EA), which together form a multi-agent principles of CA and EA are shown in Fig.3(a)and Fig. 3
control system. Distributed coordination of the MAS can be (b)respectively. After the work mode is determined, the
achieved either by task allocation based on communication control agents decide the final setting according to the
among agents or autonomous regulation based on local current control strategy and actual system state, while
self-estimation. The operation of all control agents in the ensuring that no actions will jeopardize its self-interests.
MAS is for a common objective to minimize the voltage control strategy output
normal
deviation and maintain an adequate regional voltage profile.
condition
System Global Optimal Update
Local Control Operating Control Control
Execution Voltage Var/volt State Signal of
Agent Controller Equipment contingency
Evaluation EAs
Local Control Coordinate
Execution Voltage Var/volt Actions of EAs
Coordination Agent Controller Equipment
Agent (a) Coordination Agent
Reginal
Control
...... ...... normal
Accept Control
condition Update
Center Local Request from
Local Control operating Setting of
Execution Voltage Var/volt CA Primary
Agent Controller Equipment
State
Power Evaluation contingency Voltage
Grid Controller
Autonomous
Fig.1. Basic structure of the multi-agent based SVC system
Control
A control agent is composed of six elements: a sensor, a
communicator, an actuator, a control algorithm module, a (b) Execution Agent
rule base and a decision-making head. The relations among Fig.3. Decision-making principles of the agents
these modules are briefly illustrated in Fig.2.
III. COORDINATION UNDER NORMAL CONDITIONS
Rule Base Communicator Other Under the normal operating conditions,the multi-agent
Environment Agent based SVC system works in normal mode, whose target is
Information
to realize global optimal control for maintaining an adequate
Sensor Decision-making Actuator system-wide voltage profile and keeping reasonable
Head Control reactive power reserves.
Control Agent Setting The CA periodically determines target set-point of each
Control primary voltage controller in a coordinated way via
Algorithm mathematical optimal method or rule-based heuristic method,
Fig. 2. Architecture of a control agent
and send task-performing request to the corresponding EAs.
In this paper, the following nonlinear expression (1) is taken
The communicator connects the agent to the as the mathematical optimization model for the CA to solve
information channel, which enables the agent to secondary voltage optimal control problem. This model can
communicate and negotiate with other agents for the be applied to the CSVC system as well [10].

∑ (V ) (
+ r ∑ q ref − Qi / Qimax )
coordinated execution of proper tasks. The sensor system is 2 2
MinZ = i
ref
− Vi
used to perceive the information of the surroundings and i∈a P i∈aG
estimate the voltage level and reactive power generation (1)
situation around the agent. The actuator is responsible for
executing the tasks upon receiving commands sent by the
(
+ h ∑ Vi ref − Vi )
2

i∈aG
decision-making head. During the operation it can

2
subject to implementation of the heuristic method will be discussed
g ( x, u ) = 0
a
i =1, 2, … , n elsewhere.
i

g ( x, u ) = 0
r
i i =1, 2, …, n IV. OPTIMAL COORDINATION IN SYSTEM
CONTINGENCIES
Q i
min
≤ Qi ≤ Q i
max
i ∈α G
When system runs into contingencies resulting from a
Vimin
≤ Vi ≤ Vi max
i ∈ α G Uα C large disturbance of load or a sudden fault, it is necessary for
where reactive power reserves near the bus where voltage violation
occurs to provide fast and effective reactive power support
α P ,α G and αC are sets of indices of pilot buses, voltage
[11].
regulating devices (related with EAs) and critical buses, Once voltage violation in system contingencies is
respectively. detected, the multi-agent based SVC system terminates
Vi ref and Vi are set-point voltage and actual voltage at bus normal control procedure, and switches into the emergency
work mode. In this mode, the corresponding EA makes its
i, respectively.
own decision to change the setting of primary voltage
r and h are weighted factors.
controller for rapidly restoring the abnormal voltage back to
Qi and Qimax are actual and limit reactive generations at its allowable range firstly. If voltage violation detected
bus i, respectively. cannot be removed via the EA’s voluntary control actions, the
EA should send request for voltage regulating assistance to
q ref is reference value of relative reactive power generation the CA. The CA is responsible for coordinating other EAs’
with a region, defined by the expression control actions to recover the violated voltage.
q ref = ∑ Qi / ∑ Qimax .
i∈α G i∈α G
The coordination method used in this paper is the
contract net protocol (CNP), which is widely used in MAS.
g ( x, u ) and g ir ( x, u ) are active and reactive injection
a
i A. Contract Net Protocol (CNP)
equations at bus i , respectively. The CNP is a typical method for negotiation among
It is assumed that all active generations and loads are agents [7]. The so called “contract nets” are a
known in advance, so that the state variables x include the negotiation-based way to establish efficient cooperation in a
voltage phase angles ( θ i , i =1, 2, …n) and magnitudes (Vi,i MAS. Each agent takes part in the contract net system. If one
agent discovers a single problem, it announces this problem
= 1, 2, …n, i ∉ α G ) and reactive outputs of voltage to the rest of the agent society if it is not able to solve it alone.
regulating devices ( Qi , i ∈ α G ). The control variables u are It is then the manager of this problem. Some of the other
agents will reply to the manager agent and provide help to
the terminal voltages of regulating devices ( Vi , i ∈ α G ). solve this problem by applying bidding and execute contract.
After acquiring the necessary data from SCADA, the CA can The negotiation process is described in Fig.4.
solve above nonlinear optimal problem by the second-order
Manager Agent Contract/Applicant Agent
Newton’s iteration method. Therefore, the control settings
( Vi ) of regulating devices are obtained and sent to the invite bidding
Problem Evaluation
corresponding EAs. apply
The EAs work in the normal mode, waiting for the
requests of voltage-regulating task from the CA. Once the award contract
Evaluation
requests are received,the EAs adjust the set-points of voltage Contract
controllers, while ensuring all variables of the regulating unit confirmation
are within their bounds.
Generally speaking, the CSVC is accomplished by the Idle Problem
sequential application of the linear optimization model. The Solving
control variable increment is worked out and sent to primary
Solution solution
controller every 3-10s. The overall time constant of the Solution
secondary loop is about 1-3 minutes. As for the nonlinear
optimization model of the expression (1), it may take much Fig.4. Negotiation in a contract-net-system
more time to find the solution. But on the other hand, it can
obtain the final stead-state result and decide the control target B. Optimal Coordination Based On CNP
of each primary controller in one control step. Therefore, the The voltage control agents is responsible for providing
nonlinear method can still satisfy the requirement for control var/voltage support of the nodes in its charging field to
speed of secondary voltage control. Moreover, the control maintain the global voltage profile in system contingency. A
variables obtained are more accurate. negotiation mode of request and response is proposed for
By the way, if the above-mentioned optimal program coordinating control agents [8]. Howerver, in practical power
fails to yield a convergent solution, the CA should turn to gird, this coordination method is rather simple and has less
take the heuristic methods to seek target state. The

3
flexibility in many cases since the performance of the control EA which is the most effective one to provide voltage
actions are complicated. In this paper, the CNP based method support. The EA work as a contrat/applicant Agent, applying
is used to realize flexible and rapid coordination of control the bidding according to its own capability. The system
actions among EAs. works in market mechanism for the better use of var resource.
According to the CNP principle, the CA is taken as Once voltage violation occur, coordination and cooperation
manager agent, responsible for inviting public bidding of procedure based on CNP is decribed by work state transfer
voltage control task and awarding the control contract to the diagram, as shown in Fig. 5.
d e te c t v o lt a g e v io la ti o n
a n d f a il to r e c o v e r
M o n it o r in g R e q u e s tin g
tim e o u t o r r e c e iv e
c o n f ir m a tio n

P ro v o k e d E A f a il to s u p p o r t
r e q u e s t a s s it a n c e v o lta g e

r e m o v e v o lta g e v io la tio n
f o r m c o n tr o l A g e n c y e v a lu a te s u ita b le E A s
I n v itin g A w a r d in g
M o n it o r in g B id d in g C o n tr a c ts
tim e o u t s e a r c h f o r v o lta g e s u p p o r t
o f o th e r E A s
CA
c o n f ir m
d is tr i b u te b id d in g A p p ly s ig n c o n tr a c t s c o n tr a c t

e v a lu a te v a r /v o lta g e
p r o v id e v a r /v o l ta g e
s u p p o r t c a p a b ility
su p p o rt
M o n it o r in g B id d in g E x e c u tin g
t im e o u t
e x e c u te c o n tr a c t b y a u to n o m o u s c o n tr o l

EA

Fig.5. Coordination for multi-agent based SVC based on CNP in system contingencies

As seen from Fig.5., the CA has three work state control sequence via optimal algorithm. Then the CA sends
incuding monitoring, inviting biding and awarding contract.; confirmation message and awards the voltage regulation
The EA has four work state including monitoring, bidding, contract to the first EA in control sequence. The contract task
requesting and excuting. The process of coordinatin and involves the control target and control time of the voltage
cooperation amomg control agent based on CNP is described regulating assistace. The chosen EA receiving the contract
as following. starts to execute the control task,and then run into the
1. Generally, all of the control agent work in the exeucting state.
monitoring state. The EAs monitor voltages at nodes of 5. The EAs in the biding state which don’t receive the
adjacent area; the CA monitors important nodes that none of confirmation message in given timespan will return to the
the EA can cover. State change is trigued by voltage violation monitoring state. The EA who receives the contract executes
of a certain node. Monitoring state is the initial state of the the the votage regulation task signed in contract by
control agent and is also the final state after emergent control autonomous control (local secondary voltage control) and
finished. then returns to the monitoring state.
2. Once voltage violation is detected by a certain EA, and 6. After the CA receives confirmation message that the
cannot be removed via the EA’s voluntary control actions, the contract is complete,the CA asks the provoked EA if the
EA (called the provoked EA) should send request for voltage voltage violation is removed. If it is, the CA returns to the
regulating assistance to the CA. The provoked EA reports the monitoring state,otherwise the CA should repeat to award
fault severity, and then run into the requesting state. the voltage control contract to the next EA in optimal control
3.The CA distributes notice in bulllet board for voltage sequence for more voltage support until the violated voltage
support assitancee, inviting public biding. The notice recovers.
includes fault place and severity of voltage violation. The 7.The CA in the biding state can’t receive the EA’s
EAs evaluate their own capablity of voltage support, and bidding in given timspan means that voltage violation can
apply the bidding according to var/voltage capablity, not be elimilated through secondary voltage control system.
self-limitation and control priority, then run into the biding In this case, the CA sends a message to the provoked EA
state. indicating that the CA fails to search voltage regulating
4.The CA accepts EAs’ biding information reflecting the assistace, and then return to the monitoring state.
operating state and var/voltage regulation capability of the 8. If the provoked EA in the requesting state can’t
EA’s corresponding devices, and calculates an optimal receive the CA’s message in given timspan or receive a

4
confirmation message, it returns to the monitoring state. the EA of each generator to change their set-points for
Within above process, the most important and crucial obtaining the desired system voltage level. From Fig.7 and
step is the calculation of optimal control sequence of EAs for Fig.9, it can be seen that the control actions of the proposed
taking the most effctive control action in contingencies. In scheme are capable of restoring original voltage value at
this paper, we use an genetic algorithm(GA) to solve the pilot buses and, therefore, guaranteeing an adequate
problem, desribed in[12]. system-wide voltage profile. The voltage curve of pilot bus
12 during the control procedure is shown in Fig.8. It can be
V. SIMULATIONS seen that the voltage at node 12 cannot recover to initial
To illustrate the performance and support the feasibility value without SVC. The conventional SVC adjusts voltage
of the proposed control scheme in practical power systems, a step by step. The overall time constant of the secondary loop
case study based on the well-known New England 39-bus is about 3 minutes. The multi-agent based SVC can obtain
system often used in relaible and voltage studies is presented the final result according to optimal model in section III and
in this section. This system, shown in Fig.6, includes 29 load decide the control target of each primary controller in one
buses, 9 generator buses, and one equivalent generator control step.
representing the interconnection with an extra network. Five
static var compensators are equipped in Nodes 4, 8, 11, 13,
14,17. The per-unit quantities are calculated with a 345kv,
100MVA base. According to the pilot selection method
reported in [10], nodes 5, 12, 16 and 20 are selected as pilot
buses.
The system condition obtained from optimal power
flow calculation is regarded as the initial operating state for
simulation, and the corresponding voltage profile is
presented in Fig. 7. In the simulation, the control behaviors Fig. 7. Voltage profile for the initial operating state on the New England
of the proposed control scheme under normal condition (no system
voltage violation) and system contingency are investigated,
respectively, on the test system. Three voltage control
schemes are adopted respectively, under identical system
condition, to compare the performance of different control
schemes. The first scheme does not have a SVC in the system.
The second scheme has a conventional SVC system installed.
The voltage control of pilot bus is performed in a stepwise
manner by solving a quadratic programming problem at
every control step, stated in [10]. For the third scheme, the
proposed multi-agent based SVC system is installed, and Without SVC
each controller of the generators and static var compensators
is set with a cooresponding EA. With conventional SVC
With multi-agent based SVC

Fig.8. Voltage response curves of pilot bus 12 under normal operating


condition

Fig. 6. The New England 39-bus system


For scenario 1, the reactive load at pilot bus 12 Fig. 9. Voltage profiles for scenario 1 on the New England system
increases by 100Mvar at 1s. Fig. 7 shows the voltage profile For scenario 2, the reactive load of bus 12 increases by
as a result of the disturbance without SVC and that after 200Mvar at 1s, and to make the situation worse, the line 7-8
secondary voltage control acts. In this case, with the is lost at 2s. The voltage at bus 12 will drop below the lowest
multi-agent based SVC scheme, no voltage violation is permissible value without SVC under this contingency
detected by EAs when disturbance occurs, while the CA can condition. Fig.10 shows the voltage response at bus 12, 13,
perceive the deviation of voltage at pilot bus 12 and direct 14 and 4 during the contingency. The conventional SVC

5
regulates the setting of the primary voltage controller in large disturbance condition. This ability is crucially helpful to
every sample time (4s). As a result, it will take a relatively improving voltage stability in system contingencies.
long time to recover the voltage. The multi-agent based SVC
system acts in terms of steps described in section IV. B. VI. CONCLUSION
Firstly, the EA of Asvc11 detects the voltage violationat bus The multi-agent based secondary voltage control system
12 and requests the CA for voltage regulating assistance, was proposed in this paper. Treating each controller as
then the system run into emengency work mode. Next, the corresponding control agent, the proposed scheme can
CA calculates optimal control sequence of the EAs according coordinate primary voltage controller quickly, effectively and
to the EAs’ bidding information. The result in this case is reliably, and then maintain an appropriate voltage profile
[Asvc13,Asvc14,Asvc4,Asvc8,AG3,AG2]. Then, the under both normal and contingency conditions. Simulation
CA awards voltage control contracts to the cooresponding results have illustrated the improved performance of the
EAs one by one in the sequence until the voltage violation is novel control scheme in scenarios of system operation.
totally removed. As seen from Fig.10, the voltage level can
be raise by the control actions of the EA of Asvc13,Asvc14, VII. REFERENCES
Asvc4, and then voltage violation at bus 12 can be quickly [1] J. P. Paul, J. Y. Leost, and J. M. Tesseron, “Survey of the secondary voltage
eliminated. control in France: present realization and investigation”, IEEE Trans. on Power
System, 2 (2), 1987, pp. 505-511.
[2] J. L. Sancha, J. L. Fernandez, and A. Cortes, “Secondary voltage control:
analysis, solution and simulation result for Spanish transmission system”, IEEE
Trans. on Power System, 11 (2), 1996, pp. 630-638.
[3] M. D. Ilic, X. Liu, G. Leung, and M. Athans, “Improved secondary and new
tertiary voltage control”, IEEE Trans. on Power System, 10 (4), 1995, pp.
1851-1862.
[4] H. Lefebvre, D. Fragnier, and J. Y. Boussion, “Secondary coordinated
(a) Voltage curve of fault bus 12 voltage control system: Feedback of EDF”, in Proc. IEEE/PES Summer
Meeting, Seattle, USA, July, 2000, pp. 291-295.
[5] S. Corsi, “The secondary voltage regulation in Italy, Proc”, in Proc.
IEEE/PES Summer Meeting, Seattle, USA, July, 2000, pp. 297-304.
[6] G. N. Taranto, N. Martins, and D. M. Falcao, “Benefits of applying
secondary voltage control schemes to the Brazilian system”, in Proc.
IEEE/PES Summer Meeting, Seattle, USA, July, 2000, pp. 937-941.
[7] N. R. Jennings, K. P. Sycara, and M. J. Wooldriage, Agent technology:
foundation, application and market. Hidelberg: Springer-Verlag, 1997.
(b) Voltage curve of bus 13 [8] H. F. Wang, “multi-agent co-ordination for the secondary voltage control in
power-system contingencies”, IEE Proc.-Genar. Transm. Distrib., 148 (1),
2001, pp. 61-66.
[9]G. Sheng, G. Tu, and Y. Luo, “A new secondary voltage control scheme
based on multi-agent technology”, International Journal of Power and Energy
Systems, 2003, 23(2), pp. 101-110
.[10] A. Conejo, and M. J. Agullar, “Secondary Voltage Control: Nonlinear
selection of pilot buses, design of an optimal control law, and simulation result”,
IEE Proc. Genar. Transm. Distrib., 145 (1), 1998, pp.77-81.
(c) Voltage curve of bus 14 [11] D. S. Popovic, V. A. Levi, and Z. A. Gorecan, “Coordination of emergency
secondary voltage control and load shedding to prevent voltage instability”,
IEE Proc. Genar. Transm. Distrib., 144(3), 1997, pp. 293-300.
[12] K. Iba, “Reactive Power optimization by Genetic algorithm”, IEEE Trans.
on Power System, 9(2), 1994, pp.685-692

VIII. AUTHOR BIOGRAPHIES


Sheng Gehao was born in China in Nov. 1974. He received a
(c) Voltage curve of bus 4 B.E., a M.E. and a PH.D. from Huazhong University of
Without SVC Science and Technology (HUST), China, in 1996 and 1999,
With conventional SVC respectively. He is currently a Post-doctor Fellow in Electrical
Engineering at Shanghai Jiao Tong University (SJTU). His
With multi-agent based SVC
research interests are in control theory and its applications to
Fig. 10. Voltage response curves in system contingency automatic voltage control in power systems.
From the simulation results, it can be seen that the Jiang Xiuceng was born in China in Jan. 1965. He received a
proposed multi-agent based SVC scheme is very effective in M.E. and a PH.D. from Tsinghua University and SJTU, China,
managing global voltage profile of power system as well as respectively. He is presently a member of Department of
settling local voltage violation problems in system Electrical Engineering at SJTU, where he holds the rank of
contingencies. Compared with conventional SVC, the Professor. His main fields of research include condition
proposed control system is better for providing quick and monitoring and automation of power devices.
effective voltage support for removing voltage violation under

You might also like