Professional Documents
Culture Documents
Data Centers
Daniel Salomonsson Lennart Soder Ambra Sannino
daniel.salomonsson@ee.kth.se lennart.soder@ee.kth.se ambra.sannino@ieee.org
Electric Power Systems Electric Power Systems ABB, Corporate Research
Electrical Engineering Electrical Engineering Power Technologies
Royal Institute of Technology Royal Institute of Technology SE-721 78 Vasteras, Sweden
SE-100 44 Stockholm, Sweden SE-100 44 Stockholm, Sweden
AbstractIn this paper, an adaptive control system for a dc storage. These types of sources and energy storages produce
microgrid for data centers is proposed. Data centers call for either dc voltage or ac voltage with different amplitude and
electric power with high availability and a possibility to reduce frequency than the grid, and hence need a power electronic
the electric losses and hence the need for cooling. By using
local energy sources, high reliability can be achieved, and by converter to interface with the grid [7]. The sources in a
using dc the number of conversion steps, and therefore also microgrid are operated to produce a certain amount of active
the losses, can be reduced. The dc microgrid can also be used and reactive power (P Q-mode) when it is connected to the
to supply closely located sensitive ac loads during outages on utility grid, which is responsible for voltage and frequency
the utility grid. The proposed dc microgrid can be operated in regulation. However, when the microgrid is operated in is-
eight different operation modes described here, resulting in 23
transitions. The adaptive control system coordinates the control land mode the sources must be able to perform voltage
of converters, sources and switches used in the dc microgrid. and frequency regulation. Different operation strategies of
The adaptive control system is tested in the simulation software the sources have been studied in [8], [9]. Using controllers
packages PSCAD/EMTDC, and the results of the most interesting with droop characteristics ensures load shedding, and voltage
operation modes and transitions are presented. The results show and frequency stability. Experimental results of a laboratory
that it is possible to use the proposed dc microgrid to supply
sensitive electronic loads, and also during utility grid outages, microgrid setup are presented in [10].
supply closely located sensitive ac loads. To reduce transients in Data centers provide application service and management
the voltage experienced by the sensitive ac loads, the dc microgrid for various types of data processing, such as web hosting,
requires fast utility outage detection and fast switches. Internet, intranet, telecommunication, and information tech-
nology. As the development progresses, the size of the servers
I. I NTRODUCTION
is becoming smaller simultaneously as their capacity increase
Sensitive commercial consumers need power supply which [11]. This leads to an increase of power density in data
is not affected by faults and outages in the utility grids. One centers. In a single rack the power is estimated to increase
possibility to ensure reliable power supply is to install local from approximately 4 kW up to 40 kW in a few years [12].
generation close to the sensitive loads [1][3]. Using local Each server produces heat due to losses (conversion losses and
generation together with fast and accurate protection systems, conduction losses). To prevent the equipment to malfunction
the sensitive loads will not be affected by disturbances in the it must be cooled and this also requires electric power.
utility grid. When a fault occurs, an isolated grid with local The large power consumption of the data centers (up to tens
generation and sensitive loads will be created. This microgrid of MW [13]) together with a high price of electricity result
can be designed to operate autonomously in island mode. in high cost for the owner of the data center. One possibility
However, in normal operation the microgrid is connected to to reduce the cost is to reduce the losses in the system, hence
the utility grid. Depending on the load and generation situation the need for cooling.
the microgrid can both consume or produce electric power One way for data centers to combine the need for high
from and to the utility grid, respectively. A microgrid can reliability and the possibility to reduce the losses is the dc
therefore be considered as a controllable load/generation cell. microgrid. Low-voltage (LV) dc can be superior to use com-
In most cases a microgrid is equipped with some form of pared with LV ac for commercial power systems with sensitive
energy storage to improve the load leveling capability [4][6]. electronic loads [14], [15]. The reason is that sources, energy
The interest for such systems has increased in the past few storage and loads in an ac microgrid are connected through
years. power electronic interfaces: dc/ac converters and ac/dc/ac
The sources in a microgrid are usually small (< 500 kW) converters. By using a dc microgrid one conversion step can
and often renewables. Example of sources are microturbines, be eliminated and energy storage can be directly connected.
fuel cells, photovoltaic, hydro plants and wind power. Bat- Little research work has been published about issues re-
teries, supercapacitors and flywheels can be used as energy garding dc microgrids [16][19]. Voltage control in a dc
2415
diesel engine TABLE I
diesel engine M
P OSSIBLE OPERATION MODES OF THE DC MICROGRID
M
utility
utility ac supply G
No. Utility Emergency Standby Zone Operation
ac supply G
power power power 2 mode
1 off off off disconnected off
Converter ~ Energy ~ Converter Converter ~ Energy 2 off off off connected off
1 storage 2 1 storage
= = = standby
3 off off on disconnected
mode
standby
= = =
=
= = =
= 4 off off on connected
= = =
~
= = =
~ support mode
5 off on off disconnected emergency mode
Sensitive Sensitive Sensitive Sensitive Sensitive Sensitive emergency
HVAC HVAC
load load load load load load 6 off on off connected
support mode
(a) Common dc bus (b) Common ac bus 7 off on on disconnected standby mode
standby
8 off on on connected
Fig. 2. Data center power system with dc distribution system. support mode
9 on off off disconnected -
10 on off off connected import mode
utility 11 on off on disconnected -
ac supply standby
12 on off on connected
export mode
13 on on off disconnected -
emergency
14 on on off connected
SW1 diesel engine export mode
15 on on on disconnected -
Zone 3 M standby
16 on on on connected
export mode
SW2 G
SW4 SW3
2416
export mode. IV. D ESIGN OF AN A DAPTIVE C ONTROL S YSTEM
The dc microgrid requires a control system which can
B. Defining Transitions between Modes monitor the dc microgrid and the utility grid, and based on
As previously stated, the dc microgrid has eight different a number of input variables operate the components in the dc
operation modes which can be used. The dc microgrid can only microgrid to ensure a disturbance-free supply to the sensitive
change from one operation mode to another operation mode dc loads in Zone 1 and if possible also to the sensitive ac loads
which is relevant from an operational and control perspective. in Zone 2.
Each transition from one operation mode to another operation The dc microgrid has a number of components which can
mode is due to an event (planned or unplanned). In Fig. 4 be controlled. These are converter C1, the energy storage,
the 23 possible transitions for the dc microgrid are shown. All converter C2 (together with the diesel generator), switches
transitions with the corresponding events are listed in Table II. SW2 and SW3. An adaptive control system is required to
coordinate the control of these components.
Converter C1 can be operated in three different modes:
TABLE II controllable dc source (cdcs), controllable ac source (cacs) or
T RANSITIONS AND THE CORRESPONDING EVENTS FOR THE DC controllable power source (cps). When it is operated as cdcs
MICROGRID
it is regulating the dc-link voltage in the dc microgrid. When
No. Event it is operated as cacs it can be used to generate ac voltage and
1 Outage utility grid supply the loads in Zone 2 (switch SW2 must then be open).
2 Utility grid ok
3 Diesel generator/C2 ready
Finally, when it is operated as cps it can inject a controllable
4 Utility grid ok amount of active power to the utility grid. Converter C2 can
5 C1 failure/overload only be operated as cdcs. Switch SW2 is used to disconnect
6 Utility grid ok
7 C1 failure
the dc microgrid from the utility grid, and switch SW3 to
8 C1 failure/overload disconnect converter C1 from the utility grid when it is off.
9 Diesel generator/C2 failure For each operation mode, the mode of the control variables
10 Diesel generator/C2 failure
11 Utility grid ok
of the converters C1, C2, and the switches SW2 and SW3 in
12 Diesel generator/C2 ready the dc microgrid are defined. The control variables for each
13 Utility grid ok operation mode are reported in Table III.
14 Diesel generator/C2 ready
15 High electricity price TABLE III
16 Low electricity price C ONTROL VARIABLES FOR DIFFERENT OPERATION MODES OF THE DC
17 High electricity price MICROGRID
18 Low electricity price
19 Diesel generator/C2 ready
Control variables
20 Diesel generator/C2 failure No. Operation mode
C1 C2 SW 2 SW 3
21 Outage utility grid
1 Import mode cdcs off closed closed
22 Outage utility grid
2 Emergency support mode cacs off open closed
23 Energy storage failure
3 Emergency mode off off closed open
4 Standby support mode cacs cdcs open closed
5 Standby mode off cdcs closed open
6 Standby export mode cps cdcs closed closed
18 7 Emergency export mode cps off closed closed
Emergency 8 Off off off closed open
export mode
17
22
20 19 The adaptive control system must be able to monitor the
Standby
16
condition of the utility grid, the diesel generator (together with
Import mode
21 export mode
15
converter C2), the energy storage and converter C1.
13 7 11
1 If an outage occurs in the utility grid, the dc microgrid must
change operation mode to ensure a disturbance-free supply to
Emergency Emergency
Off 8
2
the loads in Zone 1 and, if possible, Zone 2. The adaptive
23 mode support mode
9 3
control system can monitor the condition of the utility grid
by measuring the voltage. Also if converter C1 or the diesel
Standby
14 support mode
4 generator/converter C2 fail the dc microgrid must change
12 10 operation mode.
5
The dc-link voltage and the current through converter C1 are
Standby 6
also important to monitor. The dc-link voltage is an indicator
mode
of the balance between generation and consumption. Too
large load results in low dc-link voltage. In that case the dc
Fig. 4. Operation modes and transitions of the dc microgrid.
microgrid must change operation mode and some loads must
be disconnected to prevent it from collapsing. The current
2417
through converter C1 is important when it is operated as Fig. 5(a) shows one of the three phase voltages in Zone
cacs since it is unregulated. The maximum load in Zone 2 is 2 together with the utility voltage, and it can be seen that
determined by the rated current of converter C1. If the current the outage occurs after 0.02 s (the voltage drops down to
becomes too high some loads in Zone 2 must be disconnected. zero). When the outage has been detected, the control mode
The adaptive control system changes the control variables of converter C1 changes and the converter starts to supply the
based on the input variables together with the current operation prioritized ac loads in Zone 2. The generated voltage has the
mode. If any of the input variables change state, the adaptive same amplitude, frequency and phase as the utility grid voltage
control system will change the control variables, and this had before the outage.
results in a transition from one operation mode to another. Switch SW2 is opened to prevent converter C1 to supply
In Table IV the change of input variables for each transition Zone 3 during the outage. The status of switch SW2 is shown
is reported together with the change of control variables. in Fig. 5(d). However, the time before the outage has been
detected and switch SW2 has opened the loads in Zone 3 are
V. S IMULATION R ESULTS unintentionally supplied from converter C1, and the current
through converter C1 and its filter reactance increases rapidly
In this paper only a selected number of transitions will
(up to 2.3 p.u.). This can be seen from Fig. 5(b), which shows
be studied. These are the most interesting transitions which
one of the three phase currents through the converter. Different
involve outage in the utility grid, in this case transitions 1,
detection times result in different current transients, which are
when the dc microgrid changes operation mode from Import
reported in Table V. The duration of all current transients are
mode to Emergency support mode, and transition 22, when
less than 1 ms. This study shows that it is important to have a
it changes from Emergency export mode to Emergency
fast detection in order not to trip the converter or to oversize it.
support mode. Here it is important to study the voltage
Also the size of the filter reactance affects the current transient.
experienced by the loads in Zone 1 and 2. If the transients
When the outage has been detected and SW2 has opened, the
are too large it is not possible to assume that the loads are not
current through converter C1 and its filter reactance returns
affected.
to normal, which in turn causes a voltage transient (2.3 p.u.)
When the utility grid comes back and the dc microgrid
in Zone 2. This is shown in Fig. 5(a). The maximum voltage
shall be reconnected, it is important to synchronize the voltage
during the transient can also be reduced by having a faster
in Zone 2 with the voltage in the utility grid before switch
detection (see Table V). Limiting the transients is important
SW2 can be closed. Here it is also of interest to study the
to be able to keep the sensitive ac loads online. Fig. 5(b) also
voltage transients. Possible transitions to study are 2 and 4,
shows a 180-phase shift in the current due to the change of
and transition 2 has been selected.
direction of the power flow.
The transition from Import mode to Emergency export
After the outage the loads in Zone 1, 2 and 3 are supplied
mode and back will also be studied. Here it is of interest to
from the energy storage. When the loads are supplied from the
study how the transition affects the current through converter
energy storage the dc-link voltage is unregulated, which can
C1 and the dc-link voltage.
be seen in Fig. 5(c), and the voltage drop depends on the size
The system is modelled and simulated in the software
of the current and the internal impedance of the battery. The
packages PSCAD/EMTDC. The ac/dc interface is modelled as
transient voltage reduction depends on how fast the outage can
a two-level VSC with dc-link voltage controller and current
be detected and the loads in Zone 3 can be disconnected. A
controller. The design of the converter and its controller has
longer time results in a larger transient voltage reduction.
been presented earlier in [26]. The selected transitions do not
involve interaction with the diesel generator and converter C2, TABLE V
which therefore are not included in this model. The energy M AXIMUM VOLTAGE AND CURRENT TRANSIENTS DURING TRANSITION 1
WITH DIFFERENT DETECTION TIMES
storage is modelled as a dc source with an internal resistance.
The sensitive dc loads are modelled as a constant power load Detection
Voltage [p.u.] Current [p.u.]
and the ac loads are simulated as constant resistive loads. The time [ms]
size of the sensitive dc and ac loads are equal, and the loads 0.5 1.0 1.0
1 2.3 (<1 ms) 2.3 (<1 ms)
in Zone 3 are 25 times larger than the prioritized ac loads. 2 4.3 (<1 ms) 6.2 (<1 ms)
A. Transition 1 and 2 When the utility grid is back the input signal will indicate
Transition 1 is when the dc microgrid changes operation to the adaptive control system that it is possible to change
mode from Import mode to Emergency support mode due mode from Emergency support mode to Import mode
to an outage in the utility grid. From Table IV it can be seen (transition 2). Before switch SW2 can be closed converter C1
that the control variable to converter C1 will change from must first synchronize its voltage with the utility grid. Since
cdcs to cacs and switch SW2 will open after the outage has the prioritized ac loads are still supplied from converter C1
been detected by the adaptive control system. In this case it the synchronization must be done with the loads connected.
is assumed that it takes 1 ms to detect an outage in the utility The synchronization will result in a short frequency transient
grid. for the loads. The size of the transient is determined by the
2418
TABLE IV
A DAPTIVE CONTROL SYSTEM : TRANSITIONS BETWEEN DIFFERENT OPERATION MODES
2
after approximately 10 ms converter C1 has synchronized with 0
the utility grid and switch SW2 will close and converter C1 2
will change control mode from cacs to cdcs.
4
Fig. 6(a) shows one of the three phase voltages in Zone 2 0 0.01 0.02 0.03 0.04 0.05
together with the utility grid voltage. The plot shows the (b) 5
synchronization between the voltage in Zone 2 and the utility 2.5
iC1 [p.u.]
grid. The current through converter C1, shown in Fig. 6(b), has
0
a transient due to the change of power direction. The current
2.5
gradually increases when converter C1 starts to take over the
dc load current from the energy storage and the dc-link voltage 5
0 0.01 0.02 0.03 0.04 0.05
becomes regulated. The dc-link voltage is shown in Fig. 6(c).
(c) 1.2
[p.u.]
1.1
uref
dc
udc, uref
1
dc
B. Transition 17 and 18
0.9
The dc microgrid has a possibility to export power to u
dc
0.8
the utility grid. Power from the energy storage or the diesel 0 0.01 0.02 0.03 0.04 0.05
generator can be sold to the utility and money can be earned (d)
if the price of electricity is high. How often power will be
exported depends on the fuel cost and the daily price variation open
SW2
2419
(a)
uZone 2 [p.u.] 4 (a) 5
2 2.5
iC1 [p.u.]
0 0
2 2.5
4 5
0 0.05 0.10 0.15 0.20 0.25 0 0.01 0.02 0.03 0.04 0.05
(b) 5 (b) 1.2
[p.u.]
2.5 1.1
iC1 [p.u.]
uref
dc
0
udc, uref
1
dc
2.5 0.9
udc
5 0.8
0 0.05 0.10 0.15 0.20 0.25 0 0.01 0.02 0.03 0.04 0.05
(c) 1.2 Time [s]
[p.u.]
1.1
uref Fig. 7. Transition 17: (a) phase current through converter C1, (b) dc-link
dc
udc, uref
1
dc
voltage.
0.9
u
dc
0.8 (a) 5
0 0.05 0.10 0.15 0.20 0.25
2.5
iC1 [p.u.]
(d)
0
open
SW2
2.5
5
closed 0 0.02 0.04 0.06 0.08 0.10
(b) 1.2
0 0.05 0.10 0.15 0.20 0.25
[p.u.]
1
dc
Fig. 6. Transition 2: (a) phase voltage in Zone 2, (b) phase current through
0.9
converter C1, (c) dc-link voltage and (d) switch SW2. udc
0.8
0 0.02 0.04 0.06 0.08 0.10
Time [s]
Fig. 7(a) shows the current through converter C1. When the
converter changes control mode from cdcs to cps the current
Fig. 8. Transition 18: (a) phase current through converter C1, (b) dc-link
makes a 180 phase shift since the power direction changes. voltage.
However, the amplitude remains the same.
When the dc microgrid shall go back from Emergency
export mode to Import mode converter C1 must change with Fig. 5(b). The reason is that the power already flows
control mode from cps to cdcs. Fig. 8(a) shows how the current out from the dc microgrid when the outage occurs. This in
through converter C1 will change phase due to the change of turn causes a larger voltage transient which can be seen in
the direction of the power flow. Also it will gradually increase Fig. 9(a). Moreover, the large current transient results in a
when converter C1 starts to take over the dc load current from small reduction of the dc-link voltage.
the energy storage and the dc-link voltage becomes regulated,
VI. C ONCLUSIONS
which can be seen in Fig. 8(b).
In this paper the design of an adaptive control system for
C. Transition 22 a dc microgrid for data centers has been treated. The dc
The last case study investigates what happens if an outage microgrid can be operated in eight different modes depending
on the utility grid occurs simultaneously as power is exported on the status of the utility grid, and the emergency and standby
from the energy storage in the dc microgrid to the utility grid. power. To take the system from one operation mode to another
According to Table IV, the dc microgrid will change op- 23 transitions are defined. The proposed adaptive control
eration mode from Emergency export mode to Emergency system coordinates the control of the two converters and the
support mode. The difference compared with transition 2 is two switches used in the proposed dc microgrid. Which control
that the power already flows out from the dc microgrid to the mode to use is based on the input variables to the adaptive
utility grid. control system.
Fig. 9(a) shows one of the three phase voltages in Zone 2. The dc microgrid can be used to supply sensitive electronic
When the outage occurs the voltage drops to zero. Fig. 9(b) loads, but also during outage in the utility grid, to supply
shows one of the three phase currents through converter closely located sensitive ac loads. Simulations show that it is
C1. The current transient is almost 65 % larger compared important to have fast detection of a utility grid outage and to
2420
(a) 4 [7] P. Piagi and R. Lasseter, Autonomous control of microgrids, in Proc.
IEEE Power Engineering Soc. General Meeting, vol. 1, Montreal,
uZone 2 [p.u.]
2
Canada, Jun. 1822 2006, pp. 305308.
0 [8] F. Katiraei, M. Iravani, and P. Lehn, Micro-grid autonomous operation
during and subsequent to islanding process, IEEE Trans. Power Del.,
2
vol. 20, no. 1, pp. 248257, Jan. 2005.
4
[9] J. P. Lopes, C. Moreira, and A. Madureira, Defining control strategies
0 0.01 0.02 0.03 0.04 0.05
for microgrids islanded operation, IEEE Trans. Power Syst., vol. 21,
(b) 5 no. 2, pp. 916924, May 2006.
2.5 [10] D. Georgakis, S. Papathanassiou, N. Hatziargyriou, A. Engler, and
iC1 [p.u.]
1.1
IEEE INTELEC06, Berlin, Germany, Sep.1822 2005.
uref [13] E. Brown, R. Elliott, and A. Shipley, Overview of data centers and
dc
udc, uref
1
dc
2421