Professional Documents
Culture Documents
com
a
Zhejiang University, College of Electrical Engineering, Hangzhou, Zhejiang 310027, China
b
Zhejiang Electric Power Dispatching and Communication Center, Hangzhou, Zhejiang 310007, China
Received 15 August 2006; received in revised form 2 July 2007; accepted 20 July 2007
Abstract
In this paper, an artificial neural network model for short-term price forecasting and a linear regression model for mid/long-term price
forecasting are described together with forecasting results. A detailed discussion on the choice of forecast models and forecast variables is
reported. The suggested methods are being utilized by the transmission company to forecast short-term and mid/long-term prices in the
Zhejiang Electricity Market. The results show that the proposed forecast models meet the basic requirement of Zhejiang electricity mar-
ket operation. A second objective of this work is to present the results of a series of experiments designed to justify certain game-theoretic
assertions and to explain the price volatility experienced in many real-world markets under uniform pricing and pay-as-bid pricing.
2007 Elsevier Ltd. All rights reserved.
Keywords: Electricity markets; Price forecasting; Market power; Artificial neural network; Linear regression; Correlation analysis
0142-0615/$ - see front matter 2007 Elsevier Ltd. All rights reserved.
doi:10.1016/j.ijepes.2007.07.008
208 Z. Hu et al. / Electrical Power and Energy Systems 30 (2008) 207–215
^ _
Neural networks (NNs) [1–3] and time series models [4– C ¼ pT P þ qðDP eT PÞ s T P þ s T ðP PÞ; ð2Þ
6] are widespread in electricity price forecasting. Ref. [1] ^ _
where q; s and s are Lagrange multipliers. As is well-
provided an MCP predictor with confidence interval esti-
understood, the price of the last accepted generator is
mation using cascaded neural networks. In Ref. [2], a
MCP, which is equal to the Lagrange multiplier q. If the
neuro-fuzzy-based method was developed to forecast the
above problem has multiple optimal solutions, this implies
locational marginal price. In this method, the fuzzy rules
were used to perform linguistic reasoning about the contin- that the bid prices of some units are the same and these
gencies. The reasoning results served as a part of the inputs generators set the clearing price. Under such circum-
to the NNs. An artificial neural network employing a roll- stances, these generators are dispatched in proportion to
their capabilities [9]. We have made the following
ing cross-validation scheme was used to forecast the long-
assumptions:
term market price in Ref. [3], and in Ref. [4], an approach
based on the generalized autoregressive conditional het-
1. eT P DP P 0: This ensures that there are feasible solu-
eroskedastic (GARCH) was provided to predict next-day
tions to the auction problem.
electricity prices. In Ref. [5], a dynamic regression and a
transfer function model were proposed to forecast electric- 2. Bid prices are subject to a price cap c.
ity prices. Both of them were based on time series analysis. 3. A generator is allowed to bid on one block only.
Ref. [6] proposed an auto regressive integrated moving
A number of market studies have recently been per-
average (ARIMA)-based method to predict next-day elec-
formed by the transmission company. The results show
tricity prices. Most of those methods have shown good per-
that market power has a significant impact on MCPs. This
formance on test examples.
indicates that market power must be taken into consider-
However, forecasting methods sometimes are con-
ation when developing price forecast models. A market
strained by the data available in the real market, especially
in emerging markets. In addition, most of the existing power index, namely, the must-run-ratio, is selected as an
methods cannot effectively deal with price spikes in electric- input to price forecasting model. This market power index
ity markets [7]. was recently developed and has been tested using ISO New
England market operation data. Let us first summarize the
In this work, an ANN-based model and a linear regres-
main results from our previous work below.
sion model are proposed to forecast short-term prices and
mid/long-term prices, respectively. Both models have Proposition A [9]. Suppose that in aPpool-based market
inputs that reflect market power, an issue that is critically there exists a player A such that DP j62A P j > 0, and all
important for a market with a tight capacity. Market generators have identical marginal costs. Then the game
power is measured by an index called the must-run-ratio possesses an equilibrium at which q ¼ c, where q* is the
(MRR), originally developed in our previous work [8–10]. market clearing price at the equilibrium point. Furthermore,
In this paper, we will describe the results of class experi- q ¼ c uniquely.
ments designed to test the effectiveness of this market
power index, together with price forecasting results. An Proposition B [9]. Let I be the P set of all players. Suppose
advantage of the presented models is that, due the judicious that for every player A, A 2 I, j62A P j > DP , so that there
choice of inputs, the number of required input variables does not exist an equilibrium at which q > c. In other words,
can be reduced significantly without a perceived loss of if an equilibrium exists, then q = c at the equilibrium.
accuracy. Furthermore, the forecasting model can capture
the price spikes, to some extent. Finally, we will present One of the objectives of this work is to justify the above
some theoretical findings about MRR to explain the degree results from Refs. [8–10] by experiments and forecasting
price applications. These results show that, in a
of price volatility under MCP and PAB.
market where generators are identical, the quantity ðDP
P
2. Market power and price forecast j62A P j Þ, termed must-run generation, is an important mar-
ket index that dominates the behavior of suppliers. In a
market where generators are not identical, we found, using
The power dispatch and pricing is obtained from the fol-
lowing optimization problem [9]: a game-theoretic approach, that a numerical index termed
the must-run-ratio (MRR) is a dominating factor [8–10].
Min pT P The value of MRR is calculated as follows:
P !, !
s:t: eT P DP ¼ 0; ð1Þ X X
MRR ¼ max DP Pj Pj ; ð3Þ
A2I
0 6 P 6 P; j62A j2A
where p is the bidding price vector of generators, e is a vec- where P j is the upper bound of generation unit j.
tor of ones, DP is the total demand, and P and P are the It is straightforward to derive the following observation:
production vector and upper bound production vector of as long as the value of the MRR of a supplier exceeds 0%,
generators, respectively. The Lagrange function of the there is at least one supplier who has the capability of con-
above problem is trolling the MCP.
Z. Hu et al. / Electrical Power and Energy Systems 30 (2008) 207–215 209
Several approaches for short-term price forecasting have Calculate MRR value for each
been reported. Among them ‘‘similar day price forecast- trading period of a day
ing’’ is a method that has long been used for short-term
load forecasting, as is the method of time series analysis. Train BP network using
It is our understanding that the ‘‘similar day’’ approach historical data
and time series analysis do not fit well in the context of
price forecasting because they cannot take into account Run BP network to computer
forecast price
the impact of such factors as planned outages and market
power. Artificial neural networks seems to be a ‘‘natural
choices’’ for short-term price forecasting because of their Adjust forecast price based
on MRR value
capability of modeling complex issues that determine the
behavior of market players, and thus the market clearing Fig. 2. Flowchart of the short-term price forecasting algorithm.
prices.
In order to successfully make use of an ANN, one has to
judiciously choose input variables from which the ANN
will be constructed. The most important decision we made
was concerning whether different ANNs should be con-
structed for different time periods. We believed that this
was unnecessary because market clearing prices are deter-
mined by the bidding strategies of suppliers. It is natural
to believe that a supplier mainly considers the following
factors when making a decision: the forecast load, the costs
and capabilities of its own generators and those of its riv-
als. These factors may show a certain degree of periodicity
but not inherently so.
A simple 3-layer neural network was developed in this
work using the Matlab neural network toolbox. This net-
work has three input variables: forecast load, MRR, and
the market price of the trading period of the previous day. Fig. 3. Actual prices vs. forecast prices, with adjustment, for July 12,
The output of the network is the forecast price. The struc- 2002.
ture of the suggested neural network is illustrated in Fig. 1.
To further enhance the price forecasting accuracy, a illustrated in Fig. 4. The dip in the actual price data at per-
threshold MRR is set up. If the MRR of a trading period iod 23 (11:30am) can be explained as follows: the load curve
exceeds the threshold, the output of the neural network is has a 1000 MW dip at that trading period; to ensure their
ignored and instead the price cap is substituted as the fore- production was allocated by Contract-For-Difference and
casting output. As a matter of the fact, the suggested price to avoid expensive unit start-up costs, many suppliers bid
forecasting approach combines the spirit of neural net- negative prices for that period to keep their units running.
works with that of game theory. The flowchart for the In addition, the actual settlement price is zero if the clearing
overall forecasting method is depicted in Fig. 2. price is below zero according to the market rule. This is
why, in that period, the clearing price is often below zero.
3.2. The forecast results To measure the relative errors in the software, the fol-
lowing numerical index is calculated:
The price forecast results using the proposed approach 1 XN
jpMCP;i p0MCP;i j
are illustrated in Fig. 3. To make a valid comparison, the rMAPE ¼ ; ð4Þ
N i¼1 pMEAN
forecast results without the game-theoretic adjustment are
210 Z. Hu et al. / Electrical Power and Energy Systems 30 (2008) 207–215
Table 4
Market clearing prices from the first auction
Load 11,000 10,000 800 600
1st round 700 600 200 200
2nd round 780 590 210 200
Fig. 6. Error comparison between the linear and quadratic regression
3rd round 400 200 200 200
models.
212 Z. Hu et al. / Electrical Power and Energy Systems 30 (2008) 207–215
200 $/MW, while small generators have a cost equal to where N b<b denotes the number of time intervals with abso-
300 $/MW. The market clearing prices at the Nash equilib- lute error b less than a specified parameter b. Similar to the
rium points are provided in Table 5.
RPEP, the prescribed parameter b specifies the upper
The market clearing prices of this auction scenario are bound of absolute error.
summarized in Table 6 below. The proposed two indexes were tested based on actual
Again, one can find a close match between the low-load data in the Zhejiang electricity market. Both the spot price
auction results with their corresponding Nash prices, but data and the forecasting results data from May 2002 to
this conclusion is not quite valid for the high-load auctions. June 2003 were collected, including zero prices and those
close to price cap, which are very common in Zhejiang elec-
6. Error evaluations tricity market because of tight capacity constraints.
The RPEP was designed to be tested with the parameter e
In this section we will further evaluate the errors of price being equal to 10, 15, 20, 25, and 30. Similarly, the AEP is
forecasting models using two new indices. studied with the parameter b being equal to 100, 150, 200,
250, and 300. Furthermore, since the effect of price forecast-
6.1. Short-term price forecasting errors ing in those intervals with a high real price is of more impor-
tance to the market members for the purposes of risk
Relative and/or absolute error indexes are typically uti- evaluation, those intervals with a high real price level were
lized to measure the performance of price forecasting. Nev- studied separately. In this work, two high price levels were
ertheless, given that drastic fluctuation of the electricity studied: one was with actual prices higher than 400 RMB/
price happens frequently, especially in those newly intro- MW, the other was with actual prices higher than
duced electricity markets, it is very difficult to evaluate 800 RMB/MW, which is very close to price cap in Zhejiang
the effect of price forecasting simply based on these two electricity market. It should be noted that N e<e , N b<b and N in
indexes. Here we introduce two modified relative/absolute the above formulas became the corresponding numbers of
error indexes for evaluating the effect of price forecasting. high price levels. The RPEP and AEP were tested in three
One index is relative percentage error probability (RPEP), cases: case I, all time intervals; case II, time intervals with a
which is defined as the probability of the event that the rel- price above 400 RMB/MW; case III, time intervals with
ative percentage errors of forecasting results are below a price above 800 RMB/MW. The results are presented in
prescribed value. The RPEP calculated as follows: Table 7.
N e<e In case I, only 36.2% of the results have relative percent-
RPEPe<e ¼ ; ð7Þ age errors less than 10%. Moreover, only 61.1% are limited
N
to errors below 25%. As for the AEP, only 74.7% of the
where N denotes the number of total time intervals in the results have absolute errors below 100 RMB/MW and
study and N e<e denotes the number of time intervals with 89.4% are below 200 RMB/MW. These results shows no
a relative percentage error e less than a specified parameter special advantages over other related reports found in the
e. The prescribed e is a parameter specifying the upper literature using neural networks. As explained in [15], the
bound on the relative percentage errors. main reason lies in that the statistics are based on the data
Another index is the absolute error probability (AEP), of all intervals, including peak prices and zero prices, (i.e.,
which means the probability of the event that the absolute price data were not preprocessed in advance). Zero prices
errors are below a prescribed value. The AEP is calculated or prices close to zero had a great impact on the evaluation
based on: of price forecasting since they could result in extremely
N b<b large relative errors, thereby worsening the value of RPRE.
AEPb<b ¼ ; ð8Þ The statistics show that among all the intervals, about
N
4.67% are those with real a zero (or approximate) price,
Table 5 6.65% are above 800 RMB/MW and 14.77% are above
Nash prices from the second auction
400 RMB/MW.
Load Nash prices It can be observed that when considering those intervals
6000 199.99 with a price above 400 RMB/MW (case II), the perfor-
8000 200 mance of price forecasting becomes better compared to
10,000 800
case I. It can also be observed that more than 90% of the
11,000 800
forecasting results with corresponding actual prices above
800 RMB/MW (case III) have relative percentage errors
Table 6 less than 10% and absolute errors below 100 RMB/MW.
Market clearing prices from the second auction
The effect of using our model to forecast the price cap is
Load 11,000 10,000 8000 6000 very satisfactory. As mentioned before, one of the main
1st round 780 300 200 100 characteristics of the short-term price forecasting algorithm
2nd round 800 290 200 190 proposed in this paper is the introduction of the MRR into
3rd round 300 290 200 180
the neural network. From the results, one could see that
Z. Hu et al. / Electrical Power and Energy Systems 30 (2008) 207–215 213
Table 7
Typical RPEP and AEP results
Probability RPEP AEP
10 15 20 25 30 100 150 200 250 300
Upper boundary
Case I 0.362 0.464 0.545 0.611 0.660 0.747 0.835 0.894 0.922 0.938
Case II 0.483 0.506 0.550 0.601 0.657 0.524 0.601 0.702 0.762 0.816
Case III 0.903 0.908 0.913 0.917 0.920 0.905 0.912 0.917 0.921 0.926
the transmission company that manages the network and [5] Nogales FJ, Contreras J, Conejo AJ, Esp’ınola R. Forecasting next-
retail. The test results using actual market data demonstrate day electricity prices by time series models. IEEE Trans Power Syst
2002;17(2):342–8.
that the models function reasonably well, and in particular, [6] Contreras J, Espinola R, Nogales FJ, Conejo AJ. ARIMA models to
they nicely take into account the impact of market power predict next-day electricity prices. IEEE Trans Power Syst
on market clearing prices while requiring minimal computa- 2003;18(3):1014–20.
tional efforts. The success is due to, in our opinion, a careful [7] Zhao JH, Dong ZY, Li X, Wong KP. A framework for electricity
application of neural network and game-theoretic concepts. price spike analysis with advanced data mining methods. IEEE Trans
Power Syst 2007;22(1):376–85.
The second objective of this paper was to present exper- [8] Gan D, Wang J, Bourcier D. An auction game model for pool-based
imental results that justify our recent assertions. A key electricity markets. Int J Electrical Power Energy Syst 2005;27(7):
finding is that an auction game under uniform pricing, 480–7.
which is widely used world-wide, has multiple Nash equi- [9] Gan D, Shen C. A price competition model for power and reserve
librium points under high-load situations. We believe that market auctions. Electrical Power Syst Res 2004;70(3):187–93.
[10] Gan D, Bourcier DV. Locational market power screening and
this explains the high volatility of actual market prices. congestion management: experience and suggestions. IEEE Trans
Power Syst 2002(1):180–5.
Acknowledgement [11] Bunn DW. Forecasting loads and prices in competitive power
markets. Proc IEEE 2000(2):163–9.
This work is partially supported by a Young Investiga- [12] Contreras J, Conejo AJ, de la Torre S, Muñoz MG. Power
engineering lab: electricity market simulator. IEEE Trans Power
tor Award from the Zhejiang Natural Science Foundation Syst 2002;17(2).
(Grant Number: R503198) and the Zhejiang Power [13] Zimmerman R, Thomas R, Gan D, Murillo-Sanchez C. A web-based
Company. platform for experimental investigation of electric power auctions.
Decision Support Syst 1999;24(3 and 4):193–205.
References [14] Ethier R, Zimmerman R, Mount T, Schulze W, Thomas R. A
uniform price auction with locational price adjustments for compet-
itive electricity markets. Int J Electrical Power Energy Syst 1999(2):
[1] Li Z, Luh PB, Kasiviswanathan K. Energy clearing price prediction
103–10.
and confidence interval estimation with cascaded neural networks.
[15] Rodriguez CP, Anders GJ. Energy price forecasting in the Ontario
IEEE Trans Power Syst 2003(1):99–105.
competitive power system market. IEEE Trans Power Syst
[2] Hong YY, Lee CF. A neuro-fuzzy price forecasting approach in
2004;19(1):366–74.
deregulated electricity markets. Electric Power Syst Res 2005;73(2):
[16] Son YS, Baldick R, Lee KH, Siddiqi S. Short-term electricity market
151–7.
auction game analysis: uniform and pay-as-bid pricing. IEEE Trans
[3] Pao HT. Forecasting electricity market pricing using artificial neural
Power Syst 2004;19(4).
networks. Energy Convers Manage 2007;48(3):907–12.
[17] Wolfram C. Electricity markets: should the rest of the world adopt
[4] Garcia RC, Contreras J, van Akkeren M, Garcia JBC. A GARCH
the UK reforms? University of California Energy Institute, Technical
forecasting model to predict day-ahead electricity prices. IEEE Trans
Report, PWP-069, September 1999.
Power Syst 2005;20(2):867–74.