!!
!
!"



 
       
 

  
 


 
 
  
  
 
       

 
        

 



      
  




      
  
   

 !

      
"    #

   

           

  
  "  
   

  
       

    
 
        

 
     


  



   
   

  
 

  

      
 $

 % &
  
 $%

 
   

      

    


   "   
 
 
 
  



  
 "   
 
 
      
  
'()

   
   

** +      

     

  
   #

,-.  " 
    
 
  
   


 


 

  

 
 
  
 


  
 



 






  

 
  





   
 




 







 





 




 
 

    
  

 
  
 



  

  

 

  


 

 




 

  
 


 

 
 

 

 
  






 




 





 

   




 
 





!

  




    



 

 






  
 
 
 

978-1-4244-1694-3/08/$25.00 2008 IEEE



  
  
  
 




 




 
   

 
"

 






 
  


#


 
 




 
   







$

 
  

  

 
 


  
 



 
 








 
  

  





  

 
   %







 
 



 





 
 
 
 
 

 $







  

  





  
!#&
&


 




  "






 

 
 
 
  

 
 
   






 



 




 

  






 





 
 
 
 
   








  
  
 

  


  

 
 
 



 
' 


  



 
 



 

 


 

 


 







   
  




 
 

 
 
"( 



  




 
    





 

   
  
 
 


  
 


 
   





 





  







 ( 
 
 
 



 


 
   


 )


 




 



 !


 

 


  




 



 






 
  


 




 
 


 $
 



 




   

 
  

 
 
 
  
  )

   



 
$

 

 


*



 
 

 

 






 



   
 





 




 $














 



  

 
      





 

 






   

 
 

   







 

  
  315




 


 




  





  

  
   

 !$$# 







  
"( 



  




 


 $







 

 
 
  "(  

 

 ;
 
 
 


 






  





 
<



    


 
 

%; 
  325 



  

  







  


 

  









 


  






 
 $

 


) 

  


    
  
 
 

  


  

< 


 

 


 

 

 "(  %

  3=5




  









 








 


 $





 





<)

  !






 


 $






 

 "( 

 


 
  
 



 

<

   
 >
  3?5 



  





 


 


   




   
 


 


 



 
 
  
  
  
 

  )

  "(   



 
    


 







    



 


 )

   

  $


 




   







  

  

 






 ' 





  










 


 
 
 

 




   
   


  
 
 




  

 
  
  ) 


 


 





 
 !


 


   )

 
  


 


(
 

 
 
 


 

 

   


 






 +

 






 



     




 
  


 
' 

  
 
    

 
 


   

   "(    

 
  



  






 

 



 


  


 







   
 


 ( 



 



 
) 

 #,&
-



$


  

 

 

 




 



 

 )
 
  


 
   







 
 .




  

  


 








 
 


 

 
 


   


 






 



 
 
 
 
 
  



 
  /

0  
















 

 1 ( 
 


  










  
 2

 
 
  

 
    
 !

 
    

 

$
    



 








 

  
 


 
  




  

 
 

   




 %

 
  
 


 


   
  @



 #A




(
4

 
   



 






 $


 








 


  




  

 





     





 

 $
 
 














  





 





  

 



  "A 
 

 )

  

%









 


 

 










 


,
  345 



  





 




)
  
  


   



  



6
"(    

 
  
 $
 
 



 
7



  8
         )





  
 )


  
  

 

 
 



   
 



 



 

 9
  3:5 



  

 



 


  



 




   

   

 
 
 
 
 
 

#
 & )   


 
     

 

  +

  3.5 



 
 


%



*
 




 
 



 




 





 

 




 

 







 


:

  


 
 

  


Clients
Requests

Virtual
server
Load
balancing
Real
servers

  



   




 $
B
1 

 

  



 



   # 

   


 

 (
 
 
B
? 

 


   







  
!$$#


  

 


 /
   
 
  &C
0 
 

"A *
 
"A  
 





"A


 

  


 
     



  

 # 


 $
"A


 


  # 

 
 
 
  
 










 




 !

  

 



 
     
    "A

   


  
 
 







%
'()
/0

  
  
   
 !"##  $
 !&#

* "+, 
-.
 ,

1
2 ) "#"




%
'()

/0

  
  3
 #+ 3!+  
 !  $
'
4
 56  " .
* "+
* 
-.
 ,
03 0&"#
13
1
2 ) "#"





 
A$
  





 






  )  



  
 
  

4:4 




/ 



0   



  



 
 



 

 
 
 




 


  

  
 
 
            





 

   
$&#


7, 
$+B !,"8   7, $+B !,"8 $
 7, 
$+B !,"8 $&#

 


7$@, $8 $&#


 $
 

 
    )

 
        
 
  



      
  

 


   
 
 



 


 
7$@, $8 $&#






 

 
   








 #
  3-5   



 


E
 
#
  





 



 
 
   
 




 



 



 $> F4:  /  


  

0 
F2   F..  "& 



   
  
F4:   F2  "& 

  !""

 
 

 











   


 
  




 


 

 # 




  

 







    


  
"A





      





 
 

 

    









 

 

 


 



 









 
   



  



 
 





 
 



 

 
   




 $






   C ,

 
) /C,0
$
4




 
 
  



 

 


  B 

 3D5 /B 0
 


 

4:4   B 9

 



 
  



  
 4:1 
 B  $
B 
 

B
1 

  


 



     


 




   # 

 
 



 


 


 
 / 0 
 
      
 




 #,&
-- 34G5 

  
  )



 


 
   










 #,&
--




 
 
  

  






 

 (
 
 #,&
-- 




 

   

   &C

 #
 

 

H 
 3445   

 ) 
 



 


  

  
  





 
 
&C
  








 


 (&CG=? 34:5   

  



 
(
&C  
.

600

  
 





  
 !"# 
 


$" %& 
7 8
4

"

+

 

:+&;
#
:;
:
:;
"
::;

6 596
 
+ 
+
+
:";
:+;
&
:
::;
:;


:;
:+;

+
:";
:"";

 

:+;
:
:;
"
:"+;

:&;



<-
" <
 <
 <
 <
 <
: <

596
 
# 
+ 
" 
 
 

C
B

)c
es 400
m
(e
im
t 300
es
no
ps 200
e
R
100

 $ '
 (  ) 

 *
 

  














500

A. 1node-800MHz
C. 2nodes-800MHz
E. 3nodes-800MHz
G. 4nodes-800MHz
0

500

F
H

B. 1node-1800MHz
D. 2nodes-1800MHz
F. 3nodes-1800MHz
H. 4nodes-1800MHz

1000
1500
Simultaneous sessions

2000

  +

 
 

 



 

 
 




3

"+ =
:: =
!
!
!
&: =

250
H

200

G
F

)
W
r(e 150
w
op
eg
ar 100
ev
A







 

 
 
 
 
 


 






 





/

 
  

 


 

0 
 

#,&
-- 
  )  




 




 


 
$
.





 

 

$
  "

 #
 /$"#0  




 

 $



 

 

 

 

 







 

 




 


 

 $
:


  




 




    -GI 


 

 .:G3)
5
  



 
  


 
 




 

  

 




  
 




 
  




 




 


 $
 

 
 




#,&
--  







&#E 
(
:




 


 










 



 
 

 

  

 


 
 
 


 



 
 




 


 
  




 






  7
 8 (
 
 

 



 



 
 
  




 







 

  
 





 






 


 
 




(
.




 


 
 
 





 



 





50
0

A
0

500

A. 1node-800MHz
B. 1node-1800MHz
C. 2nodes-800MHz
D. 2nodes-1800MHz
E. 3nodes-800MHz
F. 3nodes-1800MHz
G. 4nodes-800MHz
H. 4nodes-1800MHz

1000
1500
Simultaneous sessions

2000

 $ +

 
 

 
 


 

 
    

 
 


 


   








 


 


  

 


 
 $



   



 


 

 
 
 
   



 

 
 
)


 
   



   
  (
. 



 
  






 
 
  




 






  

    



 


   
  

  
 

  


 
 



 
  


  

   





   

  


  


 


 
  




 






  


 

 
    


 
   

 
  
 

1

235 /

7

 8 



 

 
0
 


 

  !

 




 
   

  




 


 
  





  

 
 

   
  




 





  

   $


 






 


 


 
 
 


 

 
' 

User requests
Virtual server
Master
CPMD

Load
balancer

Server state
management

"    
 
 

  #

Slave
CPMD





 
 . 


 













 

 !

 

 




  


  



 


 
 
  

 

 



 



 
  


 




 
'


  
 



 
   



 









  


 /


0 




 

   



 
 
 "(   

 %





 



 
   


)  

 

  









  
   



 
 
 
 
   

 
 
  
"( 







  
 
    

 


 






  

 

Load
statistics

Request
distribution

Apache

Real server 0

Slave
CPMD

Apache

Real server 1

 , +  

 
 *  



   



 

 

 
   





 
 

  


 $%



  



A
 



 
 



 




 



 

  

 





  
 '    





 








  


 

  

 







  




  




 



 

  









   

  


 
 43

5

  



 

 







! "!




 
  

  
  



 
 
 
     



 






 

   

 "( 
(
1





 

   




 






  



 &


#
 @

 "
 /&#@"0 


 




 


/
 
  





 
0  





 


 


 




  



 $

&#@" 
 

  @

  

/




@

&#@"  
&#@"0 $
@

&#@" 

 
 
 
  


  
  


 



  
@

&#@" 




   





 
 

&#@"

  



 





   



 



 

  

 

 "(    
@

&#@" 


)
 J
BA  )





 

  




  





 




 

 $
%@ / $%0 /) 
&# .

34.50 





 <

 



 




  


  ) 
<

   
 

   



 



 
 



   
 < 



 






   





 



 


 








   



  




 



 







 
 
 
  
 
  






 




   
 





 )
 
 


 







4 @



  

 
    



 

 
  


 




 

 ' 
  








: %



 
<

 

  


 
 
 
 

 



 

 
 
  



 
   

 ' 



 /



  

    

 
 

 
  0   
 
 
  

   
     
   


6

  




 
 
 


 


 


)



 
     






 
  



 
 



 
       
  
2

reqs./ sec



   
*

Nt+D > Nt : Nodes addition

   
  

 
     
 
  
 

Needed nodes: Nt+D

R(t) + Rinc * D
R(t)

/40


 


Needed nodes: Nt

 
 

  

 )
 
 


  





  



 



 

 '     
 



 
  $


 

  

 
  

 

   
  $






  
 




 

  
 


  






/%0 
  





 

/%@0 
 3415 $






   


  
 







 $


   





 


 







time
t+D

: Whole server performance

: Possible request rate increase

 - 



 *





*.)  
*.)

   
    

 
  
 




 

A
 










 






 $


 


 


 


 

 




 
<

 



 
 
   




 

/

 7 

8



 0 

  
  
 

  

 



  



 


 




  
 
    




  

 



 <

 

 

 



 
   







 


6
"(   





 

 <







 

 
  

 

       
   




    
 

     
 

!

 




 


 



 


  
 

  

 

 
  


 


 

 


 
  
      

 
/40 (
 
 



     

 


         
  



      
  


  



 

  


 

 
 
 


  




  
 
  

 
  
 
  
 








 
 
 

 

 
 


     

  
   

 
 

 

 

 

 <








 

 (
2







 



 
 



 
&#@" 








 




 



 

  






 
 

   

 






 

  


/

  
  



 
 

 
43

5  

  
  







 



 


0 !

 







 
 
  
 

 
&#@"


 
  &#@"


 $







 









 





 

  

     $











  
 

*




    


 



 
 



 
  
 
  





 

  
 

.3

5  



  

 
 
43

5


 







  
  

 ;
 



 
 





#$



 


 
&#@"




 

 
   

  


 
 


 









     




  ) 
  ) 

  
 3425 











#,&
-- $

 
)  








 
 



 
#,&
--  







   


$

 &#@"







   


  

  



 




 




 
   

 

  

=

 , 
 

 



!-#  
 /     


    
9  9>6
+
&#
#
#
"
++














1.87

static-CPMD
dynamic-CPMD
non-CPMD

1.8
1.6
1.4

eu
la 1.2
v
ev 1
it
al
eR0.8

( =
"#&
""
+&
+++
++&
+&

1.00 0.95 1.00

1.11

1.00

0.94

1.00
0.83

0.6
0.4
0.2

300

static-CPMD
non-CPMD

250

dynamic-CPMD
Request rate

4000

)
(W
re 150
w
oP

2500
2000
1500

100

1000
50

# of requests with
QoS satisfied

3500
3000

200

)c
se/
sq
er
(
tea
r
ts
eu
qe
R

 
) $

 &#@"










 



 
 

/40 

 



 

  


 ) $
  &#@"






%/4G0 
 

  
 
 






 



 

 
 
  



4G


 $
) 















  
 G 3

<

5  .:GG 3

<

5
 


 

 
DG 3

<

5  (
= 

 &#@"



 

 
 
      


    

 

   



 
  &#@"


   





   

 &#@" $




   
 
  &#@" 




 
 
  

 &#@" 


 
  



 








  
 


 @


 
  

 &#@"


 
 





 
   
  &#@" 




 



 
) 


  



$
 

  

 
 
 
 

 



 
 
 








 


 
 
 

 
  

(
?

 

 
  
 
 
'

 



 



 
  



  
) 


 








  


 
&#@"


 

  ' 

 
  



  



)  
 
 
 

 .G 3

5
 
 
 
  &#@" 
 &#@"




 





  
 4?I
 =I 



 !

 
 
  '


 



 
  &#@"





 2I 

  
&#@"



 


0
0

50

100
Time (Sec)

Energy

 1 .
 
   /



 
2  

2 
 
3

 *.) 

500

Average reply time

150

 0 


 


   *


      


  





 



 

  )
  










 

 


 
















  
  




 





 
 
 





 

)


 

$
1


  


 
   


 

  

 

 
'
 
 
 -2I   




 
 
 

 .G 3

5   





 

   




 
  
 !

 



B 






 
 




 








 
 
 
   @




 
   




 
 





 
 2 35  
  




  





 

 

 





 
 
 4? 3

5
(
=



  

 
 
  



 

 



 
 )
 

 &#@"
 &#@"    
&#@"



 $




 



 

&#@"



 



 



?




 

 &#@"



 
 




 
&#@"


 $
 

  


 

 






 



 


 
  





 

  


  
 


 


 
 !

   




  

 
 








   
 ) /  
 





 




 )
 
 

C  )
 

 



0 $




 
 
  &#@"





 
 4- 

  
&#@"



!

 
  

 
 
 


 
 =4- 3

5  .=D 3

5 



 $






   



 

 
  

 







$ 



 
  



&#@"


)
 
  


 


 

  

 






 
 

 
    


 








 



 

<)
  $%

  
  
  

  

  

! " #

 


   


 
  
  

 
 $%%&

$  
" '
 ( 
 ) 
* "+
, 

 -+  
 + 
 #

 
    

 
 
 


 ! 
   

"#$

., $%%/
0 1 2 3 1
 4 5
 
 46" 
7"   8

! + #  %&

 
'    %' (##) 

 $%%9

& 6 "

. (
 ( .!
  ":


; 1+ *
*
 7" 

 

! " #


 
( '      '
(##* 4! $%%0

/  



  1+ < 
+
 -+
4!+ "  "
   " + #


 
  (##*  

 
  



 +
 
  
 
, +

$ 
 

 %   


 $%%0
=  ++ . )
 " .

 

 


  
 
 




 
&#@" 
 
 

  

'  


 






 



 





  


  







  


 

<)
  $% 


 
  "(  
 


 








  

 







 


 

 
 






  
  ) )

 

 

 
 


 






  
 
 
     




 $





 






 
 4?I    &#@"  =I 
 
&#@" 
 

   ' 
 


  







 


   


 

 
 


 
 


 

 

 

  
  &#@"


  
'

 

 

 


   


 
 
 

  
 
 





 
  


 


   


 


 
 


  

 

 )


  

 4 5
 8 
( >+
" + #


 
  (  '

  
 ! 
 
 +  


 '+"#- ., $%%=

9  ?+ 4 ;+  ++  
 4 5

8   ! + #


 
  (##$ +./ 01+203







1
 4   4 
 

 !  
1."#$ 3+ $%%/

@ 1+A 6+
 "B ,BCC***+A+
C
D E >
 "
 > +
" 
+:
( 2:+

4 (
:

 8!
 ,
  ,* ,

 ! + 
 
 
 
 + #


 
5  

 ,+, .

 %& 5+.

  (#  

"#- 


$%%=

% "

!DDB ,BCC***,C*!DDC

 . 2
  

 .  <



   1
  

#

 

   .


 
 

 
  

 ! 



 4!
DD=

$ )
 'FB ,BCC***
C

0 .


8+


*

F
B

,BCC***
,C


 &


& . "
 
6


 H . '      
7 
   7 
 
 

    

.

$



  


  
K 


 $
 
  
 &%, $ 


  ;



 7B
  ! "


#
 & 

 #  , 

 


8


DD0

/ 4 !
 ( 3 , I .   
+
*!  ,
 #

 
  8 


 9 

 %&  3+
DD@