2010 International Conference on E-Business and E-Government

An Empirical Research on Comprehensive

Assessment of Goverment Websites
Yanli Lu, Wenhai Gao, Lina Yuan
School of Economics & Management
Hebei University of Science & Technology
Shijiazhuang, China
yanly_lu@163.com
AbstractThe aim of this paper is to develop comprehensive
evaluation criteria for government websites and to apply it to a
sample. Considering the difficulty of fuzzy synthetic evaluation
method in calculation of the multiple factors and ignorance of the
relationship among evaluating objects, a new weight evaluation
process using an analytic hierarchy process (AHP) approach was
introduced. This improved method for determination of weight of
the evaluating indicators was applied in three websites assessment
of China government entities. Results showed that it is important
for websites to provide orientation information, and that website
style be properly adapted to the government web environment and
facilities be made available to users, and that website security and
privacy concerns be addressed. Compared with the original
evaluation method, the method was favorable for fuzzy synthetic
evaluation when there were more than one evaluating objects and
the evaluation results were more reasonable. The findings provide
useful information to website assessment for improving egovernment.
Keywords- government website; assessment; analytic hierarchy
process (AHP)

[1]
2008 6
gov.cn 1.3

,
[2]

Eschenfelder [3]
Alastair
G. Smith[4] Eschenfelder
5 Jon P. Gant [5]
50
Menno de Jong [6]
2007
978-0-7695-3997-3/10 $26.00 2010 IEEE
DOI 10.1109/ICEE.2010.918

[7]

I.

analytical hierarchy process

AHP T. L. Saaty 70

[8]
,

II.

A. AHP

Eschenfelder
2007

1 4
3656

A1

B1

B2

A2

B3

B4

C1

C2

C3
C4
C5
C6

C7
C8
C9

A3

A4

B5

B6

B7

B8

B9

B10

B11

C10
C11
C12
C13

C14
C15
C16
C17
C18
C19
C20
C21
C22

B.
1

,,

http://www.beijing.gov.cn
http://www.qingdao.gov.cn
http://www.sjz.gov.cn
1998 7
1

100
87 81
2
5
5 4 3 2
1
C.

A
W1 / W1 W1 / W " W1 / W
W / W W / W " W / W

= (a ij ) n n
A=
# # #

Wn / W Wn / W " Wn / W

(1)

a ii = 1, ( i = 1, 2, ", n) ;

(2) a ij = 1/a ji , ( i, j = 1, 2, ", n) ;

(3) a ij = a ik / a jk , ( i, j, k = 1, 2, ", n) ;

B
11

2
2

C
22
1

2/4/6/8

3657

22

CLC = PiWi = 5.00 0.05 + 4.17 0.04 + "

W1 / W1 W1 / W " W1 / W W1
W1
W / W W / W " W / W W
W

2
= n 2 = nW
AW =

# # #

#
#

"
W
W
W
W
W

/
W
/
/
W
W
n

n

n
n
n

i =1

+ 5.00 0.02 + 5.00 0.02

= 4.578

n A W= (W1, W2, ,
Wn )T W Pi

AHP
20
20

C1
C2
C3
C4
C5
C6
C7
C8
C9
C10
C11
C12
C13
C14
C15
C16
C17
C18
C19
C20
C21
C22

A1

A2

A3

A4

0.3276

0.2968

B1

0.3012

B2

0.4231

B3

0.2757

B4

0.4012

B5

0.2981

B6

0.3007

B7

0.469

B8

0.531

B9

0.321

B10

0.4034

B11

0.2756

0.5210
C1
C2
0.4790
0.3120
C3
C4
0.3430
C5
0.3450
C6
1.0000
0.3780
C7
C8
0.2120
C9
0.4100
C10
1.0000
0.4980
C11
C12
0.5020
0.6340
C13
C14
0.3660
0.5310
C15
C16
0.4690
0.4210
C17
C18
0.5790
0.4120
C19
C20
0.5880
0.5430
C21
C22
0.4570

0.1803

0.1953

Wj
0.0514
0.0473
0.0432
0.0475
0.0478
0.0903
0.0450
0.0252
0.0488
0.0885
0.0444
0.0448
0.0536
0.0309
0.0508
0.0449
0.0264
0.0363
0.0346
0.0494
0.0292
0.02

D.
U Pi
Pi
n

Wi (i = 1,
2,
", n ) > 0, Wi = 1
i =1

U = W1 P1 + W2 P2 + "Wn Pn = Wi Pi
i =1

5.00
4.17
5.00
5.00
5.00
5.00
4.00
5.00
4.00
5.00
1.00
5.00
4.52
3.20
4.14
4.45
5.00
4.85
4.86
4.96
5.00
5.00

Pj

1.00
1.00
4.10
3.40
3.62
2.60
4.50
4.60
1.00
5.00
1.00
5.00
4.58
3.60
4.51
4.61
4.23
3.43
4.41
4.52
1.00
1.00

III.

1.00
1.00
5.00
3.87
4.34
5.00
5.00
5.00
5.00
5.00
1.00
5.00
3.87
3.50
4.54
3.65
4.90
4.45
4.12
1.00
1.00
1.00

0.250
0.167
0.200
0.200
0.250
0.450
0.240
0.150
0.240
0.450
0.030
0.150
0.316
0.160
0.207
0.134
0.200
0.194
0.146
0.248
0.100
0.100
4.582

0.050
0.050
0.040
0.040
0.164
0.200
0.136
0.155
0.181
0.217
0.234
0.450
0.270
0.300
0.138
0.150
0.060
0.300
0.450
0.300
0.030
0.030
0.150
0.150
0.321
0.271
0.180
0.210
0.226
0.227
0.138
0.110
0.169
0.196
0.137
0.178
0.132
0.124
0.226
0.050
0.020
0.020
0.020
0.020
3.472
3.747

A.
4
4.582
3.747
3.472

B.
1 A

2 C1
C2

4
C1 C2 1

3658

IV.

2 A2
1
A2(B4)(B5)(B6)
4
(B6)C11 1
4

3 A3
(style)

CI

REFERENCES
[1]

[2]

[3]

[4]

[5]
[6]

[7]

[8]

3659

Aijing Fan, The evaluation index system and evaluation method of

government portal of Henan province. Journal of Pingdingshan Institute
of Technology, Vol 18, pp.40-43, Jan 2009 (In Chinese).
Esteves J Joseph R C, A comprehensive framework for the assessment
of eGovement projects. Government Information Quarterly, Vol 25,
pp.118-132, Jan 2008.
Eschenfelder K R, Beachboard J C, Mcclure C R, etal, Assessing federal
govermment websites. Government Information Quarterly, Vol 14,
pp.173-189, 1997.
Alastair G. Smith, Applying evaluation criteria to New Zealand
government websites. International Journal of Information Management,
Vol 21, pp.137-149, 2001.
Gant J P, Gant D B, Web portal functionality and state government eservice. System Service, Vol 7, pp.1627-1636, 2002.
Menno De Jong, Leo Lentz. Scenario evaluation of municipal websites
development and use of an expert-focused evaluation tool. Government
Information Quarterly, Vol 23, pp. 191-206, 2006.
China Software Testing Center, National Informatization Evaluation
Center, 2007 national government website performance assessment
report, Beijing: State Council Informatization Office, 2007, pp.813 (In
Chinese).
Saaty T. L. The Analytic Hierarchy Process: Planning, Priority Setting,
Resource Allocation. NewYork: McGraw-Hill, 1980.