Professional Documents
Culture Documents
I.
15
1.
16
2.
35
3.
56
4.
98
5.
118
6.
142
159
7.
160
8. (JAR):
173
9.
183
211
11. :
241
12.
264
I I I .
293
13.
294
14.
313
15.
328
16.
368
377
380
11
11
12
13
14
I.
15
1.
16
2.
,
3.
17
19
20
21
21
21
22
22
25
26
28
29
29
30
30
31
34
35
37
39
42
45
47
47
49
50
52
54
56
58
59
,
,
62
64
66
69
69
71
73
74
75
77
79
83
85
4.
5.
86
86
95
96
98
99
102
103
103
104
105
107
110
110
111
113
114
115
116
118
120
120
123
128
129
131
131
132
134
135
136
6 .
, ,
137
138
139
140
142
143
143
145
147'
149
150
153
155
156
II.
159
7.
160
8. (JAR):
JAR
JAR
9.
/ /
160
161
164
165
166
167
169
170
172
173
174
181
182
183
184
185
189
191
192
195
195
198
10.
/
/ / /
/
"-"
11. :
(
)
-
(SWEEP)
198
198
200
201
201
202
202
202
203
204
204
205
205
208
210
210
211
213
214
215
215
217
220
224
226
227
228
230
231
233
234
238
240
241
242
251
255
256
257
259
263
10
12.
264
268
287
290
III.
293
13.
294
. 1.0
14.
. 1.0
15.
. 1.0
16.
. 1.0
296
313
315
328
333
368
370
377
380
,
.
.
, ,
. ,
.
,
, , .
,
. ,
, :
,
.
,
, ,
.
, .
:
,
.
.
,
. ,
,
.
12
,
.
.
:
I. .
, .
,
.
,
,
.
,
.
II. .
,
.
,
, ,
.
, ,
, ,
,
.
III. .
,
.
(Test Management Toolkit, T M T ) ,
.
, ,
, . Web-
.
13
,
:
(Robert Culbertson) ,
,
. Cisco Systems,
Texas Instruments, IBM, , DSC Communications,
, .
(B.S.E.E.)
(M.S.E.E.),
,
.
(Gary Cobb) 25
, ,
.
, ,
. -
- ,
-.
Texas In
struments Inc., Lockheed Martin Dell C o m p u t e r Corporation.
,
,
Greater Austin Quality Award (
) . ,
.
(Chris Brown)
20 . ,
, Advanced Micro Devices, Cisco Sys
tems, C o m p a q C o m p u t e r Corporation IBM. Advanced Micro Devices
. C o m p a q
. IBM,
O S / 2 ,
. /
Computer Security Corporation, ,
- , Prudential,
14
Boeing .
- Dataserv C o m p u t e r Mainte
nance/BellSouth,
40000 .
.
(Al Dale),
SQI (Software Quality Institute
) , , .
(Paul Petralia)
.
SQI
Prentice Hall .
(Jessica Balch) Pine
T r e e Composition , ;
.
,
,
.
.
, ,
, . ,
(Bob Marinkonz), (Mark
Sherwood) .
, .
, ,
. , ,
,
.
, :
.
, , ,
. ,
, Internet.
,
.
,
.
,
, .
:
,
.
1.
17
,
, ,
, .
,
.
,
.
.
, .
,
.
(software testing)
.
, ,
. (process) ,
, , .
, ,
,
, ,
.
, "" "
" . ,
,
(static testing).
, , ..
(desk checks). , ,
,
(dynamic testing).
,
.
,
(bug). , ,
,
. ,
,
.
- , ,
.
1.1.
18
I.
.
, (error),
, .
, , ,
.
( , )
(fault).
( (bug, defect))
, .
, , ,
, ,
, ,
.
, .
,
.
, ,
, .
, *-<-.
.
1.1
,
. ,
,
. "" .
,
, ,
,
. ""
.
,
. ,
: ,
.
:
. [45] (verification
a n d validation, V&V) :
(verification)
.
(validation) ,
.
,
,
. ,
, .
1.
19
. ,
,
.
. , ,
. ,
,
.
. , ,
, .
:
, . ,
{quality), :
. ,
.
, ,
.
,
,
, .
?
" "
" ". [33],
.
.
CASE, .
[33]
:
, , "
" " ".
, .
, " " ,
.
, (rapid testing)
, -
20
I.
, .
, . . 1.1
, ,
.
, . . 1.1,
,
, , ,
.
.
. 1.1.
,
.
,
10:1 .
,
, .
,
,
.
, 6 ,
, .
, ,
,
.
1.
21
, ,
. I
.
.
.
,
. ,
, , ,
, .
,
. ,
, ,
,
. ,
. ,
, ,
.
.
, ,
,
.
,
. ,
.
, , .
,
, ,
.
, , ,
,
.
;
.
22
I.
, ?
,
?
? ?
.
.
,
, , ,
, ,
, .
,
.
.
,
.
:
- ,
?
- ,
?
- ,
,
?
,
,
.
, , .
, ,
. ,
" ",
.
1.
23
,
(, ),
.
,
.
, ,
.
,
, .
, ,
.
,
.
,
. ,
, ,
.
,
.
(software life cycle).
,
,
,
.
( )
, . 1.2.
,
.
. ,
,
. , ,
. , , ,
; ,
" " " ",
" ".
24
I.
. 1.2.
. ,
,
. ,
, . ,
,
" ".
-
.
[13] [42] ,
, .
.
,
, .
, , ,
.
, .
,
.
1.
25
,
,
. , , , ,
,
.
2.
, , , ,
.
, , ,
.
,
, .
, ,
, .
, ,
, ,
. ,
,
, , .
, ,
,
, ,
.
, ,
.
(. . 1.2)
.
, ,
, ,
.
.
, ,
, ,
, .
. 1.3.
, ,
.
26
I.
. 1.3.
1.1. ,
.
.
,
, .
, ,
.
,
. ,
,
.
1.
27
1.1.
,
,
,
,
,
,
,
" " ,
,
,
,
,
,
,
,
, ,
,
,
,
,
,
, ,
. (requirements traceability matrix)
,
, ,
.
, , Web-.
""
2.
28
I.
,
, .
,
,
, ,
. ,
, , ,
, .
,
,
.
, , ,
. 1.3 1.1,
, . ,
,
,
, :
, , ,
.
, ,
.
, .
( ),
.
, , .
,
, , , ,
.
3,
.
,
. , -
1.
29
, . ,
,
. .
, ,
, .
:
. ,
, ,
..
.
, , ,
, ,
.
, , .
.
,
, ,
. ,
, , ,
.
,
,
.
,
- . , ,
" " ,
, , ,
.
,
, .. .
,
, .
:
.
(functional testing)
,
, . ,
, ,
.
,
, ,
.
(performance testing) , -
30
I.
, ,
. , ,
.
, ,
.
, , ,
, .
5 .
.
, , (alpha testing). ,
,
- (beta testing). -, -
(pilot tests),
.
(benchmark test),
, ,
.
,
.
,
, ,
.
(installation test),
,
.
.
,
,
,
. ,
,
(regression tests)
1.
31
.
,
.
, .
.
[30].
.
,
.
, .
,
, V- , . 1.4. ,
-, ,
, V.
, .
, , , .
. 1.4. -, V-
32
I.
.
,
,
. ,
,
. , V- ,
,
.
V- ,
,
, .
,
, . 1.5.
, ,
,
.
, ,
,
.
, , ,
.
,
,
.
"
", ,
,
, ,
, .
.
. 1.5 ,
.
,
.
,
. , ,
.
1.
1.5.
33
34
I.
.
. ,
, ,
.
, ,
,
. , V-
, .
.
,
,
.
.
.
, :
,
,
.
,
.
,
, ,
.
,
,
.
.
Standish Group 350 ,
1994 , , 9% 8000
[48].
. [49]
. ,
, , 50%
. ,
, ;
36
I.
, ,
:
(13.1%)
(12.4%)
(9.9%)
(8.7%)
(7.5%).
,
.
,
,
. (Boehm) (Papaccio) (
[42]) ,
$1,
$5, $10,
$20,
$200. ,
, . 2.1.
, ,
.
$200-
. 2.1. . [28]
2.
37
Standish G r o u p ,
, ,
,
.
:
,
. ,
.
,
.
.
.
,
,
. , ,
. ,
, , .
,
.
, ,
.
.
,
(requirement) , ,
,
, . ,
, , .
,
, , .
2.2
.
, ,
,
,
.
38
I.
. 2.2.
. 2.2 ,
.
. ,
.
FAST (Facilitated Application Specification Techniques -
),
, .
,
, (requirements definition docu
ment). ,
.
, , ,
.
, , ,
.
,
, ,
.
,
(requirement specification) (functional specification).
-
2.
39
, ,
[47], [43] [42].
, (re
quirements traceability matrix). ,
, .
,
, ,
.
,
,
, , ,
.
, .
.
,
.
, ,
.
, ,
.
: ,
, ,
. , ,
, ,
.
,
,
,
.
,
. ,
,
.
,
, FAST (Facilitated Application Specification
Techniques ). -
40
I.
FAST
IBM JAD (Joint Application Development
) [43]. , JAR (Joint Application Req ui rem ent
), (Gary Cobb)
8.
FAST
[43]:
, ,
.
,
. ,
.
.
, - ,
.
,
, .
,
, .
FAST
,
. JAR, 8,
, JAR "
".
,
,
. ,
:
, .
, , .
. , ,
,
.
,
.
, ,
.
,
,
, , . ,
2.
41
;
Standish G r o u p , ,
. ,
-
,
.
, , , ,
,
. ,
,
, , ,
. , .
, ,
JAR- , ,
. ,
, .
-
- -
. (use case) ,
.
-
.
, ( ) , . ,
, ,
, .
, ,
, , .
10.
2.1
42
I.
,
,
, , .
, ,
.
:
,
,
.
.
, ,
.
,
.
.
(functional),
(nonfunctional) . ,
,
. ,
, ,
, , .
. , , ,
, , , ,
. ,
,
.
,
, . 2.3. IEEE
Standard 830: The IEEE Guide to Software Requirements Specifications [23]
IEEE
. , . 2.3,
. ,
,
. ,
,
.
2.
43
4
4
4
4
4
4
4
4
4
5
5
5
5
5
5
6
6
7
7
7
. 2.3. .
IEEE Standard 830: The IEEE Guide to
Software Requirements Specifications [23]. .
, . 2.3,
, ,
, .
,
, .
.
,
, .
()
, .
,
,
, , ,
.
. ,
, ,
,
. ,
44
I.
.
:
. ,
. ,
.
. ,
, , .
- ,
?
. .
? ?
, ?
?
.
, ,
,
,
.
,
.
.
, .
, ,
?
?
. ,
.
? ,
, ?
. ,
.
,
. ?
?
. ,
. , ,
.
. ,
.
?
2.
45
?
?
. ,
, ,
.
. , ,
,
,
.
, ,
.
,
, ,
.
, ,
, , ,
.
. ,
, . 2.4.
, "" .
,
(Test Management Toolkit
), , ,
,
.
.
, . 2.4,
.
,
,
, .
,
.
, ,
.
,
. , ,
46
I.
,
. -
,
, ,
, .
2.2.1 , , ,
, .
2.2.2 , , ,
, .
" ".
2.2.3 , , ,
,
, , ,
.
2.2.4
,
.
2.2.5 , , ,
, .
2.2.6 ,
, .
. 2.4.
,
.
,
,
, ,
, "", "", "" ..
, ,
[42].
, ,
, ,
.
, ,
, , , ,
.
2.
47
,
. . 2.5.
, ,
,
,
,
, .
" ".
"--" (,
).
,
,
.
.
.
RD2 2 4
RD2 2 4
RD2 2 4
RD2 2 4
RS2 2 4 1
RS2 2 4 2
RS2 2 4.3
RS2 2 4 4
D224 1
D2 2 4 2
D2 2 4 3
D2 2 4 4
2 2 4 1
2 2 4 2
2 2 4 3
' 2 2 4 4
UT2 2 4 1
UT2 2 4 2
UT2 2 4 3
UT2 2 4 4
IT2
IT2
IT2
IT2
2
2
2
2
4
4
4
4
ST2
ST2
ST2
ST2
2
2
2
2
4
4
4
4
2
2
2
2
2
2
2
2
4
4
4
4
. 2.5.
.
, , ,
( )
.
, , , -
48
I.
, .
. ,
Standish, , ,
, 50%
.
,
.
,
,
. -;
, "
".
2.1.
2.2 9.
2.1.
[28]
1-6
2.1 , ,
, ,
.
,
.
2.
49
,
.
.
,
.
,
. ,
.
. , [ 2 8 ] , ,
20% ,
80% .
[16] IBM,
.
,
, ,
, . ,
. ,
, . , .
,
.
.
,
, , , .
2.2.
,
,
. ,
, , ,
, .
. ,
.
:
" ",
" ", " " .
, , , .
,
.
50
I.
.
; .
. ,
, ,
.
" " " ", ,
.
.
. ,
.
, ,
, ,
.
.
,
. ,
, ,
.
, ,
.
.
, .
, ,
. ,
, ,
.
.
,
,
. ,
.
. (prototype),
,
,
. , -
2.
51
,
.
.
(throwaway prototype),
;
.
(evolutionary prototype),
,
, ,
.
.
. 2.6 [42].
.
.
. , ,
, .
. 2.6. . [42];
Prentice Hall
52
I.
,
, .
.
.
, " "
, "",
.
, ,
,
.
,
.
, ,
.
, .
,
.
, [42]. ,
, "", .
,
.
,
. ,
,
, .
, .
. 2.7.
. ,
.
,
.
, , JAR-.
2.
. 2.7.
53
54
I.
,
, ,
,
.
,
.
,
. ,
, ,
.
. , ,
, -
.
. 2.7 ,
( ,
, )
,
, .
.
,
:
,
.
,
.
.
DOORS Requisite Pro. DOORS -
, Quality System and Softwaie
(QSS) Ltd. Requisite Pro,
Rational Software. Atlantic Systems Guild, Inc.
,
Web- http://www.systemguild.com.
2 3
2.
55
,
:
,
,
.
,
, ,
, .
, ,
, .
.
, .
,
JAR-, 8. ,
,
.
,
.
.
, :
,
.
.
,
, ,
,
.
.
, ,
.
,
.
, ,
. 3.1. ,
, 2. 2,
, ,
, .
,
.
3.
57
. 3.1. ,
,
, ,
, ,
.
, ,
, ,
.
.
:
(
)
( )
.
()
.
. 12.
58
I.
.
. 3.1
, .
, ,
.
, ..
.
, ,
, ,
,
. ,
, ,
, ,
.
.
.
.
, ,
, ,
, ,
.
,
.
, .
,
.
,
, .
:
1.
,
( ), ,
. ,
,
,
,
.
2.
, .
3.
59
,
.
3.
,
,
.
4.
,
- .
,
,
.
,
.
, ,
,
. 3.1 "
?" , ,
"!". ,
, "hello, world" (, !),
o , , GUI (Graphical User Interface ).
, , ,
, -
, .
!
, , , . ,
, ?
, .
,
.
GUI-, (
, ). ,
.
, .
-, . 3.2.
, ,
h , GUI- .
, | . ,
00000 99999.
60
I.
,
$5 $20.
"--", ,
.
, ,
,
. ,
.
: .
, ,
, ,
.
,
100000 ( ,
, ). , ,
.. .
,
,
.
3 ,
5000 , 2
. , , ,
, .
, .
, ,
. 4 11 ,
,
.
,
.
, ,
. ,
' .
:
:
.
, [43]
, 100 ,
1 20 .
- if-end-else. ,
, 10 1 4
, 3170 .
,
, ,
. ,
.
3.1
3.
61
. 3.2.
,
, , . "
" , .., ,
,
. (,
),
, ,
.
.
,
.
.
, ,
. ,
,
. ,
, , .
,
. ,
, ,
,
.
,
. :
, .
.
,
. , ,
, ,
" " .
,
.
.
4 10;
62
I.
/.
, .
: " ".
- , ,
.
,
,
,
,
.
,
.
(..
),
.
, ,
.
"
" .
,
, .
, ,
. ,
,
.
,
.
.
.
.
,
. ,
: ,
. ,
.
3.
63
. ,
, ,
,
.
,
.
, .
.
. ,
. , (
), , ,
,
.
, ,
.
, . ,
. ,
.
,
.
. :
, , ,
, ,
.
,
. -
,
.
. ,
-, - .
,
, ,
.
,
, ,
,
.
. ,
. ,
, -
64
I.
. ,
,
, ,
.
,
.
.
.
, .
. ,
, ,
. , ,
, .
,
.
, ,
,
, , ,
.
,
.
.
,
-.
.
,
.
, .
, ,
. ,
, .
,
, .
,
, .
. ,
.
3.
65
,
.
, .
. : "
, ,
.
, -
, ".
, ,
,
.
/ , ,
- .
, ,
, ,
.
/ .
. ,
, ,
. ,
,
, .
, ,
. ,
" N " ,
. ,
.
, .
, ,
. ,
,
.
,
.
.
. -
66
I.
.
, , ,
,
. ,
,
. ,
, ,
.
,
, ,
.
(Dustin), (Rashka) (Paul) [15]
,
, ,
, .
() . 3.1,
. 3.2.
- ,
. ,
,
. , , ,
,
, ,
, ,
.
.
,
,
,
.
,
.
.
, ,
. ,
.
"" ,
,
, .
.
,
" ", . (
, , 6).
3.
67
3 . 1 .
( [15])
,
.
, ,
,
.
,
,
. ,
, ,
, ,
.
,
.
,
.
.
,
, ,
,
,
.
.
,
,
.
,
,
.
.
3.1.
68
I.
3.2. ,
( [15])
,
.
,
.
,
,
,
,
.
,
.
, ,
,
.
.
" " (build)
.
,
,
.
.
,
, ,
.
9.
,
.
,
.
,
.
,
.
3.
69
. 3.2
,
.
,
,
.
.
, ,
,
:
, , ,
.
:
.
, ,
. .
. ,
. ,
,
.
,
, , .
-"
,
,
, , . ,
, " , "
. -
70
I.
,
. ,
, ,
, .
.
. . ,
,
; ,
, .
(test suite).
. ,
,
, .
(test case) ,
, .
,
. ,
, , . 3.3 . 3.3.
. 3.3.
, ,
.
:
,
, .
.
3.
71
,
.
, ,
, ,
.
,
.
, -
.
3.3.
,
.
,
.
,
.
,
.
.
; ,
, .
,
,
. ,
, GUI. ,
,
Web-. ,
( ) ,
,
, ,
- .
,
, .
,
. . 3.4.
, .
72
I.
[15], [30] [40].
, .
3.4.
,
.
,
( ),
.
,
.
,
.
;
,
.
3.
73
. 3.4
GUI-
,
,
.
,
.
,
, ,
, .
, ,
. ,
,
. ,
,
,
, ,
.
(Rex Black) [33]
. :
, -
74
I.
.
, "" :
, , , ,
?
?
, ,
? , , , ,
,
.
, ,
?
,
,
. ,
, ,
.
, ,
, ,
,
.
,
, , :
5
10
20 ( ,
, )
,
5 20=1000. ,
,
240000 -, 125 -!
,
, .
,
: .
,
:
3.
75
.
. ,
,
.
:
:
?
:
?
:
?
,
, . ,
(. " "
),
,
.
,
, .
-
,
, .
, .
,
,
.
:
1.
, .
, ,
.
. ,
.
2.
. , ,
,
, .
76
I.
- . ,
.
3.
,
. ,
, , . ,
, ,
, .
, ,
.
4.
.
, , (Gantt),
.
5.
. ,
,
.
,
, . (
) ,
.
.
, ,
. ,
,
,
[40]. , . 3.4.
, ,
.
,
, ,
.
.
, .
, ,
, 12.
[40]. ,
[33],
II.
3.
77
4
2
1/2
1/4
. 3.4. . [40]
,
, ,
, .
, .
, .
,
. , ,
,
,
. -,
, . ,
, .
,
,
. ,
:
78
I.
, ,
.
,
,
.
, , ,
,
.
WBS (Work Breakdown Structure
). ,
, ,
, "
" .
.
,
. ,
,
.
, , , Microsoft Pro
ject, .
, ,
,
.
, , ,
, ,
, .
-
80
I.
, . 40
. ,
. ,
.
.
[40]. '
,
. ,
.
' **
, ,
,
.
, .
3 5
, ,
, .
,
.
. .
(-1)/2 [40].
, ,
,
:\: "
< ~ -
"" .
.
"
.
3.2.
. ,
.
,
.
3.
81
. 3.5.
1. ,
. ,
. ,
. ,
,
.
.
, ,
.
2.
.
,
. ,
,
. ,
.
3.
. ,
,
. ,
, ,
(
Wideband Delphi). Wideband Delphi
3.3.
82
I.
.
, ,
,
,
,
,
.
.
,
,
, ,
.
,
, , , ,
.
.
,
.
(LOC - number of lines)
(FP - functional points),
.
, .
12
.
,
,
W.deband Delphi Estimation Process,
. ,
.
. ,
. ,
, ,
.
. ,
, ,
, . ,
-
- .
. .
,
.
3.
83
, , -
. ,
, ( ),
,
. , , ,
(-, -).
. .
.
. ,
,
. ,
,
, , , .
,
.
, .
.
. ,
, ,
,
, .
.
.
. ,
.
.
: , "", ( )
, "", ( ).
,
.
. ,
, , .
? ( [ 3 3 ] , . 183) :
3,0 * -
1/3
, , ,
.
3.3.
, , ,
. , ,
, , .
, ,
,
. , , -
84
I.
, .
3.2.
, ,
. ,
, .
,
, ,
.
, ,
,
, .
[33].
, ( )
,
. 3.6.
, "" , :
, .
. 3.6 +. , 3.6,
.
, , ,
, ,
.
. 3.6.
3.
85
,
. ,
, , 3.4.
3.4.
1/8
1/18
1/18
1/25
2/1
2/12
2/14
2/14
,
,
, ,
, . ,
.
. ,
, ,
. , , ,
.
,
:
, ,
, ,
. , ,
86
I.
,
.
,
, ,
, ,
, .
,
. , , , ,
( 90%),
,
( ,
, , ). ,
,
,
. , ,
,
.
:
, , ,
.
,
,
. ,
,
.
.
.
, , , .
, ,
.
.
[43], [42] [30],
, .
3.
87
,
,
.
,
.
, . IEEE
Standard 829: IEEE Standard for Software Test Documentations [22] ( IEEE
). ,
,
, IEEE
. [15], [30], [40] [33].
IEEE Standard 829.
,
16 :
1.
2.
3.
4.
5.
6.
7.
8. '
9.
10.
11.
12.
13.
14.
15.
16. .
, ,
,
, -
88
I.
. ,
,
,
. ,
,
.
,
, ,
[22].
. , ,
.
, , ,
, , ,
.
.
.
.
.
.
4 ,
,
5, .
, ,
.
.
. ,
,
.
,
. ,
.
1. .
,
, . ,
:
, -
, .
- , ,
, , ,
. -
3.
89
,
.
(, ),
,
.
, ,
.
,
.
, .
. ,
, .
2. . ,
, .
,
.
,
.
(
URL- Web-),
.
,
.
.
,
,
. , IEEE Standard 829,
, ,
, , .
.
, , ,
, .
3. , .
, .
:
, .
,
90
I.
,
(, -, Web- ftp-)
, ,
, .
,
, .
, ,
.
, , .
, ""
.
, ,
, .
4. , . IEEE
Standard 829
(software feature): ,
, , .
,
. , . , " ".
, , ,
.
.
,
- ,
, .
, , ,
, .
,
.
,
,
.
5. , .
, ,
. ,
" ", :
3.
91
,
.
,
.
,
, "".
,
, "".
,
,
.
,
.
, , ,
,
, ,
, . ,
,
. , ,
,
.
, ,
.
. .
, .
,
. ,
, ,
, , " ".
, , :
,
,
/ /
/
/
GUI-
92
I.
: -, -
,
, ,
,
, ,
. , ,
GUI-. ,
.
,
.
, , .
,
,
, .
7. / .
/
. .
; ,
, ,
. /
,
.
, /
.
/
.
, ,
.. .
, ,
. ,
, .
3.
93
, , ,
, .
, ,
.
8. .
, ,
, ,
, , ,
. ,
, . ,
, ,
,
, . ,
, -
, ,
,
.
9. .
, ,
, :
,
,
(
).
. .
, , "",
,
" " . ,
. ,
. ,
,
.
,
,
, .
, -
94
I.
,
,
.
10. .
,
,
. ,
.
, , Microsoft Project, ,
.
, , ,
.
11. (
). ,
, , ,
. ,
, .
, " "
" " . ,
(..
) ,
. "
" .
12. .
-
,
, . ,
,
,
. ,
, ,
.
,
,
(,
),
.
,
.
3.
95
,
, , XYZ,
,
.
;
.
13. .
, .
,
. -
,
.
,
,
, .
14. . ,
,
. ,
, ,
, ,
.
,
, , ,
-
. ,
,
Web- .
15. . ,
, ,
.
"
".
16. .
,
, .
.
,
,
.
96
I.
, .
(. "
" 2 "/ / "
9, ).
,
, ( ,
). :
, ,
, , ,
.
,
.
, .
, ,
,
.
,
.
,
,
.
.
.
:
(
)
(
)
.
3.
97
,
,
.
,
. ,
, ,
.
, :
.
3,
,
, .
,
,
.
, ,
. 4.1.
, ,
3. ,
,
. , ..,
, .
,
.
,
, ,
.
.
, ,
, ,
.
4.
99
, , .
,
.
>
. 4.1.
. 4.1,
. ,
, ,
. ,
,
, .
. ,
, ,
.
3,
.
, ,
.
100
I.
,
, .
.
,
,
, .
,
.
.
,
,
, .
,
,
.
.
,
.
;
.
. ,
, ,
.
,
,
. ,
() ,
/ .
,
. ,
.
,
,
, ,
.
, , GUI,
. , , ,
.
,
.
" " 3.
4.
101
, , ,
.
, ,
,
.
,
. ,
.
,
, .
, ,
, ,
. , . , , ?
? ,
- .
, - ? , .
, .
,
, .
, .
, , ,
, . " ,
" , ' .
,
. ,
, ,
.
.
. . ,
, ,
,
. 3,
. (test suite).
. , , ,
, " ", " " " ".
.
102
I.
, .
(test case) ,
, .
,
.
4.1.
, ,
. ,
, 2
.
( . 2.4 2):
2 . 2 . 1 . ,
, , ,
.
2.2.1
, ,
. ,
, "Test_Plans" ("__") ,
2.2.1. , , ,
:
1.
,
,
.
2.
,
.
3.
,
,
.
4.
,
, ,
.
, , ,
. ,
.
, ,
2.2.1.
,
. ,
, ,
4.
103
, , ,
.
,
,
" ". 1 , , "
" .. , ,
. ,
, ,
.
, "
",
, ,
,
.
,
:
,
,
. ,
.
, , ,
.
,
, , ,
,
.
, ;
.
, ,
.
,
. , ,
, ,
. T P _ i n p u t l . d o c , TP_input2.doc ..,
, , D:\Test\Project_Name\Test_Plan\Inputs.
,
. ,
, ,
104
I.
.
3,
, .
,
,
.
,
. ,
, ,
,
.
.
.
,
,
. ,
.
,
.
4.1.
4 . 1 .
RD2.2.1
ST2.2.4
TP_lnput1.doc
2.0
02.2.4. ,
,
.
4.
105
),
. :
. ,
RTM ,
, .
,
.
.
.
. , - ,
. ,
. ,
.
1
. (test) ,
. , , (..
). ,
, (.. ).
, , ,
: (1)
(2) ,
. ,
. ,
, .
, ,
.
-,
, ,
.
,
;
.
106
I.
,
.
,
. ,
,
, , .
, ,
.
, ,
" "
. " "
. ,
,
; ,
, .
,
.
, - ,
, ,
.
, ,
.
.
, ,
. ,
, ,
.. , ,
.
, ,
.
, , - ,
, - ,
- . ,
, , ,
, , ,
.
/ .
/ .
,
, .
,
. , , -
4.
107
, ,
" ".
, , .
,
, ,
.
, ,
.
,
,
,
.
,
- .
,
. ,
.
, , -
,
. "
" , 10.
, ,
:
.
.
.
.
. ,
, ,
.
, ? ,
,
,
. ,
, .
, ,
,
. ,
,
108
I.
, .
, .
.
, ,
,
. , ,
.
.
,
.
.
,
"" .
-
,
API (Application P r o g r a m m i n g Inter
face ).
[17], [15] [27].
10 .
.
,
. ,
,
, .
.
,
,
. ,
, ,
. ,
, .
,
. ,
,
.
.
:
4.
109
:
,
,
,
.
. , , ,
1 100 . ,
1 100, , .
1 100,
.
, ,
, , ,
.
. 78723 20
,
.
,
. ,
, ,
.
10, [36], [27], [43], [28] [17].
.
,
-.
,
, " " .
,
, . , ,
.
, ,
,
(1 100 ), ,
(0 ), , (101
).
, , .
10, [36],
[27], [43] [17].
110
I.
. ,
; ,
, , , ,
.
, ,
.
4.2.
1.
"
" .
2.
"101"
.
"
".
3.
"0"
.
"
".
4.
"100"
.
"100 "
(V)
,
, 4.2.
. , ,
,
. ,
( ) ,
,
. ,
, - . ,
.
,
, .
, , ,
.
,
.
, ,
,
.
4.
111
,
, .
, , .
.
,
. ,
.
,
, ,
.
,
.
.
,
,
, "" ,
. .
,
,
, ,
, . ,
, , ,
.
,
. , ,
,
.
, . , ,
,
.
, ,
, . ,
, ,
, . 4.2. ,
,
, HTML-
.
112
I.
SC03 ver3.0
(Jean Douglas)
()
TestServer:D:\TestProject\TestSuite\SC03.doc
//
SC101
ST02
SC01
.
,
,
.
N/A
1.
"
" .
"
"
(V)
2.
"101"
"
"
(V)
"0"
"
"
3.
(V)
4.
"100"
"100 "
(V)
5.
" 1 "
"1 "
(V)
N/A
: JD
: //
:
- 3.
- BR1011.
. 4.2.
(P/F/B): F
4.
113
:
.
, (
).
,
.
,
. ,
, , "xxxLLL0123.tst", .
, .
, .
,
. ,
" ".
,
, .
.
, ,
. ,
run setupSC03.pl.
, ,
.
, ,
.
,
.
. ,
. ,
,
, .
,
.
CM (Configuration Manage
ment ), CVS
(Control Version System ) ClearCase.
114
I.
, ,
. ,
, ,
.
-
, .
,
. , 3.0
3.0 .
,
.
,
, .. ,
(. " " 2).
, ,
. ,
,
, .
:
, ?
?
,
?
?
? ?
,
?
( / )?
?
,
, ,
,
. ,
,
, ,
. -
4.
115
,
,
.
, ,
. , -,
, ,
, .
,
.
3 ,
.
, .
,
,
.
,
[15] [17].
. ,
.
,
,
.
, ,
.
.
, ,
,
.
, ,
, ,
.
, ,
.
,
116
I.
, ,
.
. ,
,
.
, ,
. ,
, ,
.
.
, .
.
,
,
, .
.
,
.
,
.
. , ,
,
.
.
:
(
).
4.
117
,
. , ,
.
, :
,
. ,
, . . 5.1,
, , , .
, .
: ,
?
? "
" ,
, , ?
,
.
.
,
,
.
, :
, .
, ,
, , - ,
5.
119
. , ,
,
,
.
. 5.1.
,
.
. ,
, ,
, .
, " ",
.
. , ,
, , ,
.
, .
. , ,
- ,
, ,
, .
120
I.
.
.
, ,
,
.
, ,
.
,
.
, -
.
, .
-,
,
, , -,
, , .
, ,
.
, ,
.
1 , ,
, .
,
,
.
,
,
. , ,
, "".
, :
,
? ,
, ,
?
,
?
, ,
.
, . -
5.
121
,
.
.
5.1 .
,
, .
, , ,
" ".
5.1.
(new)
,
,
.
(fix)
, .
(defer)
,
.
(trash)
,
, ,
.
(repair)
,
.
(fix verified)
,
,
.
,
, ,
. . 5.2
.
,
"". ,
.
(
) ,
. , ,
, - ,
122
I.
,
. , ,
, "", ""
"".
,
,
, , .
, ,
"" ,
. , ,
" ".
5.
123
,
, ,
, ,
, .
, 40
50 , , , .
, , i
. , <>
,
- .
,
.
,
,
, 5.2.
. \
, ,
, .
5.2. , ""
,
-
.
;
"".
""
.
,
.
,
//;
.
, .
,
.
,
.
124
I.
. 5.2
,
.
,
NA
(not applicable -
).
,
,
. ,
,
,
, ,
.
.
.
,
.
,
.
,
, , ,
, ,
.
. :
-
-
-
,
-
- ,
.
,
.
: "
-",
.
5.
125
, .
, ,
, ,
.
,
, , ,
, .
, , ,
.
.
(ad hoc) ,
,
. ,
, " ".
, ,
(
) .
?
?
? ,
, 5.3.
:
(fix) ,
, .
(defer) ,
.
(trash) ,
, .
,
. ,
"", ,
.
, .
, , "
".
5.4,
.
, ,
, .
,
.
126
I.
( )
""
""
"
"
;
"",
;
"",
-_
, -
;
,
.
,
.
,
(
,
).
,
( ,
).
, ,
,
.
, .
, ,
.
, .
,
.
, ,
.
, .
(Y/N)?
"Y",
, "N",
.
,
,
.
5.
127
. 5.3
,
,
(
,
).
( )
"",
" ".
"
",
;
"
",
,
.
,
.
,
.
, ,
.
, ,
.
,
.
,
,
;
, ,
.
;
,
.
128
I.
5.1 5.4 ,
.
, ,
,
,
.
,
.
,
.
, ,
.
, ,
. ,
.
,
,
.
,
.
. 5.3.
, , Web-
.
, 5.2.
. ,
,
,
. " ",
, ,
,
.
,
, :
, , .
, , ,
, .
,
,
, .
5.
129
:
:
:
:
(, , ):
:
:
:
:
( , .
.)
. 5.3.
:
. .
,
. ,
, ,
.
,
. , ,
, ,
.
, .
, :
130
I.
,
.
,
.
, ,
,
. ,
. ,
, , , ;
, ,
.
, , . 5.4.
: //
:
1233
/
/
/ -
.
1234
/
/
;
.
1235
/
/
-
.
:
1235 ,
.
. 5.4.
5.
131
. 5.4
, ,
. ,
,
. "
". -
, ,
,
.
, . 5.4,
, , "",
,
. ,
, .
,
.
, , . 5.1.
.
.
.
, ,
.
, , "
",
,
, , .
: ,
.
, ,
,
.
,
, , ,
, ,
.
132
I.
.
, .
,
. :
?
.
.
,
.
,
. ,
, , ,
, . "
" "",
,
.
, ,
.
, , ,
, , ,
. ,
,
.
, ,
, ,
,
. ,
, , -
. ,
,
,
.
(test cycle)
.
, . ,
.
. - ,
,
.
5.
133
, ,
.
, ,
, .
.
. , ,
.
, "
", .
,
,
.
. 5.5.
; , ,
, " " .
, ,
,
.
,
.
.
:
:
(P/F/NR)
1.
10
JimD.
1 1
Pass ( )
2.
11
Jim D.
1 1
Pass ( )
3.
11
BobZ.
2 2
Fail ( )
4.
11
BobZ.
2 2
Not run
( )
. 5.5.
134
I.
. ,
, ,
.
,
,
. ,
.
, ,
, .
, 4 (. 4.2),
, ,
(, ). ,
, ,
.
, . 4.2.
,
. 5.6.
, .
"/ /
", ,
.
,
,
.
,
, ,
.
:
, ,
.
,
, ,
Web
.
,
.
5.
135
: //
: 1
: 020202
: 1
: Jim D.
Pass/Fail/Not run
1.
10
2.
11
3.
12
4.
13
5.
14
6.
15
7.
NR
XY1234.
8.
NR
9.
NR
10.
NR
XY1233
XY1234
. 5.6.
.
,
. ,
, .
. "
?".
.
.
.
136
I.
,
.
,
, , ,
. " ".
, . 5.7, .
, ,
. , % Run ("
"), ,
. ,
, "# Fail" ( )
,
. "# Not R u n " ( )
,
. "# Tests",
- "# Pass".
: //
: 123
: 2/3
: / /
# Tests
#Pass
# Fail
# Not Run
% Run
20
12
70%
15
10
93%
25
12
72%
18
89%
78
42
20
16
79%
. 5.7.
, . 5.8.
.
5 .
137
138
I.
, ,
, 5.5. . 5.4
, ,
, ,
.
,
(change control b o a r d ) . ,
, , ,
.
,
, - .
,
.
,
.
, ,
(.
5.6) .
. 4.2 4.
(. . 5.7).
,
,
,
,
. ,
,
.
, ;
5.
139
, .
,
.
^ ^ S ^ n K H x , ^
.
,
, , ,
. ,
,
.
(. 5.4),
,
(. 5.8)
.
,
.
, .
,
.
;
,
.
,
, .
, , . ,
:
, , .
, ,
, , : "
?".
.
.
, , , : " ?"
, ,
140
I.
, , ,
.
.
SWEEP (Software Error Estimation Program
) ,
, ..
, , .
( SWEEP 11.)
- : "
?"
, ;
,
. ,
, :
,
,
,
,
, ,
.
.
;
.
.
, ,
,
, .
,
,
.
,
.
:
5.
141
,
.
,
.
,
.
,
; ,
.
, ,
.
, :
1 ,
:
.
, , .
, ,
,
, .
. , ,
, ,
[41]. Peopleware ( ) [14],
, (DeMarco) (Lister)
.
, ,
.
,
. 5 ,
. -
6. ...
143
, .
,
.
.
,
9 10.
(Barry Boehm) [21] ,
, ,
. ,
, .
,
,
4 . , ,
,
(.. ).
,
,
.
, ,
,
, ,
. ,
, .
,
,
,
.
,
, .
, .
, ,
, , ,
.
,
; ,
,
. , :
144
I.
,
.
, ,
.
.
, .
,
, .
(,
, ).
. ,
,
.
(
, ,
).
, ..
.
,
, ,
, . (
, !)
, .
;
.
, ,
, GUI-,
, ,
.
. ,
, ,
, ,
.
[14] [33].
6. ...
145
,
, .
,
,
, .
( )
.
, :
, .
, .
, ,
, , .
, ,
. ,
,
,
.
.
.
, ,
, ,
. "" , ,
, .
,
, ,
.
,
,
.
.
.
. , ,
- . ,
. ,
. ,
.
, .
,
, ,
, .
,
. , -
146
I.
,
, ,
.
,
.
, .
.
,
. - , ,
, ,
,
, , .
, .
, , -
, ,
.
, .
,
,
.
,
. , ,
.
.
.
? -
? ,
.
, ,
.
,
,
.
,
,
, , , .
10% , ,
,
,
.
6. ...
147
.
,
, ,
, , .
, ,
, , ,
, .
, .
- ?
, ?
?
?
.
, ,
.
, ,
,
.
, ,
, ,
. ,
" - ?" "
, ,
?", . ,
;
. ,
: " ,
? , ? -
, ?
, ?
?"
, ,
.
, ,
. ,
,
,
148
I.
,
.
, ,
.
,
,
. , ,
.
.
? ,
,
?
, ,
,
,
?
?.. ,
, ,
,
.
,
. ,
,
, (Boehm) [21]:
( ).
.
.
,
, ,
,
,
.
,
.
,
6. ...
149
,
. -,
, . ,
, ,
.
. ,
, , .
,
.
.
,
,
,
.
.
, ,
,
.
:
.
,
.
, ,
.
.
.
, : (Capability Maturity Model
) ,
SEI (Soft
ware Engineering Institute), (Test Maturity Model
),
, (Test Process Improvement
).
;
, , - .
150
I.
,
.
;
, .
, ,
,
, ,
. ,
, ,
,
.
, ,
, . '
. ,
.
, ,
, ,
. , ,
; ,
.
, ,
, , ,
.
, ,
,
, .
[19], [41], [38] [29].
,
.
.
SEI (Software E n g i n e e r i n g
Institute) - , 1984
.
-. ,
SEI , Web- SEI :
www. sei.cmu. edu.
,
,
6. ...
151
.
: ,
, , .
6.1.
, 6.1,
1-5. , 6.1,
.
, . , ,
1 , .. ,
. , ,
. , 2
,
, ,
,
. ,
, ,
, ,
.
, 1, 3
. 3, .. ,
, , , ,
: , ,
, , .
,
,
, .
,
.
.
4 5 , 5
, .
5 , ,
. 4 5
.
11.
,
, 18
, . (Key Proc
ess Areas )
,
. ,
.
152
I.
6.1.
. ,
, ,
. ,
,
.
.
.
. ,
.
.
.
,
.
, ,
.
.
,
,
.
, 2,
.
,
. ,
.
,
. ,
, ,
.
, .
, ,
.
,
,
.
.
,
.
, , ,
.
6. ...
153
. 6.1
.
, .
,
, ..
, -
.
,
.
, 2 [38] :
.
,
.
2 ,
.
.
1 2
, .
. ,
, 2.
,
,
.
, ,
. ,
, .
8 JAR,
,
.
154
I.
,
.
, 2,
. , ,
,
.
3,
12.
14. ,
, ,
, , :
(
)
( )
,
.
, ,
,
, .
.
, ,
.
. ,
,
,
. 5
. ,
( , ) .
Web-,
.
, ,
, .
,
, . ,
,
:
, /
. ,
-
6. . . .
155
.
. -,
. ,
. -,
,
. ,
.
, 2 ,
. 2
,
.
, , .
, ,
. "" ,
.
,
.
,
,
.
2
.
,
. ,
,
. ,
( )
. 3, 4 5,
,
.
,
, - ,
, :
. , ,
,
. ,
, .
, , -
156
I.
, , ,
, . ,
,
,
.
, .
,
.
.
.
.
,
, .
.
,
12 18
, ,
.
.
, ,
,
.
. 1
2 .
(
[38]).
,
, .
, :
.
.
, ,
, ,
.
.
6. ...
157
,
,
, .
, ,
:
.
,
.
,
.
, SEI.
.
, ,
. ,
,
. , ,
.
, .
.
, :
7.1 ,
. ,
. ,
? ,
,
,
.
,
.
, ,
,
.
7.
161
7.1
()
()
" "
" "
- , . 7.1,
, ,
. -
1, . 7.1
, , . , ,
, , ,
, .
,
.
,
:
,
,
162
II.
( ) Y /
\/
_
( )
. 7.1. - .
,
.
. ,
(
),
.
:
,
() , .
,
.
, ()
. ,
(). , ,
.
, ,
,
,
,
,
. - ,
. . , ,
(),
, , -
7.
163
. ,
" , " " , ".
,
?
,
, ,
.
,
? 8
,
(joint application requirements, JAR),
, .. ,
.
,
(.. ),
.
.
.
. , ,
. ,
,
.
. .
, , :
1.
" ". ,
, ,
. "
" ,
' .
" "
, 10.
2.
" ".
, , ,
,
. " "
,
. ,
" ",
, 9.
,
- ,
, -
164
II,
,
.
.
, , ,
10. ,
, .
,
. ,
( 8
). , : "
?". . 7.2
(
12),
. ( ),
, 100%.
, , , , 100%,
, "
".
, ,
. ,
, 8%
7% ,
, " ".
(
()). 10%
15% (
).
,
, ,
56,25%
( 3 6 % / 6 4 % ) .
,
.
7.
165
( %)
8
24
32
24
20
10
7
17
24
31
28
15
-
-
-
-
-
-
-
. 7.2. .
. ,
. : "
,
."
: ", ,
." : " , ,
,
." : " ,
?" : "
, .
. ,
!"
/
/ .
,
, , ,
,
.
.
166
II.
,
, , .
8.
.
/
, .
, ,
,
,
.
,
, .
, ,
.
,
.
,
. ,
, , ,
,
, , .
,
.
. , ,
,
, ,
.
/
. ,
(+1)-
.
,
, ,
.
, ,
, , , ,
,
, ,
.
7.
167
,
.
,
. ,
, ,
.
.
,
,
.
, , ,
.
,
. ,
,
.
,
, .
,
(change control review board CCRB),
. 7.3.
. ,
,
( ) , .
,
.
, ,
, , .. ,
.
,
.
, .
,
.
-
168
II.
, -
, .
,
.
. 7.3. :
.
. 7.3
. / .
,
, , , ,
.
, .
(patch) .
.
.
, ,
.
. ,
.
7.
169
,
. ,
. , ,
, ,
: " ,
!"
, ,
.
, "... "
,
, .
,
, ,
"",
. ,
. ,
.
" "
,
, ,
(
).
, , ,
.
.
: " "
" ". , " "
,
" "
.
,
.
,
,
, , GUI-.
170
II.
,
,
, , , ,
GUI- .
, , ,
.
, ,
,
.
,
,
.
,
.
,
. ,
.
, , ,
.
7.2.
7.2
, .
.
.
,
,
, .
,
.
7.
171
. 7.2
.
, ,
.
.
.
.
.
.
.
.
, .
.
.
.
.
.
.
.
,
.
,
.
/
.
.
/.
.
.
,
.
172
II,
8 9 .
10 . 11 12
.
:
8.
(JAR):
9.
10.
11. :
12.
(JAR):
, :
JAR
JAR
. 2,
.
,
. ,
,
(fast application specification techniques, FAST),
2.
(Joint Application Requirements, JAR) FAST,
. JAR
,
.
. ,
, .
JAR-
, -
174
II.
. , JAR-, ,
. ,
.
JAR
JAR- ,
, ,
, ,
/ JAR. ,
JAR -
-. -
JAR . 8.1.
. 8.1. JAR.
, , , ,
, . -
,
,
.
.
: ,
. JAR
.
8. (JAR)
175
:
. ,
, .
, .
- , , ,
.
,
.
.
(
, ),
/ (,
- ).
JAR
( ,
).
, , .
,
JAR, :
,
.
,
.
, . .
,
.
,
.
,
.
(source matter expert, SME), , ,
.
, ,
1,5 . -
176
II.
, .
,
,
, .
JAR ", "
. 8.1. :
, ,
.
, ,
, JAR 24
. ,
.
. ,
,
, ,
, , .
, ,
6 4
. ,
,
.
.
8.1., JAR
,
1-
2-
3-
4-
5-
8. (JAR)
177
JAR , ,
8,5x11 (4),
, ,
, , ,
.
, .
-
.
.
, ,
.
.
, . 8.2, ,
.
,
.
, ,
.
8,5x11 ,
.
, .
178
II.
,
. ,
, .
.
,
, .
, .
,
. ,
.
.
.
,
.
JAR,
, ,
,
.
. . 8.3.
, ,
,
.
.
- ""
-
-
-
-
-
-
- /
. 8.3. .
,
, .
, ,
, : " -
?"
.
:
,
.
,
.
, -
8. (JAR)
179
.
:
, , ,
( UML)
,
,
.
JAR ,
,
. JAR ,
,
.
: JAR ( (GARY COBB))
, .
.
(API) Internet
.
, / ,
3 . 16-
,
API.
, JAR,
2
.
, , 6 , .
JAR, ,
28 .
,
(
8:00 17:00). 24-
(12 ,
)
180
II.
, 13:00 , .
.
, ,
.
. ,
.
,
.
.
, ,
, ,
, ,
.
.
- '
. , .
JAR , ,
, ,
. .
.
JAR ,
. , , Internet . ,
, ASP-, Internet-,
. ,
, .
Web- , Internet-.
,
.
,
, : "
,
. , , , . ,
,
." , : "!
!" , .
8. (JAR)
181
JAR
JAR . (1)
, (2) ,
(3)
.
,
,
. , ,
,
.
:
, ,
.
,
,
.
, ,
.
,
.
, ,
,
, ' , ..
, JAR-
,
,
. ,
, , .
,
:
. ,
. ,
,
,
.
182
II.
. JAR-
,
, ,
.
,
,
.
,
,
,
.
. ,
.
,
.
, , .
,
, ,
JAR .
, ,
.
,
, ,
,
.
.
, ,
. , ,
,
, ,
, ,
.
, :
/ /
184
II.
,
. .
,
- . ,
,
, , .
,
,
.
, .
, ,
, ,
, . ,
.
,
.
, . ,
G O T O , ..
, , .
G O T O
. ,
. , IF(...), DO
WHILE(...) .
,
.
, , DD- ( decision-todecision path "---"). IFTHEN-ELSE-ENDIF , T H E N
ELSE, ENDIF .
,
(). ,
.
,
.
, ,
.
,
.
9.
185
, : ", ,
, ". (Thomas
McCabe) (Charles Butler) [32]
V e
:
1.
,
.
2.
(Vg) g
V=E- N + 2, , a N
.
3.
(Vg) g
Vg=P + 1, ( )
.
. 9.1 ,
1 5, V=5.
.
, ,
, .
PDL
,
;
1 = ,
;
;
;
, 2 = 0,
;
;
;
endif
enddo
end
: .
. 9.1. ,
.
186
II.
,
V ,
.
"",
. 9.2, ,
,
. .
? - ,
1 2? ,
?
. 9.2.
.
[18] (Peter Chase Belford) ,
Computer Science Corporation
.
: CENTRAL FLOW CONTROL
[ 1 8 ] . Central Flow Control (CFC)
.
(pseudocode design language, PDL)
, .
9.
187
,
S- . S- .
9.. ,
, ,
, .
. CFC
,
PDL 30.
:
.
,
.
,
.
,
.
, .
. 9.4 ,
,
.
.
( )
05
10
15
2 0 2 5 3 0 3 5 4 0 4 5
DD-
. 9.3. S- :
30 .
188
II.
:
,
, 100
300 LOC,
15
:
,
, :
300 LOC
5
. 9.4. ,
.
. ,
.
,
, .
, -
, ,
, , ,
.
.
, ,
.
, ,
.
, . ,
-
9.
189
,
. ,
. - ,
,
. , ,
/
.
,
.
, ,
. )',
. ,
,
:
,
.
,
.
,
.
, .
, .
,
, ,
.
190
II.
,
, , ,
, .
,
.
, ,
.
/, ,
/, -
.
/ ,
,
, , ,
. ,
,
.
,
, . ,
(
""),
.
.
,
/ , -
,
,
.
,
,
.
, .
-
"... ... ?". Internet, ,
. ,
.
9.
191
, ,
. ,
.
,
, , ,
, , ,
. :
,
, ?
,
?
, 4 ?
,
?
"abc" ,
, ,
?
,
, .
. : ,
, ,
, .
? :
,
,
,
? ,
, .
,
, .
,
. , ,
,
. ,
192
II.
:
(, ), ,
//-, ,
/.
.
, .
.
9.1.
9.1.
/
.
, 1,5
.
, 6-10
,
1,5 ,
,
,
.
, 6-10
,
1,5 ,
, ,
,
,
.
,
,
,
.
.
,
: ",
,
,
,
- .
,
, .
,
, .
,
. ,
,
.
9.
193
. 9.1
/
,
,
.
.
.
2-3 , "
"
, , , .
.
,
.
.
.
,
.
.
1999 25
, , ,
, 2000- ,
,
2000 . , ,
,
.
, 10%
2000-
: ,
,
.
194
II.
/ /
.
,
.
.
.
.
.
. ,
, , -
.
,
.
,
.
,
. /,
,
,
.
, ,
.
IBM [34].
.
.
- ,
.
. '
,
,
,
9.
195
.
, .
.
,
.
, ,
.
.
, , ,
..
,
,
. 9.2,
.
9.2.
. 9.5.
. ,
, -
.
, C++,
196
II.
,
. , ,
, ,
. 9.5,
, .
. 9.5. .
,
.
,
.
, ,
,
SEV
, .
()
,
, , . ,
, : ,
,
, , , ,
, ..
. ,
9.
197
,
.
, ,
.
, "",
..
. SEV 1 (
) ,
.
.
.
, ,
.
, ,
- .
,
.
, ,
, ,
. , ,
.
, , ,
.
, ,
.
,
, , ,
,
(Software Error Estimation Program, SWEEP).
SWEEP 11.
. -
198
II.
, ,
, . ,
,
(local area networks LANs).
(storage area network, SAN)
.
,
.
.
LAN/SAN
,
Web- .
, ,
, .
, , ,
- .
, ,
-
, - .
,
.
, ,
,
.
,
, .
,
,
.
,
.
,
,
.
,
.
,
:
,
, -
9.
199
.
, .
,
.
.
,
(SWEEP),
,
.
. SWEEP
11.
, ,
,
, ,
, ,
.
,
, ,
,
.
, ,
, .
- ,
( -1)- .
. ,
.
,
. ,
,
().
,
, ,
.
200
.
,
.
( )
, .
.
,
.
, ,
, .
Gypsy [18]
. Gypsy
.
, Gypsy (
Pascal). Gypsy
,
. ,
, Collision Avoidance (
).
. ,
-.
- ,
, , .
,
,
.
. , ,
, .
Gypsy,
.
Gypsy ,
. ,
.
.
9.
201
.
,
, .
.
, , ,
, ,
, , Internet, ..
. 8 ,
(Joint Application
Requirement, JAR) .
,
, ,
(Software Design Specification, SDS).
, , ,
,
.
, .
(Requirements Traceability Matrix, RTM),
, ,
.
,
.
, ,
, ,
, RTM,
,
.
.
, ,
. (R) -
202
II.
: Rl = D1/T1, D1 , 77 .
,
. . ,
, , ,
, /.
,
(/),
R1 (/) R2(/).
, ,
.
,
()
,
( ).
,
.
SINE, . 9.6.
, :
sin(x) =x*(l - 2 *(1/3! - 2 *(1/5! - 2 *(1/7! - 2 *(...))))).
30
. 9.6. SINE,
9.
203
9.3 ,
.
sin(x),
, :
sin(x) = - x3/! +x5/5! + 7/7!...
: ,
. ,
.
9.3. , . 9.6
J
3
5
7
*( /12) =
/12
(3/12)*2/30-5/360
5 / 3 6 0 * 2 / 5 6 = 7 /20160
- ( 4 / 2 ) * ( 3 / 1 2 ) = - 3 /6
P - P 3 / 6 + (6/2)*P 5 /360 =
P - P 3 / 3 ! + P 5 /120
P - P s / 6 + P5/120-4*(P7/20160) =
- 3 /! + 5 / 5 ! - 7 / 7 !
PJ/(J!*(J+l)/2)
j = 3,n,2
P-SUM(pj/J!)
J=3,n,2
, .
,
.
,
.
, , .
.
,
. , IF-THEN-ELSE-ENDIF
ENDIF,
. , ELSE
, .
.
204
II.
, .
. ,
,
, . ,
, - ,
.
.
, .
,
.
.
, . "
" .
. , .
. ,
, ,
, . ,
, .
,
,
,
,
. ,
,
.
,
T(a*f, + b*f2) = a*T(f,) + b*T(f2).
,
,
, .. , T~'[T\f)]=f.
, ,
, ,
9.
205
.
,
, ,
.
"" ,
.
,
10.
.
, , : "
,
, , 2 10 ".
,
.
. ,
, COMPLEX
210 INTEGER N INTEGER,
[2,10].
,
, ,
,
.
.
, (Cooley) (Tukey) 1965 [12],
- .
. ,
,
,
.
.
,
. ,
,
, ,
,
.
, , ,
, .
, ,
206
II.
, .
.
-
.
-
,
/.
(Software
Engineering Institute, SEI)
.
"" - "" ,
. -
,
, .
: ( )
,
, .
, '
. ,
,
. ,
, : .
256
, .
,
, , -'
,
. ,
,
.
: W W M , "worldwide mass" ("
). '
. ,
, :
, , 36-
32- 64-
. . , ,
(..
). '
, ( 256 ),
3 / 4 ( -
9.
207
, ,
.
, , . 8
.
,=,+ a y,D,+d E :
'
E(N)=SUM(c,+ d,)
i=1
, X, , d,
. , E(N) . .
, : ,
,
, ,
. , ,
. ,
,
.
.
. "
". ,
,
, ,
, ,
-, .
.
.
:
,
.
.
.
208
II.
,
,
.
, ,
.
, -
-.
, ,
-
, ,
, ""
, .
, .
, -,
, -
,
, .
,
,
.
, , Wintel PC, MAC, Linux PDA,
, , ,
CD-RW, ,
/. ,
,
.
, .
, .
.
.
-,
. , ^
(electronic data interchange, EDI) -;
"-" (busi
ness-to-business, 2).
9.
209
,
, ,
,
,
.
.
, ,
.
, ,
. ,
.
, ,
- ,
. ,
.
,
.
,
.
Web-, ,
, .
(application service program, ASP) .
, .
.
,
,
. 7 ,
210
II.
. ,
, ,
.
,
. ,
, , .
, ,
.
, :
/
/ /
/
"-"
212
II.
: "
,
?" : .
, , .
, , 0,2 20
( delivered source instructions, KSDI).
,
6580%. 2035%
(), (),
(), () .
,
(),
(), () . ?
, ,
. :
, , , ,
, , ,
, , ,
, , ,
,
. , ,
,
.
,
, .
.
,
, , ,
, ,
, ,
..
, .
,
. ,
,
,
.
,
.
, ,
,
, ,
.
, ,
10.
213
, .. .
.
, .
.
. ,
, , ,
.
, ,
, . ,
,
,
.
, , (Requirements Traceability Matrix, RTM).
, ,
.
, .
, y(x;)=sin(x) (.
" " 9).
,
, .
, ,
()
. ,
,
. ,
, ,
. ,
, ,
,
,
, .
214
:
( )
, j
, .
mass
(). ,
, , , .
.
, , |
( )
, .
, |
, .
, .
, , , ,
,
. ,
, ,
. ,
, ,
, ,
.
.
. ,
-.
.
.
,
, .
( ,
, ).
,
, ,
, -
10.
215
,
. ,
,
.
. , ,
, .
() .
.
, ,
, ,
. ,
.
. , ()
RTM
,
.
, ,
.
, ,
, , ,
,
.
IF.
, IF ,
.
" " " " IF
.
, .
,
, " ",
,
. ,
,
.
,
:
216
II.
, ;
;
,
;
,
;
, ,
- CD-RW, ,
..
" ",
.
,
, ,
, ,
, ..
. , ,
,
, .
.
,
.
.
, ,
, .
, , .
,
,
, .
, , ,
,
- .
, , ,
.
. , ,
,
. , ,
,
, .
.
10.
217
.
,
. - ,
10.1.
10.1.
;
,
.
,
, .
,
.
, ,
.
,
.
, ,
,
. ,
,
( )
. ,
.
,
.
,
.
IEEE Standard 1044
(Institute of Electrical and Electronics Engineers IEEE) [24]
, .
(). ,
,
, ( ).
218
II.
(),
,
.
, , ,
, ( ).
,
,
. , ,
, .
, .
10.2
, . 10.1,
.
,
,
. ,
, , ,
, ,
.
10.
219
10.2.
IEEE Standard 1044.
?
?
, .
,
?
220
II.
. ,
,
. DD-
( decision-to-decision path "-").
DD-
DD . ,
,
DD-,
.
, . 10.2, 1979-1981..,
(Soft
ware Testing System, STS).
Texas Instruments, Inc., Advanced Soft
ware Technology (AST). STS ,
Fortran .
STS
DD-. STS DD-.
DD- .
,
DD- .
, ,
, ,
, .
,
,
.
ADVANCED SOFTWARE TECHNOLOGY FORTRAN SOFTWARE TESTING SYSTEM
DATE: 12/08/80
TIME: 12:40:34
THE OPTIONS IN EFFECT FOR THIS RUN OF STS STATIC ANALYZER ARE:
LIST
= INPUT
SCANONLY
APPEND
TYPE
TIMEFIO
DOPTION
COPY
=
=
=
=
=
=
NO
NO
BOTH
NO
NO
YES
(STS)
PAGE:
10.
1*
2*
3*
4*
5*
6*
7*
8*
9*
10*
11*
12*
13*
14*
15*
16*
17*
18*
19*
20*
21*
22*
23*
24*
25*
26*
27*
1000
5000
6000
28*
29*
30*
31*
32*
33*
34* 1
35*
36*
37*
38*
39*
40*
41*
(PARM2)
CONTINUE
DO INDEX 1=1,80
CARD(I)=CBB
END DO
READ(5,1000,END=100) CARD
IF(ASCII) CALL EBCDIC(2,CARD,0)
WRITE(10,1000) CARD
NEWMEM=(CARD(l).EQ.LESSTH.AND.CARD(2).EQ.R.AND.CARD(3).EQ.E.
&AND.CARDH) .EQ.P)
WRITE(10,111) CHARS,NDX,LEN
FORMATC AT 111 '4A2,2X,2110)
IF(FIRST.AND.(.NOT.NEWMEM))
THEN
WRITE(7,1500)
221
222
II.
4 8 * 1500
FORMAT(' ERROR: FIRST RECORD IS NOT A <REP CARD')
49*
CALL ENDFIL(7)
50*
STOP
51*
END IF
52*
IF(NEWMEM)
53*
THEN
54*
NDX=5
55*
CALL HFIELD(CARD,NDX,CHARS,80,LEN,CODE)
56*
IF (.NOT.FIRST)
57*
THEN
58*
CALL ENDFIL(6)
5 9*
NRECS=NRECS+RECCNT
60*
WRITE(7,7000)OLDMEM,RECCNT
61* 7000
FORMAT(10X,4A2,26X,15)
62*
RECCNT=0
63*
END IF
64*
DO INDEX 1=1,4
65*
OLDMEM(I)=CHARS(I)
66*
END DO
67*
CALL SETMEM(CHARS,PATH80,NDEX,PATH40,3,6)
68*
FIRST=.FALSE.
69*
DO INDEX 1=1,80
70*
CARD(I)=CBB
71*
END DO
72*
READ(5,1000,END=100) CARD
73*
IF(ASCII) CALL EBCDIC(2,CARD,0)
74*
WRITE(10,1000) CARD
75*
END IF
76*
WRITE(6,1000) (CARD (I) ,1 = 1,80)
77*
RECCNT=RECCNT+1
78*
GO TO 1
7 9 * 100
CALL CLOSEW(5,IERR)
80*
CALL ENDFIL(6)
81*
NRECS=NRECS+RECCNT
82*
WRITE(7,7000)OLDMEM,RECCNT
83*
WRITE(7,3000) NRECS
8 4 * 3000
FORMAT(//,'THE TOTAL NUMBER OF RECORDS SPLIT WAS:',15)
85*
CALL ENDFIL(7)
86*
STOP
87*
END
(STS) -- STATIC ANALYSIS FOR MODULE "MAIN ", BEGINNING AT LINE 14
PATH
PATH
1:
2:
14
37
THRU37
JUMP35
MODULE NAME
MAIN
ADVANCED SOFTWARE TECHNOLOGY
DATE: 12/08/80
PATH
PATH
PATH
PATH
PATH
3
4
5
6
7
37
38
38
39
39
A
A
EOP
THRU37
THRU38
JUMP7 9
THRU39
THRU39
THRU4 5
EOP
SYSTEM
EOP
THRU8 6
EXIT
EOP
THRU45
EOP
EOP
(STS)
PAGE:
10.
PATH
PATH
PATH
8
9
10
45
45
52
PATH
PATH
PATH
PATH
PATH
PATH
PATH
PATH
PATH
PATH
11
12
13
14
15
16
17
18
19
20
52
56
56
66
66
71
71
72
72
73
PATH
21
73
JUMP52
THRU50
JUMP7 6
EOP
THRU56
JUMP64
THRU66
JUMP64
THRU71
JUMP69
THRU72
JUMP79
THRU73
THRU73
EOP
THRU7 8
EOP
EXIT
THRU78
EOP
THRU66
EOP
THRU66
EOP
THRU71
EOP
THRU8 6
EOP
THRU78
JUMP34
JUMP34
223
THRU37
EOP
EOP
EOP
EXIT
JUMP34
THRU37
THRU37
EOP
( 11 ,
22
23
24
25
26
93
95
95
96
96
A
A
THRU95
JUMP93
THRU96
THRU96
THRU100
EOP
THRU95
EOP
THRU100
EXIT
3 ,
EOP
EXIT
224
II.
,
:
< > ,
J U M P < > - GO T O ,
ENDDO IF
< > T H E N IF
,
.
. (Thomas J. McCabe) [31].
, . (Glenford J. Myers) [37]
. ,
,
.
.
.
,
. .
,
T H E N IF ,
.
, ,
. . , ,
, ,
, .
.
DD-, .
-
,
(. . 10.3).
.
.
10.
225
. [35]
.
. ,
50% ,
, 50% ,
, .. .
Internet
. 10.3. -
Internet .
DD-,
. ,
.
,
. DD-,
,
.
,
. ,
, , -
226
II.
, . ,
, ,
- .
,
!
.
,
.
,
,
.
,
.
,
. ,
,
.
. ,
, .
, ,
.
, , ,
.
/
(bebugging), ,
,
. ,
, . ,
: "
?".
: " ?"
, . ,
, , ,
.
.
,
.
.
, .
10.
227
, , ,
. ,
.
, ,
,
.
: "
?", : " ,
". ,
. ,
,
, : "
1 3,
2 4".
, ,
, ,
, , ,
..
, ,
.
.
,
, .
/ /
/
, .
, ,
. , ,
,
,
, ,
. .
, , .
, , ,
,
, .
. ,
,
228
II.
. ,
- ,
,
, .
,
.
: "
", ,
.
,
.
,
.
, , Microsoft Word,
(. . 10.4).
/: 9:40 6 / 1 3 / 2 0 0 1
: 9:50 6 / 1 3 / 2 0 0 1
support <a> groove.com
:
Groove Maintenance U p d a t e ( Groove)
"Update Groove" (" Groove") ,
, URL-.
, , , .
, . 10.4, .
. URL- , .
. ,
? ,
. ,
, .
/
,
. .
/
(breakpoint)
- . ,
,
.
,
.
10.
229
(patching)
, ,
, ""
. - ,
, .
,
, , Lotus 1-2-3.
? -
230
II.
, ,
. ,
.
, 5, .
,
. 95% ,
, ,
. 5% ,
.
,
/ .
,
, .
,
,
.
, , .
, ,
/
. ,
, ,
,
.
.
, ,
, , , ,
, , . ,
,
,
.
,
,
. ,
, (
)
.
10.
231
,
, :
IF
(I > J)
THEN B ( I )
= A(J)
ELSE B ( I )
= 0 ENDIF.
, ,
, .
,
.
,
, , , .
, .
,
, .
. . 10.5
Microsoft
Windows 95.
Microsoft
Web-.
, ,
, .
,
,
. , ,
, ,
, .
,
.
.
232
WINDOWS 95 WINDOWS
, Windows, Windows 95
, ,
.
Windows 95 (Kernel32.dll) ,
, Windows
.
.
, , , , .
Windows 95 .
. 10.5. Windows 95
.
-
. ,
(Object Histogram), ,
.
Java-
-tracepopulation. , ,
,
.
,
. C++ debug_malloc,
.
,
,
, (,
).
, .
,
,
. , ,
, ,
.
,
. ,
.
10,
233
"-"
"-" (human-computer interface, HCI)
, , , , ,
, , . ,
,
,
,
, .
"-", , ,
,
.
, .
"-"
.
"-",
. "-"
. , ,
"-"
,
,
,
.
"-" ,
. ,
.
,
.
,
.
,
.
-. , -
,
"-",
.
, , ,
234
II.
. ,
, ,
, . ,
, ,
. ,
,
. ,
, ,
, , -,
, .
.
: .
, ,
, .
/ ,
//.
, .
, ,
/,
, ,
/.
/
, ,
.
. ,
.
,
, :
.
,
.
,
, - .
,
.
.
,
10.
235
,
. ,
,
. ,
,
- .
/
,
.
,
, .
10.6.
, , ,
,
.
.
,
.
.
Web-.
. 10.6.
/.
236
: ( )
(Software Engineering Process Group, SEPG),
, . , , , , , ,
. , .
.
,
, .
. -|
,
-4
64- .
-4
, , . 10.
G E O S T R O P I C W I N D C O M P U T A T I O N
D U E T O C O R I O L I S
CONSTANTS:
. LA
.LO
30.199998
-97.800000
7.33 60E-05 per second
5927808 m
5788.875 m resolution
1024 X 1024
x.LA x.LO
30.199998
30.199998
56.865391
30.199998
3.534605
-97.800000
-124.465392
-97.800000
-71.134607
-97.800000
CENTER(C) (AUSTIN)
EAST(R.C.X)
NORTH(U. X)
WEST(L.C.X)
SOUTH (L.C.X)
MX
0
-0.46539890067
0
0.4653989006696
0
MY
0.553340844437
0.553340844437
1.212368963348
0.553340844437
0.061729665232
10.
237
x.LA
29.36670447505
31.03329152495
9.36670447505
28.5334109501
x.LO
-96.9667059751
-98.6332930249
-96.9667059751
-98.6332930249
U.LE.X
U.RI.X
L.LE.X
L.RI.X
MX
-0.575319649058
0.5753196490579
-0.575319649058
0.5753196490579
MY
1.212368963348
1.212368963348
0.061729665232
0.061729665232
x.LA
33.3166666667
33.3166666667
35.0833333333
33.3166666667
31.5833333333
x.LO
113.7500000000
111.6166666667
113.7500000000
115.8166666667
113.7500000000
MX
MY
0.617329479414
0.617329479414
0.654613029744
0.0360701378745
0.581477015532
CENTER BOX
EAST BOX
NORTH BOX
WEST BOX
SOUTH BOX
-0.037233690709
238
II.
.
,
.
.
.
-,
.
. -
. , ,
, , ,
.
,
,
.
10.3. ,
HI 2 , ,
-
.
, ,
.
,
:
, ,
?
,
.
.
, ,
10.4. ,
. ,
. ,
-, - ,
.
. ,
.
10.
239
10.3.
ID
Win98SE, SP-2
Standard Querty
IntelliPoint
Plustek
10
Psion V.90
Xircom 56
11
MS Access
Oracle 7.0
12
Build 2.4.3
Build 2.4.4
13
(
)
HP
Via
10.4.
ID
Pentium 166
( )
30
32
CD-ROM ( 4-
)
, 16 TrueColor
, Microsoft Windows
MCI
10
( )
11
Internet ( )
240
II.
,
9, 10
.
,
.
.
, ,
, ,
,
. , ,
,
.
, , .
.
, , -
, , ,
. .
,
,
, .
:
, :
(SWEEP)
- : " ?"
: " ?"
, +/-20%.
, ,
, .
,
-, -, .
, ,
.
,
.
. ,
.
, ,
, , ,
242
II.
.
, , .
,
.
,
, .
, .
.
,
, " ?" "
?".
( ),
( ), ,
(
, / ) , ()
( ).
,
,
, ,
.
,
,
: " ?"
11
. 12
.
,
,
.
, ,
.
-
.
, ,
. ,
( lines of code, KLOC),
: { : 2,6 / K L O C ; : 12,1
/ K L O C ; : 5,8 / K L O C } .
11.
243
,
,
.
,
.
, .
, .
,
.
, ,
11.1.
, ,
.
,
. ,
11.1,
,
.
. ,
,
. "
"
, (,
- ).
244
II.
11.1.
,
,
,
,
,
,
,
,
,
,
11.
245
: ( )
,
, 450 .
(Software Engineering
Process Group SEPG),
(Capability Maturity Model, C M M V1.1)
SEI, 400
, SEI. ,
. , ,
.
,
SEPG. ,
,
.
, ,
, 11.2.
11.2.
SIZE ()
(KESLOC)
EFFORT ()
SHEDULE ( )
QUALITY ()
( )
,
,
.
. (),
(), ()
(). . 11.1
,
. ,
.
.
, .
, ,
100000 . ,
, .
,
, .
. 11.2 ,
(.. 16 ) ( 16-
).
/ .
246
II.
: (), (),
(), (), (),
() ().
: "
?" , 12-, 13- 14-
, . ,
,
, , .
. 11.3 , : (), (),
(), ()
(). , , ,
: (), (),
(), ()
(). , ,
, - , , , ,
.
,
, . (). , , ( ) ,
( , ). , , , , , .
:
,
10%. , 20
, 18 22
. . ,
20 , 18 !
22 , .
. 11.4
, ( of estimated source lines of code, KESLOC). ,
, , co .
,
(), (), (), (), (),
() ().
.
, ,
. ? 4 1 %
, 36,3% , 22,7%
. -
160
120
. 11.1. .
. 11.2. .
247
248
II.
11.
249
. 11.5. .
,
, . ,
, , , ,
,
.
:
( )
SEPG ,
.
"--" (),
(Basili) (Weiss) [ 6 ] .
(goal) ,
(questions), ,
(metric),
. , ,
, :
?
?
?
250
II.
,
?
?
?
(Victor Basil!) (David Weiss)
,
, NASA. ,
[6], 1984 . (Rini van Solingen)
(Egon Berghout) [50] ,
(. . 11.6).
,
, ,
, , ,
(), . ,
, ,
, , ,
.
,
" " ,
,
. ,
, :
?
?
?
?
,
( ), ,
, . ,
, , ,
, . 11.1
, .
, .
.
, ,
.
SEPG ( ) (
) , .
11.
251
, ,
.
,
.
.
.
:
,
, .
//,
.
.
.
,
.
252
:
1.
2.
"--"
.
,
.
,
,
.
. 11.7, [6].
,
.
,
7- . U L
( ) .
,
.
10
15
( )
. 11.7. .
11.
253
, ,
/ ,
.
,
, . ,
,
,
.
,
.
, :
1.
, ,
. ,
, ,
.
2.
,
, ,
.
3.
,
.
4.
, ,
,
.
,
, , ,
SEPG
. ,
,
,
.
,
.
, 11.3.
254
II.
11.3.
,
,
.
,
.
(
).
( , ,
) ,
.
,
, .
,
. ,
. , ,
, ,
.
:
,
.
,
.
,
,
.
11.
255
,
.
, ,
- ?
,
- . ,
, 11.4.
11.4.
,
(IF, WHILE, CASE ..),
.
,
(DO, FOR ..)
.
(
).
(
).
,
.
(
).
,
, .
,
.
,
.
.
256
II.
(
)
().
,
. ,
, 11.5. ,
, 1
, 5 .
, 11.5, 5.2
5.
11.5.
, ..
.
, ..
, .
,
, .
,
, .
, ,
, .
,
, . 11.8. ,
, .
. 11.8 ,
. ,
,
. ,
,
. ,
,
. ,
,
,
.
11.
257
. 11.8. ,
.
-
, . , -
,
. , ,
,
.
. ,
, ,
. ,
,
. ,
, .
11.6.
,
. ,
(TR),
,
(, ()).
,
258
II.
.11.9. , ,
.
11.6.
LD
:
, , .
,
, .
EU
, , ,
.
DO
ST
.
,
.
ID
TR
;
, , .
DA
IF
,
.
MR
;
.
.
: -,
, -,
,
.
, ,
,
. ,
.
11.
LD
LD
EU
DO
EU
DO
ST
ID
TR
CM
ST ID TR CM
DA
DA
IF
MR
IF
259
MR
. 11.9. - .
(SWEEP)
(Software Error Estima
tion Program, SWEEP), Software Productivity Consortium,
,
. ,
, .. , , .
SWEEP ,
.
. ,
, SWEEP
. ,
:
,
.
260
II.
SWEEP
.
SWEEP
,
.
SWEEP
11.7.
11.7. SWEEP
- .
,
.
,
.
SWEEP
.
,
,
.
SWEEP
,
. SWEEP, ,
. 11.10. ,
, 3,48 .
,
, 3,48. 3,3 7,8, ,
, 3,48.
2,12
.
0,07 .
11.
261
10.07
2
3
4
5
6
7
. 11.10. 2 SWEEP:
,
, (, , , ) .
,
. 11.11 " ", ,
,
.
, ,
.
.
,
, , .
. 11.12 ,
.
,
.
SWEEP.
,
, ,
.
262
II.
30
35
40
45
. 11.11.
SWEEP.
i i i 11 l i i 11 i i i i i 111 11 i 11 11 i i nTnPi'Wxw^
,,-.
. 11.12. SWEEP
.
11.
263
, ,
, .
, :
, : ,
, .
, "-" ().
( ).
,
.
, :
, SWEEP
, .. ,
, .
,
.
,
.
"
". ( ,
)
.
.
\
\
, :
,
(verification and validation.
V&V). ,
,
.
.
(basis of
estimates, BOEs). (by-analogy estimate)
,
. ,
,
,
.
.
, , ,
.
12.
265
1. ( )
,
: " -
, ?" : " , , "", "" ""
. ,
, , , ,
PCQA (Product Certification and Quality Assessment
). , - ,
, ?"
:
, , , , ( ):
1.
(.. ,
, , , ,
, , , ,
, ).
2.
, , ,
,
, 1.
3. LOE (Level Of Effort )
, .. LOE(j) j = 1,...,, ,
FTE (Full-Time-Equivalent
) -.
' 4. S - LOE
. ,
, , LOE(j)/S, j = 1
, .
5. LOE(j)/S, j = 1,...,n ,
LOE(j),
LOE(j) .
6. KESLOC (Estimated Source
Lines Of Codes )
. KESLOC
, , ,
, .
(
) (Capers Jones),
1 2 . 1 , KESLOC .
7. EAF (Effort Adjustment Factor
) EAF = S/(2.4*(KESLOC**1,05)).
:
S = EAF*2.4*(KESLOC**1,05),
EAF , a KESLOC
.
266
II.
: "
, , ,
. , .
, , - . , , ,
. , ,
.
?"
, : ",
, , .
LOE , , , , cne, , , , , , , . , , , , ,
, , , .. , , , .
30%. , 3 0 % ,
, , 2 4 , , .
."
, , ,
(Boehm).
EAF , - , .
,
:
, ,
.. -
.
,
, . ,
1
5 KESLOC, ,
, 50 KESLOC, 1
, 10
. ,
, .
12.
267
12.1.
KESLOC [26]
A
10
50
11
16
20
12
SMALLTALK
21
20
13
OBJECTIVE-C
26
12
14
APL
32
10
15
STRATEGEM
35
16
40
17
LOGO
53
18
BASIC
64
19
FORTH
64
20
LISP
64
21
PROLOG
64
22
Ada
71
4,5
23
MODULA-2
71
4,5
24
PL/1
80
25
RPG
80
26
Pascal
81
3,5
27
JOVIAL
106
28
FORTRAN
106
29
COBOL
106
30
CHILL
106
31
ALGOL
106
32
150
2,5
33
213
1,5
34
320
,
,
, ,
,
, , ,
, .
,
, .
-
268
.
. ,
.
, ,
, , .
,
.
,
.
,
.
, ,
.
. ( "
") . 12.1.
,
, . ,
, .
: ,
.
, ,
, ,
, , ,
. ,
,
.
,
3, 10 11.
, ,
. 12.2.
- , ,
, .
,
.
,
.
12.
. 12.1.
269
270
II.
,
, , ,
,
.
, , . ,
,
.
,
, .
,
- ,
.
,
.
.
, ,
,
.
, , : "
".
, ,
, . , ,
, , ,
- ,
, ,
.
,
, .
. 12.3 - ,
/.
,
, , ,
, .
, ,
, ,
, , ,
,
. ,
.
12.
271
:
/:
:
. 12.3. - ,
[6] 63
, : ,
. , [6],
: , .
, ,
, , ,
COBOL. ,
,
,
, ,
, ,
. , -
. . 12.4,
(Constructive Cost Model
), (Barry Boehm),
.
, , . 12.5
KELOC (Equivalent Lines Of
Code ). ,
, , ,
. , ,
, -
272
II.
.
,
/
05
= 2,4 (KLOC)'
0 38
TDEV = 2,5 () '
M M A d j = (EAF) 3,2(KELOC)
TDEV = 2,5 ( ,) 0 3 8
105
MMMaint = (
) M M A d j
ELOC
EAF
MMAcij
TDEV
MM M a J n t
-
-
M M A d j = (EAF)3,0(KELOC)' 12
TDEV = 2,5(MMA d j ) 0 ' 3 5
M M A d j = (EAF)2,8(KELOC)'' 20
TDEV = 2,5(MM A d j ) 0 ' 3 2
ELOC = (
) (1/100)
(0,4*
+ 0,3*
+ 0,3
)
. 12.4. ,
, ,
,
;
( ) .
. 12.5. : ,
12.
273
EAF (Effort Adjustment Factor ),
, 12.2.
EAF (Effort Adjustment Factor
) .
,
EAF,
.
EAF,
. REVIC
(Revised a n d Improved )
,
- ( ) (TDEV).
. 12.6 TDEV ;
, 18 ,
(MM A d j ), 18
. C O C O M O / R E V I C KLOC
(Lines Of Code ),
. 12.6 .
,
. EAF
, ( ) .
, ,
. -, ,
KLOC ,
. -,
,
,
. (TDEV)
.
,
.
, (MM A d j )
, (TDEV), ,
KLOC , , ,
. , ,
,
,
, (MM A d j )
, , ,
(TDEV). , ,
, ,
.
274
II.
12.2.
[6].
0,75
0,88
1,00
1,15
1,40
0,94
1,00
1,08
1,16
0,70
0,85
1,00
1,15
1,30
1,65
TIME (
)
1,00
1,11
1,30
1,66
STOR (
)
1,00
1,06
1,21
1,56
RELY (
)
DATA ( )
CPLX (
)
VIRT (
)
0,87
1,00
1,15
1,30
TURN (
)
0,87
1,00
1,07
1,15
(
)
1,46
1,19
1,00
0,86
0,71
(
)
1,29
1,13
1,00
0,91
0,82
(
)
1,42
1,17
1,00
0,86
0,70
VEXP (
)
1,21
1,10
1,00
0,95
LEXP (
)
1,14
1,07
1,00
0,95
MODP (
)
1,21
1,10
1,00
0,91
0,82
TOOL (
)
1,21
1,10
1,00
0,91
0,83
SCED (
)
1,23
1,08
1,00
1,04
1,10
12.
275
COCOMO/REVIC
IKLOC
RELY
Ada-, REVIC,
-
-
'Adj EAFx6,8x(KLOC) 0 ' 9 4
TDEV = 4,376 x(MMAdj) 0 ' 3 2
. 12.6. COCOMO/REVIC
, ,
, .
, ,
, . . 12.7
, (
) , .
, ,
: R E Q ( ), PD (
), DD ( ), C U T ( ), IT (
).
, REQ,
, PD 1,
, PD, REQ, 0 -1.
REQ
, , ,
R E Q PD .
TDEV, , , , -,
, . 12.6. Staffing(t)
; . 12.7 ,
t -1 19.
276
II.
,
:
. 12.7.
, , . 12.8,
. MM M a i n t
, ,
, , 15%, 10% 5%
. , . 12.8, 50
KLOC, 362 -,
12 4,525
. ,
COTS- (commercial-off-the-shelf, )
(50 KLOC).
,
COTS-, .
X KLOC,
X + 50 KLOC,
4,525 - 3,017 -
COTS-. $55
-, $8305 -, , 151
. $8305 * 7,542 =
$62636. ,
, COTS , 362 -
EAF ,
.
12.
277
15
. 12.8. ,
, ,
, COTS- 50 KLOC.
, ,
. ,
?
,
(MMA[1j) TDEV. , (MM A d j ) ,
COTS- 50 KLOC,
(MMAc|j) EAF. EAF
COTS- ,
, , 75 KLOC.
, EAF,
,
. ,
: "
".
278
II.
2. COCOREV ( )
.
,
, . -
, , .
, EAF. COCOREV (MM A dj) TDEV, - REVIC.
, - ,
COCOREV. COCOREV
. (
2), , ,
EAF, 0,5.
:
15 KLOC, .
75 KLOC, .
15 KLOC, ,
.
, , ,
. . 12.9 , .
COCOREV , . , ,
,
COCOREV ,
1, 2, 3, 4 5. , , .
- 1
- 5
- 15 KDSI
-
- C++
- :
. 12.9. 1
12.
279
. 12.10 ,
15 KELOC.
C + +
EAF, 0,5, . 2
. KDSI (thou
sands of delivered instructions )
, 15 KDSI
15 KDSI. 0, 10 . , ,
10 .
COCOREV 1.02
KELOC
KDSI
1
C++
15,000
15,000
2
C++
15,000
30,000
3
C++
15,000
45,000
4
C++
15,000
60,000
5
C++
15,000
75,000
EAF:REQ
EAF:PO
1
0,500
0,500
2
0,500
0,500
3
0,500
0,500
4
0,500
0,500
5
0,500
0,500
EAF:DD
0,500
0,500
0,500
0,500
0,500
0,0
10,0
20,0
40,0
50,0
EAF:CUT
0,500
0,500
0,500
0,500
0,500
EAF: IT
0,500
0,500
0,500
0,500
0,500
KELOC
KDSI
EAF
. 12.10. . COCOREV (
, , EAF
)
. 12.11 COCOREV
1 ,
1, 2 10 ,
.. 11 .. (REQ)
-1 0,
50.
CUT, ,
1 5,
, KSDI
, , .
, "
, $1,593 , , -
280
II.
$55
. ,
. , 28968 *, - :
REQ = 14,83, PD = 32,50, DD = 41,92, CUT = 60,54, IT = 42,05,
191,94 -.
. 12.12
1. , REQ = 2,75 REQ = 14,83
-, .
34,18
2,75, REQ, 31,43 -, , . ,
COCOREV, ,
2
4,5 1,5 .
1, , 2, . 12.13.
1 2? , -, 2
, 1, . ,
2 10 . ,
11- , .. 1,5 1. , , 2, 10
, ,
, -
. "
" , , .
2 ,
1 (, 2,9 2,7 -)? 2 1.
3
4. . 12.14
.
1, , ,
, 38,22 - 31,33 = 6,89 -. ,
9 , 5 ( ), 1. , , 5 1, .
, (V6iV). COCOREV
, . 1
: (.12.15) (.12.16). 1 COCOREV. (test staff) ,
, , , ,
, , . 12.15 12.16. .
12.
(, )
IT3
281
282
II.
12.
283
.12.15. 1
COCOREV
, ,
? COCOREV , ,
-1 0, 1.
,
,
,
.
,
.
284
II.
, , ,
,
Web- .
, ,
. ,
- .
,
,
, (V&V) ,
(IT).
, ,
REQ, PD, DD CUT ,
IT
. COCOREV , '
, ,
, , . ,
, .
.
.
2 .12.17. 1, /, , .
. 75 KLOC 1 (75
K.DSI), ,
COCOREV.
!
COCOREV 1 -.
, -: REQ = 11,84, = 38,50,
DD = 42,85, CUT = 58,86, IT = 51,54, 204,59 -.
30983,7 -, , 151 -. $1,699 , , - $55. ,
.12.18, ,
16 ,
.
CUT 15 .
- 2
-1
- 75 KDSI
- C++
- :
. 12.17. 2
12.
285
. 1 2 . 1 9 1 2 . 2 0 , ,
.
PD, DD CUT,
0 , 8 .
, ,
IT 2 , 5 .
2 . . 12.21
3 .
286
II.
3.500000
3.000000
2.500000
2.000000
1.500000
1.000000
0.500000
0.000000
. 12.20.
75 KLOC
- 3
- 5 , 2
- 1 5 KDSI
-
- C++
.12.21. 3
, . 12.22.
: REQ = 14,83, PD =
32,50, DD = 41,94, CUT = 60,54, IT = 42,05, 191,86 . 28971,7 -. , 151
151 , $1,593
- $55.
, ,
PD, DD, CUT, IT, ,
,
,
.
.
,
,
-,
10 .
,
,
.
12.
287
. 5. -
. 12.3 .
- ,
. , * { .; ),
.
TDEV
5 , 15KLOC,
1,593
49
1 , 75 KLOC
1,699
14
15
5 , 15KLOC,
1,593
18
17
[1]
, ,
-
. , ,
,
:
.
,
, .
, .
288
II.
. ,
.
, , .
.
,
.
(..
,
, ).
(, ,
).
"" ,
. 12.24.
. 12.23
(function points, FP). 1 ,
.
, , .
14 , ,
, .
2 ,
, "", "" "",
" "
, . , ,
, . 12.24. SUM(F i )
,
1.
.
,
. ,
IBM, (Allan Albrecht) .
,
,
LOC (Lines Of Code ),
.
,
.
, ,
. ,
.
12.
Fi,
i = 1 , . . . , 14. 0 5.
(0 = ; 1 = ; 2 = ; 3 =
, 4 = ; 5 = )
1.
2.
3.
4.
5.
,
?
6.
7.
8.
9.
, , ?
10.
11.
12
13.
14.
?
. 12.23.
2
289
290
II.
,
(LOC), .
,
, ,
. ,
, .
, ,
LOC. ,
. LOC
,
.
, LOC
.
IFPUG (International Function Point Users
Group ),
. ,
,
. ,
,
,
. (Capers
Jones), . 12.1,
LOC
.
:
.
.
,
,
.
" "
.
:
,
,
.
12.
291
( )
.
, . ,
.
,
, ,
, .
2 .
,
. 13.1.
.
, .
,
.
, ,
(JAR); JAR 8.
,
FAST
, ,
,
, ,
(
) ,
,
, ,
,
-
. 13.1.
13.
295
2 ,
:
,
,
.
.
.
, ,
.
,
.
.
(functional),
(nonfunctional) . ,
,
. ,
, ,
, , .
. , , ,
, , , ,
. ,
,
.
, IEEE Standard 830: The IEEE Guide to Software Require
ments Specifications (
2).
,
(Test Management Toolkit, ).
,
, , ,
, .
Web-,
.
, .
,
, .
TMT-RD-10
: TMT-RD-10
: 0.8
: (Chris Brown)
1.0
0.1
08/31/2001
0.2
09/02/2001
0.3
09/02/2001
0.4
09/03/2001
0.5
09/03/2001
0.6
09/03/2001
Project Name
( )
0.7
09/07/2001
0.8
09/07/2001
. (Chuck D. Klout),
09/07/2001
(Suzanna Perl),
09/09/2001
(Bret Gater),
09/09/2001
296
TMT-RD-10
1.
1.1.
1.2.
1.3.
2.
2.1.
2.2.
2.2.1.
2.2.2.
2.2.3.
2.2.4.
2.2.5.
2.2.6.
2.2.7.
2.2.8.
2.2.9.
2.2.10.
2.3.
2.4.
2.5.
2.5.1.
2.5.2.
2.5.3.
2.5.4. Web-
2.5.5.
3.
3.1.
3.1.1.
3.1.2.
3.1.3.
3.1.4.
3.1.5.
3.1.6.
3.1.7.
3.1.8.
3.1.9.
3.1.10.
3.1.11.
3.1.12.
3.1.13.
3.1.14.
3.1.15.
3.1.16.
3.1.17.
3.1.18.
297
298
298
299
299
299
299
299
299
299
299
299
300
300
300
300
300
300
300
300
300
301
301
301
301
301
301
302
302
302
303
303
303
303
303
304
304
304
304
305
305
305
306
306
306
306
TMT-RD-10
3.1.19.
3.1.20.
3.1.21.
3.1.22.
3.1.23.
3.1.24.
3.1.25.
3.1.26.
3.1.27.
3.1.28.
3.1.29.
3.1.30.
3.1.31.
3.1.32.
3.1.33.
3.2.
3.3.
3.3.1.
3.4.
3.5.
3.6.
3.7.
1
2
3
: . (Chuck D. Klout) [cdklout@tmtco]
: (Suzie Perl [spent@tmtco.com]
: (Bret Gater) [bgater@tmtco.com]
306
307
307
307
307
307
308
308
308
308
308
308
309
309
309
309
309
309
309
309
309
309
311
311
311
311
311
312
312
1.
1.1.
, (Test Management
Toolkit, ). , ,
, ,
. , ,
. ,
,
.
, .
.
.
298
TMT-RD-10
1.2.
, ,
, . Web,
.
1.3.
,
.
,
.
. , 2.2.1 ,
,
. "2.2. .
,
, .
2.
2.1.
.
,
. ,
,
.
2.2.
. 3.0.
2.2.1.
, , ,
, .
2.2.2.
, , ,
. "
".
2.2.3.
, , ,
, , ,
, , , ,
() .
2.2.4.
.
.
299
TMT-RD-10
2.2.5.
, , ,
.
2.2.6.
,
, .
2.2.7.
,
, .
2.2.8.
.
.
2.2.9.
,
. ,
.
2.2.10.
,
.
,
.
2.3.
, ,
, .
2.4.
,
:
.
, .
.
, .
.
.
2.5.
, .
( ).
.
300
TMT-RD-10
2.5.1.
, ,
:
Microsoft
Windows 95
Windows 98
Windows Millennium Edition
Windows XP
Windows NT 3/51
Windows 2000.
Apple
MAC OS 9.x .
, ,
:
Microsoft
Windows NT 3.51 .
UNIX
Sun Solaris 2.6
HPUX 10.x
Open BSD
AIX 2.4.1
SCO Open Desktop
Linux Red Hat 6.x .
'
2.5.2.
,
: Netscape 4.0 , Internet Explorer 5.0 .
2.5.3.
, - ()
, .
, .
, , API,
SQL.
Oracle.
, ,
.
2.5.4. Web-
, - () Web, , Apache Microsoft Internet Information Server.
2.5.5.
.
86, RISC, SPARC, Mo
torola .
3.
, .
301
3.1.
TMT-RD-10
3.1.1.
HTML
Web-. HTML .
3.1.2.
:
Current Projects ( )
Completed Projects ( )
Project Maintenance ( )
Create New Project ( )
Modify Project ( )
Remove Project ( )
Help ()
Test Case Maintenance ( )
Create Test Case or Suite ( )
Modify Test Case or Suite ( )
Remove Test Case or Suite ( )
Display Test ( )
Display Suite ( )
Help ()
Test Case Execution ( )
Run Single Test ( )
Run Suite ( )
Create Run List ( )
Execute Run List ( )
Test Results ( )
Bug Summary ( )
Single Test ( )
Suite or Run List ( )
Help ()
Utilities ()
Create Trace Matrix ( )
Backup ( )
Tesf Cases ( )
Test Suites ( )
Test Results ( )
Help ()
Restore ()
Tesf Cases ( )
Test Suites ( )
Test Results ( )
Help ()
Export ()
Tesf Cases ( )
Test Suites ( )
Test Results ( )
Help ()
302
TMT-RD-10
3.1.3.
- Internet
.
. .
.
3.1.4.
, ,
.
.
3.1.5.
.
.
. /
/ . , .
.
, . ,
, .
.
. ,
.
, , "Not Known" ("
") .
.
( ) , .
3.1.6.
.
. ,
. , /
.
.
. , .
,
.
. , .
3.1.7.
.
"Create New
Project" (" ") "Project Maintenance" (" ").
.
.
/ ,
.
/ .
303
TMT-RD-10
3.1.8.
. "Modify Project" (" ")
"Project Maintenance" (" ").
, ,
. ,
.
"No Projects Have Been Created" ("
").
, "",
.
3.1.9.
"Remove Project"
(" ") "Project Maintenance" (" ").
, ,
. ,
.
"No Projects Have Been Created" ("
").
, "",
.
3.1.10.
. "Create Test
Case or Suite Test" (" ") "Test Case Maintenance" ("
").
,
.
, ,
.
. , .
:
,
. "",
. ,
.
, . ,
.
:
, .
( ) .
, .
. ,
, . ,
.
3.1.11.
. "Modify Test Case
304
TMT-RD-10
305
TMT-RD-10
, -
. .
3.1.15.
"Run Single Test" ("
") "Test Case Maintenance" (" ").
.
. , ,
.
, :
. , ,
, . , "Pass"
(""), "Fail" ("He ") "Blocked" (""). "Fail"
"Blocked" ,
.
"Blocked".
"Finish" (""), .
:
,
, Perl, TCL .
, .
3.1.16.
"Test Case Execution" ("
") "Run Suite" (" ").
.
.
.
.
"/ ".
.
, ,
.
, , .
,
.
3.1.17.
,
, .
.
3.1.18.
.
3.1.19.
. Tests Results (
). , ,
306
TMT-RD-10
- , .
- .
, .
,
.
3.1.20.
.
Tests Results ( ).
, , ,
"pass" (""), "fail" (" ") "blocked" ("").
.
3.1.21.
,
. Tests Results (
). , ,
, .
3.1.22.
(Require
ments Traceability Matrix), .
"Create Trace Matrix" ("
") "Utilities" ("").
.
.
, .
, Excel.
, "No Projects Have Been
Created" (" ").
- "" .
3.1.23.
.
"Backup/Test Cases" ("
/ ") "Utilities" ("").
. . Win
dows , .
UNIX ,
. ,
. , CD/R CD/RW,
,
CD/RW.
3.1.24.
. "Backup/Test Suites"
(" / ") "Utilities" ("").
.
. Windows ,
. UNIX ,
307
TMT-RD-10
. ,
. , CD/R
CD/RW, ,
CD/RW.
3.1.25.
. "Backup/Test
Results" (" / ") "Utilities" ("").
.
. Windows ,
. UNIX
, .
, . ,
CD/R CD/RW, ,
CD/RW.
3.1.26.
,
. "Restore/Test Cases" ("
/ ") "Utilities" ("").
.
3.1.27.
,
. "Restore/Test Suites" ("
/ ") "Utilities" ("").
.
3.1.28.
,
. "Restore/Test Results" ("
/ ") "Utilities" ("").
.
3.1.29.
ASCII -. "Export/Test
Cases" ("/ ") "Utilities" ("").
.
.
.
.
3.1.30.
,
, ASCII- -.
"Export/Test Suites" ("/ ") "Utilities"
(""). .
.
.
.
308
TMT-RD-10
3.1.31.
ASCII- -.
"Export/Test Results" ("/ ") "Utilities" ("").
.
.
.
.
3.1.32.
, .
, .
3.1.33.
,
.
,
.
,
.
3.2.
- .
3.3.
.
3.3.1.
.
,
, Web-. ,
.
, ,
.
3.4.
Oracle.
Oracle.
3.5.
3.1,
3.2.
3.6.
- .
3.7.
309
TMT-RD-10
3.1.
Project Name ( )
PRJNAM
Character
()
20
Requirement Satisfied
( )
REQSAT
Numeric
()
Requirement Name ( )
REQNAM
Character
20
Test Identifier ( )
TSTID
Character
20
Test Name ( )
TSTNAM
Character
20
Expected Result ( )
XRSLT
Character
50
Hardware Required ( )
HWREQ
Character
256
Test Setup ( )
TSTSUP
Character
256
Configuration Name ( )
CFGNUM
Character
20
Test 1 Name ( 1)
TST1NUM
Character
20
Test 1 Steps ( 1)
TST1STP
Character
256
Test 2 Name ( 2)
TST2NUM
Character
20
Test 2 Steps ( 2)
TST2STP
Character
256
Test 3 Name ( 3)
TST3NUM
Character
20
Test 3 Steps ( 3)
TST3STP
Character
256
Test 4 Name ( 4)
TST4NUM
Character
20
Test 4 Steps ( 4)
TST4STP
Character
256
Test 5 Name ( 5)
TST5NUM
Character
20
Test 5 Steps ( 5)
TST5STP
Character
256
User ID ( )
UID
Character
20
Date ()
DATRUN
Date ()
Time Start ( )
START
Time ()
Time Stop ( )
STOP
Time
Time Needed ( )
TIMREQ
Numeric
Pass()
PASS
Logical
()
Fail ()
FAIL
Logical
T/F
Fail Detail ( )
FLDTL
Character
256
Blocked ()
BLCKD
Logical
T/F
Blocked Detail ( )
BLKDTL
Character
256
CLNUP
Character
50
310
T/F
(/
)
TMT-RD-10
3.2.
Requirement Satisfied ( )
REQSAT.IDX
Test Identifier ( )
TSTID.IDX
User ID ( )
UID.IDX
Pass ()
PASS.IDX
Fail ()
FAIL.IDX
Blocked ()
BLCKD.IDX
1
APIApplication Programming Interface ( )
ASCII American Standard Code for Information Interchange (
)
CDR Compact Disc Recordable ( -)
HTML Hypertext Markup Language ( )
ISO International Organization for Standardization ( )
Power PC ( Power PC)
RISC Reduced Instruction Set Computing ( )
SQL-Structured Query Language ( )
SPARC Scalable Processor Architecture ( )
TCL Tool Command Language ( )
Test Management Toolkit ( )
86 Intel
3
:
: 9/7/01 14:23
: (Chris Brown) [cbrown@tmtco]; development@tmtco
: marketing@tmtco; customersupport@tmtco
: , 1.0
,
,
, .
( TMT-RD-10) ,
.
. ,
.
,
311
TMT-RD-10
cdklout@tmtco.com
:
(Suzie
Perl [spent@tmtco.com]
: 9/9/2001 09:30
: (Chris Brown) [cbrown@tmtco]; development@tmtco
: marketing@tmtco; customersupport@tmtco
: 1.0
,
! TMT-RD-10 ( 8)
, .
,
(Bret
Gater) [bgater@tmtco.com]
: 9/9/2001
: [cbrown@tmtco]; test@tmtco; development@tmtco
: marketing@tmtco; costumersupport@tmtco
: 1.0
,
TMT-RD-10 ( 8)
, .
,
312
3 ,
,
. . 14.1 3,
, .
, 2. 13
.
, , .
,
,
. ,
,
, , ,
.
3,
.
IEEE Standard 829, IEEE Standard for Software Test Documentation (
3). ,
,
, IEEE.
IEEE Standard 829.
, , 16
:
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
314
III.
11.
12.
13.
14.
15.
16.
->
. 14.1. , .
, tie
. ,
,
. , ,
.
. . ,
, .
,
(Test Management Toolkit, ).
,
13.
--10
: --10
: 0.8
: (Chris Brown)
(James Barnes)
1.0
0.1
09/02/2001
: TMT-RS-05
0.2
09/03/2001
: TMT-TS-05
0.3
09/03/2001
0.4
09/05/2001
0.5
09/06/2001
,
,
0.6
09/07/2001
TMT-RS-07,
0.7
09/09/2001
0.8
09/10/2001
. (Chuck D. Klout),
09/11/2001
(Suzanna Perl),
09/12/2001
(Bret Gater),
09/12/2001
315
--10
1.
2.
3. ,
4. ,
5.
5.1.
5.2.
5.3.
5.4.
5.5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
1
2
3
: . (Chuck D. Klout) [cdklout@tmtco]
: (Suzie Perl [spent@tmtco.com]
: (Bret Gater) [bgater@tmtco.com]
316
317
317
318
318
318
318
319
319
319
319
319
320
320
323
323
324
324
325
325
326
326
326
326
327
327
1.
,
. ,
, , "
, ". ,
, TMT-RD-10
Web-:
http//www .tmtcointernal.com/usr/www/docstores/desiqn/reauirements/TMT-RD-10.doc
316
--10
2.
,
:
1.0.
,
, , .
.
,
Web- . ,
, CD-ROM.
.
,
, ,
. ,
, ,
,
.
,
.
3. ,
, ,
, :
3.1.1.
3.1.2.
3.1.3.
3.1.4.
3.1.5.
3.1.6.
3.1.7.
3.1.8.
3.1.9.
3.1.10.
3.1.11.
3.1.12.
3.1.13.
3.1.14.
3.1.15.
3.1.16.
3.1.17.
3.1.18.
3.1.19.
3.1.20.
3.1.21.
317
--10
3.1.22.
3.1.23.
3.1.24.
3.1.25.
3.1.26.
3.1.27.
3.1.28.
3.1.29.
3.1.30.
3.1.31.
3.1.32.
3.1.33.
4. ,
/ ,
.
. , .
,
, .
.
/. ,
, ,
.
5.
, , ,
, ,
, .
.
5.1.
, TMT-RD-10
/, 10.
(
, ).
5.2.
,
, .
, , ,
.
:
318
--10
.
, , ,
, . ,
.
, ,
.
5.3.
, ,
, .
, . ,
UNIX
UNIX- . Windows.
(. ).
5.4.
,
, .
, , .
,
.
5.5.
:
.
.
6.
. , ,
. , ,
.
, "".
, 100%
, ,
. 100% ,
.
7.
, , ,
, .
319
--10
,
50% . ,
. ,
.
8.
,
:
,
.
().
; ,
.
9.
, :
( -),
. 09.01.2001
Wideband Delphi. ,
, ,
, .
9.1.
320
--10
9.1.
Microsoft Windows
Microsoft Windows
- Windows 85
- Windows NT 3.51
- Windows 98
UNIX
- Windows ME
- Windows XP
- HPUX 10.x
- Windows NT 3.51
- Open BSD
- Windows 2000
- AIX 2.4.1.
Apple
- MAC OS 9.x
9.1, ,
. ,
, Windows NT, Solaris 2.6, OS9.X Linux 6.x.
, 49 .
/ 5 . ,
, 5 49 = 245 ,
30 . ,
, ,
.
49 , , ,
.
,
/, 9.2.
9.2. ,
- Windows 95
- Windows NT 3.51
- Windows 98
- Windows ME
-HPUX 10.1
- Windows XP
- Open BSD
- Windows NT 3.51
- AIX 2.4.1
- Windows 2000
- Linux 6.5
- MAC OS 9.0
,
. 35 -,
245 , . , ,
9.2, -
/. -
321
--10
/ /
(. 9.3).
9.3. ,
/
- Windows 98
- Windows 2000
- Linux 6.5
,
9.2 9.3, 9.4
. ,
.
,
, 9.4.
9.4.
()
35
16
24
24
16
16
322
139
--10
10.
# 1 , . 10.1,
, /
. ,
. #1
/, 9.3. ,
#1 , .
. 10.1 ,
Oracle ,
.
. ,
.
, 1, 3 5
Internet Explorer, 2 4 - Netscape Navigator. . 10.2
#2.
, .
, #2 ,
Apple Macintosh.
11.
;
,
.
,
.
, , , .
, .
323
--10
, ,
.
" " ,
, .
.
, ,
.
, ,
(
).
.
.
, ,
6.
12.
12.1.
. (D. Nguyen) Oracle, . (.
Taylor), ,
"Software Testing 101", . (J.Barnes).
.
12.1.
100 %
100%
50%
50%
100 %
13.
13.1.
, ,
.
, .
.
324
--10
13.1.
#1 #2
10/1
10/12
10/15
10/19
#1
10/22
11/2
#2
22/5
11/16
#3
11/19
11/30
12/3
12/3
,
#1 ,
, .
14.
14.1 , ,
,
.
14.1.
,
,
.
75%
.
.
2
.
50%
,
. (R. Carini),
, .
,
.
,
.
,
-
.
20%
,
.
325
--10
1
API Application Programming Interface ( )
ASCII American Standard Code for Information Interchange (
)
CDR Compact Disc Recordable ( -)
HTML Hypertext Markup Language ( )
ISO International Organization for Standardization ( )
PPC Power PC ( Power PC)
RISC Reduced Instruction Set Computing ( )
SQL Structured Query Language ( )
SPARC Scalable Processor Architecture ( )
TCL Tool Command Language ( )
Test Management Toolkit ( )
86 Intel
3
:
: 9/11/01 16:40
: (Chris Brown) [cbrown@tmtco]; development@tmtco
: marketing@tmtco; customersupport@tmtco
: , 1.0
,
-,
.
--10, 8, , .
. ,
, .
, 9 10
.
, , ,
.
,
326
--10
cdklout@tmtco.com
:
: 9/12/2001 09:30
: (Chris Brown) [cbrown@tmtco]; development@tmtco
: marketing@tmtco; customersupport@tmtco
: 1.0
,
! --10, 8,
, .
,
327
4 ,
. ,
,
, :
, ,
; ,
, .
. 15.1 ,
.
, ,
3. , ,
.
, , , .
, ,
.
.
,
.
, .
, , ,
.
, ,
.
, .
:
15.
329
,
, ,
.
4.
:
.
, , .
, ,
,
.
, , ,
. ,
,
. ,
, ,
Microsoft Excel
.
>
. 15.1.
, 4, . 15.2.
(Requirements Traceability Matrix, RTM),
330
III.
2 (. . 2.5).
RTM-, ,
. - RTM .
, .. ,
.
4, :
,
. , RTM-
,
, .
,
.
,
, .
. ,
.
, " ",
.
RD2.2.1
ST2.2.4
TP_lnput1.doc
2.0
02.2.4
,
.
. 15.2.
, ,
"/ ". ,
, , ,
.
, ;
.
, 4. ,
15.
331
, ,
. 15.3.
:
.
, (
).
,
.
,
. ,
, "xxxLLL0123.tst".
, .
.
,
. "
" 4).
,
.
,
, , .
,
, , run setupSC03 . p i .
,
, .
,
,
.
,
.
332
SC03 ver3.0
(Jean Douglas)
()
TestServer:D:\TestProject\TestSuite\SC03.doc
//
SC101
ST02
SC01
.
,
,
.
N/A
(V)
1.
"
" .
"
"
(V)
2.
"101"
"
"
(V)
3.
"0"
"
"
4.
"100"
"100 "
(V)
5.
" 1 "
"1 "
(V)
N/A
: JD
: //
(P/F/B): F
:
- 3.
- BR1011.
. 15.3.
TMT-TPS-10
: TMT-TPS-10
: 0.5
: (Chris Brown)
(James Barnes)
1.0
0.1
08/29/2001
0.2
09/03/2001
0.3
09/05/2001
0.4
09/06/2001
0.5
09/10/2001
(Suzanna Perl),
09/11/2001
. (Chuck D. Klout),
09/12/2001
(Bret Gater),
09/12/2001
333
TMT-TPS-10
1.
2. ,
3.
3.1.
3.2.
3.3.
3.4.
3.5.
4.
5.
5.1. 3.1.1
5.2. 3.1.2
5.3. 3.1.3
5.4. 3.1.4
5.5. 3.1.5
5.6. 3.1.6
5.7. 3.1.7
5.8. 3.1.8
5.9. 3.1.9
5.10. 3.1.10
5.11. 3.1.11
5.12. 3.1.12
5.13. 3.1.13
5.14. 3.1.14
5.15. 3.1.15
5.16. 3.1.15
5.17. 3.1.17
5.18. 3.1.18 /
5.19 3.1.19 /
5.20. 3.1.20
5.21. 3.1.21 /
5.22. 3.1.22 /
5.23. 3.1.23 /
5.24. 3.1.24 /
5.25. 3.1.25 /
5.26. 3.1.26 /
5.27. 3.1.27 /
5.28. 3.1.28
5.29. 3.1.29 /
5.30. 3.1.30
5.31. 3.1.31
1
2
3
: . (Chuck D. Klout) [cdklout@tmtco]
: (Suzie Perl [spent@tmtco.com]
: (Bret Gater) [bgater@tmtco.com]
334
335
335
336
338
338
339
340
340
341
341
341
341
352
353
354
354
355
355
356
356
356
357
357
358
358
358
359
359
360
360
361
361
362
362
363
363
364
364
364
365
365
366
366
367
367
367
367
367
TMT-TPS-10
1.
,
,
(Test Management Toolkit, ). ,
, ,
" ,
". , , TMT-RD-10
Web-:
httD//www.tmtcointernal.com/usr/www/docstores/desian/reauirements/TMT-RD-10.doc
, -10, Web-:
http//www,tm tcointernal.com/usr/www/docstores/desian/reauirements/TMT-TP-10.doc
3, 5.
2. ,
, ,
, :
3.1.1.
3.1.2.
3.1.3.
3.1.4.
3.1.5.
3.1.6.
3.1.7.
3.1.8.
3.1.9.
3.1.10.
3.1.11.
3.1.12.
3.1.13.
3.1.14.
3.1.15.
3.1.16.
3.1.17.
3.1.18.
3.1.19.
3.1.20.
3.1.21.
3.1.22.
3.1.23.
3.1.24.
3.1.25.
3.1.26.
335
TMT-TPS-10
3.1.27.
3.1.28.
3.1.29.
3.1.30.
3.1.31.
3.1.32.
3.1.33.
3.
,
, ,
.
.
3.1.
, ,
, . ,
,
, .
" ".
3 . 1 .
RD3.1.1
.1.1
#1
RD3.1.2
. 1.2
#1
RD3.1.3
. 1.3
#1
RD3.1.4
. 1.4
#1
RD3.1.5
. 1.5
#1
336
TMT-TPS-10
. 3.1
RD3.1.6
. 1.6
#1
RD3.1.7
. 1.7
#1
RD3.1.8
. 1.8
#1
RD3.1.9
. 1.9
#1
RD3.1.10
.1.10
#1
RD3.1.11
.1.11
#1
RD3.1.12
.1.12
#1
RD3.1.13
.1.13
#1
(
) ,
RD3.1.14
.1.14
#1
(
) ,
RD3.1.15
.1.15
#1
337
TMT-TPS-10
. 3.1
RD3.1.16
.1.16
#1
RD3.1.17
.1.17
#1
RD3.1.18
.1.18
#1
RD3.1.19
.1.19
#1
()
RD3.1.20
.1.20
#1
()
RD3.1.21
. 1.21
#1
RD3.1.22
. 1.22
#1
3.1.
,
, .
, , ,
.
.
3.2.
,
, .
, , .
,
.
338
TMT-TPS-10
3.2.
, ,
, .
3.2 /
RD3.1.23
. 1.23
#1
RD3.1.24
. 1.24
#1
RD3.1.25
. 1.25
#1
RD3.1.26
. 1.26
#1
RD3.1.27
.1.27
#1
RD3.1.28
. 1.28
#1
3.3.
, ,
3.3.
339
TMT-TPS-10
3.3.
RD3.1.29
.1.29
#1
RD3.1.30
. 1.30
#1
RD3.1.31
. 1.31
#1
RD3.1.32
. 1.32
#1
,
,
RD3.1.33
. 1.33
#1
3.4.
, ,
, .
, . ,
UNIX
UNIX- . Windows.
(. ).
- .
, ,
, .
, 3.1.
3.5.
340
TMT-TPS-10
.
.
- .
, ,
/, . 3.1, 3.2 3.3. ,
, ,
.
4.
, 3.1, 3.2 3.3,
. # 1 # 2 ,
--08.
5.
, 3.1, 3.2 3.3.
Netscape Navigator, Microsoft Internet Ex
plorer.
5.1. 3.1.1
IP-.
"'.
1
Netscape Navigator. URL- "" "Enter".
:
.
5.2. 3.1.2
1
Netscape Navigator. URL- "" "Enter".
:
(Toolkit Main Menu).
2
"" .
:
Current Projects ( )
Completed Projects ( )
Project Maintenance ( )
Test Case Maintenance ( )
Test Case Execution ( )
Test Results ( )
Utilities ()
Help ()
:
.
341
TMT-TPS-10
3
"Current Projects'1 (" '
1:
, "Current Projects"("TeKym,He "),
.
2:
, (
).
.
3:
.
4
"Completed Projects" (" .
1:
"Completed Projects"("3aBepLueHHbie "),
.
2:
, (
).
.
3:
.
5
"Project Maintenance" (" ^.
1:
"Project 11"(" ").
2:
:
Create New Project ( )
Modify Project ( )
Remove Project ( )
Help ()
6
Project Maintenance "Create New Project" ("
1:
.
Project Maintenance.
2:
Project Maintenance.
7
Project Maintenance "Modify Project" (" .
1:
,
.
342
TMT-TPS-10
2:
, ,
( ).
Project Maintenance.
3:
Project Maintenance.
8:
Project Maintenance "Remove Project" (" ").
1:
,
.
2:
, ,
( ).
Project Maintenance.
3:
Project Maintenance.
9
Project Maintenance "Help" ("").
1:
Project Maintenance (
-
).
Project Maintenance.
2:
Project Maintenance.
10
"Test Case Maintenance" (" ").
1:
"Test Case Maintenance" (" ").
2:
:
Create Test Case or Suite ( )
Modify Test Case or Suite ( )
Remove Test Case or Suite ( )
Display Test ( )
Display Suite ( )
Help ()
11
Test Case Maintenance "Create Test Case or Suite" ("
").
1:
,
. .
343
TMT-TPS-10
2:
Test () Suite ().
Suite (), . Test (),
. ,
, .
12
Test Case Maintenance "Modify Test Case or Suite" ("
").
1:
, ,
. .
2:
, Test ()
Suite ().
Suite (),
. .
3:
, ,
( ).
4:
Test (), ,
. .
5:
, , (
).
Test Case Maintenance.
6:
Test Case Maintenance.
13
Test Case Maintenance "Remove Test Case or Suite" ("
").
1:
, ,
. .
2:
, Test ()
Suite ().
Suite (),
. .
3:
, , (
).
4:
Test (), ,
. .
344
TMT-TPS-10
5:
, , (
).
Test Case Maintenance.
6:
Test Case Maintenance.
14
Test Case Maintenance "Help" ("").
1:
Test Case Maintenance (
-
).
Test Case Maintenance.
15
Test Case Maintenance "Display Test" (" ").
1:
, ().
.
.
2:
,
( ).
16
Test Case Maintenance "Display Suite" (" ").
1:
,
(). .
.
2:
,
( ).
17
Test Case Maintenance "Help" ("").
1:
Test Case Maintenance (
-
).
Test Case Maintenance.
2:
Test Case Maintenance.
18
"Test Case Execution" (" ").
:
"Test Case Execution Menu" ("
"). :
345
TMT-TPS-10
TMT-TPS-10
23
Test Case Execution "Help" ("").
1:
Test Case Maintenance (
-
).
Test Case Execution.
.
2:
Test Management Toolkit.
24
Test Management Toolkit "Test Results" (" ").
:
Test Results Menu (
).
25:
Test Results "Bug Summary" (" ").
1:
,
. ,
, .
.
, ,
, ,
, , .
2:
(
).
Test Results.
3:
Test Results.
26
Test Results "Single Test" (" ").
1:
,
. ,
.
.
2:
(
).
Test Results.
3:
Test Results.
347
TMT-TPS-10
27
Test Results "Suite or Run List" (" "
1:
,
. ,
.
.
2:
(
).
Test Results.
3:
Test Results.
Test Management Toolkit.
4:
Test Management Toolkit.
28
Test Management Toolkit "Utilities" ("").
:
Utilities Main Menu ( ),
:
Create Trace Matrix ( )
Backup Project ( )
Backup Test Suite ( )
Backup Test Case { )
Backup Test Results ( )
Restore Project ( )
Restore Test Suite ( )
Restore Test Case ( )
Restore Test Results ( )
Export Project ( )
Export Test Suite ( )
Export Test Case ( )
Export Test Results ( )
Help ()
29
Utilities "Create Trace Matrix" (" ").
1:
.
.
.
,
.
2:
, ,
. , ,
.
Utilities.
348
TMT-TPS-10
3:
Utilities.
30
Utilities "Backup Project" (" ").
1:
Project Backup (
).
.
.
.
2:
, ,
. , .
Utilities.
3:
Utilities.
31
Utilities "Backup Test Suite" (" ").
1:
Suite Backup (
). .
.
.
.
2:
, ,
. ,
.
Utilities.
3:
Utilities.
32
Utilities "Backup Test Case" (" ").
1:
Test Case Backup (
). .
.
.
.
2:
, ,
. ,
.
Utilities.
3:
Utilities.
349
TMT-TPS-10
33
Utilities "Backup Test Results" ("
").
1:
Test Results Backup (
).
. .
.
.
2:
, ,
. ,
.
Utilities.
3:
Utilities.
34:
Utilities "Restore Project" (" ").
1:
Restore Project ( ).
.
,
. .
Utilities.
2:
Utilities.
35
Utilities "Restore Test Suite" (" ").
1:
Restore Test Suite (
). .
,
. .
Utilities.
2:
Utilities.
36
Utilities "Restore Test Case" (" ").
1:
Restore Test Case (
). .
,
. .
Utilities.
350
TMT-TPS-10
2:
Utilities.
37
Utilities "Restore Test Results" ("
").
1:
Restore Test Results (
). .
,
. .
Utilities.
2:
Utilities.
38
Utilities Export Project ( ).
1:
Export Project ( ).
, .
.
.
, .
2:
, , .
, .
Utilities.
3:
Utilities.
39
Utilities "Export Test Suite" (" ").
1:
Export Test Suite ( ).
, .
.
.
,
.
2:
, ,
. , .
Utilities.
3:
Utilities.
40
Utilities "Export Test Case" (" ").
351
TMT-TPS-10
1:
Export Test Case ( ).
, .
.
.
,
.
2:
, ,
. , .
Utilities.
3:
Utilities.
41
Utilities "Export Test Results" ("
1:
Export Test Results (
). ,
. .
.
, .
2:
, ,
. ,
.
Utilities.
3:
Utilities.
42
Utilities Help.
1:
Utilities (
-
).
Utilities.
Test Management
Toolkit.
2:
Test Management Toolkit.
5.3. 3.1.3
:
352
TMT-TPS-10
Admin
Admin
Userl
password
User2
password
User3
password
User4
password
User5
password
1
Enter
. ,
Enter.
1:
User Name ( ) Password ().
"User9" Enter, .
2:
"You entered an invalid Username or Password" ("
").
"User9" , "password".
3:
"You entered an invalid Username or Password" ("
").
"Userl" , "pickle".
4:
"You entered an invalid Username or Password" ("
").
"Userl" , "password".
5:
Test Management Toolkit.
5.4. 3.1.4
1
Enter
. ,
Enter.
1:
User Name ( ) Password ().
"User9" Enter, .
2:
"You entered an invalid Username or Password" ("
").
"User9" , "password".
3:
"You entered an invalid Username or Password" ("
").
353
TMT-TPS-10
"Userl" , "pickle".
4:
"You entered an invalid Username or Password" ("
").
"Admin" , "Admin".
5:
Test Management Toolkit.
2
TMTADMIN Enter
. ,
TMTADMIN Enter.
1:
User Name ( ) Password ().
"User9" Enter, .
2:
"You entered an invalid Username or Password" ("
").
"User9" , "password".
3:
"You entered an invalid Username or Password" ("
").
"Userl" , "pickle".
4:
"You entered an invalid Username or Password" ("
").
"Admin" , "Admin".
5:
Test Management Toolkit.
5.5. 3.1.5
.
Test Management Toolkit "Current Projects"
(" ").
1
Test Management Toolkit "Current Projects" (" ").
:
Current Projects ( ).
, , ,
. ,
, ,
.
5.6. 3.1.6
.
Test Management Toolkit "Completed Projects"
(" ").
354
TMT-TPS-10
1
Test Management Toolkit "Completed Projects" ("
").
:
Completed Projects ( ).
, , ,
. .
5.7. 3.1.7
.
Project Maintenance "Create New Project" (" ").
1
Test Management Toolkit "Project Maintenance" ("
").
1:
Project Maintenance ( ).
Project Maintenance ( ) "Create New Project" ("
").
2:
.
.
.
,
.
(Save)
(Cancel).
Project Maintenance.
5.8. 3.1.8
.
Project Maintenance "Modify Project" (" ").
1
Test Management Toolkit "Project Maintenance" ("
").
1:
Project Maintenance ( ).
Project Maintenance "Modify Project" (" ").
2:
, .
.
.
(Save)
(Cancel).
Project Maintenance.
355
TMT-TPS-10
5.9. 3.1.9
.
Project Maintenance "Remove Project" (" ").
1
Test Management Toolkit "Project Maintenance" ("
").
1:
Project Maintenance ( ).
Project Maintenance "Remove Project" (" ").
2:
, .
.
.
Project Maintenance.
5.10. 3.1.10
.
Test Case Maintenance "Create Test Case or Suite" ("
").
1
Test Management Toolkit "Test Case Maintenance" ("
").
1:
Test Case Maintenance ( ).
"Create Test Case or Suite" (" ").
2:
(Test Case)
(Test Suite).
, , , .
.
3:
.
, ,
(Save) (Cancel).
, Test Case Maintenance.
5.11. 3.1.11
.
Test Case Maintenance "Modify Test Case or Suite" ("
").
1
Test Management Toolkit "Test Case Maintenance" ("
").
1:
Test Case Maintenance ( ).
"Modify Test Case or Suite" (" ").
356
TMT-TPS-10
2:
,
. .
.
3:
(Save) (Cancel).
, Test Case Maintenance.
5.12. 3.1.12
.
Test Case Maintenance "Remove Test Case or Suite" ("
").
1
Test Management Toolkit "Test Case Maintenance" ("
").
1:
Test Case Maintenance ( ).
"Remove Test Case or Suite" (" ").
2:
,
. .
.
3:
, Test Case Maintenance.
5.13. 3.1.13
()
. Test Case Maintenance "Display Test Case
or Suite" (" ").
1
Test Management Toolkit "Test Case Maintenance" ("
").
1:
Test Case Maintenance ( ).
"Display Test Case or Suite" (" ").
2:
,
. .
.
,
.
Test Case Maintenance.
357
TMT-TPS-10
5.14. 3.1.14
()
. Test Case Maintenance "Display Test Case
or Suite" (" ").
1
Test Management Toolkit "Test Case Maintenance" ("
").
1:
Test Case Maintenance ( ).
"Display Test Case or Suite" (" ").
2:
, .
.
.
, .
.
Test Case Maintenance.
5.15. 3.1.15
.
Test Case Execution ( ) "Run
Single Test" (" ").
1
Test Management Toolkit "Test Case Execution" ("
").
1:
Test Case Execution ( ).
"Run Single Test" (" ").
2:
, .
.
.
3:
.
, .
:
, .
Test Case
Execution.
5.16. 3.1.15
.
Test Execution "Run Suite" (" ").
1
Test Management Toolkit "Test Case Execution" ("
").
358
TMT-TPS-10
1:
Test Case Execution ( ).
"Run Suite" (" ").
2:
, .
.
.
3:
, .
, .
:
, .
.
.
, .
, , .
. Test Management Toolkit
"Test Results" (" ").
1
Test Management Toolkit "Test Results" (" ").
1:
Test Results ( ).
Test Results ( ) "Single Test" (" ").
359
TMT-TPS-10
2:
,
. .
.
"' ".
Test Results.
5.19 3.1.19 /
, , .
. Test Man
agement Toolkit "Test Results" (" ").
1
Test Management Toolkit "Test Results" (" ").
1:
Test Results ( ).
Test Results ( ) "Suite or Run List" ("
").
2:
,
.
.
.
"'' '".
Test Results.
5.20.
3.1.20
. Utilities () "Create Trace Matrix"
(" ").
1
Test Management Toolkit "Utilities" ("").
1:
Utilities Menu ( ).
Utilities () "Create Trace Matrix" ("
").
2:
,
.
. ,
,
.
.
3:
,
/. -
360
TMT-TPS-10
, .
.
, .
Utilities.
5.21.
3.1.21
. Utilities "Backup Test
Case" (" ").
1
Test Management Toolkit "Utilities" ("").
1:
Utilities Menu ( ).
Utilities "Backup Test Case" (" ").
2:
, .
.
.
3:
.
, , ,
. CDR CDRW. ,
,
.
Utilities.
5.22.
3.1.22
. Utilities "Backup Test Suite" ("
").
1
Test Management Toolkit "Utilities" ("").
1:
Utilities Menu.
Utilities "Backup Test Suite" (" ").
2:
, .
.
.
3:
.
, , ,
. CDR CDRW. ,
,
.
Utilities.
361
5.23.
3.1.23
TMT-TPS-10
. Utilities "Backup Test
Results" (" ").
1
Test Management Toolkit "Utilities" ("").
1:
Utilities Menu.
Utilities "Backup Test Results" ("
").
2:
,
. .
.
3:
.
, , ,
. CDR CDRW.
, ,
.
Utilities.
5.24.
3.1.24
. Utilities "Restore
Test Case" (" ").
1
Test Management Toolkit "Utilities" ("").
1:
Utilities Menu.
Utilities "Restore Test Case" (" ").
2:
,
.
,
, , .
CDR CDRW.
, .
.
, .
,
.
Utilities.
362
5.25.
3.1.25
TMT-TPS-10
. Utilities "Restore
Test Suite" (" ").
1
Test Management Toolkit "Utilities" ("").
1:
Utilities Menu.
Utilities "Restore Test Suite" (" ").
2:
,
.
,
, , .
CDR CDRW.
, .
.
, .
,
.
Utilities.
5.26.
3.1.26
. Utilities
"Restore Test Results" (" ").
1
Test Management Toolkit "Utilities" ("").
1:
Utilities Menu.
Utilities "Restore Test Results" (" ").
2:
,
.
,
, , .
CDR CDRW.
,
. .
,
.
,
.
Utilities.
363
5.27.
3.1.27
TMT-TPS-10
. Utilities
"Export Test Case" (" ").
1
Test Management Toolkit "Utilities" ("").
1:
Utilities Menu.
Utilities "Export Test Case" (" ").
2:
,
.
.
, .
, ,
. , ,
, .
CDR CDRW.
"Continue" (""), .
Utilities.
5.28.
3.1.28
. Utilities "Ex
port Test Suite" (" ").
1
Test Management Toolkit "Utilities" ("").
1:
Utilities Menu.
Utilities "Export Test Suite" (" ").
2:
,
.
.
, .
, ,
. , ,
, .
CDR CDRW.
"Continue" (""), .
Utilities.
5.29.
3.1.29
. Utilities
"Export Test Results" (" ").
364
TMT-TPS-10
1
Test Management Toolkit "Utilities" ("!.
1:
Utilities Menu.
Utilities "Export Test Results" (" "
2:
,
.
.
,
.
, ,
. ,
, , - .
CDR CDRW.
"Continue" (""), .
Utilities.
5.30. 3.1.30
.
,
. , ,
.
, . , .
.
1
Help (
:
. .
5.31.
3.1.31
.
, .
8 .
18:00.
1
18:00. User-!, User2. User3. User4 User5 ,
.
1:
, -
.
2
18:15. Userl. User2. User3. User4 User5
.
365
TMT-TPS-10
1:
, -
.
3
18:30. User-!, User2. User3. User4 User5
, .
3:
, -
.
4
18:45. Userl, User2. User3. User4 User5 .
4:
, -
.
.
.
. ,
, . ,
- .
1
API Application Programming Interface ( )
ASCII American Standard Code for Information Interchange (
)
CDR Compact Disc Recordable ( -)
HTML Hypertext Markup Language ( )
ISO International Organization for Standardization ( )
Power PC ( Power PC)
RISC Reduced Instruction Set Computing ( )
SQL Structured Query Language ( )
SPARC Scalable Processor Architecture ( )
TCL Tool Command Language ( )
Test Management Toolkit ( )
86 Intel
366
TMT-TPS-10
3
: . (Chuck D. Klout) [cdklout@tmtco]
: 9/11/01 14:23
: (Chris Brown) [cbrown@tmtco]; development@tmtco
: marketing@tmtco; customerssupport@tmtco
: , TMT 1.0
,
, TMT-TPS-10, 5,
, .
, .
, ,
.
,
.
: 9/12/2001 07:30
: [cbrown@tmtco]; test@tmtco; development@tmtco
: marketing@tmtco; costumersupport@tmtco
: 1.0
,
TMT-TPS-10, 5,
, .
,
,
367
5
. ,
.
, " "
. . 16.1 .
. 16.1, ,
, ,
.
,
. ,
.
,
. ,
, , ,
.
.
.
,
.
,
(Test Management Toolkit, TMT).
5 ,
:
16.
369
. 16.1.
, ,
, .
.
,
.
.
, ,
. , , :
.
.
.
TMT-TPS-10
: TMT-TSR-10
: 0.2
: (James Barnes)
1.0
0.1
12/02/2001
12/03/2001
0.2
(Bret Gater),
370
12/03/2001
TMT-TPS-10
1.
371
2.
371
3. ,
375
4. ,
375
5.
376
6.
376
7.
376
376
376
3
: (Bret Gater) [bgater@tmtco.com]
376
376
1.
(Test Management Toolkit, ).
"
, ":
http://www.tmtcointernal.com/usr/www/docstores/desion/Dlans/TMT-TP-10.doc.
, ,
, " ,
":
httD://www.tmtcointernal.com/usr/www/docstores/desian/reauirements^MT-RD-10.doc.
2.
, ,
100% .
95% , .
,
.
, , 2.2.
, ,
2.3. . 3.1.
371
TMT-TPS-10
2.1.
3.1.1.
20
18
100%
3.1.2.
25
24
100%
3.1.3.
12
12
100%
3.1.4.
12
12
100%
3.1.5.
15
15
100%
3.1.6.
15
15
100%
3.1.7.
12
12
100%
3.1.8.
12
12
100%
3.1.9.
12
12
100%
3.1.10.
15
15
100%
3.1.11.
15
15
100%
3.1.12.
15
15
100%
3.1.13.
10
10
100%
3.1.14.
10
10
100%
3.1.15.
10
10
100%
3.1.16.
10
10
100%
3.1.17.
12
11
100%
3.1.18.
/
15
15
100%
3.1.19.
/
15
15
100%
3.1.20.
10
100%
3.1.21.
12
12
100%
3.1.22.
/
12
12
100%
372
TMT-TPS-10
. 2.1
3.1.23.
/
12
12
100%
3.1.24. /
12
12
100%
3.1.25. /
12
12
100%
3.1.26. /
12
12
100%
3.1.27. /
12
11
100%
3.1.28. /
12
11
100%
3.1.29. /
12
11
100%
3.1.30.
18
18
100%
3.1.31.
10
10
100%
408
400
100%
373
TMT-TPS-10
2.2.
: 30-11-02
3.1.1
15-10-01
"Test
Identifier". Tset Identifier
1.0
3.1.1
16-10-01
"Test
Name". *Test Nnme
1.0
.1.2
17-10-01
"Utility Menu"
1.0
.1.16
20-10-01
Pass
() Fail ()
1.0
.1.19
22-10-0.1
.
/Trace
1.0
.1.26
01-11-01
"Test Case"
( )
1.1
.1.27
01-11-01
"Test Suite"
( )
1.1
.1.28
01-11-01
"Test Result"
(
)
1.1
2.3. ,
1
25
32
18
374
TMT-TPS-10
3. ,
, ,
, :
3.1.1.
3.1.2.
3.1.3.
3.1.4.
3.1.5.
3.1.6.
3.1.7.
3.1.8.
3.1.9.
3.1.10.
3.1.11.
3.1.12.
3.1.13.
3.1.14.
3.1.15.
3.1.16.
3.1.17.
3.1.18.
3.1.19.
3.1.20.
3.1.21.
3.1.22.
3.1.23.
3.1.24.
3.1.25.
3.1.26.
3.1.27.
3.1.28.
3.1.29.
3.1.30.
3.1.31.
3.1.32.
3.1.33.
, ,
2.
4. ,
/ ,
.
375
TMT-TPS-10
/
.
, .
5.
.
6.
,
.
7.
Chris Brown, Test Management Toolkit, Requirements Definition (
, ). TMT-RD-10,
:
http://wvvw.trntcointernal.corn/usr/www/docstores/clesiqn/reauirernents/TMT-RD-10.doc
Chris Brown and J. Barnes, Test Management Toolkit, Test Plan (
, ). --10,
:
httD://www.tmtcointernal.com/usr/www/docstores/desiqn/plans/TMT-TP-10.doc
Chris Brown J. Barnes, Test Management Toolkit, Release 1.0. Test Procedure Specification (
,
). TMT-TPS-10,
:
httD://www.tmtcointernal.com/usrAwww/docstores/desiqn/plans^MT-TPS-10.doc
3
: (Bret Gater) [bgater@tmtco.com]
: 9/10/2001 07:30
: . [jbarnes@tmtco]; test@tmtco; development@tmtco
: marketing@tmtco; costumersupport@tmtco
: 1.0
,
TMT-TSR-10, 2, ,
.
, 1.0.
!
,
,
TMTCO
376
1.
2.
Basili, V. R. and D. M. Weiss. (1984). "A Methodology for Collecting Valid Software Engi
neering Data." IEEE Transactions on Software Engineering, SE-10 (6).
3.
Beizer, Boris. (1995). Black-Box Testing: Techniques for Functional Testing of Software and Systems.
New York: Wiley.
4.
Belford, P. C, R. A. Berg, and T. L. Hannan. (1979). "Central Flow Control Software Devel
opment: A Case Study of the Effectiveness of Software Engineering Techniques," Proceed
ings from the Fourth Summer Software Engineering Workshop, SEL-79-005.
5.
Black, Rex. (1999). Managing the Test Process. Redford, WA: Microsoft Press.
6.
Boehm, Barry W. (1981). Software engineering economics. Englewood Cliffs, NJ: Prentice-Hall, Inc.
7.
Boehm, Barry W. (1988). "A spiral model for software development and enhancement."
IEEE Computer, 21(5) (May): 61-72.
8.
Boehm, Barry W. (1991). "Software risk management: Principles and practices." IEEE Soft
ware, 8(1) (January): 32-41.
9.
Boehm, Barry W. (2000). Software Cost Estimation with COCOMO II. Englewood Cliffs, NJ:
Prentice Hall.
10. Brooks, Fred. (1982). The Mythical Man-Month: Essays on Software Engineering. Reading, MA:
Addison-Wesley.
11. Burnstein, Ilene, C.R. Carlson, and T. Suwanassart. (1996). "Developing a Testing Maturity
Model." Proceeding of the Ninth International Software Quality Week Conference, San Francisco,
May, 1996. Note: Ilene Burnstein is affiliated with the Illinois Institute of Technology, where
work on the Testing Maturity Model is being conducted.
12. Cooley, J. W., and J. W. Tukey. (1965). "An Algorithm for Machine Calculation of Complex
Fourier Series." Mathematics of Computation, Vol. 19, pp. 297-301.
13. Curtis, Bill, Herb Krasner, Vincent Shen, and Neil Iscoe. (1987). "On building software
process models under the lamppost." Proceedings of the 9th International Conference on Software
Engineering (pp. 96-103). Monterey, CA: IEEE Computer Press Society.
14. DeMarco, Tom, and Timothy Lister. (1987). Peopleware: Productive Projects and Teams. New
York: Dorset House Publishing.
15. Dustin, Elfriede, Jeff Rashka, and J o h n Paul. (1999). Automated Software Testing: Introduction,
Management, and Performance. Reading, MA: Addison-Wesley.
16. Fagan, M.E. (1976). "Design and code inspections to reduce errors in program develop
ment." IBM Systems Journal, 15(3): 182-210.
17. Fewster, Mark, and Dorothy Graham. (1999). Software Test Automation. Reading, MA: Addi
son-Wesley.
18. Good, Donald I., R. M. Cohen, G. Hoch, L. W. Hunter, and D. F. Hare. (1978). "Certifi
able Minicomputer Project, ICSCA," Report on the Language Gypsy, Version 2.0. Technical
Report ICSCA-CMP-10, The University of Texas at Austin, September 1978.
19. Humphrey, Watts S. (1990). Managing the Software Process. Reading, MA: Addison-Wesley.
378
20. Humphrey, Watts S. (1997). Introduction to the Personal Software Process. Reading, MA: Addison-Wesley.
21. Humphrey, Watts S. (2000). Introduction to the Team Software Process. Reading.MA: AddisonWesley.
22. IEEE. (1983). IEEE Standard 829: IEEE Standard for Software Test Documentation. Los Alamitos,
CA: IEEE Computer Society Press.
23. IEEE. (1984). IEEE Standard 830: The IEEE Guide to Software Requirements Specifications. Los
Alamitos, CA: IEEE Computer Society Press.
24. IEEE. (1993). IEEE Standard 1044, IEEE Standard for Software Anomalies, 1993 IEEE, New
York, NY.
25. Jones, Capers. (1986). Programming Productivity. New York: McGraw-Hill.
26. Jones, Capers. (1997). Software Quality: Analysis and Guidelines for Success. Boston: Interna
tional Thompson Computer Press.
27. Kaner, Cem, Jack Falk, and Hung Quoc Nguyen. (1999). Testing Computer Software (2nd ed.).
New York: Wiley.
28. Kit, Edward. (1995). Software Testing in the Real World: Improving the Process. Reading, MA:
Addison-Wesley.
29. Koomen, Tim, and Martin Pol. (1999). Test Process Improvement. Reading, MA: AddisonWesley.
30. Lewis, William E. (2000). Software Testing and Continuous Quality Improvement. Boca Raton,
FL: Auerbach.
31. McCabe, Thomas J. (1976). "A Complexity Measure." IEEE Transactions on Software Engineering.
32. McCabe, Thomas, and Charles W. Butler. (1989). "Design Complexity Measurement and
Testing." Communications of the ACM 32, 12 (December 1989): 1415-1425.
33. McConnell, Steve. (1996). Rapid Development: Taming Wild Software Schedules. Redmond, WA:
Microsoft Press.
34. Michael Fagan. (1976). "Design and Code Inspections to Reduce Errors in Program Devel
opment," IBM Systems Journal, 15 (), 182-211.
35. Musa, J o h n D. (1993). "Operational Profiles in Software-Reliability Engineering." IEEE Soft
ware, 14-19.
36. Myers, Glen. (1979). The Art of Software Testing. New York: Wiley.
37. Myers, GlenfordJ. (1977). "An Extension to the Cyclomatic Measure of Program Complex
ity." SIGPLAN Notices.
38. Paulk, Mark, Charles Weber, and Bill Curtis. (1995). The Capability Maturity Model: Guidelines
for Improving the Software Process. Reading, MA: Addison-Wesley.
39. Paulk, Mark. "Using the Software CMM with Small Projects and Small Organizations." In
Eugene McGuire (1999), Software Process Improvement: Concepts and Practices. Hershey, PA:
Idea Group Publishing.
40. Perry, William E. (2000). Effective Methods for Software Testing(2nd ed.). New York: Wiley.
41. Perry, William E., and Randall W. Rice. (1997). Surviving the Top Ten Challenges of Software
Testing. New York: Dorset House Publishing.
42. Pfleeger, Shari Lawrence. (2001). Software Engineering: Theory and Practice (2nd ed.). Upper
Saddle River, NJ: Prentice Hall.
379
43. Pressman, Roger. (1997). Software Engineering: A Practitioner's Approach (4th ed.). New York:
McGraw-Hill.
44. Robertson, Suzanne, and James Robertson. (1999). Mastering the Requirements Process. Read
ing, MA: Addison-Wesley.
45. Schulmeyer, G. Gordon and Garth R. Mackenzie. (2000). Verification and Validation of Modern
Software-Intensive Systems. Upper Saddle River, NJ: Prentice Hall.
46. Software Productivity Consortium (1993). Software Error Estimation Program (SWEEP)
User Manual, (SPC-92017-CMC), Version 02.00.10.
47. Sommerville, Ian. (1992). Software Engineering (4th ed.). Reading, MA: Addison-Wesley.
48. The Standish Group. (1994). The CHAOS Report. Dennis, MA: The Standish Group.
49. The Standish Group. (1995). The Scope of Software Development Project Failures. Dennis, MA:
The Standish Group.
50. van Soligen, Rini, and Egon Berghout. (1999). The Goal/Question/Metric Method: A practical
guide for quality improvement of software development. Berkshire, England: McGraw-Hill Book
Company, UK.
51. p. 5 From Verification and Validation of Modern Software-Intensive Systems by Schulmeyer 8c
MacKenzie. 2000. Reprinted by permission of Pearson Education, Inc., Upper Saddle
River, NJ.
52. pp. 6~7, 73 From Rapid Development: Taming Wild Software Schedules by Steve McConnell.
Copyright 1996. Reproduced by permission of Microsoft Press. All rights reserved.
53. pp. 10, 40 From Software Engineering: Theory and Practice, 2nd ed., by S. Pfleeger. 2001. Ma
terial is reprinted by permission of Pearson Education, Inc.
54. pp. 25, 66, 134, 139 From Software Engineering Economics by Boehm, B.W. 1981. Reprinted
by permission of Pearson Education, Inc., Upper Saddle River, NJ.
55. p. 28 From Software Engineering: A Practitioner's Approach, 4th ed., by R. Pressman. 1997
McGraw-Hill, Inc.
56. p. 31 Information regarding the content and format of requirements documents is re
printed with permission from IEEE Std. 830-1993: The IEEE Guide to Software Requirements
Specifications. Copyright 1993 by IEEE.
57. p. 36 From Software Testing in the Real World: Improving the Process, by E. Kit. 1995 AddisonWesley, Inc.
58. p. 55 From Automated Software Testing (pp. 32-38) by E. Dustin, J. Rashka, &J. Paul. 1999
Addison Wesley Longman, Inc. Reprinted by permission of Pearson Education, Inc.
59. p. 61 Material excerpted from Managing the Test Process by permission of the author, Rex
Black; second edition in press by John Wiley & Sons, Inc., ISBN 0-471-22398-0.
60. p. 70 From The Mythical Man-Month (p. 18) by F. Brooks, Jr. 1999 Addison Wesley Long
man, Inc. Reprinted by permission of Pearson Education, Inc.
61. pp. 77, SO Information regarding the content and format of test documents is reprinted with
permission from IEEE Std. 829-1983: IEEE Standard for Software Test Documentation. Copy
right 1983 by IEEE.
62. pp. 214-215 Information regarding defect reporting is reprinted with permission from
IEEE Std. 1044-1993: IEEE Standardfor Software Anomalies, Copyright 1993 by IEEE.