Professional Documents
Culture Documents
0DQXDODQG$XWRPDWHG3HQHWUDWLRQ7HVWLQJ
%HQHILWVDQG'UDZEDFNV0RGHUQ7HQGHQF\
<DURVODY6WHILQNR$QGULDQ3LVNR]XE5RPDQ%DQDNK
Abstract ,QWKLVSDSHUZHGHVFULEHSHQHWUDWLRQWHVWLQJ FRQVLGHUHGFRQILGHQWLDODQGVKDOOQRWEHGLVFORVHGXQWLO
DV D PHWKRGRORJ\ IRU LQIRUPDWLRQ VHFXULW\ 3HQWHVWLQJ LV FRPSOHWHUHVROXWLRQRIGHIHFWV>@
XVHG IRU SURDFWLYH GHIHQFH DQG LQIRUPDWLRQ V\VWHPV 3HQHWUDWLRQ WHVWHUV DWWDFN V\VWHPV WR HYDOXDWH WKHLU
SURWHFWLRQ 6SHFLDO RSHUDWLRQDO V\VWHPV RQ 81,; FRUH VHFXULW\ LQ WKH IDFH RI UHDOLVWLF WKUHDWV 7KHVH DWWDFNV
GHYHORSHG VFULSWV XWLOLWLHV DQG DSSOLFDWLRQV DUH VXJJHVWHG
WDNHWKHIRUPRIDXWKRULVHGSHQHWUDWLRQWHVWVWKDWSUREHD
0RVWSURV DQGFRQVRIPDQXDODQGDXWRPDWHGSHQWHVWDUH
JLYHQ V\VWHP
V GHIHQFHV WKHVH GHIHQFHV DUH WKHQ EUHDFKHG WR
Keywords 3HQHWUDWLRQ 7HVWLQJ ,QIRUPDWLRQ 6HFXULW\ HYDOXDWH WKH LPSDFW RI DQ\ ZHDNQHVVHV WKH UHVXOWV RI
3URDFWLYH'HIHQFH(WKLFDO+DFNHU([SORLWDWLRQ+DFNLQJ WKHVH WHVWV DUH XVHG WR LPSURYH D V\VWHP
V VHFXULW\
'DWD%UHDFK&\EHU$WWDFN0HWDVSORLW3\WKRQ PDNLQJWKHPUHVLOLHQWWRIXUWKHUDWWDFNV
, ,1752'8&7,21
&\EHUDWWDFNVKDYHEHFRPHRQHRIWKHJUHDWHVWWKUHDWV
WR WKH ZRUOG RI EXVLQHVV DQG HFRQRPLFV $PRXQW RI
GDPDJH KDV EHHQ JURZLQJ HYHU\ GD\ DQG PRUH
FRPSDQLHV RU LQVWLWXWLRQV KDYH EHFRPH YLFWLPV RI
DWWDFNVRUGDWDEUHDFKSHUIRUPHGE\EODFNKDWV+HQFH
FRPSDQLHV DUH ORRNLQJ IRU EHVW ZD\ WR SURWHFW WKHLU
V\VWHPVDQGHVVHQWLDOLQIRUPDWLRQ0RVWSRSXODUZD\LV
WRSUREHWKHLUV\VWHPVYLDSHQHWUDWLRQWHVWVE\FHUWLILHG
HWKLFDO WHDPV ZKLFK FDQ SURDFWLYHO\ GHIHQG FRPSXWHU
V\VWHPV
3HQHWUDWLRQ WHVW LV D VHFXULW\ HYDOXDWLRQ SURFHVV IRU )LJ$PRXQWRIPRQHWDU\GDPDJHFDXVHGE\UHSRUWHG
QHWZRUN RU FRPSXWHU V\VWHPV WKDW VLPXODWHV DQ DWWDFN F\EHUFULPHWRWKH)%,,&6IURPWRPOQ86
E\ DQ HWKLFDO KDFNHU SHQWHVWHU 7KH WHVWLQJ SURFHVV GROODUV6RXUFH VWDWLVWDFRP
XVXDOO\LQYROYHVVLPXODWLQJGLIIHUHQWW\SHVRIDWWDFNVRQ 7KHLPSDFWRIWKHVHDWWDFNVFDQDIIHFWWKHFRPSDQ\LQ
WKH WDUJHW V\VWHP 7KLV W\SH RI WHVWLQJ SURYLGHV DQ PDQ\ZD\VVXFKDVGDWDORVVGHQLDORIVHUYLFHOLDELOLW\
RUJDQL]HG DQG FRQWUROOHG ZD\ WR LGHQWLI\ VHFXULW\ FODLPV DQG ORVV RI SURGXFWLYLW\ 7KH VHULRXV QDWXUH RI
VKRUWFRPLQJV 7KH UHVRXUFHV DQG WLPH UHTXLUHG IRU WKH LPSDFWV KDV UHVXOWHG LQ WKH JURZWK RI DQ HQWLUH
FRPSUHKHQVLYHWHVWLQJFDQPDNHSHQHWUDWLRQWHVWLQJFRVW LQGXVWU\ ZKLFK DGGUHVVHV WKHVH VHFXULW\ LVVXHV >@
LQWHQVLYH &RQVHTXHQWO\ VXFK WHVWV DUH XVXDOO\ RQO\ 1HWZRUN ILUHZDOOV DQG YXOQHUDELOLW\ VFDQQHUV DUH WZR
SHUIRUPHGGXULQJLPSRUWDQWPLOHVWRQHV W\SHV RI FRPPRQ VHFXULW\ VROXWLRQV DYDLODEOH WRGD\
7KH PRVW LPSRUWDQW GLVWLQFWLRQ EHWZHHQ D KDFNHU 7KHVH VROXWLRQV DGGUHVV VSHFLILF FRQFHUQV D ILUHZDOO
VHWXS ZLOO SUHYHQW DQ XQDXWKRUL]HG DFFHVV LQWR WKH
DQG D SHQHWUDWLRQ WHVWHU LV WKDWSHQHWUDWLRQ WHVW LV
GRQHZLWKDOLFHQVHDQGDVLJQHGFRQWUDFWZLWKDQ V\VWHP ZKHUHDV YXOQHUDELOLW\ VFDQQHUV ZLOO VSRW WKH
RUJDQL]DWLRQRUFRPSDQ\DQGWKHRXWSXWLVSURYLGHG SRWHQWLDO YXOQHUDELOLWLHV LQ WKH V\VWHP +RZHYHU WKHVH
DV D UHSRUW 6XFK WHVWV PD\ EH OHJDO LI WKH H[ILOWUDWHGWRROVFDQQRWHQVXUHWKHLGHQWLILFDWLRQRIDOOWKHGLIIHUHQW
GDWD ZDV QRW SHUVRQDO EXW WKLV OHJDOLW\ PD\ EH PRGHV RI DWWDFNV 3HQHWUDWLRQ WHVWLQJ LV DQ LPSRUWDQW
TXHVWLRQDEOH GHSHQGLQJ RQ WKH OHJDO MXULVGLFWLRQ ZKHUH DGGLWLRQDO WRRO IRU DGGUHVVLQJ WKH FRPPRQ VHFXULW\
WKH WHVW WDNHV SODFH 6RPH ZRUGV DERXW HWKLFV ZH ZLOO LVVXHV$SHQHWUDWLRQWHVWQRWRQO\LGHQWLILHVWKHH[LVWLQJ
GLVFXVVDVZHOOLQQH[WVHFWLRQV YXOQHUDELOLWLHV EXW DOVR H[SORLWV WKHP 7KH JRDO RI
SHQHWUDWLRQWHVWLQJLVWRLPSURYHRUDXJPHQWWKHVHFXULW\
,, 3(17(67,1*%$&.*5281' SRVWXUHRIDQHWZRUNRUDV\VWHP>@+DFNLQJDV\VWHP
3HQWHVWLQJ LV XVHG WR VHDUFK IRU YXOQHUDELOLWLHV WKDW UHTXLUHVWHFKQLFDOSURZHVVFUHDWLYLW\DQGLQJHQXLW\
PLJKWH[LVWLQ D V\VWHP 7KHJRDORISHQHWUDWLRQWHVWLV WR ILQG XQH[SHFWHG ZD\V RI DSSURSULDWLQJ LW >@
WR LQFUHDVH GDWD VHFXULW\ 6HFXULW\ LQIRUPDWLRQ DQG 3HQHWUDWLRQ WHVWLQJ UHTXLUHV DOO RI WKLV ZLWK WKH
ZHDNQHVVHV WKDW DUH VSHFLILHG LQ SHQHWUDWLRQ WHVW DUH DGGHG FRQVWUDLQW WKDW ILQGLQJ DQG H[SORLWLQJ
<DURVODY6WHILQNR$QGULDQ3LVNR]XE5RPDQ%DQDNK
YXOQHUDELOLWLHV VKRXOG QHLWKHU KDUP WKH V\VWHP QRU
/YLY 3RO\WHFKQLF 1DWLRQDO 8QLYHUVLW\ 6%DQGHU\ 6WU HQFURDFKRQWKHGLJQLW\RIWKRVHDIIHFWHGE\LW
/YLY 8.5$,1( (PDLO MDULNELW#JPDLOFRP 3HQHWUDWLRQWHVWLQJLVSHUIRUPHGE\FRPSURPLVLQJWKH
SLVNR]XE#SRO\QHWOYLYXD EDQDNKUL#JPDLOFRP VHUYHUVZLUHOHVVQHWZRUNVZHEDSSOLFDWLRQVDQGRWKHU
7&6(7
)HEUXDU\/YLY6ODYVNH8NUDLQH
SRWHQWLDO SRLQWV RI H[SRVXUH WR LGHQWLI\ DQG DQDO\VH UHSUHVHQWDWLYH EHIRUH WKH SHQHWUDWLRQ WHVW LV VWDUWHG
VHFXULW\ LVVXHV >@ 7KLV HQDEOHV IRRO SURRILQJ DJDLQVW )ROORZLQJDUHLPSRUWDQWUHTXLUHPHQWVWKDWDUHSUHVHQWLQ
WKHVHLVVXHVWRSUHYHQWIXWXUHDWWDFNV3HQHWUDWLRQWHVWLQJ DOPRVWHYHU\52(
FDQ EH FRQGXFWHG HLWKHU PDQXDOO\ RU WKURXJK DQ $ SURSHU SHUPLVVLRQ WR KDFN 52( DQG D
DXWRPDWHGSURJUDP QRQGLVFORVXUH1'$DJUHHPHQWVKRXOGEHVLJQHG
7KHUH DUH QXPHURXV EHQHILWV RI SHQHWUDWLRQ WHVWLQJ E\ERWKWKHSDUWLHV
IURP WKH EXVLQHVV DV ZHOO DV WHFKQLFDO SHUVSHFWLYH 7KH VFRSH RI WKH HQJDJHPHQW DQG ZKDW SDUW RI WKH
6RPH RI WKH SULQFLSDO UHDVRQV IRU DGRSWLQJ SHQHWUDWLRQ RUJDQL]DWLRQPXVWEHWHVWHG
WHVWLQJDUHSUHVHQWHGEHORZ 7KHSURMHFWGXUDWLRQLQFOXGLQJERWKWKHVWDUWDQGWKH
6HFXULW\,VVXHV HQGGDWH
6HFXULW\ LVVXHV VXFK DV PDOZDUH DWWDFNV QHWZRUN 7KH PHWKRGRORJ\ WR EH XVHG IRU FRQGXFWLQJ D
LQWUXVLRQ DQG GDWD WKHIW FDQ UHVXOW LQ VHUYLFH SHQHWUDWLRQWHVW
LQWHUUXSWLRQDQGXQUHOLDEOHV\VWHPSURFHVVHV7KLVFRXOG 7KHJRDOVRIDSHQHWUDWLRQWHVW
OHDGWRSRWHQWLDOORVVRIFXVWRPHUOR\DOW\DQGDIIHFWWKH 7KH DOORZHG DQG GLVDOORZHG WHFKQLTXHV ZKHWKHU
FRPSDQ\V PDUNHW YDOXH 3HQHWUDWLRQ WHVWLQJ FDQ ZRUN GHQLDORIVHUYLFHWHVWLQJVKRXOGEHSHUIRUPHGRUQRW
WRDYRLGVXFKRFFXUUHQFHVE\ZHHGLQJRXWSHUVLVWHQWDV 7KH OLDELOLWLHV DQG UHVSRQVLELOLWLHV ZKLFK DUH
ZHOODVXQH[SHFWHGWKUHDWV GHFLGHG DKHDG RI WLPH $V D SHQHWUDWLRQ WHVWHU \RX
3URWHFW,QIRUPDWLRQ PLJKW EUHDN LQWR VRPHWKLQJ WKDW VKRXOG QRW EH
&RPSDQLHV XVH GLIIHUHQW VHFXULW\ PHFKDQLVPV WR DFFHVVLEOH FDXVLQJ D GHQLDO RI VHUYLFH DOVR \RX
VDIHJXDUG LQIRUPDWLRQ OLNH DFFHVV FRQWURO PHWKRGV PLJKW DFFHVV VHQVLWLYH LQIRUPDWLRQ VXFK DV FUHGLW
ILUHZDOOV FU\SWRJUDSK\ LQWUXVLRQ GHWHFWLRQ V\VWHPV FDUGV 7KHUHIRUH WKH OLDELOLWLHV VKRXOG EH GHILQHG
HWF >@ +RZHYHU ZLWK QHZ DWWDFNV EHLQJ GLVFRYHUHG SULRUWRWKHHQJDJHPHQW
HYHU\GD\ LW LV GLIILFXOW WR SURWHFW XVHUV\VWHP ,I\RXQHHGDPRUHWKRURXJKGRFXPHQWDWLRQUHIHUWR
LQIRUPDWLRQ FRQVWDQWO\ 3HQHWUDWLRQ WHVWLQJ FRXOG WKH37(63UHHQJDJHPHQWZKLWHSDSHU>@
DGGUHVV WKHVH FRQFHUQV E\ VLPXODWLQJ D YDULHW\ RI 0RVW ILQDQFLDO RUJDQL]DWLRQV ZRXOG OLNH WR EH
DWWDFNVVLPXOWDQHRXVO\ FRPSOLDQW WR ZRUOG LQIRUPDWLRQ VHFXULW\ UHTXLUHPHQWV
3ULRULWL]HVHFXULW\ULVNV ZKLFKDUHGHVFULEHGLQ7KH3D\PHQW&DUG,QGXVWU\'DWD
7KH XVH RI SHQHWUDWLRQ WHVWLQJ DV D VWDQGDUG VHFXULW\ 6HFXULW\ 6WDQGDUGQ3&, '66 DQG 7KH 8QLILHG
SUDFWLFH QRW RQO\ KHOSV XQGHUVWDQG WKH VHFXULW\ LVVXHV &RPSOLDQFH IUDPHZRUN 8)& VWDQGDUGV 8)&
EXW LW FDQ DOVR KHOS SULRULWL]H WKHVH LVVXHV 7KH LVVXHV FRQWDLQV WKH IROORZLQJ JHQHUDO UHIHUHQFH WR SHQHWUDWLRQ
LGHQWLILHG GXULQJ WKH WHVWLQJ FDQ EH SULRULWL]HG RQ WKH WHVWLQJ 8QLILHG &RPSOLDQFH 7KH RUJDQL]DWLRQ
EDVLVRIVHYHULW\$OVRWKHVHHIIRUWVFDQOHDGWRHIILFLHQW ZLOO SHUIRUP SHQHWUDWLRQ WHVWLQJ RQ DOO GHILQHG PDMRU
EXGJHWDOORFDWLRQIRULQIRUPDWLRQVHFXULW\LVVXHV JHQHUDO VXSSRUW DQG NH\ PLQRU DSSOLFDWLRQ V\VWHPV DW
)LQDQFLDO/RVV OHDVW\HDUO\RUDIWHUDQ\PDWHULDOFKDQJHV
3HQHWUDWLRQ WHVWLQJ KHOSV WR PLWLJDWH WKH ORVV RI 7KHUHLVDOVRVSHFLILFLQGXVWU\JXLGDQFH)RUH[DPSOH
UHYHQXHVFDSLWDO GXH WR VHUYLFH GRZQWLPH DULVLQJ IURP WKH 3D\PHQW &DUG ,QGXVWU\ 'DWD 6HFXULW\ 6WDQGDUG
PDOLFLRXV DWWDFNV ,W FDQ DOVR SUHYHQW RU UHGXFH FRQWDLQV WKH IROORZLQJ UHIHUHQFH WR SHQHWUDWLRQ WHVWLQJ
ILQHVODZVXLWVUHVXOWLQJIURPVHFXULW\PDOSUDFWLFHV >@ 2QFH WKH WKUHDWV DQG YXOQHUDELOLWLHV KDYH EHHQ
7UDGLWLRQDOO\ SHQWHVWLQJ VKRXOG EH LQFOXGHG DV D HYDOXDWHG GHVLJQ WKH WHVWLQJ WR DGGUHVV WKH ULVNV
VWDQGDUG SURFHVV ZLWKLQ WKH VHFXULW\ WHVWLQJ URDGPDS LGHQWLILHG WKURXJKRXW WKH HQYLURQPHQW 7KH SHQHWUDWLRQ
2UJDQL]DWLRQV SUHIHU WR SHUIRUP SHQHWUDWLRQ WHVWLQJ WHVWVKRXOGEHDSSURSULDWHIRUWKHFRPSOH[LW\DQGVL]HRI
SULRUWRDSURGXFWUHOHDVHRUDPDMRUXSJUDGH+RZHYHU DQ RUJDQL]DWLRQ $QRWKHU VHFWLRQ RI 3&, VWDQGDUG
LW LV DOVR DGYLVDEOH WR FRQGXFW WKLV WHVWLQJ LQ WKH UHIHUHQFHVWKDWWKHJRDORIWKHSHQHWUDWLRQWHVWLVWRJDLQ
IROORZLQJVLWXDWLRQV DFFHVV 3&, 7KH JRDO RI SHQHWUDWLRQ WHVWLQJ LV
1HZLQIUDVWUXFWXUHLVDGGHG WRGHWHUPLQHLIXQDXWKRUL]HGDFFHVVWRNH\V\VWHPVDQG
6RIWZDUHLVLQVWDOOHG ILOHVFDQEHDFKLHYHG>@
6\VWHPXSGDWHVDUHDSSOLHG )URP WKH PHWKRGRORJ\ VLGH WKHUH DUH SXEOLF WHVWLQJ
6HFXULW\SDWFKHVDUHDSSOLHG PHWKRGRORJLHVWKDWDUHDYDLODEOH9DULRXVRUJDQL]DWLRQV
8VHUSROLFLHVDUHPRGLILHG KDYH SXEOLVKHG IUHH IUDPHZRUNV WKDW ZLOO IDFLOLWDWH
5XOHVRI(QJDJHPHQW VXFFHVVIXOLQKRXVHSHQHWUDWLRQWHVWLQJ
(YHU\ SHQHWUDWLRQ WHVW \RX GR ZRXOG FRPSULVH RI D 7KH 2SHQ 6RXUFH 6HFXULW\ 7HVWLQJ 0HWKRGRORJ\
UXOHV RI HQJDJHPHQW ZKLFK EDVLFDOO\ GHILQHV KRZ D 0DQXDO 266700 FXUUHQWO\ YHUVLRQ DQG YHUVLRQ
SHQHWUDWLRQ WHVW ZRXOG EH ODLG RXW ZKDW PHWKRGRORJ\ /LWHDUHIUHH
ZRXOG EH XVHG WKH VWDUW DQG HQG GDWHV WKH PLOHVWRQHV 2SHQ :HE $SSOLFDWLRQ 6HFXULW\ 3URMHFW 2:$63
WKH JRDOV RI WKH SHQHWUDWLRQ WHVW WKH OLDELOLWLHV DQG 7HVWLQJ*XLGH
UHVSRQVLELOLWLHV HWF $OO RI WKHP KDYH WR EH PXWXDOO\ 1,67 6SHFLDO 3XEOLFDWLRQ *XLGHOLQH WR
DJUHHG XSRQ E\ ERWK WKH FXVWRPHU DQG WKH 1HWZRUN6HFXULW\7HVWLQJ
7&6(7
)HEUXDU\/YLY6ODYVNH8NUDLQH
7&6(7
)HEUXDU\/YLY6ODYVNH8NUDLQH
7&6(7
)HEUXDU\/YLY6ODYVNH8NUDLQH