E\ :HL*DR
$0DVWHU·VSDSHUVXEPLWWHGWRWKHIDFXOW\RI WKH6FKRRORI,QIRUPDWLRQDQG/LEUDU\6FLHQFH RIWKH8QLYHUVLW\RI1RUWK&DUROLQDDW&KDSHO+LOO
LQSDUWLDOIXOILOOPHQWRIWKHUHTXLUHPHQWV IRUWKHGHJUHHRI0DVWHURI6FLHQFHLQ
,QIRUPDWLRQ6FLHQFH
&KDSHO+LOO1RUWK&DUROLQD
$SULO
$SSURYHGE\
BBBBBBBBBBBBBBBBBBBBBBBBBBBBB
:HL*DR3HUIRUPDQFH$QDO\VLVRI5V\QF$0DVWHU·VSDSHUIRUWKH06LQ,6
GHJUHH$SULOSDJHV$GYLVRU%HUW-'HPSVH\
7KLVSDSHUVWXGLHVWKHSHUIRUPDQFHRIUV\QFDPRGLILFDWLRQWRSRSXODUPLUURULQJ WRROUV\QFRQWZRNH\SDUDPHWHUV$VDVXEVHTXHQWVWXG\RIWKH,'6,SURMHFWD VHWRIH[SHULPHQWVZDVGHVLJQHGWRLVRODWHWZRNH\SDUDPHWHUVIURPRWKHU
SDUDPHWHUV7KHH[SHULPHQWVZHUHFRQGXFWHGRQQFQLGVLQHWDQGWKHUHVXOWVZHUH DQDO\]HGWRREVHUYHWKHSHUIRUPDQFHRIUV\QF
7KLVSDSHULGHQWLILHVWKHUHODWLRQVKLSRIUV\QFUXQWLPHDQGWKHWZRNH\ SDUDPHWHUV7KHFRQFOXVLRQLVTXDQWLILHGXVLQJWKHH[SHULPHQWGDWD7KH LUUHJXODULW\LVUHFRUGHGDQGVHYHUDOSRVVLEOHUHDVRQVDUHGLVFXVVHG
+HDGLQJV
&ROOHJHDQGXQLYHUVLW\OLEUDULHV5HIHUHQFHVHUYLFHV 5HIHUHQFHVHUYLFHV1RUWK&DUROLQD
5HIHUHQFHVHUYLFHV6WDWLVWLFV
,QWURGXFWLRQ
7KHFRQWH[WRIP\ZRUNLVWKH,QWHUQHW'LVWULEXWHG6WRUDJH,QLWLDWLYH,'6,SURMHFW ZKLFKLVGHYHORSLQJUHSOLFDWLRQPLGGOHZDUHWRH[WHQGVRXUFHREMHFWUHSOLFDWLRQWRORRVHO\ FRXSOHGKHWHURJHQHRXVSODWIRUPV7KHSDUWLFLSDWLQJFRQWHQWFKDQQHOVDUHUHSOLFDWHGDFURVV DGLVWULEXWHGLQIUDVWUXFWXUHFRQVLVWLQJRIVHUYHUVZLWKVXEVWDQWLDOSURFHVVRUDQGVWRUDJH UHVRXUFHV(DFKXVHU·VUHTXHVWLVGLUHFWHGWRWKHVHUYHUFORVHVWWRWKHUHTXHVWLQJFOLHQWLQ QHWZRUNLQJWHUPV7KHUHVXOWLVWKDWQHWZRUNWUDIILFLVNHSWORFDODQGWKHORDGLVEDODQFHG DPRQJWKHGLVWULEXWHGVHUYHUV,'6,LVDQDFWLYHUHVHDUFKDUHDZLWKPDQ\SURMHFWVDQG HYHQWVJRLQJRQ
3URIHVVRU%HUW-'HPSVH\DW6FKRRORI,QIRUPDWLRQDQG/LEUDU\6FLHQFHDW8QLYHUVLW\RI 1RUWK&DUROLQDDW&KDSHO+LOOKDVGRQHVRPHUHVHDUFKUHODWHGWR,'6,DQGGHYHORSHGD VFDOHDEOHGHVLJQIRUWKHDXWRPDWHGV\QFKURQL]DWLRQRIODUJHFROOHFWLRQVRIILOHVUHSOLFDWHG DFURVVPXOWLSOHKRVWV+HXVHGUV\QFDPRGLILFDWLRQRIWKHSRSXODURSHQVRXUFHPLUURULQJ WRROUV\QFWRDFKLHYHDV\QFKURQRXVXSGDWHV1HZPRGHVRIRSHUDWLRQZHUHDGGHGWRHQDEOH HIILFLHQWPXOWLSOHVLWHV\QFKURQL]DWLRQ%\H[DPLQLQJERWKWKHVHUYHUWKURXJKSXWDQG QHWZRUNWKURXJKSXW3URIHVVRU'HPSVH\FRQILUPVWKHYDOLGLW\RIKLVVFDODELOLW\DUJXPHQWV IRUWKHGHVLJQDQGLQGLFDWHVWKHOLPLWDWLRQVRI7&3RQO\WUDQVSRUWVROXWLRQVDVWKHQXPEHU RIPLUURUVLWHVJURZV+LVH[SHULPHQWVZHUHLPSOHPHQWHGE\FUHDWLQJDPLUURUVLWHRI PHWDODEXQFHGXZKLFKFRQWDLQVRYHUJLJDE\WHVRI/LQX[UHODWHGILOHV,QRUGHUWREHWWHU XQGHUVWDQGWKHSHUIRUPDQFHRIUV\QFLWLVSUHIHUDEOHQRWWRXVHUHDOZRUOGGDWDWRWHVWWKH VFDODELOLW\RIUV\QFEHFDXVHWKHNH\SDUDPHWHUVHLWKHUGLGQRWFKDQJHRUFKDQJHGLQDQ XQV\VWHPDWLFZD\GXULQJWKHH[SHULPHQWV
/LWHUDWXUH5HYLHZ
&RQWHQWUHSOLFDWLRQLVXVHGH[WHQVLYHO\WRGD\EHFDXVHWKHUHDUHPRUHDQGPRUHFOLHQWVHUYHU DSSOLFDWLRQV RQ WKH ,QWHUQHW DQG WKH FOLHQWV DQG VHUYHUV DUH RIWHQ ZLGHO\ GLVWULEXWHG JHRJUDSKLFDOO\2QHDSSURDFKLQYROYHVFDFKLQJIUHTXHQWO\QHHGHGVHUYHUGDWDLQDSUR[\ VHUYHUZKLOHDQRWKHUDSSURDFKLVWRPLUURUWKHVRXUFHFRQWHQWVDFURVVVHUYHUSODWIRUPV
%RWKLQGLYLGXDOVDQGLQVWLWXWLRQVKDYHSXEOLVKHGDORWRIPLUURULQJWRROVWRVHUYH)73DQG +773 UHTXHVWV 0RVW WRROV DUH RSHQ VRXUFH VRIWZDUH DQG FDQ EH GRZQORDGHG IRU IUHH 0LUURU LV D SDFNDJH ZULWWHQ LQ 3HUO WKDW XVHV WKH )73 SURWRFRO WR GXSOLFDWH D GLUHFWRU\ KLHUDUFK\ EHWZHHQ WKH PDFKLQH LW LV UXQ RQ DQG D UHPRWH KRVW ,W DYRLGV FRS\LQJ ILOHV XQQHFHVVDULO\E\FRPSDULQJWKHILOHWLPHVWDPSVDQGILOHVL]HVEHIRUHWUDQVIHUULQJ$PRQJVW RWKHUWKLQJVLWFDQRSWLRQDOO\UHQDPHFRPSUHVVJ]LSDQGVSOLWILOHV,WLVQRZDYDLODEOHRQ 8QL[:LQGRZVDQG:LQGRZ17
5V\QFLVDQRWKHUSRSXODUGDWDPLUURULQJWRROZKLFKLVGHYHORSHGE\$QGUHZ7ULGJH7KH UV\QFDOJRULWKPSURYLGHVDYHU\IDVWPHWKRGIRUEULQJLQJUHPRWHILOHVLQWRV\QFKURQL]DWLRQ 7KLVLVDFKLHYHGE\VHQGLQJRQO\WKHGLIIHUHQFHVLQWKHILOHVDFURVVWKHQHWZRUNZLWKRXW UHTXLULQJWKDWERWKVHWVRIILOHVDUHSUHVHQWDWRQHRIWKHHQGVRIWKHOLQNEHIRUHKDQG5V\QF FDQSURYLGHDXWRPDWHGV\QFKURQL]DWLRQRIILOHWUHHVRQWKHVDPHPDFKLQHVRURQPDFKLQHV DFURVVWKH,QWHUQHW6HQGLQJRQO\DFWXDOFKDQJHGSLHFHVRIILOHVTXLFNHQVXSGDWHHVSHFLDOO\ RYHUVORZOLQNV7KHGLIIHUHQFHVDUHFRPSUHVVHGDQGFDQEHWUDQVIHUUHGXVLQJUVKRUVVKIRU DGGHGVHFXULW\5V\QFLVDYHU\IOH[LEOHPLUURULQJWRRORIIHULQJPDQ\IHDWXUHVDQGRSWLRQVWR FRQWUROWKHXSGDWHSURFHVV
5V\QFDPRGLILFDWLRQWRUV\QFZDVGHYHORSHGDWWKH8QLYHUVLW\RI1RUWK&DUROLQDIRUWKH ,'6,3URMHFW,WOHYHUDJHVWKHSRZHUDQGIOH[LELOLW\RIUV\QFDQGLVXVHGDVDOLJKWZHLJKW UHSOLFDWLRQPHFKDQLVPIRU,'6,FRQWHQWFKDQQHOV7KHUV\QFVRXUFHFRGHZDVPRGLILHGWR SURYLGH HIILFLHQW PXOWLSOHVLWH V\QFKURQL]DWLRQ 2SWLRQV DGGHG LQUV\QF WK H ²I DQG ²) IODJVHQDEOHWKHHQGWRHQGXSGDWHSURFHVVWREHGLYLGHGLQWRWKUHHLQGHSHQGHQWDFWLRQV
WKHJHQHUDWLRQRIUHSOLFDXSGDWHLQIRUPDWLRQDWWKHPDVWHUVLWH
WKHSURFHVVLQJRIWKHXSGDWHLQIRUPDWLRQDWHDFKVODYHVLWHLQRUGHUWRV\QFKURQL]H WKHVODYHILOHVZLWKWKRVHDWWKHPDVWHU
7KH NH\ IHDWXUH RIUV\QF LV WKDW LW GHFRXSOHV QHWZRUN FRPPXQLFDWLRQ IURP ILOH V\VWHP XSGDWH DFWLRQV 7KLV GHFRXSOLQJ HOLPLQDWHV UHGXQGDQW SURFHVVLQJ DW WKH PDVWHU VLWH DQG HQDEOHVWKHXVHRISDUDOOHOQHWZRUNFRQQHFWLRQVRUWKHPXOWLSOHVODYHVLWHVUHVXOWLQJLQD VFDOHDEOHDSSURDFKWRPXOWLSOHVLWHILOHV\QFKURQL]DWLRQ
([SHULPHQW'HVLJQ
7KHJRDORIWKHH[SHULPHQWLVWRLGHQWLI\WKHSHUIRUPDQFHRIUV\QFZKLFKFDQEHDIIHFWHG E\DYDULHW\RIIDFWRUV,QDUHDOZRUOGVLWXDWLRQWKRVHIDFWRUVHLWKHUUHPDLQXQFKDQJHGRU FKDQJH LQ DQ XQV\VWHPDWLF ZD\ VR WKDW LW LV YHU\ GLIILFXOW WR UHODWH WKH SHUIRUPDQFH WR FHUWDLQFLUFXPVWDQFHV7KHUHIRUHLQRUGHUWRREVHUYHWKHSHUIRUPDQFHRIUV\QFZHQHHG WRLGHQWLI\VRPHNH\SDUDPHWHUVDQGLVRODWHWKHPIURPRWKHUSDUDPHWHUV
7DEOH$3DUDPHWHUVXVHGIRUWKHH[SHULPHQW
1 0 'LUQXPEHU 'LUGHSWK )LOHVFKDQJHG
7KHH[SHULPHQWVDUHGRQHRQWKHPDFKLQHRIWKH1RUWK&DUROLQD1HWZRUNLQJ,QLWLDWLYHIRU '6, 3URMHFW GVLQFQLQHW , FUHDWHG WKUHH GLUHFWRULHV IRU WKLV H[SHULPHQW ² VUF IRU WKH VRXUFHGLUHFWRU\VUF0DVWHUIRUWKHPDVWHUGLUHFWRU\DQGVUF6ODYHIRUWKHVODYHGLUHFWRU\ )LUVWWKHFRQWHQWVRIVUFDUHFRSLHGWRVUF0DVWHUDQGVUF6ODYH7KHQDIWHUXSGDWLQJWKH FRQWHQWVRIVUF0DVWHU,UDQUV\QF²)WRV\QFKURQL]HVUF6ODYHZLWKVUF0DVWHU
)RUWKHGXUDWLRQRIWKHH[SHULPHQWGD\VIURP-DQXDU\UGWRWKDVHWRIWZHQW\IRXU XSGDWHRSHUDWLRQVZDVSHUIRUPHGHYHU\KRXUVWRPHDVXUHWKHSHUIRUPDQFHRIUV\QF ZLWK²)IODJIRUHDFKSDLURIWKH1DQG0YDOXHV7KHVWHSVDUHRXWOLQHGEHORZ
7KHVUFZDVFUHDWHGZLWKDVSHFLILHGYDOXHRI1
7KHFRQWHQWVRIVUFZHUHFRSLHGLQWRWKHVUF0DVWHUDQGWKHVUF6ODYH 7KHVUF0DVWHUZDVXSGDWHGDFFRUGLQJWRWKHYDOXHRI0
5V\QF ) ZDV UXQ RQ VUF6ODYH WR V\QFKURQL]H WKH FRQWHQWV ZLWK VUF0DVWHU (DFKRIWKHVXEGLUHFWRULHVZDVXSGDWHGWRR
)RUHDFKYDOXHRI1VWHSVDQGZHUHUHSHDWHGIRUGLIIHUHQWYDOXHVRI07KHZKROH SURFHVVZDVUHSHDWHGIRUGLIIHUHQWYDOXHVRI1
7DEOH%(VWLPDWHGWRWDOQXPEHURIE\WHV
1 =HVWLPDWHGLQE\WHV
3HUIRUPDQFH$QDO\VLV
)LJXUHDQGUHSUHVHQWUXQWLPHVRIUV\QFZLWKGLIIHUHQWYDOXHVRI1DQG0(DFK ILJXUHVKRZVUV\QFSHUIRUPDQFHIRURQHSDUWLFXODU1YDOXH$VWKHILJXUHVGHPRQVWUDWH IRUDIL[HGYDOXHRI1WKHUXQWLPHRIUV\QFLQFUHDVHVDOPRVWSURSRUWLRQDOO\ZLWKWKH YDOXHVRI07KLVLVQRWGLIILFXOWWRXQGHUVWDQGVLQFHWKHPRUHFKDQJHVUV\QFGHWHFWVWKH PRUHXSGDWHVLWQHHGVWRFRPSOHWH,QWHUHVWLQJO\WKHUDWHRILQFUHDVHVORZVGRZQIRUODUJHU YDOXHVRI0
&RQVLGHULQJILJXUHILUVWWKHUHVXOWVVKRZUV\QFUXQWLPHIRUDVHWRIYDOXHVRI0JLYHQ1 :KHQ0 UXQWLPHLVDQGZKHQ0 UXQWLPHLV6RWKHUDWH RILQFUHDVHLV²² :KHQ0 UV\QFUXQWLPHLV 6RWKHUDWHRILQFUHDVHLV²² :KHQ0 WKH
FRUUHVSRQGLQJUXQWLPHLVDQGWKHUDWHRILQFUHDVHLV²² )URPWKHVHFDOFXODWLRQVZHFDQVHHWKDWWKHUDWHRILQFUHDVHVORZVZKHQ0LVJHWWLQJ ELJJHU7KHVDPHGHFUHDVHRFFXUVZKHQ1 +RZHYHUZKHQ1 WKH GHFUHDVHLQUDWHFRPHVODWHUZKHQ0LQFUHDVHVIURPWR
,QRUGHUWRH[SODLQZK\WKHUDWHRILQFUHDVHVORZVGRZQZHQHHGWRILUVWXQGHUVWDQGKRZ UV\QFZRUNV5V\QFILUVWLWHUDWHVWKURXJKVUF0DVWHUDQGUHFRUGVWKHLQIRUPDWLRQIRUHDFK ILOHVXFKDVILOHVL]HV7KHQUV\QFFRPSDUHVWKLVLQIRUPDWLRQZLWKVUF6ODYHDQG
LQIRUPDWLRQLVGHWHUPLQHGE\1DQGVWD\VXQFKDQJHGIRUGLIIHUHQWYDOXHVRI07KH
UHODWLRQVKLSFDQEHUHSUHVHQWHGDV 7UXQWLPH =0W&
7UXQWLPHLVWKHWRWDOUXQWLPHRIUV\QF0LVQXPEHURIE\WHVWKDWFKDQJHGDQGWLVWKHWLPH QHHGHGWRXSGDWHRQHE\WH=LVWKHWRWDOQXPEHURIE\WHVLQVUF0DVWHU&LVWKHWLPHXVHG WR JDWKHU ILOH LQIRUPDWLRQ WKDW LV FRQVWDQW IRU D JLYHQ 1 7KH UDWH RI LQFUHDVH FDQ EH UHSUHVHQWHGDV
70 W=&0
6LQFHW=FDQEHDVVXPHGWREHDFRQVWDQWIRUDJLYHQ1&0EHFRPHVVPDOOHUZKHQ0 LQFUHDVHV7KHUHIRUH70DOVREHFRPHVVPDOOHU6RWKHUDWHRILQFUHDVHZLOOVORZGRZQ ZKHQ0LQFUHDVHV
%HORZ DUH WKUHH GLDJUDPV WKDW PDS WKH UHODWLRQVKLS EHWZHHQ UV\QF DQG 0 IRU D IL[HG YDOXHRI1$JDLQRQHRIWKHWZRNH\SDUDPHWHUVLQWKLVH[SHULPHQWLVWKHWRWDOILOHQXPEHU LQWKHPDVWHUGLUHFWRU\1DQGWKHRWKHULVWKHSHUFHQWDJHRIFKDQJHGE\WHVWRWKHWRWDO E\WHV0
N=100 3.345 3.503 3.626 3.857 3.3 3.4 3.5 3.6 3.7 3.8 3.9
0 0.1 0.2 0.3
M runt im e ( s ) rsync+ runtime )LJXUH5V\QF)UXQWLPHVIRU1 N=1000 29.41531.334 34.434 40.533 25 30 35 40 45
0 0.1 0.2 0.3
M runt im e ( s ) rsync+ runtime )LJXUH5V\QF)UXQWLPHVIRU1 N=10000 422.617 438.219 457.712 489.139 400 420 440 460 480 500
0 0.05 0.1 0.15 0.2 0.25
&RQWLQXLQJZRUN
)URPWKHH[SHULPHQWVZHFDQH[SHFWWKDWWKHUXQWLPHRIUV\QFLQFUHDVHVZKHQ1DQG0 LQFUHDVHV +RZHYHU WKH UHODWLRQVKLS EHWZHHQ UXQWLPH DQG WKHVH WZR SDUDPHWHUV LV QRW OLQHDU 7KH UXQWLPH LQFUHDVH UDWH RI UXQWLPH DFWXDOO\ GHFUHDVHV ZLWK ODUJHU YDOXHV RI 0 7KHUHIRUH WKH WKURXJKSXW RI UV\QF LQFUHDVHV IRU ODUJH YDOXHV RI 0 ,W LV SRVVLEOH WR QDUURZWKHYDOXHRIWDQG&GRZQLQDUDQJHVRWKDWZHFDQXVHWKLVIXQFWLRQWRFRPSXWH UXQWLPH RI UV\QF EHIRUH ZH FRQGXFW WKH V\QFKURQL]DWLRQ 7KLV ZLOO KHOS WKH XVHUV WR HVWLPDWHWKHWLPHQHHGHGIRUWKHXSGDWH
7KHVROHLUUHJXODULW\LQWKHH[SHULPHQWRFFXUUHGZKHQ1 DQGWKHUDWHRILQFUHDVH GLGQRWVORZXQWLO0LQFUHDVHGIURPWR7KLVLUUHJXODULW\YDULHVIURPWKHRWKHUWZR ILJXUHV 7KHUH DUH VHYHUDO IDFWRUV WKDW PD\ H[SODLQ WKH YDULDWLRQ LQ WKH H[SHULPHQW ,W LV SRVVLEOHWKDWWKHVHWRIH[SHULPHQWVLVQRWODUJHHQRXJKWRDYRLGWKHYDULDQFH2ULIWKHUH ZHUH RWKHU DFWLYLWLHV RQ WKH VDPH PDFKLQH ZKHUH WKH H[SHULPHQW ZDV EHLQJ FRQGXFWHG ZKLFK DIIHFWHG WKH UHVXOW 3RVVLEO\ RWKHU SDUDPHWHUV FRXOG DIIHFW WKH SHUIRUPDQFH RI UV\QF WKDWZHGLGQRWWDNHLQWRFRQVLGHUDWLRQLQ WKLVH[SHULPHQW )XUWKHULQYHVWLJDWLRQ PD\VKRZWKDWDQ\RQHRUDFRPELQDWLRQRIWKHVHIDFWRUVPD\KDYHFDXVHGLUUHJXODULW\LQ WKHH[SHULPHQW
7KH H[SHULPHQWV GHVFULEHG DERYH XVHG FRQWUROOHG SDUDPHWHUV DQG GDWD ,W ZLOO EH LQWHUHVWLQJWRFRPSDUHWKHVHUHVXOWVZLWKUHDOZRUOGGDWDVXFKDVWKHUHVXOWVIURP3URIHVVRU 'HPSVH\·VH[SHULPHQWVRQPHWDODEXQFHGX,WKHOSVWRYDOLGDWHWKHH[SHULPHQWUHVXOWVDQG REVHUYHKRZUV\QFEHKDYHVLQGLIIHUHQWVLWXDWLRQV
5HIHUHQFH
>@%-'HPSVH\´3HUIRUPDQFH$QDO\VLVRID6FDOHDEOH'HVLJQIRU5HSOLFDWLQJ)LOH &ROOHFWLRQVLQ:LGH$UHD1HWZRUNVµ-RXUQDORI1HWZRUNDQG&RPSXWHU$SSOLFDWLRQV 9ROXPH1XPEHU
>@0%HFN%-'HPSVH\DQG70RRUH´7KH,QWHUQHW'LVWULEXWHG6WRUDJH ,QIUDVWUXFWXUH,'6,3URMHFWµKWWSGVLLQWHUQHWHGX
>@%-'HPSVH\DQG':HLVV´2QWKH3HUIRUPDQFHDQG6FDODELOLW\RID'DWD0LUURULQJ $SSURDFKIRU,'6,µ,QWHUQHW1HWZRUN6WRUDJH6\PSRVLXP1HW6WRUH6HDWWOH:$ 2FWREHU
>@5V\QFKWWSUV\QFVDPEDRUJ
