Analysis of Gene Expression Profiles with Linear Mixed Models

$EVWUDFW

+6,(+:(13,1*$QDO\VLVRI*HQH([SUHVVLRQ3URILOHVZLWK/LQHDU0L[HG0RGHOV 8QGHUWKHGLUHFWLRQRI'U*UHJ*LEVRQDQG'U5XVV:ROILQJHU

:LWKWKHHPHUJHQFHRIKLJKWKURXJKSXWWHFKQRORJ\SURSHULQWHUSUHWDWLRQRIGDWD KDVEHFRPHFULWLFDOIRUPDQ\DVSHFWVRIELRPHGLFDOUHVHDUFK0\GLVVHUWDWLRQH[SORUHV WZR PDMRU LVVXHV LQ JHQH H[SUHVVLRQ SURILOH PLFURDUUD\ GDWD DQDO\VLV 2QH LV TXDQWLILFDWLRQ RI YDULDWLRQ DFURVV DQG DPRQJ VSHFLHV DQG LWV HIIHFW RQ ELRORJLFDO LQWHUSUHWDWLRQ7KHVHFRQGSDUWRIP\ZRUNLVWRGHYHORSEHWWHUVWDWLVWLFDOHVWLPDWHVWKDW FDQDFFRXQWIRUGLIIHUHQWVRXUFHVRIYDULDWLRQIRUVLJQLILFDQWJHQHGHWHFWLRQ

$ SUHYLRXVO\ SXEOLVKHG GDWDVHW RI ROLJRQXFOHRWLGH DUUD\ GDWD IRU WKUHH SULPDWH VSHFLHV ZDV DQDO\]HG ZLWK OLQHDU PL[HG PRGHOV %\ GHFRPSRVLQJ WKH YDULDWLRQ RI H[SUHVVLRQ LQWR GLIIHUHQW H[SODQDWRU\ IDFWRUV WKH GLIIHUHQFHV DPRQJ VSHFLHV DV ZHOO DV EHWZHHQ WLVVXHV ZDV UHYHDOHG DW WKH H[SUHVVLRQ OHYHO ,VVXHV RI FURVVVSHFLHV K\EULGL]DWLRQ DQG H[SUHVVLRQ GLYHUJHQFH FRPSDUHG WR PXWDWLRQGULIW HTXLOLEULXP ZHUH DGGUHVVHG

%LRJUDSK\

:HQ3LQJ+VLHKUHFHLYHGKHU%DFKHORURI6FLHQFHGHJUHHLQ0DWKHPDWLFVIURP1DWLRQDO 7DLZDQ8QLYHUVLW\DW7DLSHL7DLZDQLQ6KHFRPSOHWHGJUDGXDWHZRUNLQ6WDWLVWLFV DW1DWLRQDO7VLQJ+XD8QLYHUVLW\DW+VLQFKX7DLZDQUHFHLYLQJKHU0DVWHUVGHJUHHLQ ,QVKHFRPPHQFHGGRFWRUDOZRUNDW1RUWK&DUROLQD6WDWH8QLYHUVLW\ZLWK PDMRULQ%LRLQIRUPDWLFV

$FNQRZOHGJHPHQW

,ZRXOGOLNHWRH[SUHVVP\VLQFHUHDSSUHFLDWLRQWRP\DGYLVRU'U*UHJ*LEVRQ IRUWKHWLPHDQGJXLGDQFHKHSURYLGHG+LVHQWKXVLDVPIRUUHVHDUFKDQGLQWHOOLJHQWLGHDV LQVSLUHGPHDOOWKHWLPH(YHQWKRXJK,FDQQHYHUKRSHWRHTXDOKLPWKHVHHGVKDYHEHHQ SODQWHGLQP\PLQG,ZRXOGDOVROLNHWRWKDQNP\FRDGYLVRU'U5XVV:ROILQJHUIRUKLV JUHDWLQSXWLQP\UHVHDUFKZRUN,ZRXOGQRWKDYHDFKLHYHGVRPXFKLQVXFKDVKRUWWLPH LILWZDVQRWIRUKLVSURPSWUHVSRQVHVDQGWRQVRILQVLJKWIXOVXJJHVWLRQV

,ZRXOGOLNHWRWKDQN'U6SHQFHU0XVHIRUKLVHQFRXUDJHPHQWDQGKHOS+HKDV EHHQYHU\VXSSRUWLYHWKURXJKRXWP\VWXGLHVZKHWKHUPDQDJLQJWKHIXQGLQJGLVFXVVLQJ UHVHDUFK LGHDV RU VLPSO\ WHOOLQJ PH ³\RX¶OO EH ILQH´ , DOVR EHQHILWHG D ORW IURP 'U 'HQQLV %RRV¶ SURIRXQG NQRZOHGJH RI VWDWLVWLFV +H ZDV DOZD\V YHU\ SDWLHQW ZLWKP\ TXHVWLRQVDQG,DPYHU\JUDWHIXOIRUKLVVXJJHVWLRQV

6SHFLDOWKDQNVJRWR'U7]X0LQJ&KX+HLVWKHRQHWKDWLQWURGXFHGPHWRWKH ILHOGRIPLFURDUUD\GDWDDQDO\VLV,DPYHU\JUDWHIXOIRUDOOWKHDVVLVWDQFHKHJDYHPHDQG ,UHDOO\HQMR\HGWKHIUXLWIXOGLVFXVVLRQVZHKDGRYHUWKHSDVW\HDUV+HDQG)DQJ&KHQ KDYHEHHQP\EHVWVXSSRUWLQERWKP\OLIHDQGP\VWXGLHV

,WKDQNP\EHORYHG&KXQ0LQJ.XRIRUKLVZRQGHUIXOVXSSRUW

6LPXODWLRQ

$129$

'LVFXVVLRQ

5HIHUHQFHV

$SSHQGL[

/LVWRI7DEOHV

7DEOH)UDFWLRQRI*HQHVVKRZLQJ([SUHVVLRQ'LIIHUHQFHV$PRQJ3ULPDWH 6SHFLHV

7DEOH)UDFWLRQRI*HQHVVKRZLQJ([SUHVVLRQ'LIIHUHQFHV$PRQJ0XULQH 6SHFLHV

7DEOH/DWLQ6TXDUHGHVLJQ

7DEOH$YHUDJHFRUUHODWLRQFRHIILFLHQWDFURVVUHSOLFDWHVZLWKLQWKHH[SHULPHQW JURXSV

7DEOH8QH[SHFWHGVLJQLILFDQWJHQHVIURPWKHPL[HGPRGHODQDO\VLV

7DEOH3UREHVHTXHQFHVZLWKH[SUHVVLRQSURILOHPDWFKLQJWKDWRIWDUJHWBDW

7DEOH&RUUHODWLRQFRHIILFLHQWVEHWZHHQSDLUVRIDUUD\VRIWKH\HDVWH[SHULPHQW

7DEOH7\SH,,,WDEOHIRUWKH$129$DQDO\VLVRIWKHIDFWRUVFRQWULEXWLQJWR WKHH[SODQDWRU\SRZHURIWKHPRGHO

7DEOH0RGHOH[SHFWHGPHDQVTXDUHV

/LVWRI)LJXUHV )LJXUH6XEPDULQHSORWRIVWDQGDUGL]HGUHVLGXDOVDJDLQVWSUHGLFWHGYDOXHV )LJXUH9ROFDQRSORWVRIVLJQLILFDQFHDJDLQVWIROGFKDQJHLQH[SUHVVLRQIRU HDFKSULPDWHVSHFLHVFRPSDULVRQLQEUDLQDQGOLYHU )LJXUH9ROFDQRSORWVRIVLJQLILFDQFHDJDLQVWIROGFKDQJHLQH[SUHVVLRQIRU HDFKPXULQHVSHFLHVFRPSDULVRQLQEUDLQDQGOLYHU )LJXUH3DUDOOHOSORWVRILQGLYLGXDOROLJRQXFOHRWLGHPHDVXUHPHQWVIRUKXPDQ DQGFKLPSEUDLQVDPSOHVIRUVL[JHQHV )LJXUH(IIHFWRIILOWHULQJRXWOLHUVRQLQIHUHQFHRIH[SUHVVLRQGLIIHUHQFH EHWZHHQKXPDQDQGFKLPSEUDLQ )LJXUH&RQWUDVWRIFRQWULEXWLRQVRIVSHFLHVDQGLQGLYLGXDOZLWKLQVSHFLHVWR H[SUHVVLRQYDULDQFHEHWZHHQKXPDQDQGFKLPSEUDLQ 6XSSOHPHQWDU\)LJXUH6FDWWHUSORW0DWUL[RIORJEDVHIOXRUHVFHQFHLQWHQVLW\ PHDVXUHVIRUHDFKRIWKHKXPDQEUDLQVDPSOHV 6XSSOHPHQWDU\)LJXUH1HLJKERUMRLQLQJWUHHVIRUSULPDWHGDWD 6XSSOHPHQWDU\)LJXUH([FHOVSUHDGVKHHWVRUWHGE\VLJQLILFDQFHRI GLIIHUHQWLDOO\H[SUHVVHGJHQHVZLWKDQGZLWKRXWILOWHULQJIRUEUDLQDQGOLYHU FRPSDULVRQVRIKXPDQDQGFKLPS

)LJXUH6FDWWHUSORWPDWUL[RIORJ30EOXHDQGORJ00UHGIRUWKHWKUHH

UHSOLFDWHFKLSVLQH[SHULPHQW$

)LJXUH3ORWRIORJ00YHUVXVORJ30IRURQHFKLS

)LJXUH2YHUOD\RIVWDQGDUGL]HGOHDVWVTXDUHVPHDQSURILOHVIRUWKHVSLNHG JHQHV )LJXUH6WDQGDUGL]HGOHDVWVTXDUHVPHDQSURILOHVRIVLJQLILFDQWJHQHV )LJXUH6WDQGDUGL]HGOHDVWVTXDUHVPHDQSURILOHVRIXQH[SHFWHGJHQHV )LJXUH([SUHVVLRQSURILOHVRISUREHVOLVWHGLQ7DEOH )LJXUH6HTXHQFHDOLJQPHQWIRUSUREHVRIBDWDQGBDWZLWK.

)LJXUH6FDWWHUSORWRIORJ30YVORJ00SUREHVIURPGDWDRIVL[DUUD\V

)LJXUH6FDWWHUSORWRIQHJDWLYHORJSYDOXHVIURPWKHWZRPRGHOVIRU\HDVW GDWD

)LJXUH6FDWWHUSORWRIQHJDWLYHORJSYDOXHVIURPWKHWZRPRGHOVIRU\HDVWGDWD ZLWK12%281'RSWLRQ

)LJXUH&RPSDULVRQRIDHVWLPDWHVRIWUHDWPHQWHIIHFWGLIIHUHQFHEVWDQGDUG GHYLDWLRQRIWKHHVWLPDWHVDQGFHVWLPDWHVRIGHJUHHVRIIUHHGRPIURP

.HQZDUG5RJHU¶VPHWKRGIRUWKHWZRPRGHOV

)LJXUH+LVWRJUDPVRIFRYDULDQFHSDUDPHWHUHVWLPDWHVIURPWKH\HDVWGDWD

)LJXUH3RZHUFXUYHV

)LJXUH+LVWRJUDPVRIVWDQGDUGHUURUVIURPVLPXODWLRQVXQGHUWKH FRQGLWLRQRIVD V00 V30 DQG77

)LJXUH+LVWRJUDPVRIHVWLPDWHVRIGHJUHHVRIIUHHGRPIURPVLPXODWLRQV XQGHUWKHFRQGLWLRQRIVD V00 V30 DQG77

&KDSWHU ,QWURGXFWLRQ

0LFURDUUD\ WHFKQRORJ\ LV ZLGHO\ DGRSWHG LQ DOO OHYHOV RI ELRORJLFDO UHVHDUFK 7KH DSSOLFDWLRQ H[WHQVLYHO\ FRYHUV GUXJ HIILFDF\ VFUHHQLQJ -DLQ SUHGLFWLRQ RI JHQH IXQFWLRQ=KDQJHWDOWHPSRUDOSURILOLQJ&DYDOODURHWDODQGVWXGLHVRI UHJXODWRU\ QHWZRUNV /HH ,W LV DOVR DQ LPSRUWDQW WRRO LQ SKDUPDFHXWLFDO DQG FOLQLFDOUHVHDUFK:KLOHPRQLWRULQJWKHH[SUHVVLRQOHYHOVRIVHYHUDOWKRXVDQGVRIJHQHVDW WKHVDPHWLPHZLWKRQO\OLPLWHGDPRXQWRIP51$LWDFFHOHUDWHVWKHGLVFRYHU\RIGLVHDVH JHQHVDQGKHOSVXVWRXQGHUVWDQGWKHELRORJLFDOV\VWHPDVDZKROH7KHH[WUDRUGLQDULO\ ODUJHDPRXQWVRIGDWDJHQHUDWHGIURPPLFURDUUD\VWXGLHVUDLVHFRQVLGHUDEOHFKDOOHQJHVIRU VWRUDJHDQGKDQGOLQJRIWKHGDWD6\VWHPDWLFVWDWLVWLFDOVWUDWHJLHVIRUFRUUHFWO\UHWULHYLQJ LQIRUPDWLRQIURPWKHPDVVLYHGDWDVHWVKDYHEHFRPHYHU\FULWLFDOWRWKHGUDZLQJRIVROLG FRQFOXVLRQVDWWKHJHQRPLFVFDOH

7KH ILUVW LPSRUWDQW LVVXH LV WKH H[SHULPHQWDO GHVLJQ $ ORW RI VXJJHVWLRQV DQG DOWHUQDWLYHV KDYH EHHQ SURYLGHG <DQJ HW DO UHYLHZHG WKH SURV DQG FRQV RI VHYHUDO GLIIHUHQWPHWKRGV<DQJHWDOEDQGHYDOXDWHGWKHGHVLJQVEDVHGRQWKHLUHIILFLHQF\ DQGSXUSRVH.HUUHW DOSURYLGHG DGHWDLOHGGLVFXVVLRQRIGLIIHUHQWVRXUFHVRI YDULDWLRQDQGFRPSDUHGWKHWZRPRVWZLGHO\XVHGGHVLJQVWKHUHIHUHQFHGHVLJQDQGORRS GHVLJQ 7KHUH LV DOVR WKRURXJK GLVFXVVLRQ RI WKH QXPEHU RI UHSOLFDWHV DQG SURSHU DUUDQJHPHQWRIUHSOLFDWLRQLQWKHVHVWXGLHV

&OXVWHULQJ PHWKRGV DUH RIWHQ XVHG WR GLVFRYHU KLGGHQ SDWWHUQV (LVHQ HW DO 7LEVKLUDQL HW DO 'XGRLW HW DO D WKHVH DUH FDOOHG XQVXSHUYLVHG OHDUQLQJ LQ LQIRUPDWLRQVFLHQFH0RVWRIWKHZHOOGHYHORSHGVWDWLVWLFDOPHWKRGVVXFKDVKLHUDUFKLFDO FOXVWHULQJNPHDQVFOXVWHULQJVHOIRUJDQL]LQJPDSVDQGSULQFLSDO FRPSRQHQWDQDO\VLV KDYHEHHQDSSOLHGWRVHHNSRWHQWLDOVXEW\SHVRIWXPRUVDPSOHVRUWRJURXSJHQHVWKDW PLJKWEHFRUHJXODWHG$OL]HGHKHWDO(LVHQHWDO$VHFRQGFDWHJRU\RI SDWWHUQ VHDUFKLQJ LV VXSHUYLVHG OHDUQLQJ PHWKRGV ZKLFK DUH DOVR JHQHUDOO\ NQRZQ DV FODVVLILFDWLRQ PHWKRGV ,W LV RIWHQ YHU\ XVHIXO WR DVVRFLDWH VDPSOHV ZLWK GLVHDVH W\SHV %HQ'RU HW DO *ROXE HW DO DQG WR FODVVLI\ JHQHV DFFRUGLQJ WR WKHLU IXQFWLRQDOUROHV%URZQHWDO

1RUPDOL]DWLRQ

'XHWRWKHQDWXUHRIWKHWHFKQRORJ\LWVHOIWKHUHDUHVHYHUDOVRXUFHVRIWHFKQLFDOYDULDWLRQ UHODWLQJ WR 51$ H[WUDFWLRQ UHYHUVH WUDQVFULSWLRQ ODEHOLQJ DQG IOXRUHVFHQFH GHWHFWLRQ 7KHYDULDWLRQFDQEHV\VWHPDWLFZKLFKPHDQVWKDWWKH\KDYHDVLPLODUHIIHFWRQPDQ\ PHDVXUHPHQWVDQGFDQEHH[SOLFLWO\DFFRXQWHGIRU$OWHUQDWLYHO\LWFDQDOVREHODUJHO\ VWRFKDVWLFZLWKWKHUHVXOWWKDWLWFDQQRWEHFDSWXUHGDFFRUGLQJWRFXUUHQWNQRZOHGJH7KH PRUH ZH NQRZ DERXW ZKHUH WKH YDULDWLRQ FRPHV IURP WKH EHWWHU ZH FDQ LQWHJUDWH WKH VRXUFHVDVV\VWHPDWLFHIIHFWVDQGDFFRXQWIRUWKHP

WKHVDPH,IWKLVDVVXPSWLRQLVYLRODWHGDQRWKHUPHDVXUHIRUJOREDOQRLVHUHGXFWLRQLVWR XVHWKHLQIRUPDWLRQIURPDVHWRILQYDULDQWJHQHV/LDQG:RQJE7KH\DVVXPH WKDWWKHUDQNRISUREHLQWHQVLW\IURPQRQGLIIHUHQWLDOO\H[SUHVVHGJHQHVZLWKLQHDFKDUUD\ GRHV QRW FKDQJH DSSUHFLDEO\ DFURVV DUUD\V DQG XVH WKLV LQYDULDQW VHW WR GHWHUPLQH WKH QRUPDOL]DWLRQ UHODWLRQVKLSV DPRQJ DUUD\V $QRWKHU FDWHJRU\ RI QRUPDOL]DWLRQ LV LQWHQVLW\EDVHGVXFKDV/RHVVWUDQVIRUPDWLRQ<DQJHWDOF7KHPRVWIOH[LEOHDQG FRPSUHKHQVLYHJOREDOQRUPDOL]DWLRQPHWKRGLVWKH$129$DSSURDFK.HUUHWDO :ROILQJHUHWDOZKLFKFDQHDVLO\LQWHJUDWHDOOSRVVLEOHVRXUFHVRIQRLVHVDVHIIHFWV LQWKHPRGHO

6LJQLILFDQWJHQHGHWHFWLRQ

2QHRIWKHPRVWLPSRUWDQWJRDOVIRUPLFURDUUD\H[SHULPHQWVLVWRLGHQWLI\JHQHVWKDWDUH GLIIHUHQWLDOO\ H[SUHVVHG DFURVV GLIIHUHQW FRQGLWLRQV VXFK DV WUHDWPHQW DQG FRQWURO GLIIHUHQW WLVVXHV VSHFLHV GHYHORSPHQWDO VWDJHV SDWKRORJLFDO FRQGLWLRQV HWF ,Q WZR JURXSFRPSDULVRQVIROGFKDQJHLVJHQHUDOO\XVHGE\ELRORJLVWVWRDVVHVVWKHGLIIHUHQFH EHWZHHQJURXSV'UDJKLFL'H5LVL,WLVVLPSOHDQGLQWXLWLYH+RZHYHUWKH EHKDYLRU RI JHQHV DW KLJK OHYHOV RI H[SUHVVLRQ LV GLIIHUHQW IURP WKDW REVHUYHG DW ORZ H[SUHVVLRQ OHYHOV 7KHUH WHQGV WR EH D ORW PRUH YDULDWLRQ LQ ORZ H[SUHVVLRQ OHYHOV 'UDJKLFL5RFNHDQG'XUELQ$KLJKIROGFKDQJHEHWZHHQJURXSVIRUDJHQH PLJKWUHVXOWIURPUDQGRPQHVVDQGQHHGQRWKDYHVWDWLVWLFDOVLJQLILFDQFH

DSSURDFK WR GHWHFW GLIIHUHQWLDOO\ H[SUHVVHG JHQHV LV WR XVH PRGHOEDVHG FOXVWHULQJ PHWKRGVVXFKDVPL[WXUHPRGHOV/HHHWDO$VLPLODUDSSURDFKLVWRDVVD\WKH SUREDELOLW\ WKDW D JLYHQ JHQH LV WUXO\ GLIIHUHQWLDOO\ H[SUHVVHG EHWZHHQ WZR FRQGLWLRQV XVLQJHPSLULFDO%D\HVDQDO\VLV(IURQ

$129$DQDO\VLVDQG7ZRVWHS/LQHDU0L[HG0RGHODQDO\VLVRIPLFURDUUD\GDWD .HUUHWDOZHUHDPRQJWKHILUVWWRXVHDQ$129$DSSURDFKIRUPLFURDUUD\GDWDDQDO\VLV .HUU HW DO 7KHLU PRGHO SXWV DOO JHQHV LQWR RQH FRPSUHKHQVLYH PRGHO DQG GHFRPSRVHVWKHYDULDWLRQRIH[SUHVVLRQLQWRGLIIHUHQWVRXUFHVVXFKDVWKHG\HHIIHFWSLQ HIIHFWDQGEDWFKHIIHFWHWF,WFDQHVWLPDWHWKHYDULDWLRQDWWKHJOREDOOHYHODVZHOODVWKH JHQHOHYHO7KLVDSSURDFKVHHPVWREHSURPLVLQJEXWLWLVFRPSXWDWLRQDOO\SURKLELWLYHLQ PRVWODUJHH[SHULPHQWVLQZKLFKWKHLQFUHDVHGQXPEHURIJHQHVDQGFRQGLWLRQVLQFUHDVHV WKHQXPEHURISDUDPHWHUVWREHHVWLPDWHG7ZRVWHSDQDO\VHV:ROILQJHUHWDO:X HW DO KDYH EHHQ SURSRVHG DV DOWHUQDWLYHV WR WKH IXOO PRGHO DQDO\VLV $QRWKHU GUDZEDFNLVWKDWIL[HGHIIHFW$129$FDQQRWFRPSUHKHQVLYHO\DFFRXQWIRUDOONLQGVRI UDQGRPIDFWRUVVRDQH[WHQVLRQSURSRVHGE\:ROILQJHUHWDOLVWKHXVHRIPL[HG PRGHOV

WKHOHYHOVZLOOQRWEHH[DFWO\UHSHDWHGWKHQH[WWLPHZHGRWKHVDPHH[SHULPHQW:HFDQ RQO\DVVXPHWKDWVLPLODUHIIHFWVZLOOEHGUDZQIURPWKHVDPHSRSXODWLRQ&XLHWDO 7KH PHWKRG SURSRVHG E\ :ROILQJHU HW DO XVHV WZR LQWHUFRQQHFWHG VHTXHQWLDO PL[HGPRGHOV7KHILUVWPRGHODFFRXQWVIRUJOREDOHIIHFWVVXFKDVWKHG\HHIIHFWVOLGH HIIHFW SULQW WLS HIIHFW HWF 7KH UHVLGXDOV IURP WKH ILUVW PRGHO EHFRPH WKH UHVSRQVH YDULDEOHLQWKHVHFRQGPRGHO7KHVHFRQGPRGHODVVHVVHVWKHJHQHVSHFLILFHIIHFWV,W DVVRFLDWHVWKHYDULDWLRQZLWKWKHYDULHWLHVZHDUHLQWHUHVWHGLQDQGPDNHVLQIHUHQFHEDVHG RQ)VWDWLVWLFV RUWVWDWLVWLFV WR GHWHFW JHQHV WKDW DUH GLIIHUHQWLDOO\ H[SUHVVHG DPRQJ FRQGLWLRQV 0L[HG PRGHO DQDO\VLV SURYLGHV D FRPSUHKHQVLYH DQG IOH[LEOH IUDPHZRUN ZLWKZKLFKWRLGHQWLI\DOONLQGVRIV\VWHPDWLFVRXUFHVRIYDULDQFH

$OWKRXJK WKH WZRVWHS PL[HG PRGHO LV RQO\ HTXLYDOHQW WR WKH RQH VWHS PL[HG PRGHO XQGHU FHUWDLQ FLUFXPVWDQFHV <DQJ LW PD\ QRW PDNH PXFK GLIIHUHQFH LQ SUDFWLFH:ROILQJHU:KLOHWKHRQHVWHSPRGHOKDVDFRPPRQHUURUPRGHOIRUDOO JHQHVWKHWZRVWHSPRGHOFDQHYDOXDWHWKHHUURUWHUPVLQGHSHQGHQWO\IRUHDFKRQHDQG FDQDFFRPPRGDWHPRUHLQIRUPDWLRQ

%DVLFVRI$II\PHWUL[DUUD\V

GLVDEOHDQ\K\EULGL]DWLRQWRWKHWDUJHWVHTXHQFHDQGWKHPLVPDWFKSUREHVDUHGHVLJQHGWR FDSWXUH WKH FRPSDUDEOH OHYHO RI QRQVSHFLILF ELQGLQJ DQG V\VWHPDWLF QRLVH DV SHUIHFW PDWFKSUREHV

+RZWRLQFRUSRUDWHPLVPDWFKSUREHV

7KHUHDUHPDQ\GLIIHUHQWZD\VWRFRPELQHWKHLQWHQVLW\PHDVXUHIURP30DQG00WR LQWHUURJDWHWDUJHW JHQH H[SUHVVLRQ$YHUDJHGLIIHUHQFH$YJ'LIILVWKH ILUVWDSSURDFK DGRSWHGE\$II\PHWUL[DVWKHLUGHIDXOWDQDO\VLVLQ$II\PHWUL[0LFUR$UUD\6XLWH0$6 7KLVDVVXPHVWKDWWKHGLIIHUHQFH3000LVSURSRUWLRQDOWRWKHWUXHVLJQDODQG WDNHVWKHZHLJKWHGDYHUDJHDFURVVSUREHVZLWKLQDSUREHVHWDVWKHPHDVXUHPHQWIRUWKH WDUJHWJHQH7KHIDFWWKDW3000LVQRWDOZD\VSRVLWLYHFDXVHVSUREOHPVIRUORJVFDOH DQDO\VLV +XEEHOO HW DO ,UL]DUU\ HW DO 1DHI $II\PHWUL[ WKHUHIRUH XSGDWHG WKHLU DOJRULWKP LQ 0$6 XVLQJ 7XFNH\¶V ELZHLJKW IXQFWLRQ +XEEHOO HW DO 7KLVDSSURDFKKDVEHHQFULWLFL]HGIRULQHIILFLHQWPDQDJHPHQWRIWKH00GDWD DPRQJRWKHUFRQFHUQV,UL]DUU\HWDO

/LDQG:RQJ¶VDOVRGHYLVHGDPHWKRGWKDWLVEDVHGRQ3000/LDQG:RQJ D,WDQDO\]HVWKHGDWDDWWKHSUREHOHYHODQGGHFRPSRVHVWKHVLJQDOLQWRWKHSURGXFW RIDSUREHVHQVLWLYLW\LQGH[DQGWKHJHQHH[SUHVVLRQLQGH[7KHLUVRIWZDUHG&KLSKDV EHHQXVHGLQYDULRXVJHQRPLFVWXGLHV

QRLVHGHWHFWLRQVRVHYHUDOVWXGLHVKDYHIRFXVHGVROHO\RQ30GDWD/LDQG:RQJD =KRX&KXHWDODGRSWHGDOLQHDUPL[HGPRGHOZLWK00LQWHQVLW\DVDFRYDULDWH EXWWKLVDSSURDFKGRHVQRWSURGXFHPXFKLPSURYHPHQWIURPWKH30RQO\PRGHO&KXHW DO,SURSRVHDELYDULDWHPRGHOLQ&KDSWHUIROORZLQJ&KX¶VVWXG\LQRUGHUWR H[SORUHWKHEHVWZD\RIXVLQJWKH00GDWDXQGHUWKHIUDPHZRUNRIOLQHDUPL[HGPRGHOV 7KLVDSSURDFKLVFRQFHSWXDOO\VLPLODUWR:X¶VVWXG\:XHWDOZKRHVVHQWLDOO\ GHFRPSRVHGWKHLQWHQVLW\RI30LQWRWUXHVLJQDOQRQVSHFLILFELQGLQJDQGRSWLFDOQRLVH DQGWKHLQWHQVLW\RI00LQWRRQO\QRQVSHFLILFELQGLQJDQGRSWLFDOQRLVH7KH\PRGHOHG WKHQRQVSHFLILFELQGLQJIURP30DQG00DVDELYDULDWHQRUPDOGLVWULEXWLRQ7KHPDLQ GLIIHUHQFH EHWZHHQ RXU DSSURDFKHV LV WKDW P\ PRGHO FDQ G\QDPLFDOO\ DGMXVW IRU WKH FRUUHODWLRQEHWZHHQ30DQG00EDVHGRQFODVVLFDOOLQHDUPL[HGPRGHOVZKLOHWKH\XVHG DQFRQVWDQWHPSLULFDOYDOXHRILQWKHLUPRGHO

6SHFLILFLW\RIROLJRQXFOHRWLGHDUUD\V

6RPHUHFHQWVWXGLHVKDYHDWWHPSWHGWRDVVHVVZKHWKHUVHTXHQFHVDUH³VWLFN\´RUQRWXVLQJ WKHUPRG\QDPLF UXOHV =KDQJ HW DO :X HW DO 1DHI HW DO 0HL HW DO 7KH IUHHHQHUJ\ PRGHO SURSRVHG E\ =KDQJ LV EDVHG RQ WKH QHDUHVWQHLJKERU PRGHO ZLWK VRPH PRGLILFDWLRQV WR FRPSXWH WKH JHQHVSHFLILF ELQGLQJ HQHUJ\ DQG QRQVSHFLILF ELQGLQJ HQHUJ\ 1DHI HW DO VLPSOLILHG WKH PRGHO DQG FRQVLGHUHG RQO\ WKH VHTXHQFHFRPSRVLWLRQRIWKHSUREHV7KHDIILQLW\IRUQRQVSHFLILFELQGLQJZDVPRGHOHG DVDIXQFWLRQRISRVLWLRQZLWKDSRO\QRPLDORIGHJUHHIRUHDFKEDVH7KHLUDSSURDFKLV DUJXDEO\VXFFHVVIXOWRWKLVHQG6XFKFRQFHSWVDUHDOVRLQWHJUDWHGLQWKHSUREHGHVLJQRI $II\PHWUL[DUUD\V0HLHWDO

LVVXHZDVILUVWKLJKOLJKWHGLQ/LDQG:RQJ¶VPHWKRG/LDQG:RQJD%DVHGRQWKH KHXULVWLFUXOHVWKDW,SURSRVH³EDG´SUREHVWKDWPLJKWKDYHSRO\PRUSKLVPVRUVLPSO\GR QRWIXQFWLRQDUHILOWHUHGRXWRIWKHDQDO\VLV

0RWLYDWLRQDQGUHVHDUFKRXWOLQH ([SUHVVLRQYDULDWLRQRISULPDWHV

:K\ KXPDQ EHLQJV ORRN DQG EHKDYH GLIIHUHQWO\ IURP WKHLU FORVH UHODWLYHV WKH FKLPSDQ]HH JRULOOD DQG RUDQJXWDQ KDV EHHQ DQ LQWULJXLQJ TXHVWLRQ IRU D ORQJ WLPH 6LQFH.LQJHWDOFRQFOXGHGWKDWKXPDQVGLIIHUIURPFKLPSDQ]HHVDWWKHUHJXODWRU\ OHYHO RI JHQH DFWLYLWLHV SHRSOH KDYH EHHQ WU\LQJ WR FKDUDFWHUL]H JHQH H[SUHVVLRQ GLIIHUHQFHVLQGLIIHUHQWZD\V$QH[SHULPHQWIURP3DDER¶VJURXSZDVWKHILUVWVWXG\WKDW DGGUHVVHGWKLVTXHVWLRQZLWKLQIRUPDWLRQIURPWHQVRIWKRXVDQGVRIJHQHV(QDUGHWDO 7KHLUH[SHULPHQWLQFOXGHGWKUHHSULPDWHVSHFLHVDQGWZRWLVVXHV7KHFRQFOXVLRQ WKH\GUHZIURPWKHDQDO\VLVRIWKHGDWDXVLQJSK\ORJHQHWLFPHWKRGVIDYRUVWKHLGHDWKDW JHQHH[SUHVVLRQVKRZVDFFHOHUDWHGHYROXWLRQLQKXPDQEUDLQV

7KH\ILUVWJHQHUDWHGHYROXWLRQDU\WUHHVEDVHGRQWKHH[SUHVVLRQRIJHQHV 7KHGLVWDQFHPHWULFVWKH\XVHGZDVHVVHQWLDOO\ZHLJKWHGE\WKHIROGFKDQJHEHWZHHQWKH H[SUHVVLRQPHDVXUHPHQWVRILQGLYLGXDOV:KLOHWKHWRSRORJ\RIWKHLUHYROXWLRQDU\WUHHLV FRQILUPHG ZKHQ ZH UHSURGXFHG WKHLU UHVXOWV P\ DSSURDFK ZLWK OLQHDU PL[HG PRGHOV SURYLGHVDGLIIHUHQWSHUVSHFWLYHRQWKLVGDWDVHWDQGWKHFRQFOXVLRQVDUHQRWQHFHVVDULO\ FRQVLVWHQWZLWKWKHLUV

VWXGLHG WKH K\EULGL]DWLRQ RI JUHDW DSH WDUJHW F'1$ WR WKH KXPDQ $II\PHWUL[ DUUD\V PLJKWQRWJLYHFRUUHFWVLJQDOV/RZHULQWHQVLW\IURPQRQKXPDQVSHFLHVPLJKWEHFDXVHG E\WKHODFNRIK\EULGL]DWLRQLQVWHDGRIORZHUWUDQVFULSWDEXQGDQFH)URPWKHREVHUYDWLRQ RI FRQVLVWHQW SUREH SDWWHUQV ZH XVHG D KHXULVWLF UXOH WR ILOWHU SUREHV ZLWK SRWHQWLDO SRO\PRUSKLVPV 7KH FRQFOXVLRQV IURP WKH ELRORJLFDO DQDO\VLV UHJDUGLQJ UHODWLYH GLYHUJHQFHRIJHQHH[SUHVVLRQLQEUDLQDQGOLYHUQHYHUWKHOHVVUHPDLQYDOLGDIWHUILOWHULQJ WKHSUREHV

6LQFH,REVHUYHGVLJQLILFDQWVSHFLHVYDULDWLRQIRUDVLJQLILFDQWSURSRUWLRQRIWKH JHQHVWKHWKLUGTXHVWLRQ,DVNHGLVZKHWKHUWKHUHDUHWUDQVFULSWVXQGHUJRLQJVRPHQDWXUDO VHOHFWLRQ%DVHGRQWKHOLPLWHGLQIRUPDWLRQZHFDQKDYHIURPWKHVPDOOVDPSOHRQO\D IHZ JHQHV WKDW GLYHUJHG EHWZHHQ VSHFLHV JUHDWHU WKDQ H[SHFWHG XQGHU PXWDWLRQGULIW EDODQFHZHUHGHWHFWHG

&URVVK\EULGL]DWLRQGHWHFWLRQRI/DWLQ6TXDUHGDWD

FRQFHQWUDWLRQ OHYHOV DSSHDULQJ RQO\ RQFH 7KH /DWLQ 6TXDUH GHVLJQ DOORZV RQH WR HYDOXDWHWKHPDLQHIIHFWVRILQWHUHVWXVLQJWKHIHZHVWVDPSOHVQHHGHGZKLOHOHDYLQJWKH KLJKHU LQWHUDFWLRQ HIIHFWV FRQIRXQGHG ZLWK VRPH RI WKH PDLQ HIIHFWV '\HVZDSSLQJ GHVLJQIRUF'1$DUUD\VDUHHVVHQWLDOO\D/DWLQ6TXDUHGHVLJQZLWKEDODQFHGFRPELQDWLRQ RIG\HVDQGVDPSOHV.HUUHWDO

,GHPRQVWUDWHWKHDFFXUDF\RIVLJQLILFDQWJHQHGHWHFWLRQZLWKOLQHDUPL[HGPRGHOV )URPWKHDQDO\VLV,IRXQGVHYHUDOXQH[SHFWHGJHQHVVKRZLQJRQHRIWKHSDWWHUQVRIWKH GHVLJQHG WUDQVFULSWV 7KURXJK WKH H[SORUDWLRQ RI VHTXHQFH VLPLODULW\ ZLWK *LEE¶V VDPSOLQJVRPHVKRUWPRWLIVZHUHGHWHFWHGWKDWSRVVLEO\FRQWULEXWHWRWKHLQIHUUHGFURVV K\EULGL]DWLRQ7KHZRUNZDVSXEOLVKHGLQWKHSURFHHGLQJRI&$0'$+VLHKHWDO E

%LYDULDWHPRGHOYHUVXV30RQO\PRGHO

5HIHUHQFH

$II\PHWUL[ 1HZ VWDWLVWLFDO DOJRULWKP IRU PRQLWRULQJ JHQH H[SUHVVLRQ RQ *HQH&KLSSUREHDUUD\V

KWWSZZZDII\PHWUL[FRPVXSSRUWWHFKQLFDOWHFKQRWHVVWDWLVWLFDOBDOJRULWKPVBWHFKQ RWHSGI

$OL]DGHK$$(LVHQ0%'DYLV5(0D&/RVVRV,65RVHQZDOG$%ROGULFN-&6DEHW +7UDQ7<X;3RZHOO-,<DQJ/0DUWL*(0RRUH7+XGVRQ--U/X//HZLV '%7LEVKLUDQL56KHUORFN*&KDQ:&*UHLQHU7&:HLVHQEXUJHU''$UPLWDJH -2:DUQNH5/HY\5:LOVRQ:*UHYHU05%\UG-&%RWVWHLQ'%URZQ32 6WDXGW /0'LVWLQFWW\SHVRIGLIIXVHODUJH %FHOOO\PSKRPDLGHQWLILHGE\ JHQHH[SUHVVLRQSURILOLQJ1DWXUH

%HQ'RU / %UXKQ , 1DFKPDQ 0 6FKXPPHU DQG = <DNKLQL 7LVVXH &ODVVLILFDWLRQ ZLWK *HQH ([SUHVVLRQ 3URILOHV -RXUQDO RI &RPSXWDWLRQDO %LRORJ\

%URZQ 036 *UXQG\ :1 /LQ ' &ULVWLDQLQL 1 6XJQHW &: )XUH\ 76 $UHV 0 -U +DXVVOHU'.QRZOHGJHEDVHGDQDO\VLVRIPLFURDUUD\JHQHH[SUHVVLRQGDWD E\XVLQJVXSSRUWYHFWRUPDFKLQHV3URF1DW$FDG6FL86$

&KX70:HLU%6DQG:ROILQJHU5'$6\VWHPDWLF6WDWLVWLFDO/LQHDU0RGHOLQJ $SSURDFKWR2OLJRQXFOHRWLGH$UUD\([SHULPHQWV0DWKHPDWLFDO%LRVFLHQFHV

&ODYHULH - &RPSXWDWLRQDO PHWKRGV IRU WKH LGHQWLILFDWLRQ RI GLIIHUHQWLDO DQG FRRUGLQDWHGJHQHH[SUHVVLRQ+XP0RO*HQHW

&XL ; &KXUFKLOO * $ 6WDWLVWLFDO WHVWV IRU GLIIHUHQWLDO H[SUHVVLRQ LQ F'1$ PLFURDUUD\H[SHULPHQWV*HQRPH%LRORJ\±

'H5LVL-3HQODQG/%URZQ32%LWWQHU0/0HOW]HU365D\0&KHQ<6X<$7UHQW -0 8VH RI D F'1$ PLFURDUUD\ WR DQDO\VH JHQH H[SUHVVLRQ SDWWHUQV LQ KXPDQFDQFHU1DW*HQHW

'UDJKLFL66WDWLVWLFDOLQWHOOLJHQFHHIIHFWLYHDQDO\VLVRIKLJKGHQVLW\PLFURDUUD\ GDWD'UXJ'LVFRYHU\7RGD\66

'XGRLW6)ULGO\DQG-6SHHG73D&RPSDULVRQRIGLVFULPLQDWLRQPHWKRGVIRUWKH FODVVLILFDWLRQRIWXPRUVXVLQJJHQHH[SUHVVLRQGDWD7HFKQLFDO5HSRUW'HSDUWPHQW RI6WDWLVWLFV8&%HUNHOH\

'XGRLW6<DQJ<+&DOORZ0-6SHHG73E6WDWLVWLFDOPHWKRGVIRULGHQWLI\LQJ GLIIHUHQWLDOO\ H[SUHVVHG JHQHV LQ UHSOLFDWHG F'1$ PLFURDUUD\ H[SHULPHQWV 7HFKQLFDO5HSRUW'HSDUWPHQWRI6WDWLVWLFV8&%HUNHOH\

(QDUG:.KDLWRYLFK3.ORVH-=ROOQHU6+HLVVLJ)*LDYDOLVFR31LHVHOW6WUXZH. 0XFKPRUH(9DUNL$5DYLG5'R[LDGLV*0%RQWURS5(3DDER6,QWUD DQG LQWHUVSHFLILF YDULDWLRQ LQ SULPDWH JHQH H[SUHVVLRQ SDWWHUQV 6FLHQFH

(IURQ%7LEVKLUDQL56WRUH\-'DQG7XVKHU9(PSLULFDO%D\HVDQDO\VLVRI DPLFURDUUD\H[SHULPHQW-$PHU6WDWLVW$VVRF±

*ROXE756ORQLP'.7DPD\R3+XDUG&*DDVHQEHHN00HVLURY-3&ROOHU+/RK 0/ 'RZQLQJ -5 &DOLJLXUL 0$ %ORRPILHOG &' /DQGHU (6 0ROHFXODU FODVVLILFDWLRQ RI FDQFHU &ODVV GLVFRYHU\ DQG FODVV SUHGLFWLRQ E\ JHQH H[SUHVVLRQ PRQLWRULQJ6FLHQFH

+VLHK :3 &KX 70 :ROILQJHU 5' *LEVRQ * D 0L[HGPRGHO UHDQDO\VLV RI SULPDWH GDWD VXJJHVWV WLVVXH DQG VSHFLHV ELDVHV LQ ROLJRQXFOHRWLGHEDVHG JHQH H[SUHVVLRQSURILOHV*HQHWLFV

+VLHK:3&KX70DQG:ROILQJHU5'E:KRDUHWKRVHVWUDQJHUVLQWKH/DWLQ VTXDUH" ,Q0HWKRGVRI 0LFURDUUD\'DWD$QDO\VLV ,,, HG-RKQVRQ.)DQG /LQ 60.OXZHU

+XEEHOO ( /LX :0 0HL 5 5REXVW HVWLPDWRUV IRU H[SUHVVLRQ DQDO\VLV %LRLQIRUPDWLFV

,UL]DUU\5$+REEV%&ROOLQ)%HD]HU%DUFOD\<'$QWRQHOOLV.-6FKHUI86SHHG73 ([SORUDWLRQQRUPDOL]DWLRQDQGVXPPDULHVRIKLJKGHQVLW\ROLJRQXFOHRWLGH DUUD\SUREHOHYHOGDWD%LRVWDWLVWLFV

-DLQ..$SSOLFDWLRQVRIELRFKLSDQGPLFURDUUD\V\VWHPVLQSKDUPDFRJHQRPLFV 3KDUPDFRJHQRPLFV

-L:=KRX:*UHJJ.<X1'DYLV6'DYLV6$PHWKRGIRUFURVV VSHFLHVJHQHH[SUHVVLRQDQDO\VLVZLWKKLJKGHQVLW\ROLJRQXFOHRWLGHDUUD\V1XFOHLF $FLGV5HVHDUFKH

.LQJ 0& :LOVRQ $& (YROXWLRQ DW WZR OHYHOV LQ KXPDQV DQG FKLPSDQ]HHV 6FLHQFH

/HH 0/7 .XR )& :KLWPRUH *$ 6NODU - ,PSRUWDQFH RI UHSOLFDWLRQ LQ PLFURDUUD\JHQHH[SUHVVLRQVWXGLHVVWDWLVWLFDOPHWKRGVDQGHYLGHQFHIURPUHSHWLWLYH F'1$K\EULGL]DWLRQV3URF1DW$FDG6FL86$

/HH7,5LQDOGL1-5REHUW)2GRP'7%DU-RVHSK=*HUEHU*.+DQQHWW 10 +DUELVRQ &5 7KRPSVRQ &0 6LPRQ , =HLWOLQJHU - -HQQLQJV (* 0XUUD\+/*RUGRQ'%5HQ%:\ULFN--7DJQH-9RONHUW7/)UDHQNHO (*LIIRUG'.DQG<RXQJ5$7UDQVFULSWLRQDO5HJXODWRU\1HWZRUNVLQ 6DFFKDURP\FHVFHUHYLVLDH6FLHQFH

/L & DQG :RQJ :+ D 0RGHOEDVHG DQDO\VLV RI ROLJRQXFOHRWLGH DUUD\V ([SUHVVLRQLQGH[FRPSXWDWLRQDQGRXWOLHUGHWHFWLRQ3URF1DWO$FDG6FL9RO

/L&DQG:RQJ:+E0RGHOEDVHGDQDO\VLVRIROLJRQXFOHRWLGHDUUD\VPRGHO YDOLGDWLRQ GHVLJQ LVVXHV DQG VWDQGDUG HUURU DSSOLFDWLRQ *HQRPH %LRORJ\ UHVHDUFK

/RFNKDUW '- 'RQJ + %\UQH 0& )ROOHWWLH 07 *DOOR 09 &KHH 06 0LWWPDQQ 0 :DQJ & .RED\DVKL 0 +RUWRQ + %URZQ (/ ([SUHVVLRQ PRQLWRULQJ E\ K\EULGL]DWLRQWRKLJKGHQVLW\ROLJRQXFOHRWLGHDUUD\V1DW%LRWHFK

1DHI ) +DFNHU &5 3DWLO 1 0DJQDVFR 0 (PSLULFDO FKDUDFWHUL]DWLRQ RI WKH H[SUHVVLRQ UDWLR QRLVH VWUXFWXUH LQ KLJKGHQVLW\ ROLJRQXFOHRWLGH DUUD\V *HQRPH %LROUHVHDUFK

1DHI)DQG0DJQDVFR026ROYLQJWKHULGGOHRIWKHEULJKWPLVPDWFKHVODEHOLQJ DQGHIIHFWLYHELQGLQJLQROLJRQXFOHRWLGHDUUD\V3K\VLFDO5HYLHZ( 3DQ:$FRPSDUDWLYHUHYLHZRIVWDWLVWLFDOPHWKRGVIRUGLVFRYHULQJGLIIHUHQWLDOO\

H[SUHVVHGJHQHVLQUHSOLFDWHGPLFURDUUD\H[SHULPHQWV%LRLQIRUPDWLFV 4XDFNHQEXVK - &RPSXWDWLRQDO DQDO\VLV RI PLFURDUUD\ GDWD 1DW 5HY *HQHW

5RFNH'0'XUELQ%$PRGHOIRUPHDVXUHPHQWHUURUIRUJHQHH[SUHVVLRQDUUD\V -&RPSXWDWLRQDO%LRORJ\±

5RXLOODUG-0+HUEHUW&DQG=XNHU02OLJRDUUD\*HQRPHVFDOHROLJRQXFOHRWLGH GHVLJQIRUPLFURDUUD\V%LRLQIRUPDWLFV$SSOLFDWLRQV1RWH±

7LEVKLUDQL 5 +DVWLH 7 (LVHQ 0 5RVV ' %RWVWHLQ ' %URZQ 3 &OXVWHULQJ PHWKRGVIRUWKHDQDO\VLVRI'1$PLFURDUUD\GDWD7HFKQLFDO5HSRUW'HSDUWPHQWRI 6WDWLVWLFV6WDQIRUG8

:ROILQJHU5*LEVRQ*:ROILQJHU(%HQQHWW/+DPDGHK+%XVKHO3$IVKDUL & DQG 3DXOHV 6 $VVHVVLQJ JHQH VLJQLILFDQFH IURP F'1$ PLFURDUUD\ H[SUHVVLRQGDWDYLDPL[HGPRGHOV-RXUQDORI&RPSXWDWLRQDO%LRORJ\ :X+.HUU0.DQG&KXUFKLOO*$7KHDQDO\VLVRIJHQHH[SUHVVLRQGDWD

:X = ,UL]DUU\ 5$ *HQWOHPDQ 5 0DUWLQH] 0XULOOR ) 6SHQFHU ) $ 0RGHO %DVHG%DFNJURXQG$GMXVWHPHQWIRU2OLJRQXFOHRWLGH([SUHVVLRQ$UUD\V-$6$9RO ,VVS

<DQJ; 2SWLPDO'HVLJQRI6LQJOH)DFWRUF'1$0LFURDUUD\([SHULPHQWVDQG 0L[HG 0RGHOV IRU *HQH ([SUHVVLRQ 'DWD 'LVVHUWDWLRQ RI 9LUJLQLD 3RO\WHFKQLF ,QVWLWXWHDQG6WDWH8QLYHUVLW\

<DQJ < + %XFNOH\ 0 - 'XGRLW 6 DQG 6SHHG 7 3 D &RPSDULVRQ RI PHWKRGVIRULPDJHDQDO\VLVRQF'1$PLFURDUUD\ GDWD-RXUQDORI&RPSXWDWLRQDO DQG*UDSKLFDO6WDWLVWLFV

<DQJ<+6SHHG7E'HVLJQLVVXHVIRUF'1$PLFURDUUD\H[SHULPHQWV1DW5HY *HQHW$XJ

<DQJ<+'XGRLW6/XX3/LQ'03HQJ91JDL-6SHHG73F1RUPDOL]DWLRQ IRU F'1$ PLFURDUUD\ GDWD D UREXVW FRPSRVLWH PHWKRG DGGUHVVLQJ VLQJOH DQG PXOWLSOHVOLGHV\VWHPDWLFYDULDWLRQ1XFOHLF$FLGV5HVH

=KDQJ/0LOHV0)DQG$OGDSH.'$PRGHORIPROHFXODULQWHUDFWLRQVRQ VKRUWROLJRQXFOHRWLGHPLFURDUUD\VLPSOLFDWLRQVIRUSUREHGHVLJQDQGGDWDDQDO\VLV 1DWXUH%LRWHFKQRORJ\

=KDQJ:0RUULV4'&KDQJ56KDL2%DNRZVNL0$0LWVDNDNLV10RKDPPDG1 5RELQVRQ0'=LUQJLEO56RPRJ\L(/DXULQ1(IWHNKDUSRXU(6DW(*ULJXOO- 3DQ43HQJ:7.URJDQ1*UHHQEODWW-)HKOLQJV0YDQGHU.RR\'$XELQ-%UXQHDX%*5RVVDQW-%OHQFRZH%-)UH\%-+XJKHV757KHIXQFWLRQDO ODQGVFDSHRIPRXVHJHQHH[SUHVVLRQ-%LRO

&KDSWHU 0L[HG0RGHO5HDQDO\VLVRI3ULPDWH'DWD6XJJHVWV7LVVXH

DQG6SHFLHV%LDVHVLQ2OLJRQXFOHRWLGH%DVHG*HQH([SUHVVLRQ3URILOHV

$EVWUDFW

,1752'8&7,21

2QH RI WKH PRVW LQWHUHVWLQJ DSSOLFDWLRQV RI JHQH H[SUHVVLRQ SURILOLQJ LQ HYROXWLRQDU\ JHQHWLFV LV WKH FRPSDULVRQ RI WUDQVFULSW DEXQGDQFH EHWZHHQ FORVHO\ UHODWHG VSHFLHV *LYHQWKDWVWXGLHVRI\HDVWIOLHVDQGNLOOLILVKKDYHHDFKVXJJHVWHGWKDWEHWZHHQDQG RI WKH WUDQVFULSWRPH GLIIHUV VLJQLILFDQWO\ LQ H[SUHVVLRQ OHYHO EHWZHHQ DQ\ WZR LQGLYLGXDOV RI WKH VDPH VSHFLHV &+(81* DQG 63,(/0$1 -,1 HW DO

2/(.6,$.HW DO &$9$/,(5,HW DO WKHUH LV DQ H[SHFWDWLRQ WKDW D VLPLODU

IUDFWLRQ RI WKH WUDQVFULSWRPH PD\ GLIIHU EHWZHHQ VLEOLQJ VSHFLHV 6RPH RI WKHVH GLIIHUHQFHV ZLOO EH DVVRFLDWHG ZLWK PRUSKRORJLFDO SK\VLRORJLFDO DQG EHKDYLRUDO GLYHUVLILFDWLRQDQGLIFDXVDOO\UHODWHGWRWKHGLYHUJHQFHPD\DOVRSURYLGHVLJQDWXUHVRI QDWXUDOVHOHFWLRQ4XDQWLILFDWLRQRIWUDQVFULSWDEXQGDQFHZLWKLQDQGEHWZHHQVSHFLHVWKXV KDVPXFKWRFRQWULEXWHWRRXUXQGHUVWDQGLQJRIWKHHYROXWLRQDU\IRUFHVDFWLQJDWWKHOHYHO RIJHQHH[SUHVVLRQ

7KH ILUVW HIIRUW WR DGGUHVV WKHVH TXHVWLRQV LQ UHODWLRQ WR KXPDQ HYROXWLRQ ZDV UHFHQWO\ SXEOLVKHG E\ 3llER DQG FRZRUNHUV (1$5'HW DO 7KH FHQWHUSLHFH RI

FRPSXWLQJDSDLUZLVHGLVWDQFHPDWUL[EDVHGRQWKHDYHUDJHOHYHORIH[SUHVVLRQIRUHDFK JHQH RQ WKHLU DUUD\V WKH\ GUHZ QHLJKERUMRLQLQJ WUHHV WKDW VXPPDUL]H WKH RYHUDOO GLYHUJHQFHLQWUDQVFULSWDEXQGDQFHIRUHDFKWLVVXHEHWZHHQWKHWULSOHWVRIVSHFLHV7KHLU PDMRUILQGLQJZDVWKDWWKHEUDQFKMRLQLQJWKHWKUHHKXPDQVDPSOHVWRWKHFHQWUDOQRGHRQ WKHLUEUDLQH[SUHVVLRQWUHHZDVDOPRVWWZLFHDVORQJLQUHODWLYHWHUPVDVWKHVDPHEUDQFK RQWKHOLYHUWUHHRULQHLWKHURIWKHPXULQHWUHHV7KHVDPHUHVXOWZDVREWDLQHGZLWKD VPDOOHU H[SHULPHQW XVLQJ F'1$ PLFURDUUD\V +HQFH WKH DXWKRUV FRQFOXGHG WKDW JHQH H[SUHVVLRQKDGGLYHUJHGPRVWUDSLGO\LQWKHKXPDQEUDLQ

$OWKRXJKLWLVHDV\WRFULWLFL]HWKLVVWXG\RYHUFRQFHUQVVXFKDVWKHVPDOOVDPSOH VL]HWKHVXLWDELOLW\RIVHQHVFHQWLQGLYLGXDOVDQGWKHYDOLGLW\RIH[WUDSRODWLQJWRJHQHUDO FRQFOXVLRQVRQWKHEDVLVRIDVPDOOVHFWLRQRIWKHEUDLQLWLVDOVRWKHFDVHWKDWWKHDOUHDG\ ULFK GDWDVHW ZLOO VXSSRUW IXUWKHU TXDQWLWDWLYH DQDO\VHV WKDW PD\ EH RI LQWHUHVW ,Q WKH UHDQDO\VLVRIWKHGDWDUHSRUWHGKHUHZHVRXJKWWRDGGUHVVWKHIROORZLQJTXHVWLRQVKRZ PDQ\RIWKHJHQHVRQWKHDUUD\DUHDFWXDOO\VLJQLILFDQWO\PRUHGLYHUJHQWEHWZHHQWKDQ ZLWKLQVSHFLHVZKDWLVWKHPHDQPDJQLWXGHRIH[SUHVVLRQGLYHUJHQFHEHWZHHQVSHFLHV ZK\GLGRQHRIWKHKXPDQVDPSOHVKDYHDQDYHUDJHGLIIHUHQFHIURPWKHRWKHUWZRWKDW ZDVDVJUHDWDVWKHLURYHUDOOGLYHUJHQFHIURPWKHFKLPSVZKDWLVWKHQDWXUHRIWKHJHQHV WKDWKDYHGLYHUJHGLQH[SUHVVLRQDQGGRWKHVDPHJHQHVGLYHUJHEHWZHHQDOOWKUHHVSHFLHV" 2XU PDMRU ILQGLQJ LV WKDW JHQH H[SUHVVLRQ DFWXDOO\ GLYHUJHV PRUH EHWZHHQ KXPDQ DQG FKLPSOLYHUVDPSOHVWKDQEUDLQ

,Q WKH FRXUVH RI RXU DQDO\VHV ZH DOVR QRWLFHG ELDVHV LQ WKH GLUHFWLRQDOLW\ DQG VLJQLILFDQFH RI FKDQJHV LQ H[SUHVVLRQ WKDW OHG XV WR TXHVWLRQ ZKHWKHU WKH $II\PHWUL[ WHFKQRORJ\ LV UHDOO\ VXLWDEOH IRU LQWHUVSHFLILF FRPSDULVRQV :H LPSOHPHQWHG PL[HG PRGHODQDO\VLVRIYDULDQFHLQ6$6:2/),1*(5HWDO&+8HWDOWRWHDVH

DSDUW WKH FRQWULEXWLRQV WR WUDQVFULSW DEXQGDQFH RI YDULDQFH DPRQJ LQGLYLGXDOV DQG EHWZHHQ VSHFLHV )OXRUHVFHQFH LQWHQVLW\ IURP HDFK LQGLYLGXDO SHUIHFW PDWFK ROLJRQXFOHRWLGHSUREHZDVWDNHQDVWKHPHDVXUHRIH[SUHVVLRQUDWKHUWKDQWKHDYHUDJH GLIIHUHQFHEHWZHHQSHUIHFWDQGPLVPDWFKSUREHV$GHWDLOHGDQDO\VLVRIDVXEVHWRIWKH JHQHV WKDW VKRZHG VWURQJ VSHFLHVE\SUREH LQWHUDFWLRQ HIIHFWV KLJKOLJKWV VRPH RI WKH GLIILFXOWLHVDVVRFLDWHGZLWKWKHXVHRIROLJRQXFOHRWLGHDUUD\VWRFRPSDUHJHQRW\SHVWKDW GLYHUJHDWWKHQXFOHRWLGHOHYHO&RQVHTXHQWO\RXUUHVXOWVDOVRKDYHLPSOLFDWLRQVIRUWKH LQWHUSUHWDWLRQRI$II\PHWUL[GDWDIRUDQ\FRPSDULVRQVRIJHQHWLFDOO\SRO\PRUSKLFVWUDLQV

0$7(5,$/6$1'0(7+2'6

0L[HG0RGHO$QDO\VLVRI9DULDQFH9DULDWLRQLQJHQHH[SUHVVLRQZDVDVVHVVHGXVLQJD WZRVWHS VWUDWHJ\ HVVHQWLDOO\ DV RXWOLQHG LQ &+8HW DO ,Q WKH ILUVW VWHS HDFK

LQGLYLGXDOSUREHPHDVXUHPHQWZDVFHQWHUHGUHODWLYHWRWKHDUUD\PHDQE\VXEWUDFWLQJWKH ORJWUDQVIRUPHGYDOXHRIWKHLQWHQVLW\IURPWKHPHDQORJYDOXHIRUWKHSUREHVRQWKH

UDQJH IURP WR ZLWK WKH XSSHU OLPLW LQGLFDWLQJ VDWXUDWHG VLJQDO LQWHQVLW\$OPRVW RIWKHSUREHVZHUHDWWKLVOHYHOXQGRXEWHGO\UHGXFLQJWKHSRZHURIFRPSDULVRQV LQYROYLQJKLJKO\H[SUHVVHGJHQHV$VJHQHUDOO\REVHUYHGWUDQVFULSWDEXQGDQFHLVVNHZHG WRZDUG D ODUJH QXPEHU RI JHQHV VKRZLQJ UHODWLYHO\ ORZ DEXQGDQFH KHQFH WKH VNHZHG GLVWULEXWLRQ RI LQWHQVLW\ YDOXHV DERXW WKH PHDQ $OO SDLUZLVH FRPSDULVRQV FRQWUDVWLQJ LQGLYLGXDOQXPEHUZLWKLQGLYLGXDOVQXPEHURUKDYHEURDGHUVFDWWHUSORWVUHIOHFWLQJ WKHUHSRUWHGREVHUYDWLRQWKDWWKLVLQGLYLGXDOKDVPRUHGLYHUJHQWH[SUHVVLRQLQWKHEUDLQ WKDQWKHRWKHUWZRLQGLYLGXDOV6LPLODUVDWXUDWLRQYDOXHVZHUHVHHQIRUWKHRWKHUWLVVXHV DQGVSHFLHV

7KH VHFRQG PRGHOLQJ VWHS ZDV WR ILW JHQHVSHFLILF PL[HG PRGHOV XVLQJ 352& 0,;('LQ6$6DVIROORZV LMNO LM O LN MN LM N M L

LMNO 6 7 3 67 73 63 5

30 H

ORJ

LMNO

30 GHQRWHV WKH SHUIHFW PDWFK H[SUHVVLRQ PHDVXUHPHQW RI WKHNWK SUREH RI WKHOWK

LQGLYLGXDOIRULWKVSHFLHVKXPDQFKLPSRURUDQJXWDQLQWKHMWKWLVVXHEUDLQRUOLYHU 7KHV\PEROV673UHSUHVHQWWKHIL[HGHIIHFWVRIVSHFLHVWLVVXHVDQGSUREHVUHVSHFWLYHO\ ,QGLYLGXDO HIIHFWV ZLWKLQ VSHFLHV ZHUH VSHFLILHG DV UDQGRP HIIHFWV DQG DVVXPHG WR EH LQGHSHQGHQWDQGLGHQWLFDOO\GLVWULEXWHGDFFRUGLQJWRDQRUPDOGLVWULEXWLRQZLWKPHDQ]HUR

DQG YDULDQFH U

V 7KHHLMNOVZHUH DOVR VSHFLILHG DV LQGHSHQGHQW DQG LGHQWLFDO QRUPDO

GLVWULEXWLRQVZLWKPHDQ]HURDQGYDULDQFH_{V WKDWDUHLQGHSHQGHQWRIWKH5 V} LM

O )RU

&RUUHODWLRQ FRHIILFLHQWV IRU ILOWHULQJ SUREHV&RUUHODWLRQFRHIILFLHQWVZHUHFDOFXODWHG

EHWZHHQORJ WUDQVIRUPHG KXPDQ EUDLQ 30 LQWHQVLW\ YDOXHV DLMN DQG FRUUHVSRQGLQJ

FKLPSEUDLQYDOXHVELMNIURPWKHLWKLQGLYLGXDOMWKVDPSOHDQGNWKSUREHDVVRFLDWHGZLWK

D SDUWLFXODU JHQH 7KH H[SUHVVLRQ SURILOH IRU HDFK VSHFLHV ZDV ILUVW FDOFXODWHG DV WKH

DYHUDJH SUREH PHDVXUH DPRQJ VDPSOHVD D ,-E E ,- M L LMN

N M L LMN

N

¦¦

¦¦

6XEVHTXHQWO\ WKH FRUUHODWLRQ FRHIILFLHQW EHWZHHQ WKH H[SUHVVLRQ SURILOHV RI WKRVH WZR

VSHFLHVZDVFRPSXWHGDV

E . D E D .D E .E

D

N N N N

N N N

¦

¦

¦

¦

ZKHUHDLVWKHDYHUDJHRIDNDQGELVWKHDYHUDJHRIEN

2XWOLHUSUREHVZHUHWKHQGHOHWHGV\VWHPDWLFDOO\XQWLOWKHFRUUHODWLRQH[FHHGHG)RU H[DPSOHUHPRYDORIWKHVLQJOHLQFRQVLVWHQWSUREHVLQ)LJXUH&DQG'UHVXOWVLQD ODUJHLQFUHDVHLQWKHRYHUDOOFRUUHODWLRQEHWZHHQKXPDQDQGSULPDWHGDWD7KHVSHFLHV HIIHFWIRUWKHUHPDLQLQJSUREHVLVFRQVLVWHQWDQGOLNHO\UHSUHVHQWVDEHWWHUPHDVXUHRIWKH WUXHGLIIHUHQFHLQJHQHH[SUHVVLRQ

1HLJKERUMRLQLQJ WUHHV (XFOLGHDQ GLVWDQFH PDWULFHV ZHUH FRPSXWHG IRU HDFK SDLU RI DUUD\V RQ WKH OHDVW VTXDUHV PHDQ JHQH H[SUHVVLRQ PHDVXUHV IURP WKH PL[HG PRGHO DQDO\VLV DQG UHVFDOHG WR ILW WKH IRUPDW UHTXLUHG E\ WKH SDFNDJH 3+</,3 )HOVHQVWHLQ 1HLJKERUMRLQLQJWUHHVZHUH JHQHUDWHG E\WKH1(,*+%25RSWLRQZLWKGHIDXOW VHWWLQJV7KLVDQDO\VLVLVVLPLODUWRWKDWRI(1$5'HWDOH[FHSWWKDWWKH\XVHG

&UXGHHVWLPDWLRQRIWKHIUDFWLRQRIJHQHVGLYHUJLQJXQGHUSRVLWLYHVHOHFWLRQ

)ROORZLQJ 5,).,1 HW DO DQG /<1&+ DQG +,// XQGHU PXWDWLRQGULIW

HTXLOLEULXPWKHH[SHFWHGVTXDUHGGLIIHUHQFHEHWZHHQVSHFLHVIRUHDFKJHQHH[SUHVVLRQ OHYHO LV PW ZKHUH PLV WKH PXWDWLRQDO YDULDQFH DQGWWKH WLPH LQ JHQHUDWLRQV VLQFH

VHSDUDWLRQ DQG WKH H[SHFWHG OHYHO RI LQWUDVSHFLILF YDULDQFH ZKLFK LV DVVXPHG WR KDYH UHPDLQHGFRQVWDQWLQERWKOLQHDJHVVLQFHGLYHUJHQFHLV1H PZKHUH1HLVWKHHIIHFWLYH

SRSXODWLRQVL]H7KHQWKHUDWLRRIPHDQVTXDUHHVWLPDWHVRIWKHVSHFLHVDQGLQGLYLGXDO ZLWKLQ VSHFLHV HIIHFWV )KXPDQFKLPS a >06VSHFLHV06,QG6SHFLHV@> 1H P PW@ 7KH

PXWDWLRQDO YDULDQFHV FDQFHO RXW VR WKDW WKH UHODWLRQVKLS EHWZHHQ WKH REVHUYHG DQG H[SHFWHG UDWLR RI GLYHUJHQFH WR SRO\PRUSKLF YDULDQFH LV VFDOHG E\ WKH UDWLR1HW

$VVXPLQJ DQ1H RI LQGLYLGXDOV DQG RQH JHQHUDWLRQ HYHU\ \HDUV LQ WKH

PLOOLRQ\HDUVVLQFHGLYHUJHQFHEHWZHHQKXPDQDQGFKLPSWKHH[SHFWHGGLVWULEXWLRQRI) UDWLRV LV H[SHFWHG WR EH WLPHV WKH VWDQGDUG)GLVWULEXWLRQ ZLWK RQH GHJUHH RI

5(68/76

0L[HGPRGHODQDO\VLVRIWKH$II\PHWUL[GDWD

7KHSULPDWHGDWDVHWUHSRUWHGE\(1$5'HWDOFRQVLVWVRIJHQHFKLSVLQFOXGLQJ

IRUHDFKWLVVXHEUDLQRUOLYHUDQGWZRUHSOLFDWHVRIHDFKRIWKHVHYHQLQGLYLGXDOV (DFK RI WKH DSSUR[LPDWHO\ JHQHV ZDV UHSUHVHQWHG E\ XS WR XQLTXH SUREHV DOWKRXJKWKHVHRIWHQRYHUODSDVGHVFULEHGEHORZ7KLVGDWDZDVDQDO\]HGXVLQJPL[HG PRGHODQDO\VLVRIYDULDQFH:2/),1*(5HWDO&+8HWDODVGHVFULEHGLQWKH

0DWHULDOVDQG0HWKRGVDQGEULHIO\KHUH7KHGDWDZDVILUVWFHQWUDOL]HGVLPSO\E\WDNLQJ WKH ORJDULWKP RI HDFK SUREH IOXRUHVFHQFH LQWHQVLW\ RQ WKH EDVH VFDOH DQG WKHQ VXEWUDFWLQJ WKH PHDQ YDOXH IRU WKH SDUWLFXODU JHQH FKLS 7KH UHODWLYH IOXRUHVFHQFH LQWHQVLW\ORJ30LMNOWKXVUHSUHVHQWVDPHDVXUHRIWUDQVFULSWDEXQGDQFHREVHUYHGIRUWKH

NWK3HUIHFW0DWFKSUREHIRUWKHOWKLQGLYLGXDOZLWKLQWKHLWKVSHFLHVKXPDQFKLPSRU RUDQJXWDQVDPSOHGIRUWKHMWKWLVVXHEUDLQRUOLYHU$YDOXHRIFRUUHVSRQGVWRDJHQH H[SUHVVHGDWWKHVDPSOHPHDQRUDJHQHWKDWLVRQHKDOIRUWZRIROGJUHDWHUWKDQWKH VDPSOHPHDQRUDJHQHWKDWLVRQHTXDUWHURUIRXUIROGJUHDWHUDQGVRRQ,IDJHQH KDVDPHDQYDOXHRQWKLVQRUPDOL]HGVFDOHRILQRQHVSHFLHVDQG±LQDQRWKHUZHFDQ FRQFOXGHWKDWWKHUHLVDQHLJKWIROGGLIIHUHQFHLQJHQHH[SUHVVLRQEHWZHHQWKHVSHFLHV 2WKHUPHWKRGVRIQRUPDOL]DWLRQKDYHEHHQSURSRVHG48$&.(1%86+.(55HWDO

GLIIHUHQFHVDQGVLJQLILFDQFHZHUHHVWLPDWHGIRUHDFKHIIHFWDVZHOOIRUHDFKVSHFLHVDQG WLVVXHFRPSDULVRQ

6HYHUDOFKHFNVRIGDWDTXDOLW\ZHUHSHUIRUPHG)LJXUHVKRZVDVXEPDULQH

VFDWWHUSORWRIVWDQGDUGL]HGUHVLGXDOVWKHHVWLPDWHGUHVLGXDOVH_{LMNOGLYLGHGE\WKHVTXDUH}

URRW RI WKH YDULDQFH RI WKHVH UHVLGXDOV IRU HDFK JHQH PRGHO DJDLQVW SUHGLFWHG YDOXH :KLOHWKHUHDSSHDUWREHDODUJHQXPEHURIRXWOLHUVDFWXDOO\MXVWRIWKHSUREHVKDYH VWDQGDUGL]HGUHVLGXDOVJUHDWHUWKDQ0DQ\RIWKHVHFDQEHDWWULEXWHGWRGDWDVDWXUDWLRQ 7HVWLQJ IRU WKH QRUPDOLW\ RI WKH GLVWULEXWLRQ RI UHVLGXDOV IRU HDFK JHQH VSHFLILF PRGHO LQGLFDWHG WKDW DV PDQ\ DV RI WKH JHQHV GLG QRW UHDFK WKH FRQVHUYDWLYH VLJQLILFDQFHOHYHO$VGLVFXVVHGEHORZELDVHVLQWKHGDWDGXHWRSUREHHIIHFWVPD\KDYHD SDUWLFXODUO\ODUJHLPSDFWRQLQWHUSUHWDWLRQRIFRQWUDVWVDPRQJVSHFLHV

/HYHOVRIGLYHUJHQFHZLWKLQDQGEHWZHHQVSHFLHV

'LUHFWYLVXDOL]DWLRQRIWKHVLJQLILFDQFHDQGPDJQLWXGHRIHIIHFWVLQWKH SULPDWH FRPSDULVRQVDUHSURYLGHGE\YROFDQRSORWVIRUHDFKSDLUZLVHVSHFLHVFRQWUDVWDQGHDFK WLVVXHLQ)LJXUH1RWHWKDWWKHPDLQHIIHFWHVWLPDWHVDUHDYHUDJHGRYHUDQGDGMXVWHG IRUDOORIWKHGLIIHUHQWROLJRQXFOHRWLGHSUREHVIRUHDFKJHQHDQGVLJQLILFDQFHLVDVVHVVHG LQWKHPL[HGPRGHOWDNLQJLQWRDFFRXQWDPRQJSUREHYDULDQFH9ROFDQRSORWVFRQWUDVW VLJQLILFDQFHRQWKHORJSVFDOHDJDLQVWH[SUHVVLRQGLIIHUHQFHRQWKHORJVFDOH*HQHV

7ZRIHDWXUHVRIWKHVHSORWVVWDQGRXW)LUVWWKHQXPEHURIJHQHVWRZDUGWKHWRS RI HDFK SORW LV JUHDWHU IRU WKH OLYHU WKDQ WKH EUDLQ FRQWUDVWV )RU H[DPSOH FRPSDULQJ KXPDQ DQG FKLPS DW WKH VLJQLILFDQFH OHYHO RI WKH JHQHV VKRZ HYLGHQFH IRU GLIIHUHQWLDOWUDQVFULSWDEXQGDQFHLQWKHEUDLQDQGXSWRLQWKHOLYHUZLWKDPHDQRI MXVWDIROGFKDQJHLQHLWKHUGLUHFWLRQ7KHQXPEHUVLQFUHDVHVOLJKWO\IRUWKHFRQWUDVWV LQYROYLQJWKHRWKHUVSHFLHV:HFRQILUPHGWKLVREVHUYDWLRQRQWKHKXPDQFKLPSFRQWUDVW XVLQJ WKH DQDO\WLFDO DSSURDFK LPSOHPHQWHG LQ G&KLS VRIWZDUH /, DQG :21*

ZKLFKJDYHVLPLODUUHVXOWVGDWDQRWVKRZQ6HFRQGZKHUHDVWKHOLYHUSORWVDUHIDLUO\ V\PPHWULFDOWKHEUDLQSORWVDUHKLJKO\DV\PPHWULFDOLQHDFKFDVHWKRVHJHQHVRQWKHOHIW KDQG VLGH RI HDFK SORW DUH PRUH GLVSHUVHG DFURVV WKH UDQJH RI H[SUHVVLRQ GLIIHUHQFHV 6LQFHWKHSORWVZHUHGUDZQZLWKH[SUHVVLRQGLIIHUHQFHH[SUHVVHGDVFKLPSPLQXVKXPDQ RUDQJXWDQPLQXVKXPDQDQGRUDQJXWDQPLQXVFKLPSWKLVPHDQVWKDWWKHUHDUHDSSDUHQWO\ PDQ\PRUHJHQHVXSUHJXODWHGLQWKHUDQJHRIWRIROGLQWKHKXPDQEUDLQUHODWLYHWRWKH RWKHU VSHFLHV WKDQ DUH GRZQUHJXODWHG 6LPLODUO\ WKH FKLPS VKRZV DQ DSSDUHQW ELDV WRZDUGXSUHJXODWLRQUHODWLYHWRWKHRUDQJXWDQ

7DEOH7KHVHDUH[_{WKHFRQVHUYDWLYH%RQIHUURQLDGMXVWHGFRQWUDVWFDOFXODWHGDV}

DQGUHIOHFWHGLQDQHJDWLYHORJSYDOXHJUHDWHUWKDQORJS!

DQGORJS!:HDOVRSUHVHQWWKHDYHUDJHH[SUHVVLRQGLIIHUHQFHIRU

ERWK XS DQG GRZQUHJXODWHG JHQHV WKH SHUFHQWDJH RI JHQHV WKDW DUH DSSDUHQWO\ XSUHJXODWHG DQG WKH SHUFHQWDJH RI DOO JHQHV WKDW DUH GLIIHUHQWLDOO\ H[SUHVVHG IRU HDFK FRQWUDVW

7DEOH)UDFWLRQRI*HQHVVKRZLQJ([SUHVVLRQ'LIIHUHQFHV$PRQJ3ULPDWH6SHFLHV BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB &RPSDULVRQ 6LJ/HYHO_{18Su8S1'Qu'Qu$OO8SJHQHV}

BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB 5DZ'DWD BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB %UDLQ+B& %RQIHUURQL %UDLQ+B& %UDLQ+B& /LYHU+B& %RQIHUURQL /LYHU+B& /LYHU+B& %UDLQ&B2 %RQIHUURQL %UDLQ&B2 %UDLQ&B2 /LYHU&B2 %RQIHUURQL /LYHU&B2 /LYHU&B2 %UDLQ+B2 %RQIHUURQL %UDLQ+B2 %UDLQ+B2 /LYHU+B2 %RQIHUURQL /LYHU+B2 /LYHU+B2 BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB )LOWHUHG'DWD BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB %UDLQ+B& %RQIHUURQL %UDLQ+B& %UDLQ+B& BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB 1RWHV

_{6LJQLILFDQFHOHYHOV%RQIHUURQL ORJ3! ORJ3! ORJ3! 1XPEHURIJHQHVXSRUGRZQUHJXODWHGDWLQGLFDWHGVLJQLILFDQFHOHYHO}

_{0DJQLWXGHRIIROGFKDQJHXSJUHDWHULQOHIWKDQGVSHFLHVRUGRZQRSSRVLWHGLUHFWLRQ}

EDVHGRQWKHUDZXQILOWHUHGGDWD

7DEOH)UDFWLRQRI*HQHVVKRZLQJ([SUHVVLRQ'LIIHUHQFHV$PRQJ0XULQH 6SHFLHV

BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB

&RPSDULVRQ 6LJ/HYHO_{18Su8S1'Qu'Qu$OO8SJHQHV}

BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB 5DZ'DWD BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB %UDLQ0B6 %RQIHUURQL %UDLQ0B6 %UDLQ0B6 /LYHU0B6 %RQIHUURQL /LYHU0B6 /LYHU0B6 %UDLQ6B& %RQIHUURQL %UDLQ6B& %UDLQ6B& /LYHU6B& %RQIHUURQL /LYHU6B& /LYHU6B& %UDLQ0B& %RQIHUURQL %UDLQ0B& %UDLQ0B& /LYHU0B& %RQIHUURQL /LYHU0B& /LYHU0B& BBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBBB 1RWHV

_{6LJQLILFDQFHOHYHOV%RQIHUURQL ORJ3! ORJ3! ORJ3! 1XPEHURIJHQHVXSRUGRZQUHJXODWHGDWLQGLFDWHGVLJQLILFDQFHOHYHO}

_{0DJQLWXGHRIIROGFKDQJHXSJUHDWHULQOHIWKDQGVSHFLHVRUGRZQRSSRVLWHGLUHFWLRQ}

EDVHGRQWKHUDZXQILOWHUHGGDWD

RYHU0VSUHWXVRYHU0FDUROLDUHREVHUYHGWKRXJKQRWDVVWURQJO\DVIRUWKHSULPDWH GDWD

)URPERWK7DEOHVDQGLWFDQEHVHHQWKDWWKHIUDFWLRQRIJHQHVWKDWDSSHDU WR EH XSUHJXODWHG WKDW LV H[SUHVVLRQ LQ VSHFLHV $ LV JUHDWHU WKDQ LQ VSHFLHV % LV FRQVLVWHQWO\UHGXFHGDVWKHVLJQLILFDQFHOHYHOLVUHOD[HGIRUH[DPSOHIURPWR IRUWKHKXPDQFKLPSEUDLQFRQWUDVW7KLVLPSOLHVWKDWWKHWKHUHLVDV\VWHPDWLFWHQGHQF\ IRU RYHUHVWLPDWLRQ RI WKH H[SUHVVLRQ OHYHO IRU JHQHV LQ WKH RUGHU KXPDQ ! FKLPS ! RUDQJXWDQRUXQGHUHVWLPDWLRQLQWKHRSSRVLWHRUGHU$VLPLODUWHQGHQF\ZDVREVHUYHGLQ WKH PXULQH GDWDVHW 0 PXVFXOXV ! 0 VSUHWXV ! 0 FDUROL DQG LQ DOO FDVHV WKH FRQVHTXHQW DSSDUHQW ELDV WRZDUG XSUHJXODWLRQ LV REVHUYHG LQ WKH VSHFLHV JHQHWLFDOO\ FORVHVWWR0PXVFXOXVIURPZKLFKWKHSUREHVHTXHQFHVGHULYH

3UREHHIIHFWVLQWKHFRQWH[WRIJHQHWLFGLYHUJHQFH

UHGXFHGK\EULGL]DWLRQWRDIHZSUREHVLQWKHGLYHUJHQWVSHFLHVFRQWULEXWHVWRDSSDUHQWXS UHJXODWLRQ

6LJQLILFDQFHOHYHOVDUHDIIHFWHGE\DEDODQFHEHWZHHQWKHIROGFKDQJHDYHUDJHG DFURVVSUREHVWHQGLQJWRPDNHPRUHJHQHVDSSHDUWREHXSUHJXODWHGDQGWKHLQFUHDVHLQ DPRQJSUREHYDULDQFHGXHWRVHTXHQFHGLYHUJHQFHIRUVRPHSUREHVWHQGLQJWRUHGXFHWKH VLJQLILFDQFHRIFRQWUDVWV:HWKXVDVNHGZKHWKHUWKHVSHFLHVE\SUREHLQWHUDFWLRQHIIHFW LQWKHPL[HGPRGHOIRUHDFKJHQHLVPRUHOLNHO\WREHVLJQLILFDQWIRUXSUHJXODWHGJHQHV 7KLVHIIHFWLVVPDOOLQPDJQLWXGHEXWLWLVVLJQLILFDQWIRUPRUHWKDQKDOIRIWKHJHQHVVHH 6XSSOHPHQWDU\,QIRUPDWLRQ7KHUHGSRLQWVLQWKHYROFDQRSORWVLQ)LJXUHLQGLFDWH WKHJHQHVZLWKWKHWRSRIWKHPRVWVLJQLILFDQWVSHFLHVE\SUREHLQWHUDFWLRQHIIHFWV DQG WKHVH DUH DOPRVW DOO DSSDUHQWO\ XSUHJXODWHG 7KLV UHVXOW LV FRQVLVWHQW ZLWK WKH K\SRWKHVLVWKDWWKHRYHUZKHOPLQJELDVWRZDUGDSSDUHQWXSUHJXODWLRQLQWKHEUDLQLQWKH SK\ORJHQHWLFDOO\ FORVHVW VSHFLHV ZKLFK LV H[SHFWHG WR VKRZ WKH OHDVW VHTXHQFH GLYHUJHQFHPLJKWEHDWWULEXWHGWRORVVRIK\EULGL]DWLRQWRDVXEVHWRISUREHV

KXPDQUHODWLYHWRFKLPS*HQH%E\FRQWUDVWLV³SRRUO\EHKDYHG´LQVRIDUDVHDFKSUREH SUHGLFWV D GLIIHUHQW PDJQLWXGH IRU WKH VSHFLHV GLIIHUHQFH *HQH & LV DQ H[DPSOH RI D ORFXVZKHUHDVLQJOHSUREHWKDWVKRZVPXFKUHGXFHGK\EULGL]DWLRQWRFKLPSF'1$WKH IDUULJKWSUREHZRXOGEHVXIILFLHQWWRVXJJHVWDQRYHUDOOIROGXSUHJXODWLRQLQKXPDQV UHODWLYHWRFKLPSV7KLVVLWXDWLRQZDVDOVRRFFDVLRQDOO\VHHQLQWKHUHYHUVHGLUHFWLRQRQH SUREHJLYHVDVWURQJHUFKLPSVLJQDODVVKRZQIRU*HQH'+RZHYHUPDQ\RIWKHFDVHV RIVWURQJVSHFLHVE\SUREHLQWHUDFWLRQHIIHFWVLQYROYHGPXOWLSOHSUREHVDVVHHQIRU*HQHV ( DQG ) /$03 LV DSSDUHQWO\ XSUHJXODWHG LQ KXPDQV EXW RQO\ KDOI RI WKH SUREHV VKRZHG WKH GLIIHUHQFH DQG DOO RI WKHVH HLJKW SUREHV RYHUODS ZLWK WKHLU ¶ PRVW QXFOHRWLGHVVHSDUDWHGE\MXVWEDVHV7KHQH[WWZRSUREHVMXVWDQGEDVHVIXUWKHU ¶VKRZPXFKUHGXFHGVSHFLHVGLIIHUHQFH0$3/&%JDYHDVLPLODUUHVXOWH[FHSWWKDW WKHVSHFLHVGLIIHUHQFHZDVVHHQLQWZRQRQRYHUODSSLQJVHWVRISUREHV,WLVVREHULQJLQ WKLVFDVHWKDWHYHQSUREHVWKDWRYHUODSE\DOOEXWRQHQXFOHRWLGHJLYHIROGGLIIHUHQFHV LQVLJQDOLQWHQVLW\IRUERWKVSHFLHVDQGVHYHUDOIROGGLIIHUHQFHVEHWZHHQVSHFLHV

',6&866,21

3RVVLEOH%LDVHVLQ2OLJRQXFOHRWLGH([SUHVVLRQ'DWD

2XU PL[HG PRGHO DQDO\VHV RI WKH SULPDWH DQG PXULQH JHQH H[SUHVVLRQ GDWD OHDGV WR FRQFOXVLRQVWKDWDUHQRWQHFHVVDULO\FRQVLVWHQWZLWKWKRVHUHSRUWHGE\WKHRULJLQDODXWKRUV (1$5'HWDOLQVRIDUDVWKHUHLVOLWWOHHYLGHQFHIRUDFFHOHUDWHGGLYHUJHQFHLQJHQH

H[SUHVVLRQLQWKHKXPDQEUDLQ:KLFKHYHUPHWKRGRIDQDO\VLVLVXVHGWKHLQWHUSUHWDWLRQ VKRXOGEHWHPSHUHGWRVRPHH[WHQWE\RXUILQGLQJRISRWHQWLDOVSHFLHVVSHFLILFELDVHVLQ WKHPDJQLWXGHRILQIHUUHGWUDQVFULSWDEXQGDQFH6LQFHLQDOOFDVHVPRUHJHQHVZHUHVHHQ WREHXSUHJXODWHGLQWKHVSHFLHVWKDWLVFORVHVWWRWKHRQHZKRVHVHTXHQFHZDVXVHGWR JHQHUDWHWKHSUREHVWKDWLV+RPRVDSLHQVRU0PXVFXOXVWKHPRVWVWUDLJKWIRUZDUG H[SODQDWLRQLVWKDWWKLVELDVUHIOHFWVGLIIHUHQWLDOK\EULGL]DWLRQWRORVVRISHUIHFWVHTXHQFH PDWFKLQJ

JHQH 0DQ\ IDFWRUV SUHVXPDEO\ LQFOXGLQJ DPRXQW RI FURVVK\EULGL]DWLRQ DOWHUQDWLYH VSOLFLQJDQGVHTXHQFHGLYHUJHQFHPXVWFRQWULEXWHWRSUREHHIIHFWVDQGLWLVQRWREYLRXV KRZWRGHDOZLWKWKHVHVWDWLVWLFDOO\7KHIDFWWKDW$II\PHWUL[¶SUREHVHOHFWLRQDOJRULWKP WHQGVWRFKRRVHFOXVWHUVRIVHTXHQFHVWKDWGLIIHUE\MXVW D IHZEDVHV DOVRLQWURGXFHV D FRUUHODWLRQVWUXFWXUHWRWKHGDWDWKDWIRUPDOO\EXWLPSUDFWLFDOO\VKRXOGEHGHDOWZLWKRQD JHQHE\JHQHEDVLV:HDQGRWKHUV&+8HWDO/,DQG:21*6$6,.HWDO

KDYHGHPRQVWUDWHGWKDWPRGHOLQJJHQHH[SUHVVLRQSURILOHVE\SUREHZLWKLQJHQHLV JHQHUDOO\PXFKPRUHDFFXUDWHWKDQXVLQJWKHDYHUDJHGLIIHUHQFHPHDVXUHEXWLWLVDOVR FOHDUWKDWJHQRW\SLFGLIIHUHQFHVFDQDIIHFWWKHUHVXOWVLQZD\VWKDWDUHGLIILFXOWWRFRQWURO

7KHVHFRQGOLQHRIHYLGHQFHDUJXLQJDJDLQVWVHTXHQFHGLYHUJHQFHDFFRXQWLQJIRU DOORIWKHELDVHVWRZDUGXSUHJXODWLRQLVWKDWWKHHIIHFWDSSHDUVWREHPXFKJUHDWHULQWKH EUDLQVDPSOHVWKDQWKHOLYHU7KLVFRXOGLPSO\WKDWEUDLQSURWHLQVDUHGLYHUJLQJDWDIDVWHU UDWH WKDQ OLYHU SURWHLQV &RPSDUDWLYH VHTXHQFH DQDO\VHV ZLOO VRRQ UHVROYH WKLV LVVXH (1$5'HW DO DOVR SURYLGHG ' JHO HOHFWURSKRUHVLV HYLGHQFH IRU GLYHUJHQFH LQ

H[SUHVVLRQDUHUHDODQGWKDWWKHUHPD\LQIDFWEHDELRORJLFDOEDVLVWRWKHWHQGHQF\WRZDUG LQFUHDVHGJHQHH[SUHVVLRQLQKXPDQVRYHUFKLPSVDQGRUDQJXWDQ:KHWKHUWKLVUHODWHVWR LQFUHDVHGVL]HDQGRUFRPSOH[LW\RIWKHEUDLQUHPDLQVWREHVHHQ

'LYHUJHQW*HQH([SUHVVLRQDPRQJ3ULPDWHV

2XU UHDQDO\VLV RI (1$5' HW DO¶V GDWD RQ D JHQHE\JHQH EDVLV LV LQ EURDG

DJUHHPHQWZLWKWKHLUDQDO\VLVEDVHGRQZKROHWUDQVFULSWRPHYDULDWLRQLQVHYHUDOUHVSHFWV EXW DOVR DOORZV TXDQWLILFDWLRQ RI WKH IUDFWLRQ RI JHQHV WKDW FRQWULEXWH WR ZLWKLQ DQG EHWZHHQVSHFLHVGLIIHUHQFHV%RWKDQDO\VHVLQGLFDWHWKDWWKHUHDUHVLJQLILFDQWGLIIHUHQFHV LQJHQHH[SUHVVLRQDPRQJVSHFLHVWKDWDUHRI D JUHDWHUPDJQLWXGHWKDQWKHGLIIHUHQFHV DPRQJ LQGLYLGXDOV ZLWKLQ D VSHFLHV DQG WKDW WKHUH LV D JHQHUDO LQFUHDVH LQ GHJUHH RI WUDQVFULSWLRQDOGLYHUJHQFHDVVHTXHQFHDQGKHQFHWHPSRUDOGLYHUJHQFHLQFUHDVHV $V SRLQWHGRXWE\(1$5'HWDOFRQFOXVLRQVFRQFHUQLQJUHODWLYHUDWHVRIGLYHUJHQFH

DUHKRZHYHUTXLWHVHQVLWLYHWRWKHPHWULFVXVHG

GLIIHUHQWLDOO\H[SUHVVHGEHWZHHQKXPDQDQGFKLPSDOVRZLWKDQDYHUDJHIROGFKDQJH DQGJHQHVEHWZHHQKXPDQDQGRUDQJXWDQDWDVOLJKWO\KLJKHUPHDQIROGFKDQJHRI 7KH FKLPSRUDQJXWDQ FRPSDULVRQV DUH LQWHUPHGLDWH ZLWK VOLJKWO\ PRUH JHQHV GLIIHUHQWLDOO\H[SUHVVHGZLWKDODUJHUIROGFKDQJHLQWKHOLYHUWKDQLQWKHEUDLQ

0RVW RI RXU FRPSDULVRQV RI VSHFLHV DQG WLVVXH SDLUV VXJJHVW WKHQ WKDW WKHUH DUH PRUH JHQHVGLYHUJHQWO\H[SUHVVHGLQWKHOLYHUWKDQWKHEUDLQDQGWKDWWKHPDJQLWXGHRIFKDQJH DOVRWHQGVWREHJUHDWHULQWKHOLYHU:KLOHLWLVFOHDUWKDWGUDPDWLFFRJQLWLYHFKDQJHVKDYH RFFXUUHGSDUWLFXODUO\LQ WKHKXPDQOLQHDJHLWDOVRQRWVXUSULVLQJWKDWWUDQVFULSWLRQKDV HYROYHG JUHDWO\ LQ WKH OLYHU JLYHQ WKH GLIIHUHQFHV LQ GLHW DQG FXOWXUH RI WKH SULPDWH VSHFLHV$SRVVLEOHUHFRQFLOLDWLRQRIRXUILQGLQJVZLWKWKHLQIHUHQFHIDYRUHGE\(1$5'

HW DO WKDW ³FKDQJHV RI JHQH H[SUHVVLRQ LQ WKH EUDLQ PD\ KDYH EHHQ HVSHFLDOO\ SURQRXQFHGGXULQJUHFHQWKXPDQHYROXWLRQ´LVWKHVXJJHVWLRQWKDWPXFKRIWKDWFKDQJH KDVRFFXUUHGRQWKHKXPDQRUDQJXWDQD[LV:HDOVRREVHUYHDUHODWLYHO\ODUJHEUDQFK OHQJWK EHWZHHQ DOO KXPDQV DQG WKH FHQWUDO QRGH RQ QHLJKERUMRLQLQJ WUHHV EDVHG RQ WUDQVFULSWRPHZLGH DYHUDJH H[SUHVVLRQ GLIIHUHQFHV DW HDFK OHYHO RI VLJQLILFDQFH VHH 6XSSOHPHQWDU\)LJXUH,WLVQRWHZRUWK\WKRXJKWKDWWKHUHODWLYHOHQJWKRIWKLVQRGH DVZHOODVWKHGLYHUJHQFHRIWKHVHFRQGKXPDQLQGLYLGXDOIURPWKHRWKHUVLVYHU\PXFKD IXQFWLRQRIWKHQXPEHURIJHQHVLQFOXGHGLQWKHDQDO\VLV

UHFHSWRUVDQGFKDQQHOVDUHREYLRXVLQWKHEUDLQOLVWDVDUHGHWR[LILFDWLRQHQ]\PHVVXFKDV F\WRFKURPH3VRQWKHOLYHUOLVW+RZHYHUWKHPDMRULW\RIJHQHVKDYHPRUHJHQHUDO SRWHQWLDOIXQFWLRQVLQUHJXODWLRQRIFHOOJURZWKDQGGLYLVLRQDQGFHOOVWUXFWXUHPHPEHUV RIPRVWRIWKHPDMRUJHQHRQWRORJ\FDWHJRULHVDUHUHSUHVHQWHGLQERWKOLVWV

)LQDOO\ ZH FDQ DOVR DVN ZKHWKHU WKH GLYHUJHQFH LQ JHQH H[SUHVVLRQ LV PRUH OLNHO\ DWWULEXWDEOH WR GULIW RU GLYHUVLI\LQJ VHOHFWLRQ $ VLJQLILFDQWO\ HOHYDWHG PHDVXUH RI GLYHUJHQFH LQ H[SUHVVLRQ EHWZHHQ VSHFLHV UHODWLYH WR WKH REVHUYHG OHYHO RI DPRQJ LQGLYLGXDOZLWKLQVSHFLHVYDULDWLRQLVQRWSULPDIDFLHHYLGHQFHIRUVHOHFWLRQ)LJXUH$ VKRZVWKDWWKHPRVWVLJQLILFDQWJHQHVLQWKHKXPDQYHUVXVFKLPSEUDLQFRPSDULVRQERWK GLYHUJHEHWZHHQVSHFLHVDQGKDYHUHODWLYHO\ORZOHYHOVRILQWUDVSHFLILFYDULDQFH7KHUH DUH DOVR D ODUJH QXPEHU RI JHQHV IRU ZKLFK WKLV UHODWLRQVKLS LV UHYHUVHG ,Q IDFW D KLVWRJUDP RI WKH ORJ UDWLRV RI WKH PHDQ VTXDUHV IRU WKH VSHFLHV DQG LQGLYLGXDO ZLWKLQ VSHFLHV FRPSRQHQWV LV VOLJKWO\ VNHZHG WRZDUG ORZ UDWLRV VXJJHVWLQJ WKDW PDQ\ JHQHV PD\EHPRUHYDULDEOHZLWKLQVSHFLHVWKDQH[SHFWHG5,).,1HWDOKDYHUHFHQWO\

SURSRVHGIROORZLQJ/<1&+DQG+,//¶VDSSURDFKIRUSKHQRW\SLFWUDLWVWKDWWKH

H[SHFWHG GHJUHH RI GLYHUJHQFH XQGHU PXWDWLRQGULIW HTXLOLEULXP FDQ EH IRUPXODWHG E\ VFDOLQJWKHUDWLRRIPHDQVTXDUHVIRUGLYHUJHQFHDQGSRO\PRUSKLVPE\WKHUDWLRRIWZLFH WKHHIIHFWLYHSRSXODWLRQVL]HRYHUWKHQXPEHURIJHQHUDWLRQVVLQFHGLYHUJHQFH$VVXPLQJ DVPDOOHIIHFWLYHSRSXODWLRQVL]HIRUKXPDQVRILQGLYLGXDOVDQGDPHDQJHQHUDWLRQ WLPHRI\HDUVRYHUWKHPLOOLRQ\HDUVVLQFHWKHKXPDQDQGFKLPSOLQHDJHVGLYHUJHG %581(7HWDOWKHH[SHFWHGGLVWULEXWLRQRIUDWLRVIRUWKLVGDWDVHWLVWRWLPHV

SRO\PRUSKLVPUDWLRJUHDWHUWKDQDKDQGIXORIMXVWWRJHQHVLQRXUDQDO\VLV FOHDUO\OLHLQWKHXSSHUWDLOVRIWKHH[SHFWHGOHYHORIGLYHUJHQFHIRUWKHVHSRSXODWLRQ SDUDPHWHUV5HOD[DWLRQRIWKHVHFRQVHUYDWLYHDVVXPSWLRQVSURYLGHVVXJJHVWLYHHYLGHQFH WKDWRUPRUHRIWKHJHQHVPD\EHH[SHULHQFLQJGLYHUVLI\LQJVHOHFWLRQ&OHDUO\PRUH LQGLYLGXDOVQHHGWREHVDPSOHGDWGLIIHUHQWDJHVDQGIRUPRUHWDUJHWHGWLVVXHVDPSOHVEXW FRPSDULVRQ RI JHQH H[SUHVVLRQ GLYHUJHQFH FRLQFLGHQW ZLWK DVVHVVPHQW RI QXFOHRWLGH VHTXHQFHGLYHUJHQFHLVDSURPLVLQJDSSURDFKWRLGHQWLILFDWLRQRIJHQHVWKDWPD\KDYH FRQWULEXWHGWRKXPDQFRJQLWLYHHYROXWLRQ

6XSSOHPHQWDU\)LJXUH1HLJKERUMRLQLQJWUHHVIRUSULPDWHGDWD7RSWRERWWRP %UDLQPRVWVLJQLILFDQWJHQHVSIURPWKHFRPELQHGWKUHHVSHFLHVGDWDVHW %UDLQDOOJHQHV/LYHUPRVWVLJQLILFDQWJHQHVS/LYHUDOOJHQHV,QDOO SORWVWKHEUDQFKOHQJWKLVSURSRUWLRQDOWRWKHGLVWDQFHEHWZHHQLQGLYLGXDOVRUDQJXWDQ DWWLSRIOHIWEUDQFKKXPDQVDQGFKLPSVHDFKDYHUDJHGRYHUWZRUHSOLFDWHV$V QRWHGE\(QDUGHWDOWKHEUDQFKIURPWKHFHQWUDOQRGHWRWKHEDVHRIWKHKXPDQVLVPRUH WKDQWZLFHDVORQJWKDQWKHFRUUHVSRQGLQJEUDQFKWRFKLPSVEXWRQO\IRUWKHEUDLQQRW OLYHUVDPSOH+RZHYHUWKHFRQQHFWLYLW\EHWZHHQLQGLYLGXDOVZLWKLQDVSHFLHVLVVWURQJO\ LQIOXHQFHGE\WKHQXPEHURIJHQHVLQFOXGHGLQWKHDQDO\VLV

$&.12:/('*(0(176

:H WKDQN 6YDQWH 3llER IRU FRUUHVSRQGHQFH DQG FRPPHQWV RQ WKH DQDO\VLV RI GDWD JHQHUDWHG LQ KLV ODERUDWRU\ DQG %UXFH :HLU =KDR%DQJ =HQJ 6SHQFHU 0XVH DQG 0DU\HOOHQ5XYRORIRUGLVFXVVLRQV:3+LVVXSSRUWHGE\D*HQRPH6FLHQFH*UDGXDWH )HOORZVKLS IURP WKH %LRLQIRUPDWLFV 3URJUDP DW 1& 6WDWH 8QLYHUVLW\ DQG UHVHDUFK LQ **¶VODERUDWRU\LVVXSSRUWHGLQSDUWE\1,+32*0

/,7(5$785(&,7('

%UXQHW0*X\)3LOEHDP'0DFND\H+7/LNLXV$HWDO$QHZKRPLQLGIURP WKH8SSHU0LRFHQHRI&KDG&HQWUDO$IULFD1DWXUH

&DYDOLHUL'7RZQVHQG-3+DUWO'/0DQLIROGDQRPDOLHVLQJHQHH[SUHVVLRQLQD YLQH\DUGLVRODWHRI6DFFKDURP\FHVFHUHYLVLDHUHYHDOHGE\'1$PLFURDUUD\DQDO\VLV 3URF1DWO$FDG6FL86$

&KHXQJ9*6SLHOPDQ567KHJHQHWLFVRIYDULDWLRQLQJHQHH[SUHVVLRQ1DWXUH *HQHWLFV6XSSO

&KX70:HLU%:ROILQJHU5$V\VWHPDWLFVWDWLVWLFDOOLQHDUPRGHOLQJDSSURDFKWR ROLJRQXFOHRWLGHDUUD\H[SHULPHQWV0DWKHPDWLFDO%LRVFLHQFHV

(QDUG:.KDLWRYLFK3.ORVH-=ROOQHU6+HLVVLJ)HWDO,QWUDDQGLQWHUVSHFLILF YDULDWLRQLQSULPDWHJHQHH[SUHVVLRQSDWWHUQV6FLHQFH

)HOVHQVWHLQ - 3+</,3 3K\ORJHQ\ ,QIHUHQFH 3DFNDJH 9HUVLRQ &ODGLVWLFV

-LQ:5LOH\50:ROILQJHU5':KLWH.33DVVDGRU*XUJHO**LEVRQ*7KH FRQWULEXWLRQV RI VH[ JHQRW\SH DQG DJH WR WUDQVFULSWLRQDO YDULDQFH LQ 'URVRSKLOD PHODQRJDVWHU1DWXUH*HQHWLFV

.HUU 0. 0DUWLQ 0 &KXUFKLOO *$ $QDO\VLV RI YDULDQFH IRU JHQH H[SUHVVLRQ PLFURDUUD\GDWD-&RPSX%LRO

/L&:RQJ:+0RGHOEDVHGDQDO\VLVRIROLJRQXFOHRWLGHDUUD\VH[SUHVVLRQLQGH[ FRPSXWDWLRQDQGRXWOLHUGHWHFWLRQ3URF1DWO$FDG6FL86$

/\QFK0DQG+LOO:*3KHQRW\SLFHYROXWLRQE\QHXWUDOPXWDWLRQ(YROXWLRQ

2OHNVLDN0)&KXUFKLOO*$&UDZIRUG'/9DULDWLRQLQJHQHH[SUHVVLRQZLWKLQ DQGDPRQJQDWXUDOSRSXODWLRQV1DWXUH*HQHWLFV

4XDFNHQEXVK - 0LFURDUUD\ GDWD QRUPDOL]DWLRQ DQG WUDQVIRUPDWLRQ 1DWXUH

*HQHWLFV6XSSO

5LINLQ 6$ .LP - :KLWH .3 (YROXWLRQ RI JHQH H[SUHVVLRQ LQ WKH 'URVRSKLOD PHODQRJDVWHUVXEJURXS1DWXUH*HQHWLFV

6DVLN 5 &DOYR ( &RUEHLO - 6WDWLVWLFDO DQDO\VLV RI KLJKGHQVLW\ ROLJRQXFOHRWLGH DUUD\VDPXOWLSOLFDWLYHQRLVHPRGHO%LRLQIRUPDWLFV

&KDSWHU:+2$5(7+26(675$1*(56,17+(/$7,1648$5("

$EVWUDFW

$ /DWLQ 6TXDUH GDWD ZDV SURYLGHG E\ $II\PHWUL[ WR HYDOXDWH VWDWLVWLFDO DOJRULWKPV IRU PLFURDUUD\ GDWD DQDO\VLV , DSSURDFK LW IURP D FODVVLFDO SDUDPHWULF VWDWLVWLFDO PRGHOLQJ SHUVSHFWLYH7KHILUVWVWDJHLVWRIRUPXODWHDUHDVRQDEOHPRGHOIRUWKHSUREHOHYHOGDWDEDVHG RQ H[WDQW NQRZOHGJH RI WKH H[SHULPHQWDO GHVLJQ DQG WHFKQRORJ\ 6RPH RSWLRQV DUH SUHVHQWHGDQGLWLVVHWWOHGRQDOLQHDUPL[HGPRGHOIRUWKHORJSHUIHFWPDWFKGDWD8SRQ

DSSO\LQJWKLVPRGHOWRWKHGDWDIRUHYHU\JHQHLQWXUQLWLVGLVFRYHUHGWKDWQRWRQO\GRWKH IRXUWHHQ VSLNHGLQ JHQHV DSSHDU KLJKO\ VLJQLILFDQW EXW WKDW D IHZ DGGLWLRQDO XQH[SHFWHG JHQHVGLVSOD\SURILOHVUHPDUNDEO\VLPLODUWRWKRVHRIWKHIRXUWHHQ([FHSWIRUSUREHVHWV DLPHGDWH[DPLQLQJWKHVDPHJHQHVLWLVOLNHO\WKDWVRPHVKRUWPRWLIVPLJKWEHWKHUHDVRQIRU WKLV FURVV K\EULGL]DWLRQ (DFK RI WKHVH JHQHV ZDV LQYHVWLJDWHG DQG VRPH GHWDLOV ZHUH SURYLGHGZLWKSODXVLEOHH[SODQDWLRQV

,1752'8&7,21

0LFURDUUD\GDWDDQDO\VLVLVDFRPSOH[SURFHVVLQYROYLQJLPDJHDQDO\VLVQRUPDOL]DWLRQ PRGHOLQJ DQG FOXVWHULQJ (DFK VWHS SOD\V DQ LPSRUWDQW UROH LQ UHDFKLQJ DFFXUDWH FRQFOXVLRQV7RHYDOXDWHPHWKRGVXVHGIRUDQDO\VLVDKLJKTXDOLW\GDWDVHWLVYHU\XVHIXO 7KH$II\PHWUL[/DWLQ6TXDUHGDWDLVTXLWHDSSURSULDWHIRUWKLVHQG>$II\PHWUL[WHFKQLFDO UHSRUW@DVLWSURYLGHVQRWRQO\DJRRGH[SHULPHQWDOGHVLJQEXWDOVRNQRZQWDUJHWV IRUHYDOXDWLRQ7KHGHVLJQZLOOEHEULHIO\VXPPDUL]HGLQWKHQH[WVHFWLRQ

,Q WKLV UHSRUW WKH GDWD VHW ZDV ILUVW QRUPDOL]HGDQG WKHQ D OLQHDU PL[HG PRGHO >&KX HW DO @ ZDV XVHG WR GHWHFW SUREH VHWV ZLWK VLJQLILFDQW YDULDWLRQ EHWZHHQ H[SHULPHQWV ZKLFK ZHUH GHVLJQHG WR KDYH GLIIHUHQW SDWWHUQV RI WUDQVFULSW FRQFHQWUDWLRQ7KHK\EULGL]DWLRQOHYHORIHDFKJHQHLVH[DPLQHGIRUHDFKWDUJHWSURILOH ,WLVDVVXPHGWKDWRQO\WKHWDUJHWSUREHVHWVZLOOVKRZWKHH[SUHVVLRQSURILOHPDWFKLQJ WKHLU UHVSHFWLYH VSLNHG JHQHV &XULRXVO\ WKLV DQDO\VLV UHWULHYHV QRW RQO\ WKH SXWDWLYH WDUJHWVWKDWPDWFKWKHVSLNHGJHQHVEXWDOVRVRPHXQH[SHFWHGSUREHVHWVWKDWVKRZWKH VDPHSURILOHV&HUWDLQPRWLIVZHUHFRQVLGHUHGWREHWKHUHDVRQIRUFURVVK\EULGL]DWLRQ DQGVRPHH[DPSOHVZHUHGLVFXVVHGLQGHWDLO

7+($))<0(75,;/$7,1648$5((;3(5,0(17

7DEOH /DWLQ 6TXDUH GHVLJQ (DFK FROXPQ UHSUHVHQWV RQH FRPELQDWLRQ RI FRQFHQWUDWLRQVIRUWKHWUDQVFULSWVOLVWHGLQWKHOHIWPRVWFROXPQ7KHFRQFHQWUDWLRQLV LQWKHXQLWRIS0

([SHULPHQWV 7UDQVFULSW

$ % & ' ( ) * + , - . / 0

12 3

45 67

BDW

BDW

BDW

BDW

BDW

BDW

BDW

BDW

BDW

BDW

BDW

BDW

BDW

67$7,67,&$/02'(/6(/(&7,21

)RU WKHVH GDWD WKH H[SHULPHQWDO GHVLJQ LV ZHOO NQRZQ DOWKRXJK VHYHUDO RSWLRQV DUH DYDLODEOHUHJDUGLQJZKLFKGHSHQGHQWYDULDEOHWRXVHLQWHUPVRIWKHSHUIHFWPDWFK30 DQGPLVPDWFK00LQWHQVLW\PHDVXUHPHQWV6RPHFKRLFHVLQFOXGHPRGHOVIRUSDLUHG GLIIHUHQFHV>/LDQG:RQJDE@30RQO\>&KXHWDO@>/D]DULGLVHWDO @ DGMXVWHG 30 >(IURQ HW DO @ >,UL]DUUD\ HW DO @ ERWK 30 DQG 00 >/HPRQHWDO@>7HQJ@6RPHRIWKHVHDUHRQWKHRULJLQDOVFDOHDQGVRPHRQ DORJVFDOHDQGHYHQFRPSURPLVHVKDYHEHHQUHFRPPHQGHG>'XUELQHWDO@+RZ WRGHFLGH"

/LQHDU UHSURGXFLELOLW\ LV RQH FULWHULRQ WKDW KDV EHDULQJ DQG 7DEOH OLVWV WKH DYHUDJHFRUUHODWLRQFRHIILFLHQWRIVHYHUDOGLIIHUHQWLQWHQVLW\PHDVXUHPHQWVRIWKHIRXUWHHQ VSLNHGJHQHVZLWKLQHDFKRIIRXUWHHQH[SHULPHQWDOJURXSV7KHORJWUDQVIRUPHG30DQG 00YDOXHVKDYHWKHEHVWFRQVLVWHQF\LQWKLVPHWULFIRUPRVWRIWKHH[SHULPHQWDOJURXSV %DVHGRQWKLVHYLGHQFHDQGWKHIDFWWKDWWKHUDZLQWHQVLWLHVUHSUHVHQWSL[HOFRXQWVUDQJLQJ KHWHURJHQHRXVO\RYHUVHYHUDORUGHUVRIPDJQLWXGHDORJWUDQVIRUPDWLRQLVMXVWLILDEOH)RU P\PRGHOLQJHIIRUWVORJEDVHZDVXVHGVRWKDWDXQLWGLIIHUHQFHRQWKLVVFDOHFDQEH LQWHUSUHWHG DV D WZRIROG FKDQJH LQ WKH RULJLQDO VFDOH )XUWKHUPRUH LI WKH DPRXQW RI FURVVK\EULGL]DWLRQIRUDQLQGLYLGXDOSUREHLVSURSRUWLRQDOWRWKHREVHUYHGVLJQDODQGWKH FRQVWDQWRISURSRUWLRQDOLW\UHPDLQVVWDEOHDFURVVWKHH[SHULPHQWWKHQWKLVFRQVWDQWZLOO FDQFHORXWDQ\GLIIHUHQFHVWDNHQRQWKHORJVFDOH

WKDW VKRXOG EH DGGUHVVHG ,Q SDUWLFXODU RXWOLHUV WKDW DSSHDU ZHOO DZD\ IURP WKH PDLQ GLDJRQDO UHSUHVHQW LQFRQVLVWHQW PHDVXUHPHQWV WKDW VKRXOG EH KDQGOHG FDUHIXOO\ DQG SRWHQWLDOO\ILOWHUHGRXWRIWKHDQDO\VLV

7DEOH$YHUDJHFRUUHODWLRQFRHIILFLHQWDFURVVUHSOLFDWHVZLWKLQWKHH[SHULPHQWJURXSV $YHUDJH&RUUHODWLRQ&RHIILFLHQW

([SHULPHQW /RJ30 /RJ00 30 00 3000

$

%

&

'

(

)

*

+

,

-

.

/

0123

4567

$YHUDJH

)LJXUH6FDWWHUSORWPDWUL[RIORJ30EOXHDQGORJ00UHGIRUWKHWKUHHUHSOLFDWH

)LJXUH3ORWRIORJ00YHUVXVORJ30IRUFKLSHKSSBDYLQ([SHULPHQW

%DVHG XSRQ WKH SUHFHGLQJ FRQVLGHUDWLRQV , HPSOR\ ORJ30 DV D GHSHQGHQW

YDULDEOH LQ D OLQHDU PRGHOLQJ FRQWH[W 5HVHDUFK RQ PHWKRGV IRU LQFOXGLQJ 00 DV DQ DGGLWLRQDOGHSHQGHQWYDULDEOHLQDELYDULDWHIDVKLRQLVUHSRUWHGLQ&KDSWHU0\DQDO\VLV IROORZVPHWKRGVUHSRUWHGLQ>:ROILQJHUHWDO@DQG>&KXHWDO@,QSDUWLFXODU WKHIROORZLQJWZRPRGHOVDUHHPSOR\HGLQWXUQ ORJ LMNJ LMJ NJ LJ LMNJ LMNJ LM L LMNJ $ 3 ( 5 $ ( 30 H H

,Q0RGHOWKHV\PEROV30($DQG UHSUHVHQWSHUIHFWPDWFKSUREHLQWHQVLW\ JOREDO H[SHULPHQW HIIHFW JOREDO FKLS UDQGRP HIIHFW DQG VWRFKDVWLF HUURU WHUP UHVSHFWLYHO\+HUH³JOREDO´HPSKDVL]HVWKDWWKHFRUUHVSRQGLQJHIIHFWDSSOLHVDFURVVDOO

JHQHV 7R EH PRUH SUHFLVH30LMNJPHDQV WKH LQWHQVLW\ RI WKHMWK UHSOLFDWH RI WKHLWK

OHDVWVTXDUHVPHDQRIJHQHVSHFLILFH[SHULPHQWHIIHFWIURPPRGHOZHUHVWDQGDUGL]HG IRUHDFKRIWKHWDUJHWSUREHVHWV7KHILJXUHGLVSOD\VWKHSURILOHV IRUWKHVH JHQHV DFURVVHDFKRIWKHFRQFHQWUDWLRQOHYHOVRQDVWDQGDUGL]HGVFDOH7KHUHVXOWLQJVXEWOH6 VKDSHPDWFKHVWKDWVHHQLQRWKHUDQDO\VHV

:KDWVXUSULVHGXVKRZHYHUZDVWKHVLJQLILFDQFHRIVHYHUDOJHQHVLQDGGLWLRQWR WKH SXWDWLYH IRXUWHHQ 7KHVH DUH OLVWHG LQ 7DEOH ([SUHVVLRQ SURILOHV RI WDUJHW JHQHVDUHVKRZQLQ)LJXUHDQGWKHWRSILYHXQH[SHFWHGJHQHVLQFOXGLQJWKHRQHWKDW ZDVFODLPHGWREHPLVVLQJLQWKHVXSSRUWLQJLQIRUPDWLRQWKDW$II\PHWUL[SURYLGHGDUH GLVSOD\HG LQ )LJXUH $ IHZ KDYH REYLRXV H[SODQDWLRQV EXW RWKHUV GR QRW 2QH H[DPSOHRIWKHODWWHULVBDWZKLFKKDVDQH[SUHVVLRQSURILOHPDWFKLQJWKDWRIWKH VSLNHGJHQHBDW

7DEOH8QH[SHFWHGVLJQLILFDQWJHQHVIURPWKHPL[HGPRGHODQDO\VLV 3UREH6HW 7DUJHW 5HPDUN

BDW $& VKRXOGEHLQ/DWLQ6TXDUHDV7UDQVFULSW

BDW 6 VDPHSURILOHDVBDW

BJBDW / VDPHSURILOHDVBDW

BDW / VDPHSURILOHDVBDW

BDW 8 VDPHSURILOHDVBDW

, GLVFRYHUHG WKH XQH[SHFWHG JHQHV LQ 7DEOH E\ VWDWLVWLFDOO\ VFUHHQLQJ WKH H[SUHVVLRQ SURILOHV RI WKH WDUJHW WUDQVFULSWV ZLWK WKDW RI DOO SUREHV LQ WKH 8$ FKLS (PSLULFDOO\WKHLQWHQVLW\PHDVXUHPHQWLVQRWTXLWHOLQHDUO\SURSRUWLRQDOWRWKHWUDQVFULSW FRQFHQWUDWLRQ OHYHO DW KLJK DQG ORZ FRQFHQWUDWLRQV 7R UHIOHFW WKH REVHUYHG LQWHQVLW\ PHDVXUHPHQWSDWWHUQV,XVHGOHDVWVTXDUHVPHDQRIWKHH[SHULPHQWHIIHFWVLQPRGHODV TXHULHV WR UHWULHYH SUREHV ZLWK VLPLODU H[SUHVVLRQ SURILOHV , ILUVW WDNH DYHUDJHV RI H[SUHVVLRQOHYHOVDFURVVUHSOLFDWHVIRUHDFKH[SHULPHQWDQGWKHQFDOFXODWHWKHFRUUHODWLRQ FRHIILFLHQWVRIWKRVHDYHUDJHYDOXHVZLWKWKHOHDVWVTXDUHVPHDQYDOXHV7KHKLJKHU WKH FRUUHODWLRQ FRHIILFLHQW WKH KLJKHU WKH VLPLODULW\ LQ H[SUHVVLRQ SDWWHUQ EHWZHHQ WKH WDUJHWJHQHDQGWKHVHTXHQFHWRZKLFKLWFURVVK\EULGL]HG2QFHREWDLQHGWKHVHOHFWHG PDWFKHVDUHREYLRXVE\YLVXDOFRPSDULVRQRI)LJXUHVDQG

7DEOH3UREHVHTXHQFHVZLWKH[SUHVVLRQSURILOHPDWFKLQJWKDWRIWDUJHWBDWIURP QHWDII\FRP+LJKOLJKWHGPRWLIVFDQEHDOLJQHGWRWKHVHTXHQFHLQJHQH.WDUJHWRI BDWEXWQRWWKHSUREHVHTXHQFHVRIBDW

3UREH6HW 3RVLWLRQ3UREH6HTXHQFH

&RUUHODWLRQFRHIILFLHQWRI H[SUHVVLRQSURILOHZLWKWKH WDUJHWSURILOHBDW BDW DJDDWDW*&$*&&*777WFWFFWWF

&21&/86,21

$OLQHDUPL[HGPRGHORIORJ30LVDSRZHUIXOPHWKRGIRUDVVHVVLQJVLJQLILFDQFHRI JHQHH[SUHVVLRQSURILOHV)RUWKH$II\PHWUL[/DWLQ6TXDUHGDWDLWGHWHFWHGDOOIRXUWHHQ VSLNHGJHQHVZLWKH[WUHPHO\KLJKSUHFLVLRQDVZHOODVILYHDGGLWLRQDO³VWUDQJHUV´2QH RI WKH ILYH BDW GLG QRW KDYH DQ LQLWLDOO\ REYLRXV H[SODQDWLRQ EXW DIWHU D PRUH GHWDLOHGPRWLIILQGLQJH[HUFLVH,ZDVDEOHWRILQGDIHZPRWLIVWKDWOLNHO\FDXVHGWKHFURVV K\EULGL]DWLRQ$GGLWLRQDOVSLNHGLQH[SHULPHQWVOLNHWKLVRQHZLOOEHXVHIXOIRUIXUWKHU LQVLJKWVLQWRSUREHSHUIRUPDQFHDQGGHVLJQ

5()(5(1&(6

$II\PHWUL[ 1HZ VWDWLVWLFDO DOJRULWKP IRU PRQLWRULQJ JHQH H[SUHVVLRQ RQ *HQH&KLSSUREHDUUD\V

KWWSZZZDII\PHWUL[FRPVXSSRUWWHFKQLFDOWHFKQRWHVVWDWLVWLFDOBDOJRULWKPVBWHF KQRWHSGI

&KX7:HLU%DQG:ROILQJHU5$V\VWHPDWLFVWDWLVWLFDOOLQHDUPRGHOLQJ DSSURDFKWRROLJRQXFOHRWLGHDUUD\H[SHULPHQWV0DWK%LRVFL

(IURQ%7LEVKLUDQL5*RVV9DQG&KX*0LFURDUUD\VDQGWKHLUXVHLQD FRPSDUDWLYHH[SHULPHQW7HFKQLFDO5HSRUW6WDQIRUG8QLYHUVLW\

'XUELQ%+DUGLQ-+DZNLQV'DQG5RFNH'$YDULDQFHVWDELOL]LQJWUDQVIRUPDWLRQ IRUJHQHH[SUHVVLRQPLFURDUUD\GDWD%LRLQIRUPDWLFV6XSSO6 ,UL]DUU\5$+REEV%&ROOLQ)%HD]HU%DUFOD\<$QWRQHOOLV.6FKHUI8DQG

/DZUHQFH &( $OWVFKXO 6) %RJXVNL 06 /LX -6 1HXZDOG $) :RRWWRQ -& 'HWHFWLQJ VXEWOH VHTXHQFH VLJQDOV $ *LEEV VDPSOLQJ VWUDWHJ\ IRU PXOWLSOH DOLJQPHQW6FLHQFH

/D]DULGLV ( 1 6LQLEDOGL ' %ORRP * 0DQH 6 DQG -RYH 5 $ VLPSOH PHWKRGWRLPSURYHSUREHVHWHVWLPDWHVIURPROLJRQXFOHRWLGHDUUD\V0DWK%LRVFL

/HPRQ:-3DODWLQL--7.UDKH5DQG:ULJKW)$7KHRUHWLFDODQG H[SHULPHQWDOFRPSDULVRQVRIJHQHH[SUHVVLRQLQGH[HVIRUROLJRQXFOHRWLGHDUUD\V LQSUHVV

/L & DQG :RQJ : + D 0RGHOEDVHG DQDO\VLV RI ROLJRQXFOHRWLGH DUUD\V ([SUHVVLRQLQGH[FRPSXWDWLRQDQGRXWOLHUGHWHFWLRQ3URF1DW$FDG6FL86$

/L&DQG:RQJ:+E0RGHOEDVHGDQDO\VLVRIROLJRQXFOHRWLGHDUUD\V0RGHO YDOLGDWLRQ GHVLJQ LVVXHV DQG VWDQGDUG HUURU DSSOLFDWLRQ *HQRPH %LRO UHVHDUFK

7HQJ&+1HVWRURZLF]$DQG5HLIHO0LOOHU$([SHULPHQWDOGHVLJQVXVLQJ $II\PHWUL[ *HQH&KLSV 1DWXUH *HQHWLFV '2, 3RVWHU $EVWUDFWV

:ROILQJHU5'*LEVRQ*:ROILQJHU('%HQQHWW/+DPDGHK+%XVKHO3 $IVKDUL & DQG 3DXOHV 5 6 $VVHVVLQJ JHQH VLJQLILFDQFH IURP F'1$ PLFURDUUD\H[SUHVVLRQGDWDYLDPL[HGPRGHO-&RPS%LR

&KDSWHU&RPSDULVRQRI6WDWLVWLFDO3HUIRUPDQFHRI8QLYDULDWHDQG

%LYDULDWH0L[HG0RGHOVIRU$II\PHWUL[Š3UREH/HYHO'DWD

$EVWUDFW

+DOIRIWKHSUREHVRQ$II\PHWUL[ŠPLFURDUUD\VFRQWDLQDVLQJOHEDVHPLVPDWFK00RI DNQRZQSHUIHFWPDWFK30WDUJHWVHTXHQFH:KLOHSXWDWLYHO\GHVLJQHGWRGHWHFWQRQ VSHFLILF ELQGLQJ WKH 00 GDWD FDQ DOVR FRQWDLQ WUXH VLJQDO DQG VR GHEDWHV SHUVLVW FRQFHUQLQJ KRZ WR EHVW FRPELQH 30 DQG 00 GDWD IRU VWDWLVWLFDO PRGHOLQJ SXUSRVHV 0RVWFXUUHQWDSSURDFKHVLQYROYHHLWKHUVXEWUDFWLQJVRPHIXQFWLRQRI00IURP30RU LJQRULQJ00DOWRJHWKHU+HUHDELYDULDWHPRGHOLVSURSRVHGWRLQFOXGHERWK30DQG 00EDVHGRQWKHPL[HGOLQHDUPRGHOLQJIUDPHZRUN,WGLUHFWO\PRGHOVWKHFRUUHODWLRQ EHWZHHQ30DQG00DQGWKHUHE\LQFUHDVHVWKHSRZHURIVLJQLILFDQWJHQHGHWHFWLRQ ,WLVVKRZQWKDWWKHELYDULDWHPL[HGPRGHORIIHUVPRGHUDWHJDLQVLQSRZHURYHUD FRPSDUDEOHXQLYDULDWHPRGHOWKDWLJQRUHVWKH00GDWD7KHJDLQVDUHPRUHSURPLQHQW ZKHQWKHQXPEHURIUHSOLFDWHVDQGWKHDUUD\WRDUUD\YDULDELOLW\LVVPDOO7KHPRGHOVDUH DSSOLHGWRDVPDOOH[SHULPHQWRQ\HDVWDQGWKHVHGDWDDUHXVHGDVDEDVLVIRUD0RQWH &DUORVLPXODWLRQ

.H\ZRUGV$II\PHWUL[ŠPL[HGPRGHOELYDULDWHPRGHOSHUIHFWPDWFKSUREHVPLVPDWFK SUREHV

,1752'8&7,21

$II\PHWUL[ŠDUUD\VDUHFXUUHQWO\WKHPRVWZLGHO\DGRSWHGFRPPHUFLDOSODWIRUPIRUKLJK WKURXJKSXWJHQHH[SUHVVLRQSURILOLQJ&KDUDFWHULVWLFIHDWXUHVRIWKHVHDUUD\VLQFOXGHWKH PXOWLSUREHUHSUHVHQWDWLRQRIHDFKJHQHDQGWKHLQFOXVLRQRIPLVPDWFK00SUREHV 00SUREHVDUHGHVLJQHGWRKDYHWKHVDPHVWUHQJWKRIQRQVSHFLILFELQGLQJDVWKHLU FRXQWHUSDUWSHUIHFWPDWFK30SUREHVDQGVRFDQSRWHQWLDOO\VHUYHDVDQDGMXVWPHQW IDFWRUIRUWKH30VLJQDOV/LSVKXW]+RZHYHUHPSLULFDOVWXGLHVUHSRUWWKDW W\SLFDOO\SHUFHQWRI00VLJQDOVDUHJUHDWHUWKDQ30VLJQDOVDQGVHYHUDODXWKRUVKDYH SURSRVHGUHDVRQDEOHPHWKRGVIRUKDQGOLQJWKHGLIILFXOWLHV+XEEHOO,UL]DUU\

30DQG00GDWDRFFXULQSDLUVDQGWKHWZRPHDVXUHPHQWVW\SLFDOO\KDYHD FRUUHODWLRQDURXQGZLWKLQDQ\RQHFKLSVHH)LJXUH:KLOHDSRUWLRQRIWKLV VWURQJFRUUHODWLRQLVXQGRXEWHGO\GXHWRQRQVSHFLILFELQGLQJLWLVDOVRWKHFDVHWKDW00 SUREHVGHWHFWWKHWUXHVLJQDODVZHOO7KHK\EULGL]DWLRQVWUHQJWKYDULHVIURPVHTXHQFHWR VHTXHQFHDQGLVGHWHUPLQHGE\WKHVHTXHQFHFRPSRVLWLRQ3URPLVLQJH[SODQDWLRQVDUH DYDLODEOHIURPWKHUPRG\QDPLFPRGHOV1DHI=KDQJ6LQFHWKHUHDOVLJQDO GHWHFWHGE\00YDULHVIURPVHTXHQFHWRVHTXHQFH,SURSRVHDELYDULDWHPRGHOIRUHDFK JHQHXQGHUWKHPL[HGPRGHOIUDPHZRUNWRGLUHFWO\HVWLPDWHWKHFRUUHODWLRQEHWZHHQ30 DQG005DWKHUWKDQLQWHJUDWLQJDELRSK\VLFDOPRGHORIQXFOHLFDFLGK\EULGL]DWLRQLQWR WKHDQDO\VLVP\REMHFWLYHLVWRSURYLGHDJHQHUDOFRYDULDQFHPRGHOLQJDSSURDFKWR GLUHFWO\LQFRUSRUDWHDOORIWKH00GDWD

HDFKJURXSZHUHK\EULGL]HGWRWKUHHDUUD\V7KHUHDUHSUREHVHWVLQFOXGHGLQWKH $II\PHWUL[Š<*6FKLS$IWHUQRUPDOL]LQJWKHORJGDWDE\PHDQFHQWHULQJJHQH VSHFLILFXQLYDULDWHPL[HGPRGHOVZHUHILWWHGXVLQJRQO\WKH30SUREHVDVWKHILUVWPRGHO DVLQ&KXHWDODQGFRPSDUHGZLWKWKHUHVXOWVRIDELYDULDWHPL[HGPRGHO

DSSURDFKGHVFULEHGLQ6HFWLRQ&RPSDULVRQVZHUHOLPLWHGWRWKHVHWZRPRGHOVEHFDXVH WKHXQLYDULDWHPL[HGPRGHOKDVDOUHDG\EHHQVKRZQWREHYHU\FRPSHWLWLYHFRPSDUHGWR RWKHUSRSXODUDSSURDFKHV&KXHWDO

7KHLPSURYHPHQWLQSRZHURIWKHELYDULDWHPRGHORYHUWKHXQLYDULDWHPRGHOLV GHPRQVWUDWHGE\0RQWH&DUORVLPXODWLRQLQ6HFWLRQ6HYHUDOIDFWRUVWKDWFRQWULEXWHWR WKHLPSURYHPHQWRISRZHUDUHDOVRGLVFXVVHGLQFOXGLQJWKHFRUUHODWLRQEHWZHHQ30DQG 00WKH]HURERXQGDU\FRQVWUDLQWRIWKHDUUD\YDULDQFHFRPSRQHQWDQGWKHVFDOHRIWKH YDULDQFHFRPSRQHQWVDQGUHVLGXDOV

'$7$$1$/<6,6 3UHOLPLQDU\&KHFNRI'DWDDQG1RUPDOL]DWLRQ

)LJXUH6FDWWHUSORWRIORJ30YVORJ00SUREHVIURPGDWDRIVL[DUUD\V

7DEOH &RUUHODWLRQ FRHIILFLHQWV EHWZHHQ SDLUV RI DUUD\V RI WKH \HDVW H[SHULPHQW $UUD\VDUHSHUIHFWPDWFKSUREHVK\EULGL]HGZLWKFRQWUROVDPSOHVDQGDUHSHUIHFW PDWFKSUREHVK\EULGL]HGZLWKWUHDWHGVDPSOHV

$UUD\

7KHUDQJHRIWKHLQWHQVLW\LVDSSUR[LPDWHO\WKHVDPHIRUHDFKDUUD\7KDWPHDQV ZHGRQRWKDYHVLJQLILFDQWJOREDOSDWWHUQVZLWKUHVSHFWWRHLWKHUWUHDWPHQWVRUDUUD\V7R UHPRYH V\VWHPDWLF YDULDWLRQ DW WKH DUUD\ OHYHO D UHDVRQDEOH DQG VLPSOH QRUPDOL]DWLRQ PHWKRGLVWRFHQWHUWKHORJLQWHQVLWLHVVRWKDWWKHPHDQRIHDFKDUUD\LV]HUR7KLVLV EDVHG RQ WKH REVHUYDWLRQ WKDW WKH SURSRUWLRQ RI GLIIHUHQWLDOO\ H[SUHVVHG JHQHV LV YHU\ VPDOODQGZLOOQRWDIIHFWWKHPHDQYDOXHRIHDFKDUUD\

*HQHVSHFLILFPRGHOV

$129$ DQDO\VLV LV RIWHQ XVHG WR GHFRPSRVH WKH HIIHFW LQWR D OLQHDU FRPELQDWLRQ RI GLIIHUHQWIDFWRUV.HUUDQG&KXUFKLOO7RH[WHQGLQIHUHQFHWRUDQGRPSRSXODWLRQV :ROILQJHUHW DO :ROILQJHU HW DO SURSRVH D PL[HG $129$ DSSURDFK WR PRGHO DUUD\YDULDWLRQDVDUDQGRPHIIHFW&KXHWDOIXUWKHUH[WHQGHGLWWRSUREHOHYHOGDWD&KX HWDODQGXVHGRQO\30SUREHVWRGHWHFWVLJQLILFDQWHIIHFWV7KHPL[HGPRGHOIURP &KXHWDOLVWKHILUVWPRGHOFRPSDUHGLQWKLVUHSRUWDQGLWLVFDOOHGWKH30RQO\PRGHO WKURXJKRXWWKHGLVFXVVLRQ7KHPRGHOLVFRQVWUXFWHGRQDJHQHE\JHQHEDVLVWRDFFRXQW IRUWKHKHWHURJHQHLW\RIYDULDWLRQDFURVVJHQHVDQGDOVRWRDYRLGKDQGOLQJDKXJHGDWDVHW LQRQHFRPSOH[PRGHO ,30RQO\PRGHO 7KHPRGHOIRUPXODWLRQLV LMN L M LN N

L 3 73 $

7 H

LMN 30 ORJ

VWRFKDVWLF HUURU WHUP %RWK RI WKH UDQGRP WHUPV DUH DVVXPHG WR IROORZ QRUPDO GLVWULEXWLRQVDVIROORZV a RI W LQGHSHQGHQ LV a D L M

LMN 1 V $ 1 V

H

,,%LYDULDWHPRGHO

7KHFRUUHODWLRQEHWZHHQWKH30SUREHVDQG00SUREHVLVDVVKRZQLQ)LJXUH 7RERUURZWKHLQIRUPDWLRQIURP00SUREHV ,LQFOXGHERWK30DQG00LQWHQVLW\DV SDLUHG UHSHDWHG PHDVXUHV XQGHU WKH IUDPHZRUN RI WKH PL[HG PRGHO 7KH PRGHO LV IRUPXODWHGDVIROORZV LMNP L M PN LN N LP P

L 0 70 3 73 03 $

7 H

LMNP < ORJ

7KHV\PERO<LMNPUHSUHVHQWVWKHLQWHQVLW\IRU00SUREHVLIPHTXDOVWRDQGLWUHSUHVHQWV

WKH30LQWHQVLW\LIPHTXDOVWR7KHV\PEROV703707303$DQG UHSUHVHQW WKH WUHDWPHQW HIIHFW PHDQ HIIHFW IRU 30 DQG 00 SUREHV SUREH HIIHFW WUHDWPHQW E\ SUREHW\SHLQWHUDFWLRQHIIHFWSUREHW\SHE\SUREHLQWHUDFWLRQHIIHFWFKLSUDQGRPHIIHFW DQGVWRFKDVWLFHUURUWHUPV,DVVXPHDELYDULDWHQRUPDOGLVWULEXWLRQIRUWKHHUURUWHUPVRI WKH30DQG00SUREHVDVIROORZV a RI W LQGHSHQGHQ LV a D L M 30 30 00 30 00 00 LMN

LMN _{1 $ 1}

V V V UV V UV V H H ¸ ¸ ¹ · ¨ ¨ © § ¸¸ ¹ · ¨¨ © § ¸¸ ¹ · ¨¨ © §

30 DQG 00 DUH DVVXPHG WR IROORZ D ELYDULDWH QRUPDO GLVWULEXWLRQ ZLWK

FRUUHODWLRQ FRHIILFLHQW 00 D 30 D 00 30 D V V V V V UV V

_{8QGHU WKLV SUREDELOLVWLF GHVFULSWLRQ} D

V LV

FRQVWUDLQHGWREHQRQQHJDWLYH+RZHYHULWLVSHUPLVVLEOHWRDOORZWKHHVWLPDWHRI D

EH QHJDWLYH DV ORQJ DV WKH PDUJLQDO YDULDQFHFRYDULDQFH PDWUL[ RI WKH GDWD LV SRVLWLYH GHILQLWH7KHLPSOLFDWLRQRIWKLVZLOOEHH[SORUHGLQWKHQH[WVHFWLRQ

7KLVPRGHOLVVLPLODUWRWKDWRI:XHWDO:XHWDOH[FHSWWKDWUFDQEH

HVWLPDWHGGLUHFWO\XVLQJUHVWULFWHGPD[LPXPOLNHOLKRRG:XHODOXVHGLQIRUPDWLRQIURP RWKHU H[SHULPHQWV WR VFRUH WKH RSWLFDO QRLVH DQG QRQVSHFLILF ELQGLQJ VWUHQJWK 6XFK H[WUD H[SHULPHQWV QHHG WR EH SHUIRUPHG XQGHU SDUDOOHO FRQGLWLRQV DQG DUH RIWHQ XQDYDLODEOH

+\SRWKHVLV7HVWV

7KH PDLQ LQWHUHVW KHUH LV WKH GLIIHUHQFH RI H[SUHVVLRQ OHYHOV EHWZHHQ WUHDWPHQW DQG FRQWUROJURXSVIRUHDFKJHQH7KHK\SRWKHVLVWHVWHGLQWKH30RQO\PRGHOLVVLPSO\WKDW WKHGLIIHUHQFHRIWKHWZRWUHDWPHQWHIIHFWVLV]HUR

7 7

+

)RUWKHELYDULDWHPRGHOWKHWUHDWPHQWHIIHFWVDUHWHVWHGXVLQJSDUDPHWHUVFRUUHVSRQGLQJ WRWKH30GDWD

7 7 70 70

+

7KHWZRK\SRWKHVHVDUHFRPSDUDEOHLQWKHVHQVHWKDWWKH\KDYHH[DFWO\WKHVDPHSRLQW HVWLPDWHVIURPWKHGDWD6HHWKH$SSHQGL[$IRU6$6FRGHGHVFULELQJWKHWZRPRGHOV DQGWKHWHVWHGK\SRWKHVLV

5HVXOWV